May 27 02:54:33.298096 np0000001475 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service.
May 27 02:54:34.933246 np0000001475 nova-compute[98471]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=98471) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}}
May 27 02:54:34.933931 np0000001475 nova-compute[98471]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=98471) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}}
May 27 02:54:34.933931 np0000001475 nova-compute[98471]: INFO os_vif [-] Loaded VIF plugins: noop, ovs
May 27 02:54:35.048143 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:54:35.058660 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.011s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:54:35.199471 np0000001475 nova-compute[98471]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative
May 27 02:54:35.962366 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks.
May 27 02:54:35.962651 np0000001475 nova-compute[98471]: INFO nova.utils [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] The long task thread pool MainProcess.long_task is initialized
May 27 02:54:35.962911 np0000001475 nova-compute[98471]: INFO nova.virt.driver [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Loading compute driver 'libvirt.LibvirtDriver'
May 27 02:54:36.063958 np0000001475 nova-compute[98471]: INFO nova.compute.provider_config [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
May 27 02:54:36.566004 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Acquiring lock "singleton_lock" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:54:36.566150 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Acquired lock "singleton_lock" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:54:36.566370 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Releasing lock "singleton_lock" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:54:36.566558 np0000001475 nova-compute[98471]: WARNING oslo_service.backend._threading.service [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] no_fork=True: running service in main process
May 27 02:54:36.566857 np0000001475 nova-compute[98471]: INFO nova.service [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Starting compute node (version 33.1.0)
May 27 02:54:37.069832 np0000001475 nova-compute[98471]: INFO nova.utils [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] The default thread pool MainProcess.default is initialized
May 27 02:54:37.070215 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:54:37.070511 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Starting event thread {{(pid=98471) start /opt/stack/nova/nova/virt/libvirt/host.py:252}}
May 27 02:54:37.070952 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Starting connection event dispatch thread {{(pid=98471) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:553}}
May 27 02:54:37.071787 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Connecting to libvirt: qemu:///system {{(pid=98471) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:558}}
May 27 02:54:37.680777 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x75573587f4d0> {{(pid=98471) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:564}}
May 27 02:54:37.681667 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x75573587f4d0> {{(pid=98471) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:585}}
May 27 02:54:37.682127 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Connection event '1' reason 'None'
May 27 02:54:38.185913 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Cannot update service status on host "np0000001475" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001475 could not be found.
May 27 02:54:38.186526 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.mount [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Initialising _HostMountState generation 0 {{(pid=98471) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
May 27 02:54:48.154590 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host capabilities <capabilities>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:   <host>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:     <uuid>057eef24-dd8c-48d3-9d64-7a8bcae32990</uuid>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:     <cpu>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <arch>x86_64</arch>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <model>EPYC-Milan</model>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <vendor>AMD</vendor>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <microcode version='16777317'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <signature family='25' model='1' stepping='1'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <topology sockets='12' dies='1' cores='1' threads='1'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <maxphysaddr mode='emulate' bits='40'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='x2apic'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='tsc-deadline'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='osxsave'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='hypervisor'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='tsc_adjust'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='ospke'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='vaes'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='vpclmulqdq'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='spec-ctrl'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='stibp'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='arch-capabilities'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='ssbd'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='cmp_legacy'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='topoext'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='stibp-always-on'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='virt-ssbd'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='amd-psfd'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='lbrv'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='tsc-scale'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='vmcb-clean'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='flushbyasid'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='pause-filter'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='pfthreshold'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='v-vmsave-vmload'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='vgif'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='no-nested-data-bp'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='lfence-always-serializing'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='null-sel-clr-base'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='rdctl-no'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='skip-l1dfl-vmentry'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='mds-no'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='pschange-mc-no'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <feature name='gds-no'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <pages unit='KiB' size='4'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <pages unit='KiB' size='2048'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <pages unit='KiB' size='1048576'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:     </cpu>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:     <power_management/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:     <iommu support='no'/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:     <migration_features>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <live/>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       <uri_transports>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:         <uri_transport>tcp</uri_transport>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:         <uri_transport>rdma</uri_transport>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:       </uri_transports>
May 27 02:54:48.154590 np0000001475 nova-compute[98471]:     </migration_features>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:     <topology>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:       <cells num='1'>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:         <cell id='0'>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:           <memory unit='KiB'>24607188</memory>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:           <pages unit='KiB' size='4'>6151797</pages>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:           <pages unit='KiB' size='2048'>0</pages>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:           <pages unit='KiB' size='1048576'>0</pages>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:           <distances>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:             <sibling id='0' value='10'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:           </distances>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:           <cpus num='12'>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:             <cpu id='1' socket_id='1' die_id='1' core_id='0' siblings='1'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:             <cpu id='2' socket_id='2' die_id='2' core_id='0' siblings='2'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:             <cpu id='3' socket_id='3' die_id='3' core_id='0' siblings='3'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:             <cpu id='4' socket_id='4' die_id='4' core_id='0' siblings='4'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:             <cpu id='5' socket_id='5' die_id='5' core_id='0' siblings='5'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:             <cpu id='6' socket_id='6' die_id='6' core_id='0' siblings='6'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:             <cpu id='7' socket_id='7' die_id='7' core_id='0' siblings='7'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:             <cpu id='8' socket_id='8' die_id='8' core_id='0' siblings='8'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:             <cpu id='9' socket_id='9' die_id='9' core_id='0' siblings='9'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:             <cpu id='10' socket_id='10' die_id='10' core_id='0' siblings='10'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:             <cpu id='11' socket_id='11' die_id='11' core_id='0' siblings='11'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:           </cpus>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:         </cell>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:       </cells>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:     </topology>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:     <cache>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:       <bank id='0' level='3' type='both' size='32' unit='MiB' cpus='0'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:       <bank id='1' level='3' type='both' size='32' unit='MiB' cpus='1'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:       <bank id='2' level='3' type='both' size='32' unit='MiB' cpus='2'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:       <bank id='3' level='3' type='both' size='32' unit='MiB' cpus='3'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:       <bank id='4' level='3' type='both' size='32' unit='MiB' cpus='4'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:       <bank id='5' level='3' type='both' size='32' unit='MiB' cpus='5'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:       <bank id='6' level='3' type='both' size='32' unit='MiB' cpus='6'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:       <bank id='7' level='3' type='both' size='32' unit='MiB' cpus='7'/>
May 27 02:54:48.156939 np0000001475 nova-compute[98471]:       <bank id='8' level='3' type='both' size='32' unit='MiB' cpus='8'/>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <bank id='9' level='3' type='both' size='32' unit='MiB' cpus='9'/>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <bank id='10' level='3' type='both' size='32' unit='MiB' cpus='10'/>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <bank id='11' level='3' type='both' size='32' unit='MiB' cpus='11'/>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:     </cache>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:     <secmodel>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <model>apparmor</model>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <doi>0</doi>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:     </secmodel>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:     <secmodel>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <model>dac</model>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <doi>0</doi>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <baselabel type='kvm'>+64055:+993</baselabel>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <baselabel type='qemu'>+64055:+993</baselabel>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:     </secmodel>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:   </host>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:     <arch name='alpha'>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <wordsize>64</wordsize>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>clipper</machine>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:     <arch name='armv6l'>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <wordsize>32</wordsize>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-8.2</machine>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>mori-bmc</machine>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>ast2600-evb</machine>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>borzoi</machine>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>spitz</machine>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.7</machine>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>nuri</machine>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>romulus-bmc</machine>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-3.0</machine>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-5.0</machine>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>npcm750-evb</machine>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.10</machine>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>rainier-bmc</machine>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mps3-an547</machine>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>musca-b1</machine>
May 27 02:54:48.158298 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>versatileab</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>kzm</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.8</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>fby35-bmc</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>musca-a</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-3.1</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-5.1</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>smdkc210</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>sx1</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.11</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>imx25-pdk</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.9</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>orangepi-pc</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>z2</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-5.2</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>tosa</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mps2-an500</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.12</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>mps2-an521</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>sabrelite</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mps2-an511</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>canon-a1100</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>realview-eb</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-7.0</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-4.0</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>raspi1ap</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>sx1-v1</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>n810</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>g220a-bmc</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>n800</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-7.1</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 27 02:54:48.159994 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-4.1</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>quanta-gsj</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>versatilepb</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>terrier</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mainstone</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>integratorcp</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-7.2</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-4.2</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>mps3-an524</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>kudo-bmc</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>vexpress-a9</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>midway</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>musicpal</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>lm3s811evb</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>microbit</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='3'>fby35</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mps2-an505</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mps2-an385</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-6.0</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-8.0</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>cubieboard</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>ast1030-evb</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>verdex</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>bpim2u</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>netduino2</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mps2-an386</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-6.1</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-8.1</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>raspi2b</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>vexpress-a15</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>fuji-bmc</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-6.2</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>cheetah</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.6</machine>
May 27 02:54:48.161321 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>ast2500-evb</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>highbank</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>akita</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>connex</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>netduinoplus2</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>collie</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>raspi0</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:     <arch name='armv7l'>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <wordsize>32</wordsize>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-8.2</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>mori-bmc</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>ast2600-evb</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>borzoi</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>spitz</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.7</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>nuri</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>romulus-bmc</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-3.0</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-5.0</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>npcm750-evb</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.10</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>rainier-bmc</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mps3-an547</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>musca-b1</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>versatileab</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>kzm</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.8</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>fby35-bmc</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>musca-a</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-3.1</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 27 02:54:48.162454 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-5.1</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>smdkc210</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>sx1</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.11</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>imx25-pdk</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.9</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>orangepi-pc</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>z2</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-5.2</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>tosa</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mps2-an500</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.12</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>mps2-an521</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>sabrelite</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mps2-an511</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>canon-a1100</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>realview-eb</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-7.0</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-4.0</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>raspi1ap</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>sx1-v1</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>n810</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>g220a-bmc</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>n800</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-7.1</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-4.1</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>quanta-gsj</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>versatilepb</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>terrier</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mainstone</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>integratorcp</machine>
May 27 02:54:48.163931 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-7.2</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-4.2</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>mps3-an524</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>kudo-bmc</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>vexpress-a9</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>midway</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>musicpal</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>lm3s811evb</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>microbit</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='3'>fby35</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mps2-an505</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mps2-an385</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-6.0</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-8.0</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>cubieboard</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>ast1030-evb</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>verdex</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>bpim2u</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>netduino2</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mps2-an386</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-6.1</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-8.1</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>raspi2b</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>vexpress-a15</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>fuji-bmc</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-6.2</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>cheetah</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.6</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>ast2500-evb</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>highbank</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>akita</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>connex</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>netduinoplus2</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>collie</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>raspi0</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 27 02:54:48.165526 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:     <arch name='aarch64'>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <wordsize>64</wordsize>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-8.2</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>mori-bmc</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>ast2600-evb</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>borzoi</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>spitz</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.7</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>nuri</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>romulus-bmc</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-3.0</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-5.0</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>npcm750-evb</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.10</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>rainier-bmc</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mps3-an547</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.8</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>musca-b1</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>versatileab</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>kzm</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>fby35-bmc</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>musca-a</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-3.1</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-5.1</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>smdkc210</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>sx1</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.11</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>imx25-pdk</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.9</machine>
May 27 02:54:48.166837 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>orangepi-pc</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>z2</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-5.2</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='6'>xlnx-zcu102</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>tosa</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mps2-an500</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.12</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>mps2-an521</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>sabrelite</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mps2-an511</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>canon-a1100</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>realview-eb</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>sbsa-ref</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-7.0</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-4.0</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>raspi1ap</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>sx1-v1</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>n810</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>g220a-bmc</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>n800</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-7.1</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-4.1</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>quanta-gsj</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>versatilepb</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>terrier</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mainstone</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>integratorcp</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-7.2</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-4.2</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 27 02:54:48.168213 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>mps3-an524</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>kudo-bmc</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>vexpress-a9</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>midway</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>musicpal</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>lm3s811evb</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>microbit</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='3'>fby35</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mps2-an505</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mps2-an385</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-6.0</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-8.0</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>raspi3ap</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>cubieboard</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>ast1030-evb</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>verdex</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>bpim2u</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>netduino2</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>xlnx-versal-virt</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mps2-an386</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-6.1</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-8.1</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>raspi3b</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>raspi2b</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>vexpress-a15</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='2'>fuji-bmc</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt-6.2</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>cheetah</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>virt-2.6</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>ast2500-evb</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>highbank</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>akita</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>connex</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>netduinoplus2</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>collie</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>raspi0</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <acpi default='on' toggle='yes'/>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.169400 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:     <arch name='cris'>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <wordsize>32</wordsize>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-cris</emulator>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>axis-dev88</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:     <arch name='i686'>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <wordsize>32</wordsize>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-i386</emulator>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 27 02:54:48.170793 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>x-remote</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 27 02:54:48.172271 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>isapc</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 27 02:54:48.173389 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>microvm</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 27 02:54:48.174441 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <domain type='kvm'/>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <pae/>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <nonpae/>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <acpi default='on' toggle='yes'/>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <apic default='on' toggle='no'/>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:     <arch name='m68k'>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <wordsize>32</wordsize>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mcf5208evb</machine>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>virt-7.0</machine>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>an5206</machine>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>virt-6.0</machine>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>q800</machine>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>virt-8.1</machine>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>virt-7.2</machine>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>virt-6.2</machine>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>virt-8.0</machine>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>next-cube</machine>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>virt-7.1</machine>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>virt-6.1</machine>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>virt-8.2</machine>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <machine canonical='virt-8.2' maxCpus='1'>virt</machine>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:     <arch name='microblaze'>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <wordsize>32</wordsize>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:     <arch name='microblazeel'>
May 27 02:54:48.175561 np0000001475 nova-compute[98471]:       <wordsize>32</wordsize>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:     <arch name='mips'>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <wordsize>32</wordsize>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-mips</emulator>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <machine maxCpus='16'>malta</machine>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mipssim</machine>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:     <arch name='mipsel'>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <wordsize>32</wordsize>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <machine maxCpus='16'>malta</machine>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mipssim</machine>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:     <arch name='mips64'>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <wordsize>64</wordsize>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <machine maxCpus='16'>malta</machine>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mipssim</machine>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>pica61</machine>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>magnum</machine>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:     <arch name='mips64el'>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <wordsize>64</wordsize>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
May 27 02:54:48.177511 np0000001475 nova-compute[98471]:       <machine maxCpus='16'>malta</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='16'>loongson3-virt</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mipssim</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>pica61</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>magnum</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='16'>boston</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>fuloong2e</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:     <arch name='ppc'>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <wordsize>32</wordsize>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>g3beige</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>amigaone</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>virtex-ml507</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mac99</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>ppce500</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>sam460ex</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>pegasos2</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>bamboo</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>40p</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>ref405ep</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='15'>mpc8544ds</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:     <arch name='ppc64'>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <wordsize>64</wordsize>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-noble</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>amigaone</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='2048'>powernv9</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='15'>mpc8544ds</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 27 02:54:48.179482 np0000001475 nova-compute[98471]:       <machine maxCpus='2048'>powernv10</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>ppce500</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>40p</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>pegasos2</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>bamboo</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-focal</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>g3beige</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-disco</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>virtex-ml507</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 27 02:54:48.181134 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mac99</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-impish</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-artful</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>sam460ex</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>ref405ep</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='2048'>powernv8</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:     <arch name='ppc64le'>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <wordsize>64</wordsize>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-noble</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>amigaone</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='2048'>powernv9</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='15'>mpc8544ds</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='2048'>powernv10</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>ppce500</machine>
May 27 02:54:48.182284 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>40p</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>pegasos2</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>bamboo</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-focal</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>g3beige</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-disco</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>virtex-ml507</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>mac99</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-impish</machine>
May 27 02:54:48.183650 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-artful</machine>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>sam460ex</machine>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>ref405ep</machine>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <machine maxCpus='2048'>powernv8</machine>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:     <arch name='riscv32'>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <wordsize>32</wordsize>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt</machine>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <machine maxCpus='8'>spike</machine>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>opentitan</machine>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <machine maxCpus='5'>sifive_u</machine>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>sifive_e</machine>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:     <arch name='riscv64'>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <wordsize>64</wordsize>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <machine maxCpus='512'>virt</machine>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <machine maxCpus='8'>spike</machine>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <machine maxCpus='5'>sifive_u</machine>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>shakti_c</machine>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>sifive_e</machine>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:     <arch name='s390x'>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <wordsize>64</wordsize>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
May 27 02:54:48.184809 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-noble</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine canonical='s390-ccw-virtio-noble' maxCpus='248'>s390-ccw-virtio</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-8.0</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-7.0</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-mantic</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-8.2</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-7.2</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-lunar</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-kinetic</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-8.1</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
May 27 02:54:48.186838 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-7.1</machine>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:     <arch name='sh4'>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <wordsize>32</wordsize>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>shix</machine>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>r2d</machine>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:     <arch name='sh4eb'>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <wordsize>64</wordsize>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>shix</machine>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>r2d</machine>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:     <arch name='sparc'>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <wordsize>32</wordsize>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>SS-5</machine>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>SS-20</machine>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>LX</machine>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>SPARCClassic</machine>
May 27 02:54:48.187939 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>leon3_generic</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>SPARCbook</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>SS-4</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>SS-600MP</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>SS-10</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>Voyager</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:     <arch name='sparc64'>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <wordsize>64</wordsize>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>sun4u</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>niagara</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>sun4v</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:     <arch name='x86_64'>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <wordsize>64</wordsize>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 27 02:54:48.189687 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>x-remote</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 27 02:54:48.191066 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='1'>isapc</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 27 02:54:48.191691 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>microvm</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 27 02:54:48.192400 np0000001475 nova-compute[98471]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <domain type='kvm'/>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <acpi default='on' toggle='yes'/>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <apic default='on' toggle='no'/>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:     <arch name='xtensa'>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <wordsize>32</wordsize>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>sim</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>kc705</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>ml605</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>ml605-nommu</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>virt</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>lx60-nommu</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>lx200</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>lx200-nommu</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>lx60</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>kc705-nommu</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:   <guest>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:     <os_type>hvm</os_type>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:     <arch name='xtensaeb'>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <wordsize>32</wordsize>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='4'>sim</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>kc705</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>ml605</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>ml605-nommu</machine>
May 27 02:54:48.193033 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>virt</machine>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>lx60-nommu</machine>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>lx200</machine>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>lx200-nommu</machine>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>lx60</machine>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       <machine maxCpus='32'>kc705-nommu</machine>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       <domain type='qemu'/>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:     </arch>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:     <features>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       <cpuselection/>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       <deviceboot/>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       <disksnapshot default='on' toggle='no'/>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       <externalSnapshot/>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:     </features>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:   </guest>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]: </capabilities>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]: 
May 27 02:54:48.194062 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.194062 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None:
May 27 02:54:48.194062 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-alpha</path>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:   <machine>clipper</machine>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:   <arch>alpha</arch>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:   <vcpu max='4'/>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:     <mode name='custom' supported='no'/>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.194062 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:     <tpm supported='no'/>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.195172 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.196634 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.196634 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None:
May 27 02:54:48.196634 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-arm</path>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:   <machine>virt-8.2</machine>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:   <arch>armv6l</arch>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:   <vcpu max='512'/>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.196634 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='yes'>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <enum name='maximumMigratable'>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:         <value>on</value>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:         <value>off</value>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:     <mode name='custom' supported='yes'>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>max</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 27 02:54:48.197710 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>ramfb</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.198424 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     <tpm supported='yes'>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>tpm-tis</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>passthrough</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>emulator</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>external</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       <enum name='backendVersion'>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>1.2</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>2.0</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     </tpm>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     <gic supported='yes'>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       <enum name='version'>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>2</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:         <value>3</value>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     </gic>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='yes'/>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.199589 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.201361 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt:
May 27 02:54:48.201361 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-arm</path>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:   <machine>virt-8.2</machine>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:   <arch>armv6l</arch>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:   <vcpu max='512'/>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='yes'>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       <enum name='maximumMigratable'>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:         <value>on</value>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:         <value>off</value>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:     <mode name='custom' supported='yes'>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 27 02:54:48.201361 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>max</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.202177 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>ramfb</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:     <tpm supported='yes'>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>tpm-tis</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>passthrough</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>emulator</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>external</value>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:       <enum name='backendVersion'>
May 27 02:54:48.202933 np0000001475 nova-compute[98471]:         <value>1.2</value>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:         <value>2.0</value>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:     </tpm>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:     <gic supported='yes'>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:       <enum name='version'>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:         <value>2</value>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:         <value>3</value>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:     </gic>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='yes'/>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.204163 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.204163 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt:
May 27 02:54:48.204163 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-arm</path>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:   <machine>virt-8.2</machine>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:   <arch>armv7l</arch>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:   <vcpu max='512'/>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:     <enum name='firmware'>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:       <value>efi</value>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.204163 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='yes'>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <enum name='maximumMigratable'>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:         <value>on</value>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:         <value>off</value>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:     <mode name='custom' supported='yes'>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 27 02:54:48.205198 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>max</model>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:         <value>ramfb</value>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.205960 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:     <tpm supported='yes'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>tpm-tis</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>passthrough</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>emulator</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>external</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       <enum name='backendVersion'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>1.2</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>2.0</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:     </tpm>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:     <gic supported='yes'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       <enum name='version'>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>2</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:         <value>3</value>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.206950 np0000001475 nova-compute[98471]:     </gic>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='yes'/>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.208267 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.208267 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt:
May 27 02:54:48.208267 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-aarch64</path>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:   <machine>virt-8.2</machine>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:   <arch>aarch64</arch>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:   <vcpu max='512'/>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:     <enum name='firmware'>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:       <value>efi</value>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.ms.fd</value>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.secboot.fd</value>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.no-secboot.fd</value>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='yes'>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:       <enum name='maximumMigratable'>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:         <value>on</value>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:         <value>off</value>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:     <mode name='custom' supported='yes'>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>neoverse-n2</model>
May 27 02:54:48.208267 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a57</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a76</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>a64fx</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>neoverse-v1</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a710</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>max</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a53</model>
May 27 02:54:48.209924 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a72</model>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a55</model>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>neoverse-n1</model>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-a35</model>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.210696 np0000001475 nova-compute[98471]:         <value>ramfb</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:     <tpm supported='yes'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>tpm-tis</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>passthrough</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>emulator</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>external</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       <enum name='backendVersion'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>1.2</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>2.0</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:     </tpm>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:     <gic supported='yes'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:       <enum name='version'>
May 27 02:54:48.211729 np0000001475 nova-compute[98471]:         <value>2</value>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:         <value>3</value>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:     </gic>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='yes'/>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.213044 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for cris via machine types: {None} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.213044 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None:
May 27 02:54:48.213044 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-cris</path>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:   <machine>axis-dev88</machine>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:   <arch>cris</arch>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:   <vcpu max='1'/>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:     <mode name='custom' supported='no'/>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.213044 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       <enum name='model'/>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     <tpm supported='no'/>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     <redirdev supported='no'/>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       <enum name='model'/>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.214041 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.215400 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.215400 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
May 27 02:54:48.215400 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-i386</path>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:   <machine>pc-i440fx-noble-v2</machine>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:   <arch>i686</arch>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:   <vcpu max='255'/>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='yes'>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:       <enum name='maximumMigratable'>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:         <value>on</value>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:         <value>off</value>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='yes'>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:       <model fallback='forbid'>EPYC</model>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:       <vendor>AMD</vendor>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:       <feature policy='require' name='acpi'/>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:       <feature policy='require' name='ss'/>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:       <feature policy='require' name='monitor'/>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:       <feature policy='require' name='hypervisor'/>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:       <feature policy='require' name='erms'/>
May 27 02:54:48.215400 np0000001475 nova-compute[98471]:       <feature policy='require' name='mpx'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='require' name='pcommit'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='require' name='clwb'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='require' name='umip'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='require' name='pku'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='require' name='vaes'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='require' name='la57'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='require' name='rdpid'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='require' name='pks'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrm'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='require' name='fzrm'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrs'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrc'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='require' name='3dnowext'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='require' name='3dnow'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='require' name='xsaveerptr'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='require' name='wbnoinvd'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='require' name='npt'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='require' name='vgif'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='require' name='svme-addr-chk'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='disable' name='vme'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='disable' name='xsavec'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='disable' name='fxsr_opt'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='disable' name='lm'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='disable' name='misalignsse'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='disable' name='osvw'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='disable' name='topoext'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <feature policy='disable' name='nrip-save'/>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:     <mode name='custom' supported='yes'>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <model usable='no' vendor='unknown'>qemu64</model>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>phenom</model>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium</model>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>n270</model>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <model usable='no' vendor='unknown'>kvm64</model>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>core2duo</model>
May 27 02:54:48.216249 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='AMD'>athlon</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Westmere</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Penryn</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 27 02:54:48.216956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC</model>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Conroe</model>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>486</model>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>ide</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>vmvga</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>qxl</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>ramfb</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.217593 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:     <tpm supported='yes'>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>tpm-tis</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>tpm-crb</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>passthrough</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>emulator</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>external</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       <enum name='backendVersion'>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>1.2</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>2.0</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:     </tpm>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='yes'/>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:     <genid supported='yes'/>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.218794 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:     <hyperv supported='yes'>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:       <enum name='features'>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>relaxed</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>vapic</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>spinlocks</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>vpindex</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>runtime</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>synic</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>stimer</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>reset</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>vendor_id</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>frequencies</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>reenlightenment</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>tlbflush</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>ipi</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>avic</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:     </hyperv>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.220413 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
May 27 02:54:48.220413 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-i386</path>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:   <machine>pc-q35-noble</machine>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:   <arch>i686</arch>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:   <vcpu max='1024'/>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='yes'>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:       <enum name='maximumMigratable'>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>on</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:         <value>off</value>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='yes'>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:       <model fallback='forbid'>EPYC</model>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:       <vendor>AMD</vendor>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:       <feature policy='require' name='acpi'/>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:       <feature policy='require' name='ss'/>
May 27 02:54:48.220413 np0000001475 nova-compute[98471]:       <feature policy='require' name='monitor'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='hypervisor'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='erms'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='mpx'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='pcommit'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='clwb'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='umip'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='pku'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='vaes'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='la57'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='rdpid'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='pks'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrm'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='fzrm'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrs'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrc'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='3dnowext'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='3dnow'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='xsaveerptr'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='wbnoinvd'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='npt'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='vgif'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='require' name='svme-addr-chk'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='disable' name='vme'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='disable' name='xsavec'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='disable' name='fxsr_opt'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='disable' name='lm'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='disable' name='misalignsse'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='disable' name='osvw'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='disable' name='topoext'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <feature policy='disable' name='nrip-save'/>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:     <mode name='custom' supported='yes'>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <model usable='no' vendor='unknown'>qemu64</model>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>phenom</model>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium</model>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>n270</model>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <model usable='no' vendor='unknown'>kvm64</model>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 27 02:54:48.221477 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>core2duo</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='AMD'>athlon</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Westmere</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Penryn</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 27 02:54:48.222211 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC</model>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Conroe</model>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>486</model>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>vmvga</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>qxl</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:         <value>ramfb</value>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.222796 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:     <tpm supported='yes'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>tpm-tis</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>tpm-crb</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>passthrough</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>emulator</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>external</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       <enum name='backendVersion'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>1.2</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>2.0</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:     </tpm>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='yes'/>
May 27 02:54:48.223838 np0000001475 nova-compute[98471]:     <genid supported='yes'/>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:     <hyperv supported='yes'>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:       <enum name='features'>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>relaxed</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>vapic</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>spinlocks</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>vpindex</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>runtime</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>synic</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>stimer</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>reset</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>vendor_id</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>frequencies</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>reenlightenment</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>tlbflush</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>ipi</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>avic</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:     </hyperv>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.225609 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
May 27 02:54:48.225609 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-i386</path>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:   <machine>pc-i440fx-noble</machine>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:   <arch>i686</arch>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:   <vcpu max='255'/>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='yes'>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:       <enum name='maximumMigratable'>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>on</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:         <value>off</value>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='yes'>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:       <model fallback='forbid'>EPYC</model>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:       <vendor>AMD</vendor>
May 27 02:54:48.225609 np0000001475 nova-compute[98471]:       <feature policy='require' name='acpi'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='ss'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='monitor'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='hypervisor'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='erms'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='mpx'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='pcommit'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='clwb'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='umip'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='pku'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='vaes'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='la57'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='rdpid'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='pks'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrm'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='fzrm'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrs'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrc'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='3dnowext'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='3dnow'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='xsaveerptr'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='wbnoinvd'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='npt'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='vgif'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='require' name='svme-addr-chk'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='disable' name='vme'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='disable' name='xsavec'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='disable' name='fxsr_opt'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='disable' name='lm'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='disable' name='misalignsse'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='disable' name='osvw'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='disable' name='topoext'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <feature policy='disable' name='nrip-save'/>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:     <mode name='custom' supported='yes'>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <model usable='no' vendor='unknown'>qemu64</model>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>phenom</model>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium</model>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>n270</model>
May 27 02:54:48.226692 np0000001475 nova-compute[98471]:       <model usable='no' vendor='unknown'>kvm64</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>core2duo</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='AMD'>athlon</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Westmere</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Penryn</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell</model>
May 27 02:54:48.227634 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC</model>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Conroe</model>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>486</model>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>ide</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>vmvga</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>qxl</value>
May 27 02:54:48.228212 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>ramfb</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:     <tpm supported='yes'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>tpm-tis</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>tpm-crb</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>passthrough</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>emulator</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>external</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       <enum name='backendVersion'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>1.2</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>2.0</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:     </tpm>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.229264 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='yes'/>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:     <genid supported='yes'/>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:     <hyperv supported='yes'>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:       <enum name='features'>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>relaxed</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>vapic</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>spinlocks</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>vpindex</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>runtime</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>synic</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>stimer</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>reset</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>vendor_id</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>frequencies</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>reenlightenment</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>tlbflush</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>ipi</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>avic</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:     </hyperv>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.230699 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
May 27 02:54:48.230699 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-i386</path>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:   <machine>pc-q35-noble-v2</machine>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:   <arch>i686</arch>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:   <vcpu max='1024'/>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='yes'>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:       <enum name='maximumMigratable'>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>on</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:         <value>off</value>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.230699 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='yes'>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <model fallback='forbid'>EPYC</model>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <vendor>AMD</vendor>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='acpi'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='ss'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='monitor'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='hypervisor'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='erms'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='mpx'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='pcommit'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='clwb'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='umip'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='pku'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='vaes'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='la57'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='rdpid'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='pks'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrm'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='fzrm'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrs'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrc'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='3dnowext'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='3dnow'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='xsaveerptr'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='wbnoinvd'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='npt'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='vgif'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='require' name='svme-addr-chk'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='disable' name='vme'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='disable' name='xsavec'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='disable' name='fxsr_opt'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='disable' name='lm'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='disable' name='misalignsse'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='disable' name='osvw'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='disable' name='topoext'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <feature policy='disable' name='nrip-save'/>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:     <mode name='custom' supported='yes'>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <model usable='no' vendor='unknown'>qemu64</model>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>phenom</model>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 27 02:54:48.231823 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>n270</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='unknown'>kvm64</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>core2duo</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='AMD'>athlon</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Westmere</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Penryn</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 27 02:54:48.232596 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell</model>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC</model>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Conroe</model>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>486</model>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.233262 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>vmvga</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>qxl</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>ramfb</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:     <tpm supported='yes'>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>tpm-tis</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>tpm-crb</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>passthrough</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>emulator</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>external</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       <enum name='backendVersion'>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>1.2</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>2.0</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:     </tpm>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.234211 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='yes'/>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:     <genid supported='yes'/>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:     <hyperv supported='yes'>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:       <enum name='features'>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:         <value>relaxed</value>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:         <value>vapic</value>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:         <value>spinlocks</value>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:         <value>vpindex</value>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:         <value>runtime</value>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:         <value>synic</value>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:         <value>stimer</value>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:         <value>reset</value>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:         <value>vendor_id</value>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:         <value>frequencies</value>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:         <value>reenlightenment</value>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:         <value>tlbflush</value>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:         <value>ipi</value>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:         <value>avic</value>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:     </hyperv>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.235819 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.235819 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None:
May 27 02:54:48.235819 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-m68k</path>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:   <machine>mcf5208evb</machine>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:   <arch>m68k</arch>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:   <vcpu max='1'/>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.235819 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:     <mode name='custom' supported='no'/>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.236926 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     <tpm supported='no'/>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     <redirdev supported='no'/>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.238229 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt:
May 27 02:54:48.238229 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-m68k</path>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:   <machine>virt-8.2</machine>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:   <arch>m68k</arch>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:   <vcpu max='1'/>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.238229 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:     <mode name='custom' supported='no'/>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:     <tpm supported='no'/>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:     <redirdev supported='no'/>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.239451 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.240817 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.240817 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None:
May 27 02:54:48.240817 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-microblaze</path>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:   <machine>petalogix-s3adsp1800</machine>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:   <arch>microblaze</arch>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:   <vcpu max='1'/>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.240817 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:     <mode name='custom' supported='no'/>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       <enum name='model'/>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:     <tpm supported='no'/>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:     <redirdev supported='no'/>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.241800 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:       <enum name='model'/>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.243267 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.243267 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None:
May 27 02:54:48.243267 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-microblazeel</path>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:   <machine>petalogix-s3adsp1800</machine>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:   <arch>microblazeel</arch>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:   <vcpu max='1'/>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:     <mode name='custom' supported='no'/>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.243267 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       <enum name='model'/>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:     <tpm supported='no'/>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:     <redirdev supported='no'/>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       <enum name='model'/>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.244254 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.246055 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for mips via machine types: {None} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.246055 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None:
May 27 02:54:48.246055 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-mips</path>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:   <machine>malta</machine>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:   <arch>mips</arch>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:   <vcpu max='16'/>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:     <mode name='custom' supported='no'/>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.246055 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>ide</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>vmvga</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.247721 np0000001475 nova-compute[98471]:     <tpm supported='no'/>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.249733 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.249733 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None:
May 27 02:54:48.249733 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-mipsel</path>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:   <machine>malta</machine>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:   <arch>mipsel</arch>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:   <vcpu max='16'/>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.249733 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:     <mode name='custom' supported='no'/>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>ide</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>vmvga</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.251338 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:     <tpm supported='no'/>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.253550 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.253550 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None:
May 27 02:54:48.253550 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-mips64</path>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:   <machine>malta</machine>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:   <arch>mips64</arch>
May 27 02:54:48.253550 np0000001475 nova-compute[98471]:   <vcpu max='16'/>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:     <mode name='custom' supported='no'/>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>ide</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>vmvga</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.255422 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:     <tpm supported='no'/>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.257603 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.259671 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.259671 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None:
May 27 02:54:48.259671 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-mips64el</path>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:   <machine>malta</machine>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:   <arch>mips64el</arch>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:   <vcpu max='16'/>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:     <mode name='custom' supported='no'/>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:         <value>ide</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.259671 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>vmvga</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:     <tpm supported='no'/>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.261501 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.263974 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.263974 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None:
May 27 02:54:48.263974 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-ppc</path>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:   <machine>g3beige</machine>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:   <arch>ppc</arch>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:   <vcpu max='1'/>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:     <mode name='custom' supported='no'/>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.263974 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>ide</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:     <tpm supported='no'/>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.265728 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.267037 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for ppc64 via machine types: {None, 'pseries', 'powernv'} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.267037 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None:
May 27 02:54:48.267037 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-ppc64</path>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:   <machine>pseries-noble</machine>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:   <arch>ppc64</arch>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:   <vcpu max='4096'/>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.267037 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:     <mode name='custom' supported='yes'>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.268045 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:     <tpm supported='yes'>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>tpm-spapr</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>spapr-tpm-proxy</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>passthrough</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>emulator</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>external</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       <enum name='backendVersion'>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>1.2</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>2.0</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:     </tpm>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.269420 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.271353 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries:
May 27 02:54:48.271353 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-ppc64</path>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:   <machine>pseries-noble</machine>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:   <arch>ppc64</arch>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:   <vcpu max='4096'/>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:     <mode name='custom' supported='yes'>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.271353 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:     <tpm supported='yes'>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>tpm-spapr</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>spapr-tpm-proxy</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>passthrough</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>emulator</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>external</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       <enum name='backendVersion'>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>1.2</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>2.0</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:     </tpm>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.272995 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.274176 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv:
May 27 02:54:48.274176 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-ppc64</path>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:   <machine>powernv9</machine>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:   <arch>ppc64</arch>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:   <vcpu max='2048'/>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:     <mode name='custom' supported='yes'>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.274176 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.275164 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:     <tpm supported='yes'>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:         <value>tpm-spapr</value>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:         <value>spapr-tpm-proxy</value>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:         <value>passthrough</value>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:         <value>emulator</value>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:         <value>external</value>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:       <enum name='backendVersion'>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:         <value>1.2</value>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:         <value>2.0</value>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:     </tpm>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.276346 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.276346 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries:
May 27 02:54:48.276346 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 27 02:54:48.276346 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:   <machine>pseries-noble</machine>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:   <arch>ppc64le</arch>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:   <vcpu max='4096'/>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:     <mode name='custom' supported='yes'>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.277282 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:     <tpm supported='yes'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>tpm-spapr</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>spapr-tpm-proxy</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>passthrough</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>emulator</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>external</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       <enum name='backendVersion'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>1.2</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>2.0</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:     </tpm>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.279161 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.281251 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv:
May 27 02:54:48.281251 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:   <machine>powernv9</machine>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:   <arch>ppc64le</arch>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:   <vcpu max='2048'/>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:     <mode name='custom' supported='yes'>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.281251 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:     <tpm supported='yes'>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>tpm-spapr</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:         <value>spapr-tpm-proxy</value>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.282621 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:         <value>passthrough</value>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:         <value>emulator</value>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:         <value>external</value>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:       <enum name='backendVersion'>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:         <value>1.2</value>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:         <value>2.0</value>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:     </tpm>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.284201 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.284201 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None:
May 27 02:54:48.284201 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-riscv32</path>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:   <machine>virt</machine>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:   <arch>riscv32</arch>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:   <vcpu max='512'/>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.284201 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='yes'>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       <enum name='maximumMigratable'>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>on</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>off</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:     <mode name='custom' supported='no'/>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>ramfb</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.285693 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     <tpm supported='yes'>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>tpm-tis</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>passthrough</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>emulator</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>external</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       <enum name='backendVersion'>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>1.2</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>2.0</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     </tpm>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='yes'/>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.287352 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.288912 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.288912 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None:
May 27 02:54:48.288912 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-riscv64</path>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:   <machine>virt</machine>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:   <arch>riscv64</arch>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:   <vcpu max='512'/>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='yes'>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:       <enum name='maximumMigratable'>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:         <value>on</value>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:         <value>off</value>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:     <mode name='custom' supported='yes'>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>rv64</model>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>sifive-e51</model>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>any</model>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>x-rv128</model>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>shakti-c</model>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>max</model>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>thead-c906</model>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>sifive-u54</model>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:       <model usable='unknown' vendor='unknown'>veyron-v1</model>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.288912 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>ramfb</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.289954 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:     <tpm supported='yes'>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:         <value>tpm-tis</value>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:         <value>passthrough</value>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:         <value>emulator</value>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:         <value>external</value>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:       <enum name='backendVersion'>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:         <value>1.2</value>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:         <value>2.0</value>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:     </tpm>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='yes'/>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.291204 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.291204 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio:
May 27 02:54:48.291204 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-s390x</path>
May 27 02:54:48.291204 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:   <machine>s390-ccw-virtio-noble</machine>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:   <arch>s390x</arch>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:   <vcpu max='248'/>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='yes'>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <enum name='maximumMigratable'>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:         <value>on</value>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:         <value>off</value>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:     <mode name='custom' supported='yes'>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z13</model>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z990.3</model>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z13-base</model>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z990.2</model>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z196.2-base</model>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z14</model>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z14.2-base</model>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z990.4</model>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z196</model>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z10BC.2-base</model>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z114-base</model>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>gen16b</model>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z890.3-base</model>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>gen16a</model>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z990.5</model>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z196.2</model>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>zEC12</model>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>zEC12.2</model>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z9EC.2</model>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z9BC</model>
May 27 02:54:48.292269 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z9EC.3-base</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='IBM'>z800-base</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z14ZR1-base</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z890</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z990.4-base</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z9EC.3</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z13.2</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z10BC.2</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>gen15a-base</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z14.2</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>zBC12-base</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>gen16a-base</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='IBM'>z900.3</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z196-base</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z990</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z14-base</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='IBM'>z900.2</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='IBM'>z800</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z10EC</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z14ZR1</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='IBM'>z900</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z10EC.2</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z10EC.2-base</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='IBM'>z900.2-base</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='IBM'>z900-base</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z10EC.3</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z990.5-base</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>max</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>gen15b</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z9BC.2-base</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>gen15a</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z990.2-base</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z10EC-base</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>gen16b-base</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z114</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z9EC-base</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z13s</model>
May 27 02:54:48.293176 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>qemu</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>gen15b-base</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>zEC12-base</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z890.3</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z10EC.3-base</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z890.2-base</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z890.2</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z10BC-base</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>zEC12.2-base</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z890-base</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z9BC-base</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z10BC</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z9EC</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z9EC.2-base</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z13.2-base</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='IBM'>z900.3-base</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z990.3-base</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z13s-base</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>zBC12</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z990-base</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <model usable='no' vendor='IBM'>z9BC.2</model>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.293850 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     <tpm supported='no'/>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     <s390-pv supported='no'/>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.294796 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.296102 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.296102 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None:
May 27 02:54:48.296102 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-sh4</path>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:   <machine>shix</machine>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:   <arch>sh4</arch>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:   <vcpu max='1'/>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:     <mode name='custom' supported='no'/>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.296102 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:     <tpm supported='no'/>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.297124 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.298588 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.298588 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None:
May 27 02:54:48.298588 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-sh4eb</path>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:   <machine>shix</machine>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:   <arch>sh4eb</arch>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:   <vcpu max='1'/>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:     <mode name='custom' supported='no'/>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.298588 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:     <tpm supported='no'/>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.299539 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.300730 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.300730 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None:
May 27 02:54:48.300730 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-sparc</path>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:   <machine>SS-5</machine>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:   <arch>sparc</arch>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:   <vcpu max='1'/>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.300730 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     <mode name='custom' supported='no'/>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       <enum name='model'/>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     <tpm supported='no'/>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     <redirdev supported='no'/>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.301713 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:       <enum name='model'/>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.303110 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.303110 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None:
May 27 02:54:48.303110 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-sparc64</path>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:   <machine>sun4u</machine>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:   <arch>sparc64</arch>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:   <vcpu max='1'/>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.303110 np0000001475 nova-compute[98471]:     <mode name='custom' supported='no'/>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>ide</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.304061 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:     <tpm supported='no'/>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.305322 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.305322 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
May 27 02:54:48.305322 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-x86_64</path>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:   <machine>pc-i440fx-noble-v2</machine>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:   <arch>x86_64</arch>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:   <vcpu max='255'/>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:     <enum name='firmware'>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:       <value>efi</value>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.305322 np0000001475 nova-compute[98471]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='yes'>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <enum name='maximumMigratable'>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:         <value>on</value>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:         <value>off</value>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='yes'>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <model fallback='forbid'>EPYC</model>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <vendor>AMD</vendor>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='acpi'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='ss'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='monitor'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='hypervisor'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='erms'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='mpx'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='pcommit'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='clwb'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='umip'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='pku'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='vaes'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='la57'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='rdpid'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='pks'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrm'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='fzrm'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrs'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrc'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='3dnowext'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='3dnow'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='xsaveerptr'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='wbnoinvd'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='npt'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='vgif'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='require' name='svme-addr-chk'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='disable' name='vme'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='disable' name='xsavec'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='disable' name='fxsr_opt'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='disable' name='misalignsse'/>
May 27 02:54:48.306315 np0000001475 nova-compute[98471]:       <feature policy='disable' name='osvw'/>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <feature policy='disable' name='topoext'/>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <feature policy='disable' name='nrip-save'/>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:     <mode name='custom' supported='yes'>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>phenom</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>n270</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='AMD'>athlon</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 27 02:54:48.307266 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>486</model>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:         <value>ide</value>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.307977 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>vmvga</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>qxl</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>ramfb</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:     <tpm supported='yes'>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>tpm-tis</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>tpm-crb</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>passthrough</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>emulator</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:         <value>external</value>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.308881 np0000001475 nova-compute[98471]:       <enum name='backendVersion'>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>1.2</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>2.0</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:     </tpm>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='yes'/>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:     <genid supported='yes'/>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:     <hyperv supported='yes'>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:       <enum name='features'>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>relaxed</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>vapic</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>spinlocks</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>vpindex</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>runtime</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>synic</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>stimer</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>reset</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>vendor_id</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>frequencies</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>reenlightenment</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>tlbflush</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>ipi</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:         <value>avic</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:     </hyperv>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.310198 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
May 27 02:54:48.310198 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-x86_64</path>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:   <machine>pc-q35-noble</machine>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:   <arch>x86_64</arch>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:   <vcpu max='1024'/>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:     <enum name='firmware'>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:       <value>efi</value>
May 27 02:54:48.310198 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='yes'>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <enum name='maximumMigratable'>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:         <value>on</value>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:         <value>off</value>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='yes'>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <model fallback='forbid'>EPYC</model>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <vendor>AMD</vendor>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='acpi'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='ss'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='monitor'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='hypervisor'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='erms'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='mpx'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='pcommit'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='clwb'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='umip'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='pku'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='vaes'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='la57'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='rdpid'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='pks'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrm'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='fzrm'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrs'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrc'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='3dnowext'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='3dnow'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='xsaveerptr'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='wbnoinvd'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='npt'/>
May 27 02:54:48.311394 np0000001475 nova-compute[98471]:       <feature policy='require' name='vgif'/>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <feature policy='require' name='svme-addr-chk'/>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <feature policy='disable' name='vme'/>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <feature policy='disable' name='xsavec'/>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <feature policy='disable' name='fxsr_opt'/>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <feature policy='disable' name='misalignsse'/>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <feature policy='disable' name='osvw'/>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <feature policy='disable' name='topoext'/>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <feature policy='disable' name='nrip-save'/>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:     <mode name='custom' supported='yes'>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>phenom</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>n270</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='AMD'>athlon</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 27 02:54:48.312400 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>486</model>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.313043 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>vmvga</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>qxl</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>ramfb</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:     <tpm supported='yes'>
May 27 02:54:48.313795 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>tpm-tis</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>tpm-crb</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>passthrough</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>emulator</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>external</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:       <enum name='backendVersion'>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>1.2</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>2.0</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:     </tpm>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='yes'/>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:     <genid supported='yes'/>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:     <hyperv supported='yes'>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:       <enum name='features'>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>relaxed</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>vapic</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>spinlocks</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>vpindex</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>runtime</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>synic</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>stimer</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>reset</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>vendor_id</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>frequencies</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>reenlightenment</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>tlbflush</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>ipi</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:         <value>avic</value>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:     </hyperv>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.315031 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.315031 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
May 27 02:54:48.315031 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-x86_64</path>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:   <machine>pc-i440fx-noble</machine>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:   <arch>x86_64</arch>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:   <vcpu max='255'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:     <enum name='firmware'>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <value>efi</value>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='yes'>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <enum name='maximumMigratable'>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:         <value>on</value>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:         <value>off</value>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='yes'>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <model fallback='forbid'>EPYC</model>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <vendor>AMD</vendor>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='acpi'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='ss'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='monitor'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='hypervisor'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='erms'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='mpx'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='pcommit'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='clwb'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='umip'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='pku'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='vaes'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='la57'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='rdpid'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='pks'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrm'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='fzrm'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrs'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrc'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='3dnowext'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='3dnow'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='xsaveerptr'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='wbnoinvd'/>
May 27 02:54:48.316195 np0000001475 nova-compute[98471]:       <feature policy='require' name='npt'/>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <feature policy='require' name='vgif'/>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <feature policy='require' name='svme-addr-chk'/>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <feature policy='disable' name='vme'/>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <feature policy='disable' name='xsavec'/>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <feature policy='disable' name='fxsr_opt'/>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <feature policy='disable' name='misalignsse'/>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <feature policy='disable' name='osvw'/>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <feature policy='disable' name='topoext'/>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <feature policy='disable' name='nrip-save'/>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:     <mode name='custom' supported='yes'>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>phenom</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>n270</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='AMD'>athlon</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 27 02:54:48.317175 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>486</model>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.317857 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>ide</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>vmvga</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>qxl</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>ramfb</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.318594 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:     <tpm supported='yes'>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>tpm-tis</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>tpm-crb</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>passthrough</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>emulator</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>external</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:       <enum name='backendVersion'>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>1.2</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>2.0</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:     </tpm>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='yes'/>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:     <genid supported='yes'/>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:     <hyperv supported='yes'>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:       <enum name='features'>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>relaxed</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>vapic</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>spinlocks</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>vpindex</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>runtime</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>synic</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>stimer</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>reset</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>vendor_id</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>frequencies</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>reenlightenment</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>tlbflush</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>ipi</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:         <value>avic</value>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:     </hyperv>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.319970 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.321487 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
May 27 02:54:48.321487 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-x86_64</path>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:   <machine>pc-q35-noble-v2</machine>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:   <arch>x86_64</arch>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:   <vcpu max='1024'/>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:     <enum name='firmware'>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <value>efi</value>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='yes'>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <enum name='maximumMigratable'>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:         <value>on</value>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:         <value>off</value>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='yes'>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <model fallback='forbid'>EPYC</model>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <vendor>AMD</vendor>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <feature policy='require' name='acpi'/>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <feature policy='require' name='ss'/>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <feature policy='require' name='monitor'/>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <feature policy='require' name='hypervisor'/>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <feature policy='require' name='erms'/>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <feature policy='require' name='mpx'/>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <feature policy='require' name='pcommit'/>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <feature policy='require' name='clwb'/>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <feature policy='require' name='umip'/>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <feature policy='require' name='pku'/>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <feature policy='require' name='vaes'/>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <feature policy='require' name='la57'/>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <feature policy='require' name='rdpid'/>
May 27 02:54:48.321487 np0000001475 nova-compute[98471]:       <feature policy='require' name='pks'/>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrm'/>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <feature policy='require' name='fzrm'/>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrs'/>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <feature policy='require' name='fsrc'/>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <feature policy='require' name='3dnowext'/>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <feature policy='require' name='3dnow'/>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <feature policy='require' name='xsaveerptr'/>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <feature policy='require' name='wbnoinvd'/>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <feature policy='require' name='npt'/>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <feature policy='require' name='vgif'/>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <feature policy='require' name='svme-addr-chk'/>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <feature policy='disable' name='vme'/>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <feature policy='disable' name='xsavec'/>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <feature policy='disable' name='fxsr_opt'/>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <feature policy='disable' name='misalignsse'/>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <feature policy='disable' name='osvw'/>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <feature policy='disable' name='topoext'/>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <feature policy='disable' name='nrip-save'/>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:     <mode name='custom' supported='yes'>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>phenom</model>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>pentium</model>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>n270</model>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='AMD'>athlon</model>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 27 02:54:48.322489 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Haswell</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='AMD'>EPYC</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 27 02:54:48.323141 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       <model usable='yes' vendor='unknown'>486</model>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:     </mode>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>vmvga</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>qxl</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>ramfb</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.323956 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:     <tpm supported='yes'>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>tpm-tis</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>tpm-crb</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>passthrough</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>emulator</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>external</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       <enum name='backendVersion'>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>1.2</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>2.0</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:     </tpm>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='yes'/>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:     <genid supported='yes'/>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:     <hyperv supported='yes'>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:       <enum name='features'>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>relaxed</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>vapic</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>spinlocks</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>vpindex</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>runtime</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>synic</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>stimer</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>reset</value>
May 27 02:54:48.325468 np0000001475 nova-compute[98471]:         <value>vendor_id</value>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:         <value>frequencies</value>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:         <value>reenlightenment</value>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:         <value>tlbflush</value>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:         <value>ipi</value>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:         <value>avic</value>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:     </hyperv>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.326713 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.326713 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None:
May 27 02:54:48.326713 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-xtensa</path>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:   <machine>sim</machine>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:   <arch>xtensa</arch>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:   <vcpu max='4'/>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:     <mode name='custom' supported='no'/>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.326713 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:     <tpm supported='no'/>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.327879 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.329085 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=98471) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 27 02:54:48.329085 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None:
May 27 02:54:48.329085 np0000001475 nova-compute[98471]: <domainCapabilities>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:   <path>/usr/bin/qemu-system-xtensaeb</path>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:   <domain>qemu</domain>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:   <machine>sim</machine>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:   <arch>xtensaeb</arch>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:   <vcpu max='4'/>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:   <iothreads supported='yes'/>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:   <os supported='yes'>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:     <enum name='firmware'/>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:     <loader supported='yes'>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:         <value>rom</value>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:         <value>pflash</value>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:       <enum name='readonly'>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:         <value>yes</value>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:       <enum name='secure'>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:         <value>no</value>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:     </loader>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:   </os>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:   <cpu>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:     <mode name='host-passthrough' supported='no'/>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:     <mode name='maximum' supported='no'/>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:     <mode name='host-model' supported='no'/>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:     <mode name='custom' supported='no'/>
May 27 02:54:48.329085 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:   <memoryBacking supported='yes'>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:     <enum name='sourceType'>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       <value>file</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       <value>anonymous</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       <value>memfd</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:     </enum>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:   </memoryBacking>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:   <devices>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:     <disk supported='yes'>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       <enum name='diskDevice'>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>disk</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>cdrom</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>floppy</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>lun</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>fdc</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>sata</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:     </disk>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:     <graphics supported='yes'>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>sdl</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>vnc</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>spice</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>egl-headless</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>dbus</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:     </graphics>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:     <video supported='yes'>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       <enum name='modelType'>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>vga</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>cirrus</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>none</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>bochs</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:     </video>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:     <hostdev supported='yes'>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       <enum name='mode'>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>subsystem</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       <enum name='startupPolicy'>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>default</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>mandatory</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>requisite</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>optional</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       <enum name='subsysType'>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>pci</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>scsi</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       <enum name='capsType'/>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       <enum name='pciBackend'/>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:     </hostdev>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:     <rng supported='yes'>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>virtio-transitional</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>virtio-non-transitional</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>random</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>egd</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:     </rng>
May 27 02:54:48.330080 np0000001475 nova-compute[98471]:     <filesystem supported='yes'>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:       <enum name='driverType'>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:         <value>path</value>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:         <value>handle</value>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:         <value>virtiofs</value>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:     </filesystem>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:     <tpm supported='no'/>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:     <redirdev supported='yes'>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:       <enum name='bus'>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:         <value>usb</value>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:     </redirdev>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:     <channel supported='yes'>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:         <value>pty</value>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:         <value>unix</value>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:         <value>spicevmc</value>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:     </channel>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:     <crypto supported='yes'>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:       <enum name='model'>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:         <value>virtio</value>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:       <enum name='type'>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:         <value>qemu</value>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:       <enum name='backendModel'>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:         <value>builtin</value>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:       </enum>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:     </crypto>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:   </devices>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:   <features>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:     <gic supported='no'/>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:     <vmcoreinfo supported='no'/>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:     <genid supported='no'/>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:     <backingStoreInput supported='yes'/>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:     <backup supported='yes'/>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:     <async-teardown supported='yes'/>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:     <sev supported='no'/>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:     <sgx supported='no'/>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:   </features>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]: </domainCapabilities>
May 27 02:54:48.331321 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 27 02:54:48.331321 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Checking secure boot support for host arch (x86_64) {{(pid=98471) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 27 02:54:48.331321 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Checking secure boot support for host arch (x86_64) {{(pid=98471) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 27 02:54:48.331321 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Checking secure boot support for host arch (x86_64) {{(pid=98471) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 27 02:54:48.332069 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Secure Boot support detected
May 27 02:54:48.746148 np0000001475 nova-compute[98471]: INFO nova.virt.node [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Generated node identity 379b682a-2af7-4cd6-bb46-9d0c412d430a
May 27 02:54:48.746366 np0000001475 nova-compute[98471]: INFO nova.virt.node [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Wrote node identity 379b682a-2af7-4cd6-bb46-9d0c412d430a to /opt/stack/data/nova/compute_id
May 27 02:54:49.248401 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Compute nodes ['379b682a-2af7-4cd6-bb46-9d0c412d430a'] for host np0000001475 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
May 27 02:54:50.251906 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
May 27 02:54:51.256074 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] No compute node record found for host np0000001475. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001475 could not be found.
May 27 02:54:51.256578 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:54:51.256578 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:54:51.256578 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:54:51.256578 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 02:54:51.311025 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 02:54:51.311832 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:54:51.325599 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] CMD "env LANG=C uptime" returned: 0 in 0.014s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:54:51.325941 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Hypervisor/Node resource view: name=np0000001475 free_ram=16537MB free_disk=75.20245742797852GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 02:54:51.326069 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:54:51.326327 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:54:51.829115 np0000001475 nova-compute[98471]: WARNING nova.compute.resource_tracker [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] No compute node record for np0000001475:379b682a-2af7-4cd6-bb46-9d0c412d430a: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 379b682a-2af7-4cd6-bb46-9d0c412d430a could not be found.
May 27 02:54:52.334118 np0000001475 nova-compute[98471]: INFO nova.compute.resource_tracker [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Compute node record created for np0000001475:np0000001475 with uuid: 379b682a-2af7-4cd6-bb46-9d0c412d430a
May 27 02:54:53.841164 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 02:54:53.841737 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:54:51 up 26 min,  2 users,  load average: 2.15, 1.39, 0.71\n'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 02:54:54.329400 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] [req-93601d4d-d2d6-405e-87ce-6ff06f209286] Created resource provider record via placement API for resource provider with UUID 379b682a-2af7-4cd6-bb46-9d0c412d430a and name np0000001475.
May 27 02:54:54.387986 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] /sys/module/kvm_amd/parameters/sev contains [N
May 27 02:54:54.387986 np0000001475 nova-compute[98471]: ] {{(pid=98471) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2038}}
May 27 02:54:54.388178 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.host [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] kernel doesn't support AMD SEV
May 27 02:54:54.388285 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:54:54.388486 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Updating inventory in ProviderTree for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a with inventory: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 27 02:54:54.389208 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 02:54:54.392828 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Libvirt baseline CPU <cpu>
May 27 02:54:54.392828 np0000001475 nova-compute[98471]:   <arch>x86_64</arch>
May 27 02:54:54.392828 np0000001475 nova-compute[98471]:   <model>Nehalem</model>
May 27 02:54:54.392828 np0000001475 nova-compute[98471]:   <vendor>AMD</vendor>
May 27 02:54:54.392828 np0000001475 nova-compute[98471]:   <topology sockets="12" cores="1" threads="1"/>
May 27 02:54:54.392828 np0000001475 nova-compute[98471]:   <maxphysaddr mode="emulate" bits="40"/>
May 27 02:54:54.392828 np0000001475 nova-compute[98471]: </cpu>
May 27 02:54:54.392828 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13740}}
May 27 02:54:54.976817 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Updated inventory for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
May 27 02:54:54.977177 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Updating resource provider 379b682a-2af7-4cd6-bb46-9d0c412d430a generation from 0 to 1 during operation: update_inventory {{(pid=98471) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 27 02:54:54.977177 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Updating inventory in ProviderTree for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a with inventory: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 27 02:54:55.121147 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Updating resource provider 379b682a-2af7-4cd6-bb46-9d0c412d430a generation from 1 to 2 during operation: update_traits {{(pid=98471) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 27 02:54:55.627762 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 02:54:55.627999 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.302s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:54:55.628235 np0000001475 nova-compute[98471]: DEBUG nova.service [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=98471) start /opt/stack/nova/nova/service.py:195}}
May 27 02:54:55.653166 np0000001475 nova-compute[98471]: DEBUG nova.service [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=98471) start /opt/stack/nova/nova/service.py:211}}
May 27 02:54:55.666592 np0000001475 nova-compute[98471]: DEBUG nova.service [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] Join ServiceGroup membership for this service compute {{(pid=98471) start /opt/stack/nova/nova/service.py:221}}
May 27 02:54:55.666842 np0000001475 nova-compute[98471]: DEBUG nova.servicegroup.drivers.db [None req-c456b35e-de6b-432b-aa7f-4cf00d7b991b None None] DB_Driver: join new ServiceGroup member np0000001475 to the compute group, service = <Service: host=np0000001475, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=98471) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
May 27 02:55:01.170765 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 02:55:39.668716 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:55:39.669550 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:55:39.669550 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:55:39.669906 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:55:39.670087 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:55:39.670407 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:55:39.671497 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:55:40.173689 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:55:40.173689 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 02:55:40.174089 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:55:40.677997 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:55:40.677997 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:55:40.677997 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:55:40.677997 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 02:55:40.688760 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 02:55:40.688760 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:55:40.700698 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.014s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:55:40.701313 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=16301MB free_disk=75.06229019165039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 02:55:40.701626 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:55:40.701964 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:55:41.757803 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 02:55:41.757803 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:55:40 up 27 min,  2 users,  load average: 1.58, 1.36, 0.73\n'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 02:55:41.793625 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:55:41.794033 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:55:42.298773 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:55:42.802812 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 02:55:42.802812 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.101s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:55:42.803344 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:55:42.804211 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 55.53 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 02:56:38.330524 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:56:38.331033 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:56:38.331251 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:56:38.331464 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:56:38.331720 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:56:38.331925 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:56:38.332115 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:56:38.332408 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:56:38.332408 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 02:56:38.332760 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:56:38.835802 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:56:38.835802 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:56:38.835802 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:56:38.835995 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 02:56:38.843022 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 02:56:38.843769 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:56:38.856847 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.013s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:56:38.857192 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=16372MB free_disk=74.86762619018555GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 02:56:38.857317 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:56:38.857575 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:56:39.903795 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 02:56:39.903795 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:56:38 up 28 min,  2 users,  load average: 1.12, 1.27, 0.75\n'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 02:56:39.943462 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:56:39.943462 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:56:40.445259 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:56:40.950636 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 02:56:40.951081 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.093s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:56:40.951081 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 02:57:01.175215 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 02:57:16.742396 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Acquiring lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:16.742903 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:17.245901 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 02:57:17.820093 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:17.820560 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:17.823191 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 02:57:17.823442 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Claim successful on node np0000001475
May 27 02:57:18.947955 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:57:18.948494 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:57:19.451810 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:57:19.961250 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.141s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:19.962000 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 02:57:20.469079 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 02:57:20.469553 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 02:57:20.470715 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:20.472682 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:20.976167 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 02:57:21.213400 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3ddfa3ebacf44829d4caf8767fcc602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd98ab6915e41e38c307ad09c795d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 02:57:21.480801 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 02:57:22.190135 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Successfully created port: daedba8a-0db5-40e8-a99a-bdfe0324387c {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:57:22.493777 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 02:57:22.495501 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 02:57:22.496007 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Creating image(s)
May 27 02:57:22.496638 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Acquiring lock "/opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:22.496882 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "/opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:22.497442 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "/opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:22.497894 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:22.498650 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:22.809011 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:22.812915 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:22.813096 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c.part --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:22.875314 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c.part --force-share --output=json" returned: 0 in 0.062s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:22.875940 np0000001475 nova-compute[98471]: DEBUG nova.virt.images [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] bb7555b3-2f7b-4a56-b628-91b0c2265c8d was qcow2, converting to raw {{(pid=98471) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 02:57:22.877128 np0000001475 nova-compute[98471]: DEBUG nova.privsep.utils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98471) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 02:57:22.877874 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c.part /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c.converted {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:23.036247 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c.part /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c.converted" returned: 0 in 0.158s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:23.042032 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c.converted --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:23.078121 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Acquiring lock "82be1ace-dc06-42dd-8660-02439941fa00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:23.078393 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "82be1ace-dc06-42dd-8660-02439941fa00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:23.108247 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c.converted --force-share --output=json" returned: 0 in 0.066s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:23.110452 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.611s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:23.110452 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:23.113884 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:23.113989 np0000001475 nova-compute[98471]: INFO oslo.privsep.daemon [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpulclvlch/privsep.sock']
May 27 02:57:23.120798 np0000001475 sudo[109917]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpulclvlch/privsep.sock
May 27 02:57:23.121539 np0000001475 sudo[109917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 27 02:57:23.369936 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 27 02:57:23.369936 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 27 02:57:23.369936 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 27 02:57:23.370307 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 02:57:23.370307 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 27 02:57:23.370307 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 27 02:57:23.370307 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 27 02:57:23.370307 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 02:57:23.370307 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 27 02:57:23.580524 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 02:57:23.694408 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 27 02:57:23.694580 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 27 02:57:23.694580 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 27 02:57:23.694580 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 02:57:23.694685 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 27 02:57:23.694725 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 27 02:57:23.694831 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 27 02:57:23.694899 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 02:57:23.694995 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 27 02:57:23.898098 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Acquiring lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:23.898238 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:23.930939 np0000001475 sudo[109917]: pam_unix(sudo:session): session closed for user root
May 27 02:57:23.932483 np0000001475 nova-compute[98471]: INFO oslo.privsep.daemon [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Spawned new privsep daemon via rootwrap
May 27 02:57:23.933429 np0000001475 nova-compute[98471]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 27 02:57:23.933538 np0000001475 nova-compute[98471]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 27 02:57:23.933639 np0000001475 nova-compute[98471]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
May 27 02:57:23.933800 np0000001475 nova-compute[98471]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109938
May 27 02:57:23.987113 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:24.050938 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.063s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:24.051521 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:24.052077 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:24.052612 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:24.068797 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:24.069184 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:24.146474 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.077s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:24.147968 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:24.160297 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:24.160596 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:24.164149 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 02:57:24.164336 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Claim successful on node np0000001475
May 27 02:57:24.174980 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38/disk 1073741824" returned: 0 in 0.027s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:24.175403 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.123s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:24.175776 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:24.263526 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.085s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:24.263526 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 02:57:24.263526 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:24.327719 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38/disk --force-share --output=json" returned: 0 in 0.064s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:24.327719 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Cannot resize image /opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 02:57:24.327719 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 02:57:24.327946 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Ensure instance console log exists: /opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 02:57:24.328252 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:24.329506 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:24.329506 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:24.400792 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 02:57:24.970314 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Successfully updated port: daedba8a-0db5-40e8-a99a-bdfe0324387c {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:57:24.973155 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:25.417642 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:57:25.417642 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:57:25.472381 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Acquiring lock "refresh_cache-b69fd9f2-86d9-4dab-9bae-60e4e27e9f38" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:25.472591 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Acquired lock "refresh_cache-b69fd9f2-86d9-4dab-9bae-60e4e27e9f38" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:25.472591 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 02:57:25.921180 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:57:25.946048 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ca5b4932-0813-49a0-a09d-d9cb2ce84e83 req-3224ad64-5d14-44c5-a36e-cd1685aeb0d0 service nova] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Received event network-changed-daedba8a-0db5-40e8-a99a-bdfe0324387c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:25.946192 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ca5b4932-0813-49a0-a09d-d9cb2ce84e83 req-3224ad64-5d14-44c5-a36e-cd1685aeb0d0 service nova] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Refreshing instance network info cache due to event network-changed-daedba8a-0db5-40e8-a99a-bdfe0324387c. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:57:25.946383 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ca5b4932-0813-49a0-a09d-d9cb2ce84e83 req-3224ad64-5d14-44c5-a36e-cd1685aeb0d0 service nova] Acquiring lock "refresh_cache-b69fd9f2-86d9-4dab-9bae-60e4e27e9f38" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:25.986738 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "63151241-1b03-4b3c-9ecd-27703137e752" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:25.987008 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "63151241-1b03-4b3c-9ecd-27703137e752" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:26.024502 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:26.024715 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:26.084963 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:57:26.314152 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:26.431957 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.271s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:26.432560 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 02:57:26.437587 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.460s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:26.441048 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 02:57:26.441228 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Claim successful on node np0000001475
May 27 02:57:26.489834 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 02:57:26.519736 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Updating instance_info_cache with network_info: [{"id": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "address": "fa:16:3e:13:80:1f", "network": {"id": "5ab3067a-935a-455e-8b66-8ffc4661c70a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93250037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfd98ab6915e41e38c307ad09c795d82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaedba8a-0d", "ovs_interfaceid": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:26.529164 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 02:57:26.941967 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 02:57:26.942348 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 02:57:26.942592 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:26.943084 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:27.022392 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Releasing lock "refresh_cache-b69fd9f2-86d9-4dab-9bae-60e4e27e9f38" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:27.022598 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Instance network_info: |[{"id": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "address": "fa:16:3e:13:80:1f", "network": {"id": "5ab3067a-935a-455e-8b66-8ffc4661c70a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93250037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfd98ab6915e41e38c307ad09c795d82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaedba8a-0d", "ovs_interfaceid": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 02:57:27.025429 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Start _get_guest_xml network_info=[{"id": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "address": "fa:16:3e:13:80:1f", "network": {"id": "5ab3067a-935a-455e-8b66-8ffc4661c70a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93250037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfd98ab6915e41e38c307ad09c795d82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaedba8a-0d", "ovs_interfaceid": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 02:57:27.028431 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ca5b4932-0813-49a0-a09d-d9cb2ce84e83 req-3224ad64-5d14-44c5-a36e-cd1685aeb0d0 service nova] Acquired lock "refresh_cache-b69fd9f2-86d9-4dab-9bae-60e4e27e9f38" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:27.028431 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ca5b4932-0813-49a0-a09d-d9cb2ce84e83 req-3224ad64-5d14-44c5-a36e-cd1685aeb0d0 service nova] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Refreshing network info cache for port daedba8a-0db5-40e8-a99a-bdfe0324387c {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:57:27.041053 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 02:57:27.044561 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-1401556361', uuid='b69fd9f2-86d9-4dab-9bae-60e4e27e9f38'), owner=OwnerMeta(userid='b3ddfa3ebacf44829d4caf8767fcc602', username='tempest-DeleteServersTestJSON-1346066477-project-member', projectid='bfd98ab6915e41e38c307ad09c795d82', projectname='tempest-DeleteServersTestJSON-1346066477'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "address": "fa:16:3e:13:80:1f", "network": {"id": "5ab3067a-935a-455e-8b66-8ffc4661c70a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93250037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfd98ab6915e41e38c307ad09c795d82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaedba8a-0d", "ovs_interfaceid": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850647.0433352) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 02:57:27.045566 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 02:57:27.046025 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 02:57:27.047068 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 02:57:27.047423 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 02:57:27.048819 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 02:57:27.049267 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 02:57:27.049693 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 02:57:27.049861 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 02:57:27.050019 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 02:57:27.050104 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 02:57:27.050218 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 02:57:27.050493 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 02:57:27.050638 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 02:57:27.051132 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 02:57:27.051588 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 02:57:27.051588 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 02:57:27.063813 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:27.067776 np0000001475 nova-compute[98471]: DEBUG nova.privsep.utils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98471) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 02:57:27.068112 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6306920125540b790ddb7ba260e1910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3143b7b9c4034100aa249427ea1f1115', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 02:57:27.070293 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T02:57:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1401556361',display_name='tempest-DeleteServersTestJSON-server-1401556361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-deleteserverstestjson-server-1401556361',id=1,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfd98ab6915e41e38c307ad09c795d82',ramdisk_id='',reservation_id='r-qm2z4tx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1346066477',owner_user_name='tempest-DeleteServersTestJSON-1346066477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:22Z,user_data=None,user_id='b3ddfa3ebacf44829d4caf8767fcc602',uuid=b69fd9f2-86d9-4dab-9bae-60e4e27e9f38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "address": "fa:16:3e:13:80:1f", "network": {"id": "5ab3067a-935a-455e-8b66-8ffc4661c70a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93250037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfd98ab6915e41e38c307ad09c795d82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaedba8a-0d", "ovs_interfaceid": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:57:27.070460 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Converting VIF {"id": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "address": "fa:16:3e:13:80:1f", "network": {"id": "5ab3067a-935a-455e-8b66-8ffc4661c70a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93250037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfd98ab6915e41e38c307ad09c795d82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaedba8a-0d", "ovs_interfaceid": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:57:27.071342 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:80:1f,bridge_name='br-int',has_traffic_filtering=True,id=daedba8a-0db5-40e8-a99a-bdfe0324387c,network=Network(5ab3067a-935a-455e-8b66-8ffc4661c70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaedba8a-0d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:57:27.072134 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lazy-loading 'pci_devices' on Instance uuid b69fd9f2-86d9-4dab-9bae-60e4e27e9f38 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:57:27.093731 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:27.442981 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
May 27 02:57:27.530123 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-ca5b4932-0813-49a0-a09d-d9cb2ce84e83 req-3224ad64-5d14-44c5-a36e-cd1685aeb0d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:27.576230 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] End _get_guest_xml xml=<domain type="qemu">
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:   <uuid>b69fd9f2-86d9-4dab-9bae-60e4e27e9f38</uuid>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:   <name>instance-00000001</name>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:   <metadata>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <nova:name>tempest-DeleteServersTestJSON-server-1401556361</nova:name>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 02:57:27</nova:creationTime>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       </nova:image>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:         <nova:user uuid="b3ddfa3ebacf44829d4caf8767fcc602">tempest-DeleteServersTestJSON-1346066477-project-member</nova:user>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:         <nova:project uuid="bfd98ab6915e41e38c307ad09c795d82">tempest-DeleteServersTestJSON-1346066477</nova:project>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:         <nova:port uuid="daedba8a-0db5-40e8-a99a-bdfe0324387c">
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:   </metadata>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     <system>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <entry name="serial">b69fd9f2-86d9-4dab-9bae-60e4e27e9f38</entry>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <entry name="uuid">b69fd9f2-86d9-4dab-9bae-60e4e27e9f38</entry>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     </system>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:   <os>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:   </os>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:   <features>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     <acpi/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     <tcg>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     </tcg>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:   </features>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:   <devices>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38/disk"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     </disk>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38/disk.config"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     </disk>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:13:80:1f"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <target dev="tapdaedba8a-0d"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     </interface>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38/console.log" append="off"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     </serial>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     <video>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     </video>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     </rng>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:     </memballoon>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:   </devices>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]: </domain>
May 27 02:57:27.576230 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 02:57:27.578837 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Preparing to wait for external event network-vif-plugged-daedba8a-0db5-40e8-a99a-bdfe0324387c {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:57:27.578837 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Acquiring lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:27.578837 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:27.578837 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:27.578837 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T02:57:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1401556361',display_name='tempest-DeleteServersTestJSON-server-1401556361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-deleteserverstestjson-server-1401556361',id=1,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfd98ab6915e41e38c307ad09c795d82',ramdisk_id='',reservation_id='r-qm2z4tx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1346066477',owner_user_name='tempest-DeleteServersTestJSON-1346066477-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:22Z,user_data=None,user_id='b3ddfa3ebacf44829d4caf8767fcc602',uuid=b69fd9f2-86d9-4dab-9bae-60e4e27e9f38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "address": "fa:16:3e:13:80:1f", "network": {"id": "5ab3067a-935a-455e-8b66-8ffc4661c70a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93250037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfd98ab6915e41e38c307ad09c795d82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaedba8a-0d", "ovs_interfaceid": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:57:27.579138 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Converting VIF {"id": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "address": "fa:16:3e:13:80:1f", "network": {"id": "5ab3067a-935a-455e-8b66-8ffc4661c70a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93250037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfd98ab6915e41e38c307ad09c795d82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaedba8a-0d", "ovs_interfaceid": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:57:27.579138 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:80:1f,bridge_name='br-int',has_traffic_filtering=True,id=daedba8a-0db5-40e8-a99a-bdfe0324387c,network=Network(5ab3067a-935a-455e-8b66-8ffc4661c70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaedba8a-0d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:57:27.579138 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:80:1f,bridge_name='br-int',has_traffic_filtering=True,id=daedba8a-0db5-40e8-a99a-bdfe0324387c,network=Network(5ab3067a-935a-455e-8b66-8ffc4661c70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaedba8a-0d') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:57:27.627944 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Created schema index Interface.name {{(pid=98471) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 27 02:57:27.627944 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Created schema index Port.name {{(pid=98471) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 27 02:57:27.627944 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Created schema index Bridge.name {{(pid=98471) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 27 02:57:27.632871 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=98471) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 02:57:27.637119 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [POLLOUT] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:27.637302 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98471) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 02:57:27.638635 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:27.665764 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:27.689369 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:27.689564 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:27.689756 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:57:27.690652 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:27.690652 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bd14209-5f4e-5c22-b99b-2b323c0952b2', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:27.691637 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:27.692511 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:57:27.693695 np0000001475 nova-compute[98471]: INFO oslo.privsep.daemon [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpj55do2nd/privsep.sock']
May 27 02:57:27.702606 np0000001475 sudo[110148]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpj55do2nd/privsep.sock
May 27 02:57:27.703412 np0000001475 sudo[110148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 27 02:57:27.846535 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:57:27.846822 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:57:27.947995 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 02:57:28.021999 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 27 02:57:28.022175 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 27 02:57:28.022175 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 27 02:57:28.022175 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 02:57:28.022175 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 27 02:57:28.022348 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 27 02:57:28.022348 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 27 02:57:28.022348 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 02:57:28.022348 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 27 02:57:28.087006 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-ca5b4932-0813-49a0-a09d-d9cb2ce84e83 req-3224ad64-5d14-44c5-a36e-cd1685aeb0d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:28.103229 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Successfully created port: dd748286-2659-4519-a5d7-5a24424d66f5 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:57:28.256355 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ca5b4932-0813-49a0-a09d-d9cb2ce84e83 req-3224ad64-5d14-44c5-a36e-cd1685aeb0d0 service nova] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Updated VIF entry in instance network info cache for port daedba8a-0db5-40e8-a99a-bdfe0324387c. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 02:57:28.256355 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ca5b4932-0813-49a0-a09d-d9cb2ce84e83 req-3224ad64-5d14-44c5-a36e-cd1685aeb0d0 service nova] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Updating instance_info_cache with network_info: [{"id": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "address": "fa:16:3e:13:80:1f", "network": {"id": "5ab3067a-935a-455e-8b66-8ffc4661c70a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93250037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfd98ab6915e41e38c307ad09c795d82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaedba8a-0d", "ovs_interfaceid": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:28.348407 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 27 02:57:28.348492 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 27 02:57:28.348555 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 27 02:57:28.348604 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 02:57:28.348643 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 27 02:57:28.348701 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 27 02:57:28.348759 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 27 02:57:28.348801 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 02:57:28.348836 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 27 02:57:28.352863 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:57:28.648441 np0000001475 sudo[110148]: pam_unix(sudo:session): session closed for user root
May 27 02:57:28.650047 np0000001475 nova-compute[98471]: INFO oslo.privsep.daemon [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Spawned new privsep daemon via rootwrap
May 27 02:57:28.650607 np0000001475 nova-compute[98471]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 27 02:57:28.651157 np0000001475 nova-compute[98471]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 27 02:57:28.652096 np0000001475 nova-compute[98471]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
May 27 02:57:28.652096 np0000001475 nova-compute[98471]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 110178
May 27 02:57:28.669456 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Successfully updated port: dd748286-2659-4519-a5d7-5a24424d66f5 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:57:28.750398 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9291b79e-98ce-48a5-832f-06456c39babe req-12b5de7d-156e-4707-8e25-9bd65793a296 service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Received event network-changed-dd748286-2659-4519-a5d7-5a24424d66f5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:28.750398 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9291b79e-98ce-48a5-832f-06456c39babe req-12b5de7d-156e-4707-8e25-9bd65793a296 service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Refreshing instance network info cache due to event network-changed-dd748286-2659-4519-a5d7-5a24424d66f5. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:57:28.750398 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9291b79e-98ce-48a5-832f-06456c39babe req-12b5de7d-156e-4707-8e25-9bd65793a296 service nova] Acquiring lock "refresh_cache-82be1ace-dc06-42dd-8660-02439941fa00" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:28.750398 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9291b79e-98ce-48a5-832f-06456c39babe req-12b5de7d-156e-4707-8e25-9bd65793a296 service nova] Acquired lock "refresh_cache-82be1ace-dc06-42dd-8660-02439941fa00" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:28.750398 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-9291b79e-98ce-48a5-832f-06456c39babe req-12b5de7d-156e-4707-8e25-9bd65793a296 service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Refreshing network info cache for port dd748286-2659-4519-a5d7-5a24424d66f5 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:57:28.759408 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ca5b4932-0813-49a0-a09d-d9cb2ce84e83 req-3224ad64-5d14-44c5-a36e-cd1685aeb0d0 service nova] Releasing lock "refresh_cache-b69fd9f2-86d9-4dab-9bae-60e4e27e9f38" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:28.859762 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.427s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:28.862813 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 02:57:28.866094 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.800s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:28.868375 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 02:57:28.868517 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Claim successful on node np0000001475
May 27 02:57:28.902778 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:28.903060 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaedba8a-0d, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:28.903285 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdaedba8a-0d, col_values=(('qos', UUID('4c7c2e6b-170f-4f58-a3f2-e793ef395a84')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:28.903910 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdaedba8a-0d, col_values=(('external_ids', {'iface-id': 'daedba8a-0db5-40e8-a99a-bdfe0324387c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:80:1f', 'vm-uuid': 'b69fd9f2-86d9-4dab-9bae-60e4e27e9f38'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:28.904757 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:28.906193 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:57:28.911821 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:28.913102 np0000001475 nova-compute[98471]: INFO os_vif [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:80:1f,bridge_name='br-int',has_traffic_filtering=True,id=daedba8a-0db5-40e8-a99a-bdfe0324387c,network=Network(5ab3067a-935a-455e-8b66-8ffc4661c70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaedba8a-0d')
May 27 02:57:28.960378 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 02:57:28.961909 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 02:57:28.962207 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Creating image(s)
May 27 02:57:28.962772 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Acquiring lock "/opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:28.963028 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "/opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:28.963993 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "/opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:28.964331 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Acquiring lock "22ab8070d856eb6ab16506bf6921beabf301ee64" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:28.964825 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "22ab8070d856eb6ab16506bf6921beabf301ee64" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:29.020850 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "7c0291f5-62af-417b-9418-41d808856a8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:29.021041 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "7c0291f5-62af-417b-9418-41d808856a8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:29.171759 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Acquiring lock "refresh_cache-82be1ace-dc06-42dd-8660-02439941fa00" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:29.252300 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-9291b79e-98ce-48a5-832f-06456c39babe req-12b5de7d-156e-4707-8e25-9bd65793a296 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:29.321881 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-9291b79e-98ce-48a5-832f-06456c39babe req-12b5de7d-156e-4707-8e25-9bd65793a296 service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:57:29.330899 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Acquiring lock "09039461-93a4-458a-886e-9783f6edaf45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:29.330899 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Lock "09039461-93a4-458a-886e-9783f6edaf45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:29.385912 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 02:57:29.386659 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 02:57:29.388360 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:29.388674 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:29.475304 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ffeea9297304ecaaf2b2a69dac6e7ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ece615dc6a9547cc849be4c1d0f45636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 02:57:29.505063 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-9291b79e-98ce-48a5-832f-06456c39babe req-12b5de7d-156e-4707-8e25-9bd65793a296 service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:29.523382 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 02:57:29.752493 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:29.755536 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:29.755950 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22ab8070d856eb6ab16506bf6921beabf301ee64.part --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:29.818830 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22ab8070d856eb6ab16506bf6921beabf301ee64.part --force-share --output=json" returned: 0 in 0.063s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:29.819272 np0000001475 nova-compute[98471]: DEBUG nova.virt.images [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] 61e040ca-4dc7-4069-bedc-1677643361fc was qcow2, converting to raw {{(pid=98471) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 02:57:29.820288 np0000001475 nova-compute[98471]: DEBUG nova.privsep.utils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98471) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 02:57:29.820603 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/22ab8070d856eb6ab16506bf6921beabf301ee64.part /opt/stack/data/nova/instances/_base/22ab8070d856eb6ab16506bf6921beabf301ee64.converted {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:29.832367 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 02:57:29.904843 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 02:57:29.975835 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/22ab8070d856eb6ab16506bf6921beabf301ee64.part /opt/stack/data/nova/instances/_base/22ab8070d856eb6ab16506bf6921beabf301ee64.converted" returned: 0 in 0.155s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:29.980163 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22ab8070d856eb6ab16506bf6921beabf301ee64.converted --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:30.010392 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9291b79e-98ce-48a5-832f-06456c39babe req-12b5de7d-156e-4707-8e25-9bd65793a296 service nova] Releasing lock "refresh_cache-82be1ace-dc06-42dd-8660-02439941fa00" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:30.011108 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Acquired lock "refresh_cache-82be1ace-dc06-42dd-8660-02439941fa00" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:30.011411 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 02:57:30.052964 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22ab8070d856eb6ab16506bf6921beabf301ee64.converted --force-share --output=json" returned: 0 in 0.073s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:30.055386 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "22ab8070d856eb6ab16506bf6921beabf301ee64" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.090s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:30.055832 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:30.059001 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:30.061344 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22ab8070d856eb6ab16506bf6921beabf301ee64 --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:30.100947 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:30.125608 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22ab8070d856eb6ab16506bf6921beabf301ee64 --force-share --output=json" returned: 0 in 0.064s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:30.126366 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Acquiring lock "22ab8070d856eb6ab16506bf6921beabf301ee64" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:30.127126 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "22ab8070d856eb6ab16506bf6921beabf301ee64" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:30.127834 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:30.131354 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:30.132021 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22ab8070d856eb6ab16506bf6921beabf301ee64 --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:30.203986 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22ab8070d856eb6ab16506bf6921beabf301ee64 --force-share --output=json" returned: 0 in 0.072s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:30.204518 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22ab8070d856eb6ab16506bf6921beabf301ee64,backing_fmt=raw /opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:30.233148 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22ab8070d856eb6ab16506bf6921beabf301ee64,backing_fmt=raw /opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk 1073741824" returned: 0 in 0.028s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:30.233667 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "22ab8070d856eb6ab16506bf6921beabf301ee64" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.107s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:30.234024 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22ab8070d856eb6ab16506bf6921beabf301ee64 --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:30.257250 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Successfully created port: fb928353-bed5-4524-83af-a0f2f19dafad {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:57:30.298805 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22ab8070d856eb6ab16506bf6921beabf301ee64 --force-share --output=json" returned: 0 in 0.064s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:30.298805 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 02:57:30.299022 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:30.366959 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk --force-share --output=json" returned: 0 in 0.068s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:30.368073 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Cannot resize image /opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 02:57:30.368073 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 02:57:30.368073 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Ensure instance console log exists: /opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 02:57:30.368516 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:30.368516 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:30.368675 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:30.384200 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:57:30.384549 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:57:30.402309 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:30.409436 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 02:57:30.429880 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:57:30.430007 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:57:30.430162 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] No VIF found with MAC fa:16:3e:13:80:1f, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:57:30.430676 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Using config drive
May 27 02:57:30.609002 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:57:30.672512 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:30.768249 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Successfully updated port: fb928353-bed5-4524-83af-a0f2f19dafad {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:57:30.825894 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:30.888465 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:57:30.937944 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:30.971773 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Updating instance_info_cache with network_info: [{"id": "dd748286-2659-4519-a5d7-5a24424d66f5", "address": "fa:16:3e:e1:4a:f7", "network": {"id": "3122ca85-812a-4888-92a6-8aeababd262d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1174494551-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3143b7b9c4034100aa249427ea1f1115", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd748286-26", "ovs_interfaceid": "dd748286-2659-4519-a5d7-5a24424d66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:31.270544 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Acquiring lock "refresh_cache-7ccb28d3-b43c-44bd-93d6-7dfb12b6a858" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:31.271257 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Acquired lock "refresh_cache-7ccb28d3-b43c-44bd-93d6-7dfb12b6a858" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:31.271257 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 02:57:31.276826 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f8b60919-0cd4-42bd-82f1-9f854deb2942 req-4e93887b-3b6f-401c-9b3f-bbf114659457 service nova] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Received event network-changed-fb928353-bed5-4524-83af-a0f2f19dafad {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:31.276826 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f8b60919-0cd4-42bd-82f1-9f854deb2942 req-4e93887b-3b6f-401c-9b3f-bbf114659457 service nova] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Refreshing instance network info cache due to event network-changed-fb928353-bed5-4524-83af-a0f2f19dafad. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:57:31.276826 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8b60919-0cd4-42bd-82f1-9f854deb2942 req-4e93887b-3b6f-401c-9b3f-bbf114659457 service nova] Acquiring lock "refresh_cache-7ccb28d3-b43c-44bd-93d6-7dfb12b6a858" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:31.306248 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Creating config drive at /opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38/disk.config
May 27 02:57:31.310421 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdr0jdj47 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:31.338254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdr0jdj47" returned: 0 in 0.028s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:31.398933 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.536s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:31.399834 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.306s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:31.399908 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 02:57:31.407136 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 02:57:31.408003 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Claim successful on node np0000001475
May 27 02:57:31.418102 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 02:57:31.419490 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 02:57:31.419727 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Creating image(s)
May 27 02:57:31.420210 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:31.420448 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Lock "/opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:31.421028 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Lock "/opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:31.422369 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:31.426384 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:31.428507 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:31.476758 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Releasing lock "refresh_cache-82be1ace-dc06-42dd-8660-02439941fa00" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:31.477184 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Instance network_info: |[{"id": "dd748286-2659-4519-a5d7-5a24424d66f5", "address": "fa:16:3e:e1:4a:f7", "network": {"id": "3122ca85-812a-4888-92a6-8aeababd262d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1174494551-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3143b7b9c4034100aa249427ea1f1115", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd748286-26", "ovs_interfaceid": "dd748286-2659-4519-a5d7-5a24424d66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 02:57:31.481752 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Start _get_guest_xml network_info=[{"id": "dd748286-2659-4519-a5d7-5a24424d66f5", "address": "fa:16:3e:e1:4a:f7", "network": {"id": "3122ca85-812a-4888-92a6-8aeababd262d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1174494551-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3143b7b9c4034100aa249427ea1f1115", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd748286-26", "ovs_interfaceid": "dd748286-2659-4519-a5d7-5a24424d66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:57:16Z,direct_url=<?>,disk_format='qcow2',id=61e040ca-4dc7-4069-bedc-1677643361fc,min_disk=0,min_ram=0,name='',owner='e7dba25da6fd4c329fce8e8279be01aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:57:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/sda', 'encryption_options': None, 'disk_bus': 'scsi', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': '61e040ca-4dc7-4069-bedc-1677643361fc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 02:57:31.486500 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 02:57:31.488429 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='61e040ca-4dc7-4069-bedc-1677643361fc', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-1093428290', uuid='82be1ace-dc06-42dd-8660-02439941fa00'), owner=OwnerMeta(userid='a6306920125540b790ddb7ba260e1910', username='tempest-AttachSCSIVolumeTestJSON-1060946454-project-member', projectid='3143b7b9c4034100aa249427ea1f1115', projectname='tempest-AttachSCSIVolumeTestJSON-1060946454'), image=ImageMeta(id='61e040ca-4dc7-4069-bedc-1677643361fc', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dd748286-2659-4519-a5d7-5a24424d66f5", "address": "fa:16:3e:e1:4a:f7", "network": {"id": "3122ca85-812a-4888-92a6-8aeababd262d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1174494551-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3143b7b9c4034100aa249427ea1f1115", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd748286-26", "ovs_interfaceid": "dd748286-2659-4519-a5d7-5a24424d66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850651.4880106) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 02:57:31.491133 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 02:57:31.491638 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 02:57:31.492453 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 02:57:31.492707 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 02:57:31.494039 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 02:57:31.494556 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:57:16Z,direct_url=<?>,disk_format='qcow2',id=61e040ca-4dc7-4069-bedc-1677643361fc,min_disk=0,min_ram=0,name='',owner='e7dba25da6fd4c329fce8e8279be01aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:57:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 02:57:31.494848 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 02:57:31.495040 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 02:57:31.495286 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 02:57:31.495537 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 02:57:31.495847 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 02:57:31.496086 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 02:57:31.496764 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 02:57:31.496764 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 02:57:31.496764 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 02:57:31.496764 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 02:57:31.506658 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.078s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:31.507594 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:31.508147 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:31.509121 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:31.513895 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:31.514443 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:31.530086 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1093428290',display_name='tempest-AttachSCSIVolumeTestJSON-server-1093428290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachscsivolumetestjson-server-1093428290',id=2,image_ref='61e040ca-4dc7-4069-bedc-1677643361fc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcYC4E5oslIwBpUJjq6LsoNJUSOV9DuFR7ZS7Uzg33JqWqO1PU/8wdQTmKFTSU00Cufa+/XU/Rw04Vkgh/alYmsRgY3cZ8+wmpuaX6el9t62wYLH956lKjmCFSKszRQoA==',key_name='tempest-keypair-693312116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3143b7b9c4034100aa249427ea1f1115',ramdisk_id='',reservation_id='r-hle01r5n',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61e040ca-4dc7-4069-bedc-1677643361fc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1060946454',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1060946454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6306920125540b790ddb7ba260e1910',uuid=82be1ace-dc06-42dd-8660-02439941fa00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd748286-2659-4519-a5d7-5a24424d66f5", "address": "fa:16:3e:e1:4a:f7", "network": {"id": "3122ca85-812a-4888-92a6-8aeababd262d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1174494551-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3143b7b9c4034100aa249427ea1f1115", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd748286-26", "ovs_interfaceid": "dd748286-2659-4519-a5d7-5a24424d66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:57:31.530394 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Converting VIF {"id": "dd748286-2659-4519-a5d7-5a24424d66f5", "address": "fa:16:3e:e1:4a:f7", "network": {"id": "3122ca85-812a-4888-92a6-8aeababd262d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1174494551-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3143b7b9c4034100aa249427ea1f1115", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd748286-26", "ovs_interfaceid": "dd748286-2659-4519-a5d7-5a24424d66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:57:31.531284 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:4a:f7,bridge_name='br-int',has_traffic_filtering=True,id=dd748286-2659-4519-a5d7-5a24424d66f5,network=Network(3122ca85-812a-4888-92a6-8aeababd262d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd748286-26') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:57:31.532037 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lazy-loading 'pci_devices' on Instance uuid 82be1ace-dc06-42dd-8660-02439941fa00 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:57:31.585147 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.071s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:31.586050 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:31.613615 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858/disk 1073741824" returned: 0 in 0.028s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:31.614135 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.106s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:31.614535 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:31.676467 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.062s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:31.677105 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 02:57:31.677264 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:31.740725 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858/disk --force-share --output=json" returned: 0 in 0.063s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:31.741660 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Cannot resize image /opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 02:57:31.741733 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 02:57:31.741960 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Ensure instance console log exists: /opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 02:57:31.742244 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:31.742509 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:31.742826 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:31.751527 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:31.771479 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:31.858980 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:57:31.866684 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:31.872955 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:31.908365 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 02:57:31.908365 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 02:57:31.908365 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:31.910006 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:32.036039 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] End _get_guest_xml xml=<domain type="qemu">
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:   <uuid>82be1ace-dc06-42dd-8660-02439941fa00</uuid>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:   <name>instance-00000002</name>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:   <metadata>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1093428290</nova:name>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 02:57:31</nova:creationTime>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <nova:image uuid="61e040ca-4dc7-4069-bedc-1677643361fc">
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">scsi</nova:property>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">scsi</nova:property>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:           <nova:property name="hw_scsi_model">virtio-scsi</nova:property>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       </nova:image>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:         <nova:user uuid="a6306920125540b790ddb7ba260e1910">tempest-AttachSCSIVolumeTestJSON-1060946454-project-member</nova:user>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:         <nova:project uuid="3143b7b9c4034100aa249427ea1f1115">tempest-AttachSCSIVolumeTestJSON-1060946454</nova:project>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="61e040ca-4dc7-4069-bedc-1677643361fc"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:         <nova:port uuid="dd748286-2659-4519-a5d7-5a24424d66f5">
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:   </metadata>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     <system>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <entry name="serial">82be1ace-dc06-42dd-8660-02439941fa00</entry>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <entry name="uuid">82be1ace-dc06-42dd-8660-02439941fa00</entry>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     </system>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:   <os>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:   </os>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:   <features>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     <acpi/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     <tcg>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     </tcg>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:   </features>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:   <devices>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <target dev="sda" bus="scsi"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <address type="drive" controller="0" unit="0"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     </disk>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk.config"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <target dev="sdb" bus="scsi"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <address type="drive" controller="0" unit="1"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     </disk>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     <controller type="scsi" index="0" model="virtio-scsi"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:e1:4a:f7"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <target dev="tapdd748286-26"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     </interface>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/console.log" append="off"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     </serial>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     <video>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     </video>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     </rng>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:     </memballoon>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:   </devices>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]: </domain>
May 27 02:57:32.036039 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 02:57:32.038565 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Preparing to wait for external event network-vif-plugged-dd748286-2659-4519-a5d7-5a24424d66f5 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:57:32.038565 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Acquiring lock "82be1ace-dc06-42dd-8660-02439941fa00-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:32.038565 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "82be1ace-dc06-42dd-8660-02439941fa00-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:32.038804 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "82be1ace-dc06-42dd-8660-02439941fa00-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:32.039383 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1093428290',display_name='tempest-AttachSCSIVolumeTestJSON-server-1093428290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachscsivolumetestjson-server-1093428290',id=2,image_ref='61e040ca-4dc7-4069-bedc-1677643361fc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcYC4E5oslIwBpUJjq6LsoNJUSOV9DuFR7ZS7Uzg33JqWqO1PU/8wdQTmKFTSU00Cufa+/XU/Rw04Vkgh/alYmsRgY3cZ8+wmpuaX6el9t62wYLH956lKjmCFSKszRQoA==',key_name='tempest-keypair-693312116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3143b7b9c4034100aa249427ea1f1115',ramdisk_id='',reservation_id='r-hle01r5n',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61e040ca-4dc7-4069-bedc-1677643361fc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1060946454',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1060946454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6306920125540b790ddb7ba260e1910',uuid=82be1ace-dc06-42dd-8660-02439941fa00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd748286-2659-4519-a5d7-5a24424d66f5", "address": "fa:16:3e:e1:4a:f7", "network": {"id": "3122ca85-812a-4888-92a6-8aeababd262d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1174494551-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3143b7b9c4034100aa249427ea1f1115", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd748286-26", "ovs_interfaceid": "dd748286-2659-4519-a5d7-5a24424d66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:57:32.039534 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Converting VIF {"id": "dd748286-2659-4519-a5d7-5a24424d66f5", "address": "fa:16:3e:e1:4a:f7", "network": {"id": "3122ca85-812a-4888-92a6-8aeababd262d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1174494551-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3143b7b9c4034100aa249427ea1f1115", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd748286-26", "ovs_interfaceid": "dd748286-2659-4519-a5d7-5a24424d66f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:57:32.040317 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:4a:f7,bridge_name='br-int',has_traffic_filtering=True,id=dd748286-2659-4519-a5d7-5a24424d66f5,network=Network(3122ca85-812a-4888-92a6-8aeababd262d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd748286-26') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:57:32.040602 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:4a:f7,bridge_name='br-int',has_traffic_filtering=True,id=dd748286-2659-4519-a5d7-5a24424d66f5,network=Network(3122ca85-812a-4888-92a6-8aeababd262d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd748286-26') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:57:32.044129 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84dc8d0aa07e4080860c3b0ef5b1a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254e04d10914b0d9b3768ba32b8559d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 02:57:32.045546 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:32.045546 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:32.045546 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:57:32.046197 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:32.047184 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a87899e-796f-5c8f-9f0a-03e78b4be64b', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:32.048191 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:32.050362 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:57:32.052771 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:32.057076 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd748286-26, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:32.057076 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd748286-26, col_values=(('qos', UUID('c11bb982-9aa3-48dd-8c2b-61c90a9569b9')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:32.057076 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd748286-26, col_values=(('external_ids', {'iface-id': 'dd748286-2659-4519-a5d7-5a24424d66f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:4a:f7', 'vm-uuid': '82be1ace-dc06-42dd-8660-02439941fa00'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:32.057544 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:32.058694 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:57:32.063629 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:32.064728 np0000001475 nova-compute[98471]: INFO os_vif [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:4a:f7,bridge_name='br-int',has_traffic_filtering=True,id=dd748286-2659-4519-a5d7-5a24424d66f5,network=Network(3122ca85-812a-4888-92a6-8aeababd262d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd748286-26')
May 27 02:57:32.077003 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:32.275482 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Updating instance_info_cache with network_info: [{"id": "fb928353-bed5-4524-83af-a0f2f19dafad", "address": "fa:16:3e:a8:2e:10", "network": {"id": "ba582098-1dc2-4a13-9479-4e40d17cba1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-926668277-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ece615dc6a9547cc849be4c1d0f45636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb928353-be", "ovs_interfaceid": "fb928353-bed5-4524-83af-a0f2f19dafad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:32.412591 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 02:57:32.678586 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779850652.6782303, b69fd9f2-86d9-4dab-9bae-60e4e27e9f38 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:32.679480 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] VM Started (Lifecycle Event)
May 27 02:57:32.778199 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Releasing lock "refresh_cache-7ccb28d3-b43c-44bd-93d6-7dfb12b6a858" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:32.778638 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Instance network_info: |[{"id": "fb928353-bed5-4524-83af-a0f2f19dafad", "address": "fa:16:3e:a8:2e:10", "network": {"id": "ba582098-1dc2-4a13-9479-4e40d17cba1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-926668277-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ece615dc6a9547cc849be4c1d0f45636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb928353-be", "ovs_interfaceid": "fb928353-bed5-4524-83af-a0f2f19dafad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 02:57:33.244433 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Start _get_guest_xml network_info=[{"id": "fb928353-bed5-4524-83af-a0f2f19dafad", "address": "fa:16:3e:a8:2e:10", "network": {"id": "ba582098-1dc2-4a13-9479-4e40d17cba1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-926668277-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ece615dc6a9547cc849be4c1d0f45636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb928353-be", "ovs_interfaceid": "fb928353-bed5-4524-83af-a0f2f19dafad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 02:57:33.244433 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8b60919-0cd4-42bd-82f1-9f854deb2942 req-4e93887b-3b6f-401c-9b3f-bbf114659457 service nova] Acquired lock "refresh_cache-7ccb28d3-b43c-44bd-93d6-7dfb12b6a858" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:33.244433 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f8b60919-0cd4-42bd-82f1-9f854deb2942 req-4e93887b-3b6f-401c-9b3f-bbf114659457 service nova] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Refreshing network info cache for port fb928353-bed5-4524-83af-a0f2f19dafad {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:57:33.244433 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 02:57:33.244433 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-24137274', uuid='7ccb28d3-b43c-44bd-93d6-7dfb12b6a858'), owner=OwnerMeta(userid='0ffeea9297304ecaaf2b2a69dac6e7ee', username='tempest-VolumesAdminNegativeTest-2074834210-project-member', projectid='ece615dc6a9547cc849be4c1d0f45636', projectname='tempest-VolumesAdminNegativeTest-2074834210'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fb928353-bed5-4524-83af-a0f2f19dafad", "address": "fa:16:3e:a8:2e:10", "network": {"id": "ba582098-1dc2-4a13-9479-4e40d17cba1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-926668277-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ece615dc6a9547cc849be4c1d0f45636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb928353-be", "ovs_interfaceid": "fb928353-bed5-4524-83af-a0f2f19dafad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850652.7865057) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 02:57:33.246999 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 02:57:33.246999 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 02:57:33.246999 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 02:57:33.246999 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 02:57:33.246999 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 02:57:33.246999 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 02:57:33.246999 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 02:57:33.246999 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 02:57:33.246999 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 02:57:33.246999 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 02:57:33.246999 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 02:57:33.246999 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 02:57:33.246999 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 02:57:33.246999 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 02:57:33.246999 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 02:57:33.248114 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 02:57:33.248114 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T02:57:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-24137274',display_name='tempest-VolumesAdminNegativeTest-server-24137274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesadminnegativetest-server-24137274',id=3,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ece615dc6a9547cc849be4c1d0f45636',ramdisk_id='',reservation_id='r-d0ypw61n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2074834210',owner_user_name='tempest-VolumesAdminNegativeTest-2074834210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:30Z,user_data=None,user_id='0ffeea9297304ecaaf2b2a69dac6e7ee',uuid=7ccb28d3-b43c-44bd-93d6-7dfb12b6a858,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb928353-bed5-4524-83af-a0f2f19dafad", "address": "fa:16:3e:a8:2e:10", "network": {"id": "ba582098-1dc2-4a13-9479-4e40d17cba1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-926668277-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ece615dc6a9547cc849be4c1d0f45636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb928353-be", "ovs_interfaceid": "fb928353-bed5-4524-83af-a0f2f19dafad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:57:33.248114 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Converting VIF {"id": "fb928353-bed5-4524-83af-a0f2f19dafad", "address": "fa:16:3e:a8:2e:10", "network": {"id": "ba582098-1dc2-4a13-9479-4e40d17cba1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-926668277-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ece615dc6a9547cc849be4c1d0f45636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb928353-be", "ovs_interfaceid": "fb928353-bed5-4524-83af-a0f2f19dafad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:57:33.248114 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2e:10,bridge_name='br-int',has_traffic_filtering=True,id=fb928353-bed5-4524-83af-a0f2f19dafad,network=Network(ba582098-1dc2-4a13-9479-4e40d17cba1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb928353-be') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:57:33.249149 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:57:33.249149 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:57:33.249149 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:57:33.249149 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 02:57:33.249149 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Successfully created port: abb5cffe-8cbc-49eb-8f62-0014bcc3d411 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:57:33.249149 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:33.249149 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850653.1834521, b69fd9f2-86d9-4dab-9bae-60e4e27e9f38 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:33.249149 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] VM Paused (Lifecycle Event)
May 27 02:57:33.287586 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f8b60919-0cd4-42bd-82f1-9f854deb2942 req-4e93887b-3b6f-401c-9b3f-bbf114659457 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:33.321887 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] End _get_guest_xml xml=<domain type="qemu">
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:   <uuid>7ccb28d3-b43c-44bd-93d6-7dfb12b6a858</uuid>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:   <name>instance-00000003</name>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:   <metadata>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <nova:name>tempest-VolumesAdminNegativeTest-server-24137274</nova:name>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 02:57:32</nova:creationTime>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       </nova:image>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:         <nova:user uuid="0ffeea9297304ecaaf2b2a69dac6e7ee">tempest-VolumesAdminNegativeTest-2074834210-project-member</nova:user>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:         <nova:project uuid="ece615dc6a9547cc849be4c1d0f45636">tempest-VolumesAdminNegativeTest-2074834210</nova:project>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:         <nova:port uuid="fb928353-bed5-4524-83af-a0f2f19dafad">
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:   </metadata>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     <system>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <entry name="serial">7ccb28d3-b43c-44bd-93d6-7dfb12b6a858</entry>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <entry name="uuid">7ccb28d3-b43c-44bd-93d6-7dfb12b6a858</entry>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     </system>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:   <os>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:   </os>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:   <features>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     <acpi/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     <tcg>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     </tcg>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:   </features>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:   <devices>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858/disk"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     </disk>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858/disk.config"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     </disk>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:a8:2e:10"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <target dev="tapfb928353-be"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     </interface>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858/console.log" append="off"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     </serial>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     <video>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     </video>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     </rng>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:     </memballoon>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:   </devices>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]: </domain>
May 27 02:57:33.321887 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 02:57:33.323917 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Preparing to wait for external event network-vif-plugged-fb928353-bed5-4524-83af-a0f2f19dafad {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:57:33.323917 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Acquiring lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:33.323917 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:33.323917 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:33.324561 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T02:57:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-24137274',display_name='tempest-VolumesAdminNegativeTest-server-24137274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesadminnegativetest-server-24137274',id=3,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ece615dc6a9547cc849be4c1d0f45636',ramdisk_id='',reservation_id='r-d0ypw61n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2074834210',owner_user_name='tempest-VolumesAdminNegativeTest-2074834210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:30Z,user_data=None,user_id='0ffeea9297304ecaaf2b2a69dac6e7ee',uuid=7ccb28d3-b43c-44bd-93d6-7dfb12b6a858,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb928353-bed5-4524-83af-a0f2f19dafad", "address": "fa:16:3e:a8:2e:10", "network": {"id": "ba582098-1dc2-4a13-9479-4e40d17cba1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-926668277-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ece615dc6a9547cc849be4c1d0f45636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb928353-be", "ovs_interfaceid": "fb928353-bed5-4524-83af-a0f2f19dafad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:57:33.324864 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Converting VIF {"id": "fb928353-bed5-4524-83af-a0f2f19dafad", "address": "fa:16:3e:a8:2e:10", "network": {"id": "ba582098-1dc2-4a13-9479-4e40d17cba1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-926668277-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ece615dc6a9547cc849be4c1d0f45636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb928353-be", "ovs_interfaceid": "fb928353-bed5-4524-83af-a0f2f19dafad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:57:33.325664 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2e:10,bridge_name='br-int',has_traffic_filtering=True,id=fb928353-bed5-4524-83af-a0f2f19dafad,network=Network(ba582098-1dc2-4a13-9479-4e40d17cba1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb928353-be') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:57:33.329187 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2e:10,bridge_name='br-int',has_traffic_filtering=True,id=fb928353-bed5-4524-83af-a0f2f19dafad,network=Network(ba582098-1dc2-4a13-9479-4e40d17cba1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb928353-be') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:57:33.329638 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:33.329983 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:33.330578 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:57:33.331462 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:33.331520 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3bd2da8-f068-5f7a-9952-a967d8c4c46a', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:33.332783 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:33.334777 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:57:33.339889 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:33.342575 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:33.342867 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb928353-be, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:33.343156 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb928353-be, col_values=(('qos', UUID('b192e873-ea35-457c-966e-4574a57047f5')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:33.343584 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb928353-be, col_values=(('external_ids', {'iface-id': 'fb928353-bed5-4524-83af-a0f2f19dafad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:2e:10', 'vm-uuid': '7ccb28d3-b43c-44bd-93d6-7dfb12b6a858'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:33.344894 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:33.346390 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:57:33.363253 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:33.363253 np0000001475 nova-compute[98471]: INFO os_vif [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2e:10,bridge_name='br-int',has_traffic_filtering=True,id=fb928353-bed5-4524-83af-a0f2f19dafad,network=Network(ba582098-1dc2-4a13-9479-4e40d17cba1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb928353-be')
May 27 02:57:33.393552 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:57:33.594187 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] No BDM found with device name sda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:57:33.594630 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:57:33.594854 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] No VIF found with MAC fa:16:3e:e1:4a:f7, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:57:33.595566 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Using config drive
May 27 02:57:33.686239 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:33.691061 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:57:33.836852 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f8b60919-0cd4-42bd-82f1-9f854deb2942 req-4e93887b-3b6f-401c-9b3f-bbf114659457 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:33.849840 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Successfully updated port: abb5cffe-8cbc-49eb-8f62-0014bcc3d411 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:57:33.902433 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.503s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:33.903567 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.802s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:33.903648 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 02:57:33.914453 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 02:57:33.915624 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Claim successful on node np0000001475
May 27 02:57:33.922764 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ae935c73-058b-492c-895b-4fa720937e55 req-a5a791eb-7fc8-4f33-bcd9-7d867e9ad369 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Received event network-changed-abb5cffe-8cbc-49eb-8f62-0014bcc3d411 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:33.923924 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ae935c73-058b-492c-895b-4fa720937e55 req-a5a791eb-7fc8-4f33-bcd9-7d867e9ad369 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Refreshing instance network info cache due to event network-changed-abb5cffe-8cbc-49eb-8f62-0014bcc3d411. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:57:33.924106 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ae935c73-058b-492c-895b-4fa720937e55 req-a5a791eb-7fc8-4f33-bcd9-7d867e9ad369 service nova] Acquiring lock "refresh_cache-63151241-1b03-4b3c-9ecd-27703137e752" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:33.924223 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ae935c73-058b-492c-895b-4fa720937e55 req-a5a791eb-7fc8-4f33-bcd9-7d867e9ad369 service nova] Acquired lock "refresh_cache-63151241-1b03-4b3c-9ecd-27703137e752" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:33.924366 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ae935c73-058b-492c-895b-4fa720937e55 req-a5a791eb-7fc8-4f33-bcd9-7d867e9ad369 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Refreshing network info cache for port abb5cffe-8cbc-49eb-8f62-0014bcc3d411 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:57:33.926515 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 02:57:33.928098 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 02:57:33.930101 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Creating image(s)
May 27 02:57:33.930101 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "/opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:33.930299 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "/opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:33.930676 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "/opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:33.931198 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:33.935277 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:33.938564 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:34.031223 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.092s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:34.032959 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:34.035544 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f8b60919-0cd4-42bd-82f1-9f854deb2942 req-4e93887b-3b6f-401c-9b3f-bbf114659457 service nova] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Updated VIF entry in instance network info cache for port fb928353-bed5-4524-83af-a0f2f19dafad. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 02:57:34.035977 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f8b60919-0cd4-42bd-82f1-9f854deb2942 req-4e93887b-3b6f-401c-9b3f-bbf114659457 service nova] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Updating instance_info_cache with network_info: [{"id": "fb928353-bed5-4524-83af-a0f2f19dafad", "address": "fa:16:3e:a8:2e:10", "network": {"id": "ba582098-1dc2-4a13-9479-4e40d17cba1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-926668277-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ece615dc6a9547cc849be4c1d0f45636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb928353-be", "ovs_interfaceid": "fb928353-bed5-4524-83af-a0f2f19dafad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:34.039859 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:34.039859 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:34.043353 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:34.043683 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:34.102258 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:34.119830 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.073s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:34.119830 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:34.187990 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk 1073741824" returned: 0 in 0.070s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:34.189630 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.151s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:34.190716 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:34.202091 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 02:57:34.259347 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.069s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:34.259791 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 02:57:34.260077 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:34.317121 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Creating config drive at /opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk.config
May 27 02:57:34.323824 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw_8tostd {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:34.336366 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:34.337044 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Cannot resize image /opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 02:57:34.337688 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 02:57:34.337989 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Ensure instance console log exists: /opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 02:57:34.338347 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:34.338681 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:34.338896 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:34.352330 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "refresh_cache-63151241-1b03-4b3c-9ecd-27703137e752" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:34.367338 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw_8tostd" returned: 0 in 0.044s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:34.429216 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 02:57:34.430497 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 02:57:34.431174 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:34.431716 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:34.435028 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-ae935c73-058b-492c-895b-4fa720937e55 req-a5a791eb-7fc8-4f33-bcd9-7d867e9ad369 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:34.537800 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ae935c73-058b-492c-895b-4fa720937e55 req-a5a791eb-7fc8-4f33-bcd9-7d867e9ad369 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:57:34.545147 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8b60919-0cd4-42bd-82f1-9f854deb2942 req-4e93887b-3b6f-401c-9b3f-bbf114659457 service nova] Releasing lock "refresh_cache-7ccb28d3-b43c-44bd-93d6-7dfb12b6a858" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:34.559354 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84dc8d0aa07e4080860c3b0ef5b1a6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2254e04d10914b0d9b3768ba32b8559d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 02:57:34.597583 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:34.609717 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:34.611433 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:34.637657 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:34.647246 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:34.894726 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:34.900299 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:57:34.900299 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:57:34.900299 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] No VIF found with MAC fa:16:3e:a8:2e:10, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:57:34.901812 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Using config drive
May 27 02:57:34.906559 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ae935c73-058b-492c-895b-4fa720937e55 req-a5a791eb-7fc8-4f33-bcd9-7d867e9ad369 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:34.922349 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:34.940209 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 02:57:35.015671 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:35.326771 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:57:35.327004 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:57:35.406458 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:35.408514 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ae935c73-058b-492c-895b-4fa720937e55 req-a5a791eb-7fc8-4f33-bcd9-7d867e9ad369 service nova] Releasing lock "refresh_cache-63151241-1b03-4b3c-9ecd-27703137e752" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:35.408812 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquired lock "refresh_cache-63151241-1b03-4b3c-9ecd-27703137e752" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:35.409080 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 02:57:35.423962 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:35.429991 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:35.436031 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:35.444519 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 02:57:35.452950 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:35.460450 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:35.483355 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Successfully created port: 85ecf3fb-ef43-44a6-836b-a5e5da02646a {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:57:35.600490 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Creating config drive at /opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858/disk.config
May 27 02:57:35.603780 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi29yr8ws {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:35.632164 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi29yr8ws" returned: 0 in 0.028s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:35.682654 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:35.731438 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850655.731068, 82be1ace-dc06-42dd-8660-02439941fa00 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:35.731586 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] VM Started (Lifecycle Event)
May 27 02:57:35.830464 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:57:35.992935 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:57:36.053371 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:36.072476 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:36.074728 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:36.164101 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:36.174818 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:36.235106 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:36.237002 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850656.2367556, 82be1ace-dc06-42dd-8660-02439941fa00 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:36.237173 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] VM Paused (Lifecycle Event)
May 27 02:57:36.337651 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.435s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:36.338007 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 02:57:36.340893 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 5.939s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:36.352336 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 02:57:36.352580 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Claim successful on node np0000001475
May 27 02:57:36.356151 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Updating instance_info_cache with network_info: [{"id": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "address": "fa:16:3e:c9:82:f2", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb5cffe-8c", "ovs_interfaceid": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:36.397883 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:36.402270 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:36.403651 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:36.406285 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:36.424737 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:36.452673 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 02:57:36.453822 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 02:57:36.454060 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Creating image(s)
May 27 02:57:36.454769 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:36.455137 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "/opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:36.455654 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "/opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:36.456310 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:36.459441 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:36.461307 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:36.543688 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.082s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:36.544324 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:36.544975 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:36.545583 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:36.548910 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:36.549453 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:36.620760 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.071s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:36.621466 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:36.656731 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk 1073741824" returned: 0 in 0.035s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:36.659155 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.113s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:36.659703 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:36.705524 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Successfully updated port: 85ecf3fb-ef43-44a6-836b-a5e5da02646a {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:57:36.737203 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.078s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:36.737666 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 02:57:36.737970 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:36.746926 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:36.751785 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:57:36.767526 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-904c3f2e-3773-46f8-8ee7-c804074a2dac req-74b82fd6-fe97-4c96-95fe-dab435128c35 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Received event network-changed-85ecf3fb-ef43-44a6-836b-a5e5da02646a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:36.767734 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-904c3f2e-3773-46f8-8ee7-c804074a2dac req-74b82fd6-fe97-4c96-95fe-dab435128c35 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Refreshing instance network info cache due to event network-changed-85ecf3fb-ef43-44a6-836b-a5e5da02646a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:57:36.768015 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-904c3f2e-3773-46f8-8ee7-c804074a2dac req-74b82fd6-fe97-4c96-95fe-dab435128c35 service nova] Acquiring lock "refresh_cache-a6c0c0f0-846a-4ffb-8f02-d43af196da22" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:36.768704 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-904c3f2e-3773-46f8-8ee7-c804074a2dac req-74b82fd6-fe97-4c96-95fe-dab435128c35 service nova] Acquired lock "refresh_cache-a6c0c0f0-846a-4ffb-8f02-d43af196da22" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:36.770401 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-904c3f2e-3773-46f8-8ee7-c804074a2dac req-74b82fd6-fe97-4c96-95fe-dab435128c35 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Refreshing network info cache for port 85ecf3fb-ef43-44a6-836b-a5e5da02646a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:57:36.811397 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:36.811897 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Cannot resize image /opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 02:57:36.812234 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 02:57:36.812388 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Ensure instance console log exists: /opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 02:57:36.812650 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:36.812830 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:36.813100 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:36.844396 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 02:57:36.844487 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 02:57:36.844903 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:36.845102 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:36.861008 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Releasing lock "refresh_cache-63151241-1b03-4b3c-9ecd-27703137e752" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:36.861374 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Instance network_info: |[{"id": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "address": "fa:16:3e:c9:82:f2", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb5cffe-8c", "ovs_interfaceid": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 02:57:36.863881 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Start _get_guest_xml network_info=[{"id": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "address": "fa:16:3e:c9:82:f2", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb5cffe-8c", "ovs_interfaceid": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 02:57:36.867342 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 02:57:36.868708 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-35889191-1', uuid='63151241-1b03-4b3c-9ecd-27703137e752'), owner=OwnerMeta(userid='84dc8d0aa07e4080860c3b0ef5b1a6f8', username='tempest-TestMultiAttachVolumeSwap-90789856-project-member', projectid='2254e04d10914b0d9b3768ba32b8559d', projectname='tempest-TestMultiAttachVolumeSwap-90789856'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "address": "fa:16:3e:c9:82:f2", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb5cffe-8c", "ovs_interfaceid": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850656.8683069) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 02:57:36.870421 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 02:57:36.870828 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 02:57:36.871757 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 02:57:36.871948 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 02:57:36.873011 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 02:57:36.873435 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 02:57:36.873614 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 02:57:36.873937 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 02:57:36.874116 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 02:57:36.874256 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 02:57:36.874392 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 02:57:36.874948 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 02:57:36.874948 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 02:57:36.874948 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 02:57:36.875061 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 02:57:36.875261 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 02:57:36.888790 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T02:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-35889191-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testmultiattachvolumeswap-server-35889191-1',id=4,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlRtMXwXqxxfCfk2wyrdM1hVxwG04jAUqbKrwT0tKGr215eYb70ufBC6UJCH08Wx1O2T2A6AmB32SehIkLbG1sWa6RBHWBcWk6dNyZtDA3quPSBXjFAUUg0eY2X8vP3HQ==',key_name='tempest-keypair-1968274056',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2254e04d10914b0d9b3768ba32b8559d',ramdisk_id='',reservation_id='r-3gu306zc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-90789856',owner_user_name='tempest-TestMultiAttachVolumeSwap-90789856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84dc8d0aa07e4080860c3b0ef5b1a6f8',uuid=63151241-1b03-4b3c-9ecd-27703137e752,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "address": "fa:16:3e:c9:82:f2", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb5cffe-8c", "ovs_interfaceid": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:57:36.889037 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Converting VIF {"id": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "address": "fa:16:3e:c9:82:f2", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb5cffe-8c", "ovs_interfaceid": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:57:36.889791 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=abb5cffe-8cbc-49eb-8f62-0014bcc3d411,network=Network(d665ed1b-f99c-428d-840a-3ab6ee008b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb5cffe-8c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:57:36.890067 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lazy-loading 'pci_devices' on Instance uuid 63151241-1b03-4b3c-9ecd-27703137e752 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:57:36.975261 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34d4ecd608df47c6b6057f74772ef553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36131e6324ff45ddb65932f4ade9a1a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 02:57:37.210070 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "refresh_cache-a6c0c0f0-846a-4ffb-8f02-d43af196da22" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:37.254952 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 02:57:37.255347 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850657.255143, 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:37.255486 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] VM Started (Lifecycle Event)
May 27 02:57:37.273645 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-904c3f2e-3773-46f8-8ee7-c804074a2dac req-74b82fd6-fe97-4c96-95fe-dab435128c35 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:37.337582 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-904c3f2e-3773-46f8-8ee7-c804074a2dac req-74b82fd6-fe97-4c96-95fe-dab435128c35 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:57:37.348176 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 02:57:37.392312 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] End _get_guest_xml xml=<domain type="qemu">
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:   <uuid>63151241-1b03-4b3c-9ecd-27703137e752</uuid>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:   <name>instance-00000004</name>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:   <metadata>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-35889191-1</nova:name>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 02:57:36</nova:creationTime>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       </nova:image>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:         <nova:user uuid="84dc8d0aa07e4080860c3b0ef5b1a6f8">tempest-TestMultiAttachVolumeSwap-90789856-project-member</nova:user>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:         <nova:project uuid="2254e04d10914b0d9b3768ba32b8559d">tempest-TestMultiAttachVolumeSwap-90789856</nova:project>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:         <nova:port uuid="abb5cffe-8cbc-49eb-8f62-0014bcc3d411">
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:   </metadata>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     <system>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <entry name="serial">63151241-1b03-4b3c-9ecd-27703137e752</entry>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <entry name="uuid">63151241-1b03-4b3c-9ecd-27703137e752</entry>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     </system>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:   <os>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:   </os>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:   <features>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     <acpi/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     <tcg>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     </tcg>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:   </features>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:   <devices>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     </disk>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk.config"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     </disk>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:c9:82:f2"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <target dev="tapabb5cffe-8c"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     </interface>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/console.log" append="off"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     </serial>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     <video>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     </video>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     </rng>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:     </memballoon>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:   </devices>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]: </domain>
May 27 02:57:37.392312 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 02:57:37.394986 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Preparing to wait for external event network-vif-plugged-abb5cffe-8cbc-49eb-8f62-0014bcc3d411 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:57:37.394986 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "63151241-1b03-4b3c-9ecd-27703137e752-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:37.394986 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "63151241-1b03-4b3c-9ecd-27703137e752-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:37.394986 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "63151241-1b03-4b3c-9ecd-27703137e752-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:37.394986 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T02:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-35889191-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testmultiattachvolumeswap-server-35889191-1',id=4,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlRtMXwXqxxfCfk2wyrdM1hVxwG04jAUqbKrwT0tKGr215eYb70ufBC6UJCH08Wx1O2T2A6AmB32SehIkLbG1sWa6RBHWBcWk6dNyZtDA3quPSBXjFAUUg0eY2X8vP3HQ==',key_name='tempest-keypair-1968274056',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2254e04d10914b0d9b3768ba32b8559d',ramdisk_id='',reservation_id='r-3gu306zc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-90789856',owner_user_name='tempest-TestMultiAttachVolumeSwap-90789856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84dc8d0aa07e4080860c3b0ef5b1a6f8',uuid=63151241-1b03-4b3c-9ecd-27703137e752,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "address": "fa:16:3e:c9:82:f2", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb5cffe-8c", "ovs_interfaceid": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:57:37.395373 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Converting VIF {"id": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "address": "fa:16:3e:c9:82:f2", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb5cffe-8c", "ovs_interfaceid": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:57:37.395373 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=abb5cffe-8cbc-49eb-8f62-0014bcc3d411,network=Network(d665ed1b-f99c-428d-840a-3ab6ee008b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb5cffe-8c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:57:37.395373 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=abb5cffe-8cbc-49eb-8f62-0014bcc3d411,network=Network(d665ed1b-f99c-428d-840a-3ab6ee008b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb5cffe-8c') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:57:37.395999 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:37.397476 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Successfully created port: 51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:57:37.399007 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:37.399980 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:57:37.403546 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:37.403831 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0066044-549b-592f-ae39-a5ea3f096f9d', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:37.404673 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:37.405626 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:57:37.406946 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:37.408887 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:37.409046 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabb5cffe-8c, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:37.409474 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabb5cffe-8c, col_values=(('qos', UUID('b9e31009-283c-431f-96ad-19e50f0b31d9')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:37.409706 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabb5cffe-8c, col_values=(('external_ids', {'iface-id': 'abb5cffe-8cbc-49eb-8f62-0014bcc3d411', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:82:f2', 'vm-uuid': '63151241-1b03-4b3c-9ecd-27703137e752'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:37.411125 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:37.411990 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:57:37.417827 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:37.418632 np0000001475 nova-compute[98471]: INFO os_vif [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=abb5cffe-8cbc-49eb-8f62-0014bcc3d411,network=Network(d665ed1b-f99c-428d-840a-3ab6ee008b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb5cffe-8c')
May 27 02:57:37.492095 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-904c3f2e-3773-46f8-8ee7-c804074a2dac req-74b82fd6-fe97-4c96-95fe-dab435128c35 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:37.751130 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:57:37.751448 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:57:37.758013 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:37.760012 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850657.7597575, 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:37.760157 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] VM Paused (Lifecycle Event)
May 27 02:57:37.850970 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 02:57:37.897618 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Successfully updated port: 51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:57:37.996814 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-904c3f2e-3773-46f8-8ee7-c804074a2dac req-74b82fd6-fe97-4c96-95fe-dab435128c35 service nova] Releasing lock "refresh_cache-a6c0c0f0-846a-4ffb-8f02-d43af196da22" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:37.997689 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquired lock "refresh_cache-a6c0c0f0-846a-4ffb-8f02-d43af196da22" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:37.997689 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 02:57:38.254510 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:57:38.262702 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:38.264861 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:57:38.355680 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Booting with volume dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 at /dev/vda
May 27 02:57:38.400116 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "refresh_cache-7c0291f5-62af-417b-9418-41d808856a8d" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:38.400116 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquired lock "refresh_cache-7c0291f5-62af-417b-9418-41d808856a8d" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:38.400116 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 02:57:38.416331 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:57:38.417317 np0000001475 nova-compute[98471]: INFO oslo.privsep.daemon [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpb8lkirnq/privsep.sock']
May 27 02:57:38.425407 np0000001475 sudo[110982]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpb8lkirnq/privsep.sock
May 27 02:57:38.426233 np0000001475 sudo[110982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 27 02:57:38.577798 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:57:38.694314 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 27 02:57:38.694406 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 27 02:57:38.694434 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 27 02:57:38.695357 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 02:57:38.695357 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 27 02:57:38.695357 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 27 02:57:38.695357 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 27 02:57:38.695357 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 02:57:38.695357 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 27 02:57:38.738786 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:38.738916 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:38.764342 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.424s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:38.764790 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 02:57:38.767293 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 02:57:38.801986 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:38.845647 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ff7bf0bb-ee84-446b-b9d4-7ee7439bdb8c req-ca50b0fc-a2f1-41d9-8653-dce10deaed70 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received event network-changed-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:38.845769 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ff7bf0bb-ee84-446b-b9d4-7ee7439bdb8c req-ca50b0fc-a2f1-41d9-8653-dce10deaed70 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Refreshing instance network info cache due to event network-changed-51f6cb37-5c11-47c2-bf1c-d072ecfff71a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:57:38.846568 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ff7bf0bb-ee84-446b-b9d4-7ee7439bdb8c req-ca50b0fc-a2f1-41d9-8653-dce10deaed70 service nova] Acquiring lock "refresh_cache-7c0291f5-62af-417b-9418-41d808856a8d" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:38.937651 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:57:38.937822 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:57:38.937984 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] No VIF found with MAC fa:16:3e:c9:82:f2, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:57:38.938480 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Using config drive
May 27 02:57:38.960755 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Updating instance_info_cache with network_info: [{"id": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "address": "fa:16:3e:f0:b1:7a", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf3fb-ef", "ovs_interfaceid": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:39.003907 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:57:39.011040 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 27 02:57:39.011114 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 27 02:57:39.011191 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 27 02:57:39.011244 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 02:57:39.011291 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 27 02:57:39.011332 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 27 02:57:39.011376 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 27 02:57:39.011412 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log: 
May 27 02:57:39.011451 np0000001475 nova-compute[98471]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 27 02:57:39.182389 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:39.240653 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 02:57:39.270664 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 02:57:39.271042 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 02:57:39.271353 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:39.271586 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:39.302819 np0000001475 sudo[110982]: pam_unix(sudo:session): session closed for user root
May 27 02:57:39.304770 np0000001475 nova-compute[98471]: INFO oslo.privsep.daemon [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Spawned new privsep daemon via rootwrap
May 27 02:57:39.336751 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Updating instance_info_cache with network_info: [{"id": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "address": "fa:16:3e:26:2c:eb", "network": {"id": "c7f25d43-cc3f-4be2-b8f5-311363bbd4ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1793934555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36131e6324ff45ddb65932f4ade9a1a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f6cb37-5c", "ovs_interfaceid": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:39.368398 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4409687dc6c64de9b9b3926cd5f1a3c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2779cce722472da45319e6a0faa7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 02:57:39.403411 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 02:57:39.405305 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.nvmeof [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
May 27 02:57:39.423315 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:39.448097 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:39.453271 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 02:57:39.453563 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 02:57:39.461525 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 02:57:39.463023 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe13:801f', 'fe80::2083:28ff:fee3:52ac', 'fe80::fc16:3eff:fee1:4af7', 'fe80::2088:d9ff:fe30:a71f', 'fe80::fc16:3eff:fea8:2e10', 'fe80::989d:c8ff:fee6:da02'] 
May 27 02:57:39.463236 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 02:57:39.463393 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 02:57:39.464607 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Releasing lock "refresh_cache-a6c0c0f0-846a-4ffb-8f02-d43af196da22" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:39.465130 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] <== get_connector_properties: return (1047ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:57:39.465677 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Instance network_info: |[{"id": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "address": "fa:16:3e:f0:b1:7a", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf3fb-ef", "ovs_interfaceid": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 02:57:39.466077 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Updating existing volume attachment record: a9422f84-b30e-48cd-a5e4-8e4754a87ef2 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 02:57:39.470062 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Start _get_guest_xml network_info=[{"id": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "address": "fa:16:3e:f0:b1:7a", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf3fb-ef", "ovs_interfaceid": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 02:57:39.473820 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 02:57:39.476379 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-35889191-2', uuid='a6c0c0f0-846a-4ffb-8f02-d43af196da22'), owner=OwnerMeta(userid='84dc8d0aa07e4080860c3b0ef5b1a6f8', username='tempest-TestMultiAttachVolumeSwap-90789856-project-member', projectid='2254e04d10914b0d9b3768ba32b8559d', projectname='tempest-TestMultiAttachVolumeSwap-90789856'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "address": "fa:16:3e:f0:b1:7a", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf3fb-ef", "ovs_interfaceid": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850659.4759817) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 02:57:39.477425 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 02:57:39.477790 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 02:57:39.478478 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 02:57:39.479179 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 02:57:39.480152 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 02:57:39.480659 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 02:57:39.480871 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 02:57:39.481023 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 02:57:39.481209 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 02:57:39.481341 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 02:57:39.481599 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 02:57:39.481711 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 02:57:39.481870 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 02:57:39.482040 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 02:57:39.482197 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 02:57:39.482399 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 02:57:39.492452 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T02:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-35889191-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testmultiattachvolumeswap-server-35889191-2',id=5,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlRtMXwXqxxfCfk2wyrdM1hVxwG04jAUqbKrwT0tKGr215eYb70ufBC6UJCH08Wx1O2T2A6AmB32SehIkLbG1sWa6RBHWBcWk6dNyZtDA3quPSBXjFAUUg0eY2X8vP3HQ==',key_name='tempest-keypair-1968274056',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2254e04d10914b0d9b3768ba32b8559d',ramdisk_id='',reservation_id='r-3gu306zc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-90789856',owner_user_name='tempest-TestMultiAttachVolumeSwap-90789856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84dc8d0aa07e4080860c3b0ef5b1a6f8',uuid=a6c0c0f0-846a-4ffb-8f02-d43af196da22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "address": "fa:16:3e:f0:b1:7a", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf3fb-ef", "ovs_interfaceid": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:57:39.492712 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Converting VIF {"id": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "address": "fa:16:3e:f0:b1:7a", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf3fb-ef", "ovs_interfaceid": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:57:39.493414 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b1:7a,bridge_name='br-int',has_traffic_filtering=True,id=85ecf3fb-ef43-44a6-836b-a5e5da02646a,network=Network(d665ed1b-f99c-428d-840a-3ab6ee008b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ecf3fb-ef') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:57:39.494012 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lazy-loading 'pci_devices' on Instance uuid a6c0c0f0-846a-4ffb-8f02-d43af196da22 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:57:39.620323 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Creating config drive at /opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk.config
May 27 02:57:39.624719 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3wklfw8q {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:39.652661 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3wklfw8q" returned: 0 in 0.028s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:39.775525 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 02:57:39.814001 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:39.814203 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:39.817580 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 02:57:39.817735 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Claim successful on node np0000001475
May 27 02:57:39.839409 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Releasing lock "refresh_cache-7c0291f5-62af-417b-9418-41d808856a8d" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:39.839554 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Instance network_info: |[{"id": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "address": "fa:16:3e:26:2c:eb", "network": {"id": "c7f25d43-cc3f-4be2-b8f5-311363bbd4ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1793934555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36131e6324ff45ddb65932f4ade9a1a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f6cb37-5c", "ovs_interfaceid": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 02:57:39.840097 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ff7bf0bb-ee84-446b-b9d4-7ee7439bdb8c req-ca50b0fc-a2f1-41d9-8653-dce10deaed70 service nova] Acquired lock "refresh_cache-7c0291f5-62af-417b-9418-41d808856a8d" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:39.840330 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ff7bf0bb-ee84-446b-b9d4-7ee7439bdb8c req-ca50b0fc-a2f1-41d9-8653-dce10deaed70 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Refreshing network info cache for port 51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:57:39.848127 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Successfully created port: 897240c0-5223-4d8f-b4dd-e3c9e51e849a {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:57:39.997786 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] End _get_guest_xml xml=<domain type="qemu">
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:   <uuid>a6c0c0f0-846a-4ffb-8f02-d43af196da22</uuid>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:   <name>instance-00000005</name>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:   <metadata>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-35889191-2</nova:name>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 02:57:39</nova:creationTime>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       </nova:image>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:         <nova:user uuid="84dc8d0aa07e4080860c3b0ef5b1a6f8">tempest-TestMultiAttachVolumeSwap-90789856-project-member</nova:user>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:         <nova:project uuid="2254e04d10914b0d9b3768ba32b8559d">tempest-TestMultiAttachVolumeSwap-90789856</nova:project>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:         <nova:port uuid="85ecf3fb-ef43-44a6-836b-a5e5da02646a">
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:   </metadata>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     <system>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <entry name="serial">a6c0c0f0-846a-4ffb-8f02-d43af196da22</entry>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <entry name="uuid">a6c0c0f0-846a-4ffb-8f02-d43af196da22</entry>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     </system>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:   <os>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:   </os>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:   <features>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     <acpi/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     <tcg>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     </tcg>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:   </features>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:   <devices>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     </disk>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk.config"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     </disk>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:f0:b1:7a"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <target dev="tap85ecf3fb-ef"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     </interface>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/console.log" append="off"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     </serial>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     <video>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     </video>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     </rng>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:     </memballoon>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:   </devices>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]: </domain>
May 27 02:57:39.997786 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 02:57:40.000466 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Preparing to wait for external event network-vif-plugged-85ecf3fb-ef43-44a6-836b-a5e5da02646a {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:57:40.000466 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:40.000466 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:40.000466 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:40.000466 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T02:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-35889191-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testmultiattachvolumeswap-server-35889191-2',id=5,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlRtMXwXqxxfCfk2wyrdM1hVxwG04jAUqbKrwT0tKGr215eYb70ufBC6UJCH08Wx1O2T2A6AmB32SehIkLbG1sWa6RBHWBcWk6dNyZtDA3quPSBXjFAUUg0eY2X8vP3HQ==',key_name='tempest-keypair-1968274056',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2254e04d10914b0d9b3768ba32b8559d',ramdisk_id='',reservation_id='r-3gu306zc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-90789856',owner_user_name='tempest-TestMultiAttachVolumeSwap-90789856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84dc8d0aa07e4080860c3b0ef5b1a6f8',uuid=a6c0c0f0-846a-4ffb-8f02-d43af196da22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "address": "fa:16:3e:f0:b1:7a", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf3fb-ef", "ovs_interfaceid": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:57:40.000770 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Converting VIF {"id": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "address": "fa:16:3e:f0:b1:7a", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf3fb-ef", "ovs_interfaceid": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:57:40.000770 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b1:7a,bridge_name='br-int',has_traffic_filtering=True,id=85ecf3fb-ef43-44a6-836b-a5e5da02646a,network=Network(d665ed1b-f99c-428d-840a-3ab6ee008b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ecf3fb-ef') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:57:40.001083 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b1:7a,bridge_name='br-int',has_traffic_filtering=True,id=85ecf3fb-ef43-44a6-836b-a5e5da02646a,network=Network(d665ed1b-f99c-428d-840a-3ab6ee008b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ecf3fb-ef') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:57:40.001603 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:40.002061 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:40.002430 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:57:40.003393 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:40.003575 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b1e80cc-e1bb-5640-bd08-bb5db194a5c6', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:40.004729 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:40.005583 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:57:40.010611 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:40.013108 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:40.013382 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85ecf3fb-ef, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:40.013810 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85ecf3fb-ef, col_values=(('qos', UUID('7a6886be-7f07-4b22-ac47-75f32bfe9e98')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:40.014017 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85ecf3fb-ef, col_values=(('external_ids', {'iface-id': '85ecf3fb-ef43-44a6-836b-a5e5da02646a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:b1:7a', 'vm-uuid': 'a6c0c0f0-846a-4ffb-8f02-d43af196da22'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:40.015035 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:40.016590 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:57:40.025276 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:40.026513 np0000001475 nova-compute[98471]: INFO os_vif [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:b1:7a,bridge_name='br-int',has_traffic_filtering=True,id=85ecf3fb-ef43-44a6-836b-a5e5da02646a,network=Network(d665ed1b-f99c-428d-840a-3ab6ee008b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ecf3fb-ef')
May 27 02:57:40.097523 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:40.121430 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:40.202877 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:40.280005 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 02:57:40.345682 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-ff7bf0bb-ee84-446b-b9d4-7ee7439bdb8c req-ca50b0fc-a2f1-41d9-8653-dce10deaed70 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:40.399523 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Successfully updated port: 897240c0-5223-4d8f-b4dd-e3c9e51e849a {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:57:40.447944 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:40.453600 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:40.478337 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:40.485142 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:40.672622 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-ff7bf0bb-ee84-446b-b9d4-7ee7439bdb8c req-ca50b0fc-a2f1-41d9-8653-dce10deaed70 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:40.684226 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:40.799326 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ff7bf0bb-ee84-446b-b9d4-7ee7439bdb8c req-ca50b0fc-a2f1-41d9-8653-dce10deaed70 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Updated VIF entry in instance network info cache for port 51f6cb37-5c11-47c2-bf1c-d072ecfff71a. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 02:57:40.799597 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ff7bf0bb-ee84-446b-b9d4-7ee7439bdb8c req-ca50b0fc-a2f1-41d9-8653-dce10deaed70 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Updating instance_info_cache with network_info: [{"id": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "address": "fa:16:3e:26:2c:eb", "network": {"id": "c7f25d43-cc3f-4be2-b8f5-311363bbd4ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1793934555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36131e6324ff45ddb65932f4ade9a1a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f6cb37-5c", "ovs_interfaceid": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:40.879493 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850660.8790026, 63151241-1b03-4b3c-9ecd-27703137e752 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:40.879604 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] VM Started (Lifecycle Event)
May 27 02:57:40.901857 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Acquiring lock "refresh_cache-09039461-93a4-458a-886e-9783f6edaf45" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:40.901857 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Acquired lock "refresh_cache-09039461-93a4-458a-886e-9783f6edaf45" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:40.902920 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 02:57:40.939968 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-16ba0264-0558-449b-9615-7ffce6dab0da req-ea2ac011-9722-4e76-8644-6608c58a6a41 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Received event network-changed-897240c0-5223-4d8f-b4dd-e3c9e51e849a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:40.939968 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-16ba0264-0558-449b-9615-7ffce6dab0da req-ea2ac011-9722-4e76-8644-6608c58a6a41 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Refreshing instance network info cache due to event network-changed-897240c0-5223-4d8f-b4dd-e3c9e51e849a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:57:40.939968 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-16ba0264-0558-449b-9615-7ffce6dab0da req-ea2ac011-9722-4e76-8644-6608c58a6a41 service nova] Acquiring lock "refresh_cache-09039461-93a4-458a-886e-9783f6edaf45" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:40.951756 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:57:40.952120 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:57:40.952626 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:57:40.952866 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:57:40.953086 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:57:40.953317 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:57:40.953515 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:57:40.953679 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 02:57:40.953872 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:57:41.245597 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:57:41.245834 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:57:41.288150 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 02:57:41.289206 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 02:57:41.289450 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Creating image(s)
May 27 02:57:41.289939 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Acquiring lock "/opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:41.290092 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Lock "/opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:41.290502 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Lock "/opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:41.290989 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:41.293776 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:41.294999 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:41.305799 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ff7bf0bb-ee84-446b-b9d4-7ee7439bdb8c req-ca50b0fc-a2f1-41d9-8653-dce10deaed70 service nova] Releasing lock "refresh_cache-7c0291f5-62af-417b-9418-41d808856a8d" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:41.364148 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.069s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:41.364553 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:41.364996 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:41.365533 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:41.368052 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:57:41.368397 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:41.384218 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:41.387664 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850661.387303, 63151241-1b03-4b3c-9ecd-27703137e752 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:41.387865 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] VM Paused (Lifecycle Event)
May 27 02:57:41.437445 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.069s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:41.438788 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:41.462888 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:41.471372 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45/disk 1073741824" returned: 0 in 0.032s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:41.471941 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.107s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:41.472082 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:41.484787 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:57:41.544468 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:57:41.544592 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:57:41.544661 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] No VIF found with MAC fa:16:3e:f0:b1:7a, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:57:41.545311 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Using config drive
May 27 02:57:41.547763 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.076s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:41.548202 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 02:57:41.548593 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:41.592350 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 02:57:41.596768 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 02:57:41.596768 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Creating image(s)
May 27 02:57:41.596768 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 02:57:41.596768 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Ensure instance console log exists: /opt/stack/data/nova/instances/7c0291f5-62af-417b-9418-41d808856a8d/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 02:57:41.597121 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:41.597356 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:41.597490 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:41.598072 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Start _get_guest_xml network_info=[{"id": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "address": "fa:16:3e:26:2c:eb", "network": {"id": "c7f25d43-cc3f-4be2-b8f5-311363bbd4ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1793934555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36131e6324ff45ddb65932f4ade9a1a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f6cb37-5c", "ovs_interfaceid": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7c0291f5-62af-417b-9418-41d808856a8d', 'attached_at': '', 'detached_at': '', 'volume_id': 'dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'serial': 'dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'a9422f84-b30e-48cd-a5e4-8e4754a87ef2', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 02:57:41.601041 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 02:57:41.602372 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1629751309', uuid='7c0291f5-62af-417b-9418-41d808856a8d'), owner=OwnerMeta(userid='34d4ecd608df47c6b6057f74772ef553', username='tempest-ServerActionsV293TestJSON-450650320-project-member', projectid='36131e6324ff45ddb65932f4ade9a1a8', projectname='tempest-ServerActionsV293TestJSON-450650320'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "address": "fa:16:3e:26:2c:eb", "network": {"id": "c7f25d43-cc3f-4be2-b8f5-311363bbd4ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1793934555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36131e6324ff45ddb65932f4ade9a1a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f6cb37-5c", "ovs_interfaceid": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850661.601924) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 02:57:41.603456 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 02:57:41.603848 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 02:57:41.604520 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 02:57:41.604698 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 02:57:41.605796 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 02:57:41.606094 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 02:57:41.606796 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 02:57:41.606796 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 02:57:41.606796 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 02:57:41.606796 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 02:57:41.606796 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 02:57:41.607098 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 02:57:41.607098 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 02:57:41.607285 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 02:57:41.607427 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 02:57:41.607559 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 02:57:41.617442 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:41.617649 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:41.619684 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45/disk --force-share --output=json" returned: 0 in 0.071s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:41.620596 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connector [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Factory for ISCSI on None {{(pid=98471) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}}
May 27 02:57:41.621605 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Cannot resize image /opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 02:57:41.621691 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:41.621934 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 02:57:41.622421 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 02:57:41.622683 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:57:41.623028 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:57:41.623327 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Ensure instance console log exists: /opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 02:57:41.623573 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:41.623816 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:41.623906 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:41.624163 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:57:41.625038 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 02:57:41.637763 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:57:41.638225 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:57:41.638652 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:57:41.638908 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:57:41.639569 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:57:41.639569 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:57:41.649700 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:57:41.649700 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:57:41.654711 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:57:41.654711 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:57:41.662099 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41] added
May 27 02:57:41.662099 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:57:41.662099 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:57:41.662099 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:57:41.662099 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:57:41.662099 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:57:41.662099 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:57:41.662346 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:57:41.662712 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0237(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:57:41.662964 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:57:41.666709 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41] added
May 27 02:57:41.666709 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:57:41.666709 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:57:41.666709 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:57:41.666709 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:57:41.666709 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:57:41.666709 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:57:41.666958 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:57:41.667090 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:57:41.667301 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:57:41.694377 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:41.748509 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:57:41.866711 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Updating instance_info_cache with network_info: [{"id": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "address": "fa:16:3e:0e:05:47", "network": {"id": "d7d2098f-0324-469b-a994-bde15b0c7538", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1155020550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce2779cce722472da45319e6a0faa7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap897240c0-52", "ovs_interfaceid": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:41.892817 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:41.894355 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:57:42.051133 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:42.223639 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Creating config drive at /opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk.config
May 27 02:57:42.227602 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppb6f6gaf {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:42.260073 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.446s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:42.261119 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 02:57:42.262610 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.800s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:42.262826 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:42.262975 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 02:57:42.265128 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppb6f6gaf" returned: 0 in 0.037s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:42.368950 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Releasing lock "refresh_cache-09039461-93a4-458a-886e-9783f6edaf45" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:42.369397 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Instance network_info: |[{"id": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "address": "fa:16:3e:0e:05:47", "network": {"id": "d7d2098f-0324-469b-a994-bde15b0c7538", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1155020550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce2779cce722472da45319e6a0faa7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap897240c0-52", "ovs_interfaceid": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 02:57:42.369689 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-16ba0264-0558-449b-9615-7ffce6dab0da req-ea2ac011-9722-4e76-8644-6608c58a6a41 service nova] Acquired lock "refresh_cache-09039461-93a4-458a-886e-9783f6edaf45" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:42.371593 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Start _get_guest_xml network_info=[{"id": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "address": "fa:16:3e:0e:05:47", "network": {"id": "d7d2098f-0324-469b-a994-bde15b0c7538", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1155020550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce2779cce722472da45319e6a0faa7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap897240c0-52", "ovs_interfaceid": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 02:57:42.371926 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-16ba0264-0558-449b-9615-7ffce6dab0da req-ea2ac011-9722-4e76-8644-6608c58a6a41 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Refreshing network info cache for port 897240c0-5223-4d8f-b4dd-e3c9e51e849a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:57:42.374016 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 02:57:42.375662 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-1095595740', uuid='09039461-93a4-458a-886e-9783f6edaf45'), owner=OwnerMeta(userid='4409687dc6c64de9b9b3926cd5f1a3c3', username='tempest-VolumesAssistedSnapshotsTest-1998652501-project-member', projectid='ce2779cce722472da45319e6a0faa7e1', projectname='tempest-VolumesAssistedSnapshotsTest-1998652501'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "address": "fa:16:3e:0e:05:47", "network": {"id": "d7d2098f-0324-469b-a994-bde15b0c7538", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1155020550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce2779cce722472da45319e6a0faa7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap897240c0-52", "ovs_interfaceid": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850662.3751216) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 02:57:42.376889 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 02:57:42.377351 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 02:57:42.378061 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 02:57:42.378277 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 02:57:42.379220 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 02:57:42.379696 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 02:57:42.379696 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 02:57:42.379859 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 02:57:42.379937 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 02:57:42.380021 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 02:57:42.380110 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 02:57:42.380297 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 02:57:42.380432 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 02:57:42.380673 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 02:57:42.380827 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 02:57:42.380976 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 02:57:42.392682 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T02:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1095595740',display_name='tempest-VolumesAssistedSnapshotsTest-server-1095595740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesassistedsnapshotstest-server-1095595740',id=7,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqZvogiAMkt/fZUwOoh2XI0OVMEpZfVKfy3b5cAonbft5xj1LYsxTthreuUpoeXXwQKQV3UXus+6lfq7OdV5Vuu5jN2/a/Hg241OTA9slRPfTkSMwMotjADjkQW9SBSsQ==',key_name='tempest-keypair-2107810849',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce2779cce722472da45319e6a0faa7e1',ramdisk_id='',reservation_id='r-h3p5wp2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1998652501',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1998652501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4409687dc6c64de9b9b3926cd5f1a3c3',uuid=09039461-93a4-458a-886e-9783f6edaf45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "address": "fa:16:3e:0e:05:47", "network": {"id": "d7d2098f-0324-469b-a994-bde15b0c7538", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1155020550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce2779cce722472da45319e6a0faa7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap897240c0-52", "ovs_interfaceid": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:57:42.392944 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Converting VIF {"id": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "address": "fa:16:3e:0e:05:47", "network": {"id": "d7d2098f-0324-469b-a994-bde15b0c7538", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1155020550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce2779cce722472da45319e6a0faa7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap897240c0-52", "ovs_interfaceid": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:57:42.393700 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:05:47,bridge_name='br-int',has_traffic_filtering=True,id=897240c0-5223-4d8f-b4dd-e3c9e51e849a,network=Network(d7d2098f-0324-469b-a994-bde15b0c7538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap897240c0-52') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:57:42.394396 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Lazy-loading 'pci_devices' on Instance uuid 09039461-93a4-458a-886e-9783f6edaf45 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:57:42.396647 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 02:57:42.663497 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:57:42.667839 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:57:42.674915 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:57:42.674915 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:57:42.679846 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:57:42.679846 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:57:42.685968 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:57:42.691957 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:57:42.697477 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 02:57:42.697477 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:57:42.698362 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 02:57:42.698362 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:57:42.698362 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 02:57:42.698362 np0000001475 nova-compute[98471]: 
May 27 02:57:42.703447 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 02:57:42.703447 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:57:42.703633 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 02:57:42.703633 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:57:42.703807 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 02:57:42.703807 np0000001475 nova-compute[98471]: 
May 27 02:57:42.723312 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, portal: 192.168.40.100,3260]
May 27 02:57:42.723312 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, portal: 192.168.40.100,3260] successful.
May 27 02:57:42.723312 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:57:42.733446 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:57:42.738666 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, portal: 192.168.50.100,3260]
May 27 02:57:42.738666 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, portal: 192.168.50.100,3260] successful.
May 27 02:57:42.738666 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:57:42.744505 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:57:42.744505 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:57:42.744505 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:57:42.744662 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:57:42.744662 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:57:42.744662 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:57:42.744914 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.106s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:57:42.745099 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:57:42.746033 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] HCTL ('7', '-', '-', 0) found on session 5 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:57:42.746207 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:57:42.751647 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:57:42.754877 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:42.765111 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Searching for a device in session 5 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:57:42.765111 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:57:42.771395 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 02:57:42.771811 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 02:57:42.772478 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:42.772820 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:42.782684 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:57:42.782684 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:57:42.782684 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:57:42.783080 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:42.783223 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:57:42.783223 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:57:42.783223 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:57:42.784894 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:57:42.785070 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:57:42.785562 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] HCTL ('8', '-', '-', 0) found on session 6 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:57:42.785660 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:57:42.815060 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Searching for a device in session 6 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:57:42.815060 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:57:42.874125 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-16ba0264-0558-449b-9615-7ffce6dab0da req-ea2ac011-9722-4e76-8644-6608c58a6a41 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:42.884100 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:42.898387 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] End _get_guest_xml xml=<domain type="qemu">
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:   <uuid>09039461-93a4-458a-886e-9783f6edaf45</uuid>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:   <name>instance-00000007</name>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:   <metadata>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1095595740</nova:name>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 02:57:42</nova:creationTime>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       </nova:image>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:         <nova:user uuid="4409687dc6c64de9b9b3926cd5f1a3c3">tempest-VolumesAssistedSnapshotsTest-1998652501-project-member</nova:user>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:         <nova:project uuid="ce2779cce722472da45319e6a0faa7e1">tempest-VolumesAssistedSnapshotsTest-1998652501</nova:project>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:         <nova:port uuid="897240c0-5223-4d8f-b4dd-e3c9e51e849a">
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:   </metadata>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     <system>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <entry name="serial">09039461-93a4-458a-886e-9783f6edaf45</entry>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <entry name="uuid">09039461-93a4-458a-886e-9783f6edaf45</entry>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     </system>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:   <os>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:   </os>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:   <features>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     <acpi/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     <tcg>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     </tcg>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:   </features>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:   <devices>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45/disk"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     </disk>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45/disk.config"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     </disk>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:0e:05:47"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <target dev="tap897240c0-52"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     </interface>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45/console.log" append="off"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     </serial>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     <video>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     </video>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     </rng>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:     </memballoon>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:   </devices>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]: </domain>
May 27 02:57:42.898387 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 02:57:42.901372 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Preparing to wait for external event network-vif-plugged-897240c0-5223-4d8f-b4dd-e3c9e51e849a {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:57:42.901372 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Acquiring lock "09039461-93a4-458a-886e-9783f6edaf45-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:42.901372 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Lock "09039461-93a4-458a-886e-9783f6edaf45-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:42.901372 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Lock "09039461-93a4-458a-886e-9783f6edaf45-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:42.901372 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T02:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1095595740',display_name='tempest-VolumesAssistedSnapshotsTest-server-1095595740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesassistedsnapshotstest-server-1095595740',id=7,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqZvogiAMkt/fZUwOoh2XI0OVMEpZfVKfy3b5cAonbft5xj1LYsxTthreuUpoeXXwQKQV3UXus+6lfq7OdV5Vuu5jN2/a/Hg241OTA9slRPfTkSMwMotjADjkQW9SBSsQ==',key_name='tempest-keypair-2107810849',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce2779cce722472da45319e6a0faa7e1',ramdisk_id='',reservation_id='r-h3p5wp2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1998652501',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1998652501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4409687dc6c64de9b9b3926cd5f1a3c3',uuid=09039461-93a4-458a-886e-9783f6edaf45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "address": "fa:16:3e:0e:05:47", "network": {"id": "d7d2098f-0324-469b-a994-bde15b0c7538", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1155020550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce2779cce722472da45319e6a0faa7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap897240c0-52", "ovs_interfaceid": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:57:42.901654 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Converting VIF {"id": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "address": "fa:16:3e:0e:05:47", "network": {"id": "d7d2098f-0324-469b-a994-bde15b0c7538", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1155020550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce2779cce722472da45319e6a0faa7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap897240c0-52", "ovs_interfaceid": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:57:42.901654 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:05:47,bridge_name='br-int',has_traffic_filtering=True,id=897240c0-5223-4d8f-b4dd-e3c9e51e849a,network=Network(d7d2098f-0324-469b-a994-bde15b0c7538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap897240c0-52') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:57:42.902499 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:05:47,bridge_name='br-int',has_traffic_filtering=True,id=897240c0-5223-4d8f-b4dd-e3c9e51e849a,network=Network(d7d2098f-0324-469b-a994-bde15b0c7538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap897240c0-52') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:57:42.903856 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:42.904176 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:42.904917 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:57:42.907035 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:42.907035 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7ef33aa-150d-5346-bd72-6fd6e1ddcc74', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:42.907856 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:42.908914 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:57:42.912491 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:42.912584 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap897240c0-52, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:42.913241 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap897240c0-52, col_values=(('qos', UUID('238c1dad-b4e4-472b-9826-3524f8a2dbe1')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:42.913406 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap897240c0-52, col_values=(('external_ids', {'iface-id': '897240c0-5223-4d8f-b4dd-e3c9e51e849a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:05:47', 'vm-uuid': '09039461-93a4-458a-886e-9783f6edaf45'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:42.914106 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:42.915411 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:57:42.925569 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:42.930671 np0000001475 nova-compute[98471]: INFO os_vif [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:05:47,bridge_name='br-int',has_traffic_filtering=True,id=897240c0-5223-4d8f-b4dd-e3c9e51e849a,network=Network(d7d2098f-0324-469b-a994-bde15b0c7538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap897240c0-52')
May 27 02:57:42.966033 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:42.975930 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:43.072282 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4fa9534d56bc4598916f1bb64d785832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73947699c9fc4e078220ba0dbcaa9cf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 02:57:43.274874 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 02:57:43.345599 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-16ba0264-0558-449b-9615-7ffce6dab0da req-ea2ac011-9722-4e76-8644-6608c58a6a41 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:43.487006 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-16ba0264-0558-449b-9615-7ffce6dab0da req-ea2ac011-9722-4e76-8644-6608c58a6a41 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Updated VIF entry in instance network info cache for port 897240c0-5223-4d8f-b4dd-e3c9e51e849a. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 02:57:43.487605 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-16ba0264-0558-449b-9615-7ffce6dab0da req-ea2ac011-9722-4e76-8644-6608c58a6a41 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Updating instance_info_cache with network_info: [{"id": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "address": "fa:16:3e:0e:05:47", "network": {"id": "d7d2098f-0324-469b-a994-bde15b0c7538", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1155020550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce2779cce722472da45319e6a0faa7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap897240c0-52", "ovs_interfaceid": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:43.517259 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Successfully created port: 85e3c8c8-e081-465f-aeb5-dd4eeccd64eb {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:57:43.637674 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850663.637244, a6c0c0f0-846a-4ffb-8f02-d43af196da22 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:43.637674 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] VM Started (Lifecycle Event)
May 27 02:57:43.640680 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 02:57:43.984976 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:43.996283 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-16ba0264-0558-449b-9615-7ffce6dab0da req-ea2ac011-9722-4e76-8644-6608c58a6a41 service nova] Releasing lock "refresh_cache-09039461-93a4-458a-886e-9783f6edaf45" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:44.068572 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:44.068685 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:44.141451 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:44.142876 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850664.1425982, a6c0c0f0-846a-4ffb-8f02-d43af196da22 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:44.143026 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] VM Paused (Lifecycle Event)
May 27 02:57:44.144887 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:44.148882 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:44.228461 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:44.229085 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:44.268663 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Successfully created port: 65194802-b80c-4a1f-855a-69a13e0abadb {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:57:44.303092 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk --force-share --output=json" returned: 0 in 0.074s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:44.305206 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:44.379564 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858/disk --force-share --output=json" returned: 0 in 0.074s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:44.379993 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:44.455407 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:57:44.455554 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:57:44.455675 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] No VIF found with MAC fa:16:3e:0e:05:47, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:57:44.456353 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Using config drive
May 27 02:57:44.463525 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:44.465716 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:44.549617 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:44.550260 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:44.628609 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:44.631482 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:44.648632 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Successfully created port: 74a2c471-0365-423f-b184-a314411fe9d3 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:57:44.654562 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:44.656389 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:57:44.663081 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Found WWN 330000000dfd8a205 for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 02:57:44.663941 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:57:44.663941 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000dfd8a205', 'path': '/dev/dm-0', 'multipath_id': '330000000dfd8a205'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:57:44.664053 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000dfd8a205', 'path': '/dev/dm-0', 'multipath_id': '330000000dfd8a205'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 02:57:44.708304 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:44.711761 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:44.773488 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk --force-share --output=json" returned: 0 in 0.064s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:44.776334 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 02:57:44.777615 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:44.787842 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 02:57:44.805400 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.028s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:44.806268 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=14609MB free_disk=74.74456024169922GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 02:57:44.806268 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:44.806547 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:44.967414 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:45.101510 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Successfully created port: eed880fe-1d2b-42cd-98fc-a00da6b63892 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:57:45.110236 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Creating config drive at /opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45/disk.config
May 27 02:57:45.113861 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxugskrwn {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:45.153035 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxugskrwn" returned: 0 in 0.039s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:45.159168 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 02:57:45.176608 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T02:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1629751309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serveractionsv293testjson-server-1629751309',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD01cBGq/IkOVvMiNNSEzke/Ew4L0jaQY97yIGPfSv1JXwnxRa+HmYDFmBWFxgN0p371J80Ye8vuUhMxKGiaH6IKyRaiveYFSXCzEZJC6BeRyymyWvE7WXoWHiN9My+zCA==',key_name='tempest-keypair-795165112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36131e6324ff45ddb65932f4ade9a1a8',ramdisk_id='',reservation_id='r-hxvg0h83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-450650320',owner_user_name='tempest-ServerActionsV293TestJSON-450650320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d4ecd608df47c6b6057f74772ef553',uuid=7c0291f5-62af-417b-9418-41d808856a8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "address": "fa:16:3e:26:2c:eb", "network": {"id": "c7f25d43-cc3f-4be2-b8f5-311363bbd4ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1793934555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36131e6324ff45ddb65932f4ade9a1a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f6cb37-5c", "ovs_interfaceid": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:57:45.176812 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Converting VIF {"id": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "address": "fa:16:3e:26:2c:eb", "network": {"id": "c7f25d43-cc3f-4be2-b8f5-311363bbd4ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1793934555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36131e6324ff45ddb65932f4ade9a1a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f6cb37-5c", "ovs_interfaceid": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:57:45.177614 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:2c:eb,bridge_name='br-int',has_traffic_filtering=True,id=51f6cb37-5c11-47c2-bf1c-d072ecfff71a,network=Network(c7f25d43-cc3f-4be2-b8f5-311363bbd4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f6cb37-5c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:57:45.178374 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c0291f5-62af-417b-9418-41d808856a8d {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:57:45.295624 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Booting with volume 65b881ec-6fab-4885-9b21-011dc2650d9e at /dev/vda
May 27 02:57:45.338806 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:57:45.349625 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 02:57:45.374915 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:45.395461 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 02:57:45.395754 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 02:57:45.404076 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 02:57:45.405139 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe13:801f', 'fe80::2083:28ff:fee3:52ac', 'fe80::fc16:3eff:fee1:4af7', 'fe80::2088:d9ff:fe30:a71f', 'fe80::fc16:3eff:fea8:2e10', 'fe80::989d:c8ff:fee6:da02', 'fe80::fc16:3eff:fec9:82f2', 'fe80::8c31:51ff:fe45:f0e7', 'fe80::fc16:3eff:fef0:b17a'] 
May 27 02:57:45.405272 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 02:57:45.405518 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 02:57:45.405578 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] <== get_connector_properties: return (66ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:57:45.405814 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Updating existing volume attachment record: 64727d2e-b0b2-4810-a3aa-c1f12b2a3d99 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 02:57:45.528251 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Successfully created port: f95be436-eeae-44d9-94cd-0f361c1beb5b {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:57:45.610920 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:45.632929 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:45.686773 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] End _get_guest_xml xml=<domain type="qemu">
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:   <uuid>7c0291f5-62af-417b-9418-41d808856a8d</uuid>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:   <name>instance-00000006</name>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:   <metadata>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1629751309</nova:name>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 02:57:41</nova:creationTime>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       </nova:image>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:         <nova:user uuid="34d4ecd608df47c6b6057f74772ef553">tempest-ServerActionsV293TestJSON-450650320-project-member</nova:user>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:         <nova:project uuid="36131e6324ff45ddb65932f4ade9a1a8">tempest-ServerActionsV293TestJSON-450650320</nova:project>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:         <nova:port uuid="51f6cb37-5c11-47c2-bf1c-d072ecfff71a">
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:   </metadata>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     <system>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <entry name="serial">7c0291f5-62af-417b-9418-41d808856a8d</entry>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <entry name="uuid">7c0291f5-62af-417b-9418-41d808856a8d</entry>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     </system>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:   <os>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:   </os>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:   <features>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     <acpi/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     <tcg>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     </tcg>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:   </features>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:   <devices>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/7c0291f5-62af-417b-9418-41d808856a8d/disk.config"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     </disk>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <alias name="ua-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-0"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <serial>dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41</serial>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     </disk>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:26:2c:eb"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <target dev="tap51f6cb37-5c"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     </interface>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/7c0291f5-62af-417b-9418-41d808856a8d/console.log" append="off"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     </serial>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     <video>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     </video>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     </rng>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:     </memballoon>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:   </devices>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]: </domain>
May 27 02:57:45.686773 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 02:57:45.686773 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:45.686773 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Preparing to wait for external event network-vif-plugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:57:45.689319 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "7c0291f5-62af-417b-9418-41d808856a8d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:45.689319 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:45.689319 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:45.689319 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T02:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1629751309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serveractionsv293testjson-server-1629751309',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD01cBGq/IkOVvMiNNSEzke/Ew4L0jaQY97yIGPfSv1JXwnxRa+HmYDFmBWFxgN0p371J80Ye8vuUhMxKGiaH6IKyRaiveYFSXCzEZJC6BeRyymyWvE7WXoWHiN9My+zCA==',key_name='tempest-keypair-795165112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36131e6324ff45ddb65932f4ade9a1a8',ramdisk_id='',reservation_id='r-hxvg0h83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-450650320',owner_user_name='tempest-ServerActionsV293TestJSON-450650320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d4ecd608df47c6b6057f74772ef553',uuid=7c0291f5-62af-417b-9418-41d808856a8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "address": "fa:16:3e:26:2c:eb", "network": {"id": "c7f25d43-cc3f-4be2-b8f5-311363bbd4ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1793934555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36131e6324ff45ddb65932f4ade9a1a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f6cb37-5c", "ovs_interfaceid": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:57:45.689608 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Converting VIF {"id": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "address": "fa:16:3e:26:2c:eb", "network": {"id": "c7f25d43-cc3f-4be2-b8f5-311363bbd4ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1793934555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36131e6324ff45ddb65932f4ade9a1a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f6cb37-5c", "ovs_interfaceid": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:57:45.689608 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:2c:eb,bridge_name='br-int',has_traffic_filtering=True,id=51f6cb37-5c11-47c2-bf1c-d072ecfff71a,network=Network(c7f25d43-cc3f-4be2-b8f5-311363bbd4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f6cb37-5c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:57:45.689608 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:2c:eb,bridge_name='br-int',has_traffic_filtering=True,id=51f6cb37-5c11-47c2-bf1c-d072ecfff71a,network=Network(c7f25d43-cc3f-4be2-b8f5-311363bbd4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f6cb37-5c') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:57:45.690804 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:45.690804 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:45.690804 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:57:45.694836 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:45.694836 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f01475d1-1f38-5fb0-8416-61f7631cdba3', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:45.696110 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:45.696110 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:57:45.696759 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:45.701599 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:45.701599 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51f6cb37-5c, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:45.701599 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51f6cb37-5c, col_values=(('qos', UUID('2bc35210-6bdb-466a-b73f-9bccb803eada')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:45.701599 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51f6cb37-5c, col_values=(('external_ids', {'iface-id': '51f6cb37-5c11-47c2-bf1c-d072ecfff71a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:2c:eb', 'vm-uuid': '7c0291f5-62af-417b-9418-41d808856a8d'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:57:45.702152 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:45.703840 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:57:45.709599 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:45.710567 np0000001475 nova-compute[98471]: INFO os_vif [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:2c:eb,bridge_name='br-int',has_traffic_filtering=True,id=51f6cb37-5c11-47c2-bf1c-d072ecfff71a,network=Network(c7f25d43-cc3f-4be2-b8f5-311363bbd4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f6cb37-5c')
May 27 02:57:45.756722 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:45.854852 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:45.855053 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "27b7be13-fa61-4916-a350-a2370d4430bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:45.891375 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance b69fd9f2-86d9-4dab-9bae-60e4e27e9f38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:57:45.891517 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 82be1ace-dc06-42dd-8660-02439941fa00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:57:45.891613 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:57:45.892053 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 63151241-1b03-4b3c-9ecd-27703137e752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:57:45.892053 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance a6c0c0f0-846a-4ffb-8f02-d43af196da22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:57:45.892053 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 7c0291f5-62af-417b-9418-41d808856a8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:57:45.892053 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 09039461-93a4-458a-886e-9783f6edaf45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:57:45.892231 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 8b048373-2f8d-454a-9ad5-888403e8ee5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:57:45.988250 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:45.996450 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:45.998970 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:46.020607 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:46.027045 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:46.113529 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Successfully updated port: 85e3c8c8-e081-465f-aeb5-dd4eeccd64eb {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:57:46.174929 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4f9c1635-7d43-4e77-901f-4cf13dfad80d req-70ecd4a5-b9b5-4a17-9e06-8d9247f0071b service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-changed-85e3c8c8-e081-465f-aeb5-dd4eeccd64eb {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:46.175063 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4f9c1635-7d43-4e77-901f-4cf13dfad80d req-70ecd4a5-b9b5-4a17-9e06-8d9247f0071b service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Refreshing instance network info cache due to event network-changed-85e3c8c8-e081-465f-aeb5-dd4eeccd64eb. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:57:46.175277 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4f9c1635-7d43-4e77-901f-4cf13dfad80d req-70ecd4a5-b9b5-4a17-9e06-8d9247f0071b service nova] Acquiring lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:46.175394 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4f9c1635-7d43-4e77-901f-4cf13dfad80d req-70ecd4a5-b9b5-4a17-9e06-8d9247f0071b service nova] Acquired lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:46.176435 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4f9c1635-7d43-4e77-901f-4cf13dfad80d req-70ecd4a5-b9b5-4a17-9e06-8d9247f0071b service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Refreshing network info cache for port 85e3c8c8-e081-465f-aeb5-dd4eeccd64eb {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:57:46.357332 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 02:57:46.395941 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 27b7be13-fa61-4916-a350-a2370d4430bb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 27 02:57:46.396216 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 02:57:46.396412 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:57:44 up 29 min,  2 users,  load average: 4.98, 2.34, 1.15\n', 'num_instances': '8', 'num_vm_building': '8', 'num_task_spawning': '7', 'num_os_type_None': '8', 'num_proj_bfd98ab6915e41e38c307ad09c795d82': '1', 'io_workload': '8', 'num_proj_3143b7b9c4034100aa249427ea1f1115': '1', 'num_proj_ece615dc6a9547cc849be4c1d0f45636': '1', 'num_proj_2254e04d10914b0d9b3768ba32b8559d': '2', 'num_proj_36131e6324ff45ddb65932f4ade9a1a8': '1', 'num_proj_ce2779cce722472da45319e6a0faa7e1': '1', 'num_task_networking': '1', 'num_proj_73947699c9fc4e078220ba0dbcaa9cf9': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 02:57:46.412525 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850666.4121063, 09039461-93a4-458a-886e-9783f6edaf45 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:46.412864 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 09039461-93a4-458a-886e-9783f6edaf45] VM Started (Lifecycle Event)
May 27 02:57:46.678493 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-4f9c1635-7d43-4e77-901f-4cf13dfad80d req-70ecd4a5-b9b5-4a17-9e06-8d9247f0071b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:46.761843 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4f9c1635-7d43-4e77-901f-4cf13dfad80d req-70ecd4a5-b9b5-4a17-9e06-8d9247f0071b service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:57:46.917540 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:46.922136 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850666.9218342, 09039461-93a4-458a-886e-9783f6edaf45 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:46.922270 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 09039461-93a4-458a-886e-9783f6edaf45] VM Paused (Lifecycle Event)
May 27 02:57:46.938021 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4f9c1635-7d43-4e77-901f-4cf13dfad80d req-70ecd4a5-b9b5-4a17-9e06-8d9247f0071b service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:46.939249 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:57:46.939541 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:57:46.943283 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:47.024971 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Booting with volume 953364d7-cec1-4e74-99f1-263c29a519bd at /dev/vdb
May 27 02:57:47.069421 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Successfully updated port: e6fafd7a-ad8c-4d3f-83c1-93e0bc017695 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:57:47.071776 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:57:47.082231 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 02:57:47.104205 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:47.125330 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f33d7f18-2ebf-4fc7-91c8-4e27e785d312 req-33225f52-37ac-461f-a653-1e2861d41a93 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-changed-e6fafd7a-ad8c-4d3f-83c1-93e0bc017695 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:47.125762 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f33d7f18-2ebf-4fc7-91c8-4e27e785d312 req-33225f52-37ac-461f-a653-1e2861d41a93 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Refreshing instance network info cache due to event network-changed-e6fafd7a-ad8c-4d3f-83c1-93e0bc017695. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:57:47.126032 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f33d7f18-2ebf-4fc7-91c8-4e27e785d312 req-33225f52-37ac-461f-a653-1e2861d41a93 service nova] Acquiring lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:47.127889 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 02:57:47.128425 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 02:57:47.135705 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 02:57:47.136914 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe13:801f', 'fe80::2083:28ff:fee3:52ac', 'fe80::fc16:3eff:fee1:4af7', 'fe80::2088:d9ff:fe30:a71f', 'fe80::fc16:3eff:fea8:2e10', 'fe80::989d:c8ff:fee6:da02', 'fe80::fc16:3eff:fec9:82f2', 'fe80::8c31:51ff:fe45:f0e7', 'fe80::fc16:3eff:fef0:b17a', 'fe80::fc16:3eff:fe0e:547', 'fe80::807d:e5ff:fe89:3c7a'] 
May 27 02:57:47.137061 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 02:57:47.137205 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 02:57:47.137461 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] <== get_connector_properties: return (65ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:57:47.137655 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Updating existing volume attachment record: b69ab72a-0caa-4025-86de-8184c1c176a4 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 02:57:47.230183 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:57:47.230415 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:57:47.230415 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] No VIF found with MAC fa:16:3e:26:2c:eb, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:57:47.230857 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Using config drive
May 27 02:57:47.425013 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:47.426295 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:57:47.444338 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4f9c1635-7d43-4e77-901f-4cf13dfad80d req-70ecd4a5-b9b5-4a17-9e06-8d9247f0071b service nova] Releasing lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:47.445731 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:57:47.451067 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f33d7f18-2ebf-4fc7-91c8-4e27e785d312 req-33225f52-37ac-461f-a653-1e2861d41a93 service nova] Acquired lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:47.451550 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f33d7f18-2ebf-4fc7-91c8-4e27e785d312 req-33225f52-37ac-461f-a653-1e2861d41a93 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Refreshing network info cache for port e6fafd7a-ad8c-4d3f-83c1-93e0bc017695 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:57:47.736340 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:47.844280 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Creating config drive at /opt/stack/data/nova/instances/7c0291f5-62af-417b-9418-41d808856a8d/disk.config
May 27 02:57:47.849281 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7c0291f5-62af-417b-9418-41d808856a8d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3t_dlk9r {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:47.877735 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7c0291f5-62af-417b-9418-41d808856a8d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3t_dlk9r" returned: 0 in 0.028s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:57:47.928575 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 09039461-93a4-458a-886e-9783f6edaf45] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 02:57:47.954029 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f33d7f18-2ebf-4fc7-91c8-4e27e785d312 req-33225f52-37ac-461f-a653-1e2861d41a93 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:47.957433 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 02:57:47.957709 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.151s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:47.959373 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.016s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:47.960611 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 58.24 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 02:57:47.962717 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 02:57:47.962876 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Claim successful on node np0000001475
May 27 02:57:48.051421 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Successfully updated port: 91efaab4-fe42-47f8-af98-c6ad87c5dc25 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:57:48.056980 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f33d7f18-2ebf-4fc7-91c8-4e27e785d312 req-33225f52-37ac-461f-a653-1e2861d41a93 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:57:48.208286 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f33d7f18-2ebf-4fc7-91c8-4e27e785d312 req-33225f52-37ac-461f-a653-1e2861d41a93 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:48.249777 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6fdc1f06-88a7-4f64-9b3a-9b2a46a03e8e req-af949fe8-e443-4661-b74e-9ef2cf8c59b0 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-changed-91efaab4-fe42-47f8-af98-c6ad87c5dc25 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:48.249777 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6fdc1f06-88a7-4f64-9b3a-9b2a46a03e8e req-af949fe8-e443-4661-b74e-9ef2cf8c59b0 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Refreshing instance network info cache due to event network-changed-91efaab4-fe42-47f8-af98-c6ad87c5dc25. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:57:48.249777 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6fdc1f06-88a7-4f64-9b3a-9b2a46a03e8e req-af949fe8-e443-4661-b74e-9ef2cf8c59b0 service nova] Acquiring lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:48.277820 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:48.299898 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:48.303153 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:48.395072 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:48.613487 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:48.615410 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:48.617503 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:48.619403 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:48.637865 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:48.710291 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f33d7f18-2ebf-4fc7-91c8-4e27e785d312 req-33225f52-37ac-461f-a653-1e2861d41a93 service nova] Releasing lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:48.710991 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6fdc1f06-88a7-4f64-9b3a-9b2a46a03e8e req-af949fe8-e443-4661-b74e-9ef2cf8c59b0 service nova] Acquired lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:48.711161 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-6fdc1f06-88a7-4f64-9b3a-9b2a46a03e8e req-af949fe8-e443-4661-b74e-9ef2cf8c59b0 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Refreshing network info cache for port 91efaab4-fe42-47f8-af98-c6ad87c5dc25 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:57:48.750262 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Booting with volume caaa9313-7a2a-4d2c-9c2f-0693b05d3daf at /dev/vdc
May 27 02:57:48.790804 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:57:48.803579 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 02:57:48.823633 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:48.847340 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 02:57:48.847719 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 02:57:48.858338 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 02:57:48.859996 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe13:801f', 'fe80::2083:28ff:fee3:52ac', 'fe80::fc16:3eff:fee1:4af7', 'fe80::2088:d9ff:fe30:a71f', 'fe80::fc16:3eff:fea8:2e10', 'fe80::989d:c8ff:fee6:da02', 'fe80::fc16:3eff:fec9:82f2', 'fe80::8c31:51ff:fe45:f0e7', 'fe80::fc16:3eff:fef0:b17a', 'fe80::fc16:3eff:fe0e:547', 'fe80::807d:e5ff:fe89:3c7a', 'fe80::fc16:3eff:fe26:2ceb', 'fe80::dc63:41ff:fe48:d91a'] 
May 27 02:57:48.860232 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 02:57:48.860490 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 02:57:48.861860 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] <== get_connector_properties: return (69ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:57:48.862215 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Updating existing volume attachment record: 0ec70891-fe75-41e6-9f11-e89b4062ed41 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 02:57:49.026069 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Successfully updated port: 65194802-b80c-4a1f-855a-69a13e0abadb {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:57:49.072286 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850669.0718758, 7c0291f5-62af-417b-9418-41d808856a8d => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:49.072697 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] VM Started (Lifecycle Event)
May 27 02:57:49.181781 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4b555d3c-7d06-4024-9620-b627be0877af req-c99c8ede-a310-44b6-a407-ad76dd73af98 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-changed-65194802-b80c-4a1f-855a-69a13e0abadb {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:49.182131 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4b555d3c-7d06-4024-9620-b627be0877af req-c99c8ede-a310-44b6-a407-ad76dd73af98 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Refreshing instance network info cache due to event network-changed-65194802-b80c-4a1f-855a-69a13e0abadb. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:57:49.182396 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b555d3c-7d06-4024-9620-b627be0877af req-c99c8ede-a310-44b6-a407-ad76dd73af98 service nova] Acquiring lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:49.213423 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-6fdc1f06-88a7-4f64-9b3a-9b2a46a03e8e req-af949fe8-e443-4661-b74e-9ef2cf8c59b0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:49.299935 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-6fdc1f06-88a7-4f64-9b3a-9b2a46a03e8e req-af949fe8-e443-4661-b74e-9ef2cf8c59b0 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:57:49.433066 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:57:49.433378 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:57:49.500606 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-6fdc1f06-88a7-4f64-9b3a-9b2a46a03e8e req-af949fe8-e443-4661-b74e-9ef2cf8c59b0 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:49.575362 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:49.578546 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850669.5782642, 7c0291f5-62af-417b-9418-41d808856a8d => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:49.578727 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] VM Paused (Lifecycle Event)
May 27 02:57:49.756074 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5a319713-8d0b-4d15-b740-88bdf033ded6 req-20faab44-de28-4160-bfff-2ff3c68eb83d service nova] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Received event network-vif-unplugged-daedba8a-0db5-40e8-a99a-bdfe0324387c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:49.756395 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5a319713-8d0b-4d15-b740-88bdf033ded6 req-20faab44-de28-4160-bfff-2ff3c68eb83d service nova] Acquiring lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:49.756509 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5a319713-8d0b-4d15-b740-88bdf033ded6 req-20faab44-de28-4160-bfff-2ff3c68eb83d service nova] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:49.756650 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5a319713-8d0b-4d15-b740-88bdf033ded6 req-20faab44-de28-4160-bfff-2ff3c68eb83d service nova] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:49.756837 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5a319713-8d0b-4d15-b740-88bdf033ded6 req-20faab44-de28-4160-bfff-2ff3c68eb83d service nova] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] No event matching network-vif-unplugged-daedba8a-0db5-40e8-a99a-bdfe0324387c in dict_keys([('network-vif-plugged', 'daedba8a-0db5-40e8-a99a-bdfe0324387c')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 02:57:49.757243 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-5a319713-8d0b-4d15-b740-88bdf033ded6 req-20faab44-de28-4160-bfff-2ff3c68eb83d service nova] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Received unexpected event network-vif-unplugged-daedba8a-0db5-40e8-a99a-bdfe0324387c for instance with vm_state building and task_state spawning.
May 27 02:57:49.937011 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:57:50.001921 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Successfully updated port: 74a2c471-0365-423f-b184-a314411fe9d3 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:57:50.003175 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6fdc1f06-88a7-4f64-9b3a-9b2a46a03e8e req-af949fe8-e443-4661-b74e-9ef2cf8c59b0 service nova] Releasing lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:50.003956 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b555d3c-7d06-4024-9620-b627be0877af req-c99c8ede-a310-44b6-a407-ad76dd73af98 service nova] Acquired lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:50.003956 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4b555d3c-7d06-4024-9620-b627be0877af req-c99c8ede-a310-44b6-a407-ad76dd73af98 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Refreshing network info cache for port 65194802-b80c-4a1f-855a-69a13e0abadb {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:57:50.085073 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:50.086522 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:57:50.444455 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.485s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:50.444670 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 02:57:50.505813 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-4b555d3c-7d06-4024-9620-b627be0877af req-c99c8ede-a310-44b6-a407-ad76dd73af98 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:50.588926 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 02:57:50.619183 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4b555d3c-7d06-4024-9620-b627be0877af req-c99c8ede-a310-44b6-a407-ad76dd73af98 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:57:50.688046 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:50.702306 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:50.761933 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4b555d3c-7d06-4024-9620-b627be0877af req-c99c8ede-a310-44b6-a407-ad76dd73af98 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:50.951504 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 02:57:50.951504 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 02:57:50.951688 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:50.952007 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:51.087851 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 02:57:51.088902 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 02:57:51.089128 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Creating image(s)
May 27 02:57:51.089632 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 02:57:51.089632 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Ensure instance console log exists: /opt/stack/data/nova/instances/8b048373-2f8d-454a-9ad5-888403e8ee5f/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 02:57:51.089719 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:51.089873 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:51.089982 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:51.146155 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53592b383294428a94c52288ed87629d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa29a06cd694e828f6bc5146d9f7339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 02:57:51.249077 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-37a669ed-4b93-4e5f-aa1f-dcb09920f1be req-dbe6ea71-fb84-490e-a795-2c3b3c53a068 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-changed-74a2c471-0365-423f-b184-a314411fe9d3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:51.249236 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-37a669ed-4b93-4e5f-aa1f-dcb09920f1be req-dbe6ea71-fb84-490e-a795-2c3b3c53a068 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Refreshing instance network info cache due to event network-changed-74a2c471-0365-423f-b184-a314411fe9d3. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:57:51.249878 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-37a669ed-4b93-4e5f-aa1f-dcb09920f1be req-dbe6ea71-fb84-490e-a795-2c3b3c53a068 service nova] Acquiring lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:51.258272 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Successfully updated port: eed880fe-1d2b-42cd-98fc-a00da6b63892 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:57:51.264238 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b555d3c-7d06-4024-9620-b627be0877af req-c99c8ede-a310-44b6-a407-ad76dd73af98 service nova] Releasing lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:51.264766 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-37a669ed-4b93-4e5f-aa1f-dcb09920f1be req-dbe6ea71-fb84-490e-a795-2c3b3c53a068 service nova] Acquired lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:51.265080 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-37a669ed-4b93-4e5f-aa1f-dcb09920f1be req-dbe6ea71-fb84-490e-a795-2c3b3c53a068 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Refreshing network info cache for port 74a2c471-0365-423f-b184-a314411fe9d3 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:57:51.442788 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:51.455820 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 02:57:51.583361 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Successfully created port: f7c38424-435e-481a-b1a2-6b3e7f8c7d42 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:57:51.767208 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-37a669ed-4b93-4e5f-aa1f-dcb09920f1be req-dbe6ea71-fb84-490e-a795-2c3b3c53a068 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:51.851331 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Received event network-vif-unplugged-dd748286-2659-4519-a5d7-5a24424d66f5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:51.854454 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "82be1ace-dc06-42dd-8660-02439941fa00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:51.854454 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "82be1ace-dc06-42dd-8660-02439941fa00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:51.854454 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "82be1ace-dc06-42dd-8660-02439941fa00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:51.854454 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] No event matching network-vif-unplugged-dd748286-2659-4519-a5d7-5a24424d66f5 in dict_keys([('network-vif-plugged', 'dd748286-2659-4519-a5d7-5a24424d66f5')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 02:57:51.854454 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Received unexpected event network-vif-unplugged-dd748286-2659-4519-a5d7-5a24424d66f5 for instance with vm_state building and task_state spawning.
May 27 02:57:51.854454 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Received event network-vif-unplugged-fb928353-bed5-4524-83af-a0f2f19dafad {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:51.854454 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:51.854454 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:51.854454 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:51.854454 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] No event matching network-vif-unplugged-fb928353-bed5-4524-83af-a0f2f19dafad in dict_keys([('network-vif-plugged', 'fb928353-bed5-4524-83af-a0f2f19dafad')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 02:57:51.854454 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Received unexpected event network-vif-unplugged-fb928353-bed5-4524-83af-a0f2f19dafad for instance with vm_state building and task_state spawning.
May 27 02:57:51.854454 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Received event network-vif-plugged-daedba8a-0db5-40e8-a99a-bdfe0324387c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:51.854454 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:51.854454 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:51.855078 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:51.855078 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Processing event network-vif-plugged-daedba8a-0db5-40e8-a99a-bdfe0324387c {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:57:51.855078 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Received event network-vif-plugged-daedba8a-0db5-40e8-a99a-bdfe0324387c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:51.855879 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:51.856061 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:51.856193 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:51.857440 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] No waiting events found dispatching network-vif-plugged-daedba8a-0db5-40e8-a99a-bdfe0324387c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:57:51.857440 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Received unexpected event network-vif-plugged-daedba8a-0db5-40e8-a99a-bdfe0324387c for instance with vm_state building and task_state spawning.
May 27 02:57:51.857440 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-e6fafd7a-ad8c-4d3f-83c1-93e0bc017695 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:51.857440 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:51.857627 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:51.857627 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:51.857798 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No waiting events found dispatching network-vif-unplugged-e6fafd7a-ad8c-4d3f-83c1-93e0bc017695 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:57:51.858722 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Instance event wait completed in 19 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 02:57:51.858894 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received unexpected event network-vif-unplugged-e6fafd7a-ad8c-4d3f-83c1-93e0bc017695 for instance with vm_state building and task_state spawning.
May 27 02:57:51.859126 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Received event network-vif-unplugged-abb5cffe-8cbc-49eb-8f62-0014bcc3d411 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:51.859255 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "63151241-1b03-4b3c-9ecd-27703137e752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:51.859356 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "63151241-1b03-4b3c-9ecd-27703137e752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:51.859458 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "63151241-1b03-4b3c-9ecd-27703137e752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:51.859574 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] No event matching network-vif-unplugged-abb5cffe-8cbc-49eb-8f62-0014bcc3d411 in dict_keys([('network-vif-plugged', 'abb5cffe-8cbc-49eb-8f62-0014bcc3d411')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 02:57:51.859645 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Received unexpected event network-vif-unplugged-abb5cffe-8cbc-49eb-8f62-0014bcc3d411 for instance with vm_state building and task_state spawning.
May 27 02:57:51.859730 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Received event network-vif-plugged-dd748286-2659-4519-a5d7-5a24424d66f5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:51.859920 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "82be1ace-dc06-42dd-8660-02439941fa00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:51.860644 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "82be1ace-dc06-42dd-8660-02439941fa00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:51.860644 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "82be1ace-dc06-42dd-8660-02439941fa00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:51.860644 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Processing event network-vif-plugged-dd748286-2659-4519-a5d7-5a24424d66f5 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:57:51.860644 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Received event network-vif-plugged-dd748286-2659-4519-a5d7-5a24424d66f5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:51.860644 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "82be1ace-dc06-42dd-8660-02439941fa00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:51.860857 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "82be1ace-dc06-42dd-8660-02439941fa00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:51.861144 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "82be1ace-dc06-42dd-8660-02439941fa00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:51.862803 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] No waiting events found dispatching network-vif-plugged-dd748286-2659-4519-a5d7-5a24424d66f5 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:57:51.864108 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Instance event wait completed in 16 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 02:57:51.864569 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Received unexpected event network-vif-plugged-dd748286-2659-4519-a5d7-5a24424d66f5 for instance with vm_state building and task_state spawning.
May 27 02:57:51.864895 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 02:57:51.865366 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850671.8642726, b69fd9f2-86d9-4dab-9bae-60e4e27e9f38 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:51.865833 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Received event network-vif-unplugged-85ecf3fb-ef43-44a6-836b-a5e5da02646a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:51.866545 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] VM Resumed (Lifecycle Event)
May 27 02:57:51.867450 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:51.868141 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:51.868141 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:51.868141 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] No event matching network-vif-unplugged-85ecf3fb-ef43-44a6-836b-a5e5da02646a in dict_keys([('network-vif-plugged', '85ecf3fb-ef43-44a6-836b-a5e5da02646a')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 02:57:51.868259 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Received unexpected event network-vif-unplugged-85ecf3fb-ef43-44a6-836b-a5e5da02646a for instance with vm_state building and task_state spawning.
May 27 02:57:51.868305 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Received event network-vif-plugged-fb928353-bed5-4524-83af-a0f2f19dafad {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:51.868408 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:51.868520 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:51.868646 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:51.869877 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Processing event network-vif-plugged-fb928353-bed5-4524-83af-a0f2f19dafad {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:57:51.869877 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Received event network-vif-plugged-fb928353-bed5-4524-83af-a0f2f19dafad {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:51.869877 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:51.869877 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:51.870501 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 02:57:51.870877 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:51.871593 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Instance event wait completed in 14 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 02:57:51.871855 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Instance spawned successfully.
May 27 02:57:51.873141 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] No waiting events found dispatching network-vif-plugged-fb928353-bed5-4524-83af-a0f2f19dafad {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:57:51.875379 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-37a669ed-4b93-4e5f-aa1f-dcb09920f1be req-dbe6ea71-fb84-490e-a795-2c3b3c53a068 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:57:51.877679 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Received unexpected event network-vif-plugged-fb928353-bed5-4524-83af-a0f2f19dafad for instance with vm_state building and task_state spawning.
May 27 02:57:51.877997 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received event network-vif-unplugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:51.879154 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 02:57:51.883668 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "7c0291f5-62af-417b-9418-41d808856a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:51.886220 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:51.889441 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 02:57:51.891588 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Instance spawned successfully.
May 27 02:57:51.893775 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:51.893775 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] No event matching network-vif-unplugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a in dict_keys([('network-vif-plugged', '51f6cb37-5c11-47c2-bf1c-d072ecfff71a')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 02:57:51.893775 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received unexpected event network-vif-unplugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a for instance with vm_state building and task_state spawning.
May 27 02:57:51.893775 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Received event network-vif-unplugged-897240c0-5223-4d8f-b4dd-e3c9e51e849a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:51.893775 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "09039461-93a4-458a-886e-9783f6edaf45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:51.893775 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "09039461-93a4-458a-886e-9783f6edaf45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:51.893775 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "09039461-93a4-458a-886e-9783f6edaf45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:51.893775 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] No event matching network-vif-unplugged-897240c0-5223-4d8f-b4dd-e3c9e51e849a in dict_keys([('network-vif-plugged', '897240c0-5223-4d8f-b4dd-e3c9e51e849a')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 02:57:51.894218 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Received unexpected event network-vif-unplugged-897240c0-5223-4d8f-b4dd-e3c9e51e849a for instance with vm_state building and task_state spawning.
May 27 02:57:51.895001 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 02:57:51.897610 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Received event network-vif-plugged-abb5cffe-8cbc-49eb-8f62-0014bcc3d411 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:51.897610 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "63151241-1b03-4b3c-9ecd-27703137e752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:51.897610 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "63151241-1b03-4b3c-9ecd-27703137e752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:51.897610 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "63151241-1b03-4b3c-9ecd-27703137e752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:51.897610 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Processing event network-vif-plugged-abb5cffe-8cbc-49eb-8f62-0014bcc3d411 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:57:51.897610 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Received event network-vif-plugged-abb5cffe-8cbc-49eb-8f62-0014bcc3d411 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:51.897610 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "63151241-1b03-4b3c-9ecd-27703137e752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:51.897610 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "63151241-1b03-4b3c-9ecd-27703137e752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:51.897610 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "63151241-1b03-4b3c-9ecd-27703137e752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:51.897610 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] No waiting events found dispatching network-vif-plugged-abb5cffe-8cbc-49eb-8f62-0014bcc3d411 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:57:51.897610 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Received unexpected event network-vif-plugged-abb5cffe-8cbc-49eb-8f62-0014bcc3d411 for instance with vm_state building and task_state spawning.
May 27 02:57:51.897610 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Received event network-vif-plugged-85ecf3fb-ef43-44a6-836b-a5e5da02646a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:51.897610 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:51.897610 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:51.899772 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:51.899772 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Processing event network-vif-plugged-85ecf3fb-ef43-44a6-836b-a5e5da02646a {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:57:51.899772 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Received event network-vif-plugged-85ecf3fb-ef43-44a6-836b-a5e5da02646a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:51.899772 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:51.899772 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:51.899772 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:51.899772 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] No waiting events found dispatching network-vif-plugged-85ecf3fb-ef43-44a6-836b-a5e5da02646a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:57:51.899772 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Received unexpected event network-vif-plugged-85ecf3fb-ef43-44a6-836b-a5e5da02646a for instance with vm_state building and task_state spawning.
May 27 02:57:51.900131 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-changed-eed880fe-1d2b-42cd-98fc-a00da6b63892 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:51.901178 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Instance event wait completed in 8 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 02:57:51.901633 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Refreshing instance network info cache due to event network-changed-eed880fe-1d2b-42cd-98fc-a00da6b63892. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:57:51.901633 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:51.902361 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Instance event wait completed in 11 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 02:57:51.903020 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Instance spawned successfully.
May 27 02:57:51.904824 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:51.905174 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:51.905454 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:51.905844 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:51.908711 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 02:57:51.911702 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 02:57:51.915752 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 02:57:51.916068 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Instance spawned successfully.
May 27 02:57:51.916805 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 02:57:51.921175 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Instance spawned successfully.
May 27 02:57:51.923220 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 02:57:51.967833 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Successfully created port: 8eaa84fe-02ca-447a-8993-74f9a4fc8e8f {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:57:52.180272 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-37a669ed-4b93-4e5f-aa1f-dcb09920f1be req-dbe6ea71-fb84-490e-a795-2c3b3c53a068 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:52.372942 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:52.374858 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:57:52.395235 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Successfully updated port: f95be436-eeae-44d9-94cd-0f361c1beb5b {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:57:52.401572 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.401722 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.402533 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.402533 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.402797 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.403003 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.416244 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Took 23.45 seconds to spawn the instance on the hypervisor.
May 27 02:57:52.416472 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:52.418623 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.418731 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.419027 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.419244 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.419482 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.419722 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.441178 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.441178 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.441178 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.443351 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.448820 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.448820 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.453529 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Successfully created port: 538a6aad-d866-4a39-85f1-ec6544f540ff {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:57:52.455728 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.455728 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.457045 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.457045 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.457045 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.457898 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:52.684523 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-37a669ed-4b93-4e5f-aa1f-dcb09920f1be req-dbe6ea71-fb84-490e-a795-2c3b3c53a068 service nova] Releasing lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:52.687591 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquired lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:52.687591 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Refreshing network info cache for port eed880fe-1d2b-42cd-98fc-a00da6b63892 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:57:52.879863 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 02:57:52.880502 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850672.8799407, 82be1ace-dc06-42dd-8660-02439941fa00 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:52.880502 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] VM Resumed (Lifecycle Event)
May 27 02:57:52.900298 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:52.909827 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Took 30.42 seconds to spawn the instance on the hypervisor.
May 27 02:57:52.910004 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:52.930896 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Took 21.51 seconds to spawn the instance on the hypervisor.
May 27 02:57:52.931006 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:52.941845 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Took 28.85 seconds to build instance.
May 27 02:57:52.954105 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Took 19.03 seconds to spawn the instance on the hypervisor.
May 27 02:57:52.954266 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:52.964247 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Took 16.51 seconds to spawn the instance on the hypervisor.
May 27 02:57:52.964450 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:52.980768 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 02:57:53.024448 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Successfully created port: fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:57:53.190716 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:53.293626 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:57:53.382820 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:53.385937 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:57:53.424909 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Took 35.67 seconds to build instance.
May 27 02:57:53.444242 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Took 28.54 seconds to build instance.
May 27 02:57:53.449357 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-45222787-acf6-4622-adfc-48417930e884 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "82be1ace-dc06-42dd-8660-02439941fa00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.371s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:53.470034 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Took 26.47 seconds to build instance.
May 27 02:57:53.476006 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Successfully created port: ad76a2d7-6ae6-45c6-b51f-5967a5392afa {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:57:53.489131 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Booting with volume 5ffa6ef1-5054-4e50-b2d9-79430a736c19 at /dev/vda
May 27 02:57:53.491245 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Took 26.46 seconds to build instance.
May 27 02:57:53.555205 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:53.587667 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:57:53.600157 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 02:57:53.628350 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:53.648779 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 02:57:53.649884 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 02:57:53.665962 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 02:57:53.669523 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe13:801f', 'fe80::2083:28ff:fee3:52ac', 'fe80::fc16:3eff:fee1:4af7', 'fe80::2088:d9ff:fe30:a71f', 'fe80::fc16:3eff:fea8:2e10', 'fe80::989d:c8ff:fee6:da02', 'fe80::fc16:3eff:fec9:82f2', 'fe80::8c31:51ff:fe45:f0e7', 'fe80::fc16:3eff:fef0:b17a', 'fe80::fc16:3eff:fe0e:547', 'fe80::807d:e5ff:fe89:3c7a', 'fe80::fc16:3eff:fe26:2ceb', 'fe80::dc63:41ff:fe48:d91a'] 
May 27 02:57:53.669863 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 02:57:53.670091 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 02:57:53.670961 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:57:53.670961 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Updating existing volume attachment record: ed2824ea-ca4b-410f-8a1b-5aea2ad42ea8 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 02:57:53.892265 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850673.8904843, 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:53.892265 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] VM Resumed (Lifecycle Event)
May 27 02:57:53.928600 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d3c9b2-1395-47cc-a19a-479ceb3d7c1a tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.186s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:53.950534 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8aa603f4-b0ef-4b53-81c6-bb2ddb4e7d1e tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.052s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:53.974982 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "63151241-1b03-4b3c-9ecd-27703137e752" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.988s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:53.997772 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.972s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:54.060876 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Releasing lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:54.060876 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Received event network-vif-plugged-897240c0-5223-4d8f-b4dd-e3c9e51e849a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:54.060876 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "09039461-93a4-458a-886e-9783f6edaf45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:54.060876 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "09039461-93a4-458a-886e-9783f6edaf45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:54.061098 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "09039461-93a4-458a-886e-9783f6edaf45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:54.061180 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Processing event network-vif-plugged-897240c0-5223-4d8f-b4dd-e3c9e51e849a {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:57:54.064041 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquired lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:54.064471 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Received event network-vif-plugged-897240c0-5223-4d8f-b4dd-e3c9e51e849a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:54.064683 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "09039461-93a4-458a-886e-9783f6edaf45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:54.064992 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 02:57:54.065950 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "09039461-93a4-458a-886e-9783f6edaf45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:54.069132 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Instance event wait completed in 7 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 02:57:54.069418 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "09039461-93a4-458a-886e-9783f6edaf45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:54.069635 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] No waiting events found dispatching network-vif-plugged-897240c0-5223-4d8f-b4dd-e3c9e51e849a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:57:54.069985 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Received unexpected event network-vif-plugged-897240c0-5223-4d8f-b4dd-e3c9e51e849a for instance with vm_state building and task_state spawning.
May 27 02:57:54.069985 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received event network-vif-plugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:54.070083 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "7c0291f5-62af-417b-9418-41d808856a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:54.070268 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:54.070435 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:54.070537 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Processing event network-vif-plugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:57:54.070674 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received event network-vif-plugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:54.075194 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 02:57:54.075846 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 02:57:54.076676 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Acquiring lock "7c0291f5-62af-417b-9418-41d808856a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:54.076985 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:54.077113 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:54.077696 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] No waiting events found dispatching network-vif-plugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:57:54.077851 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-8b9a216a-0f77-4aff-9835-698b3d1a7089 req-c97a0d5c-3deb-420a-9572-3a5710e732e7 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received unexpected event network-vif-plugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a for instance with vm_state building and task_state spawning.
May 27 02:57:54.080090 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Instance spawned successfully.
May 27 02:57:54.080860 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 02:57:54.083308 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 02:57:54.087087 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Instance spawned successfully.
May 27 02:57:54.087573 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 02:57:54.104029 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b687487c-2073-4c15-91b6-9a9aa2286d33 req-ca452278-bb93-4da6-a359-05e6613c6704 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-changed-f95be436-eeae-44d9-94cd-0f361c1beb5b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:54.104853 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b687487c-2073-4c15-91b6-9a9aa2286d33 req-ca452278-bb93-4da6-a359-05e6613c6704 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Refreshing instance network info cache due to event network-changed-f95be436-eeae-44d9-94cd-0f361c1beb5b. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:57:54.104853 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b687487c-2073-4c15-91b6-9a9aa2286d33 req-ca452278-bb93-4da6-a359-05e6613c6704 service nova] Acquiring lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:54.292455 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Successfully updated port: f7c38424-435e-481a-b1a2-6b3e7f8c7d42 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:57:54.373799 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ff7ee496-6d7e-4eb6-a9bc-58f236b52766 req-95a4d7d4-6305-421f-a573-29e047ac73ee service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-changed-f7c38424-435e-481a-b1a2-6b3e7f8c7d42 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:54.374214 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ff7ee496-6d7e-4eb6-a9bc-58f236b52766 req-95a4d7d4-6305-421f-a573-29e047ac73ee service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Refreshing instance network info cache due to event network-changed-f7c38424-435e-481a-b1a2-6b3e7f8c7d42. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:57:54.377441 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ff7ee496-6d7e-4eb6-a9bc-58f236b52766 req-95a4d7d4-6305-421f-a573-29e047ac73ee service nova] Acquiring lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:54.377441 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ff7ee496-6d7e-4eb6-a9bc-58f236b52766 req-95a4d7d4-6305-421f-a573-29e047ac73ee service nova] Acquired lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:54.377441 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ff7ee496-6d7e-4eb6-a9bc-58f236b52766 req-95a4d7d4-6305-421f-a573-29e047ac73ee service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Refreshing network info cache for port f7c38424-435e-481a-b1a2-6b3e7f8c7d42 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:57:54.395143 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:54.400114 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:57:54.599891 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:54.600072 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:54.600390 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:54.600693 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:54.601044 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:54.604835 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:54.604835 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:54.607722 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:54.608167 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:54.608418 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:54.609085 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:54.609379 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:57:54.723318 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:57:54.886045 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-ff7ee496-6d7e-4eb6-a9bc-58f236b52766 req-95a4d7d4-6305-421f-a573-29e047ac73ee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:54.910365 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850674.909961, a6c0c0f0-846a-4ffb-8f02-d43af196da22 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:54.910365 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] VM Resumed (Lifecycle Event)
May 27 02:57:55.079915 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Acquiring lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:55.080086 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:55.119344 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Took 13.83 seconds to spawn the instance on the hypervisor.
May 27 02:57:55.122837 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Took 13.53 seconds to spawn the instance on the hypervisor.
May 27 02:57:55.123371 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:55.123753 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:55.361640 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Booting with volume 16fec4f6-6aec-4a56-9937-69c00d6e904e at /dev/vdb
May 27 02:57:55.415435 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:55.419366 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:57:55.435197 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:57:55.449011 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 02:57:55.480046 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:55.525191 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 02:57:55.525533 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 02:57:55.538554 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 02:57:55.540198 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe13:801f', 'fe80::2083:28ff:fee3:52ac', 'fe80::fc16:3eff:fee1:4af7', 'fe80::2088:d9ff:fe30:a71f', 'fe80::fc16:3eff:fea8:2e10', 'fe80::989d:c8ff:fee6:da02', 'fe80::fc16:3eff:fec9:82f2', 'fe80::8c31:51ff:fe45:f0e7', 'fe80::fc16:3eff:fef0:b17a', 'fe80::fc16:3eff:fe0e:547', 'fe80::807d:e5ff:fe89:3c7a', 'fe80::fc16:3eff:fe26:2ceb', 'fe80::dc63:41ff:fe48:d91a'] 
May 27 02:57:55.540384 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 02:57:55.540500 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 02:57:55.540843 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:57:55.541159 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Updating existing volume attachment record: d1b153b8-c1d8-4e53-b514-558f594eb309 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 02:57:55.588417 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lazy-loading 'flavor' on Instance uuid b69fd9f2-86d9-4dab-9bae-60e4e27e9f38 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:57:55.642815 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Successfully updated port: 72bf3a93-7d2a-4507-940a-d8e5fcf51f41 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:57:55.673353 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Took 25.33 seconds to build instance.
May 27 02:57:55.685863 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:55.692077 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:55.703202 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:55.724583 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Took 25.69 seconds to build instance.
May 27 02:57:55.738767 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ff7ee496-6d7e-4eb6-a9bc-58f236b52766 req-95a4d7d4-6305-421f-a573-29e047ac73ee service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:57:55.927436 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850675.9252584, 63151241-1b03-4b3c-9ecd-27703137e752 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:55.927436 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] VM Resumed (Lifecycle Event)
May 27 02:57:56.051195 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ff7ee496-6d7e-4eb6-a9bc-58f236b52766 req-95a4d7d4-6305-421f-a573-29e047ac73ee service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:56.195104 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Lock "09039461-93a4-458a-886e-9783f6edaf45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.865s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:56.229358 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "7c0291f5-62af-417b-9418-41d808856a8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.208s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:56.249472 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:56.431735 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:56.436730 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:57:56.557677 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ff7ee496-6d7e-4eb6-a9bc-58f236b52766 req-95a4d7d4-6305-421f-a573-29e047ac73ee service nova] Releasing lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:56.597329 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:56.619403 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-de25a4d4-ebf9-456d-ab3e-67926d620c0d req-c970e876-e64c-4b79-a3ef-20f22e1bbf52 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Received event network-changed-85ecf3fb-ef43-44a6-836b-a5e5da02646a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:56.621945 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-de25a4d4-ebf9-456d-ab3e-67926d620c0d req-c970e876-e64c-4b79-a3ef-20f22e1bbf52 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Refreshing instance network info cache due to event network-changed-85ecf3fb-ef43-44a6-836b-a5e5da02646a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:57:56.622205 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-de25a4d4-ebf9-456d-ab3e-67926d620c0d req-c970e876-e64c-4b79-a3ef-20f22e1bbf52 service nova] Acquiring lock "refresh_cache-a6c0c0f0-846a-4ffb-8f02-d43af196da22" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:56.622325 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-de25a4d4-ebf9-456d-ab3e-67926d620c0d req-c970e876-e64c-4b79-a3ef-20f22e1bbf52 service nova] Acquired lock "refresh_cache-a6c0c0f0-846a-4ffb-8f02-d43af196da22" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:56.622460 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-de25a4d4-ebf9-456d-ab3e-67926d620c0d req-c970e876-e64c-4b79-a3ef-20f22e1bbf52 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Refreshing network info cache for port 85ecf3fb-ef43-44a6-836b-a5e5da02646a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:57:56.635314 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:56.651636 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a26cba9c-d982-4938-8bea-32490e7c6eff req-7e577673-e660-4c55-91dd-ef9c0007940d service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Received event network-changed-dd748286-2659-4519-a5d7-5a24424d66f5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:56.656352 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a26cba9c-d982-4938-8bea-32490e7c6eff req-7e577673-e660-4c55-91dd-ef9c0007940d service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Refreshing instance network info cache due to event network-changed-dd748286-2659-4519-a5d7-5a24424d66f5. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:57:56.659416 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a26cba9c-d982-4938-8bea-32490e7c6eff req-7e577673-e660-4c55-91dd-ef9c0007940d service nova] Acquiring lock "refresh_cache-82be1ace-dc06-42dd-8660-02439941fa00" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:56.660231 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a26cba9c-d982-4938-8bea-32490e7c6eff req-7e577673-e660-4c55-91dd-ef9c0007940d service nova] Acquired lock "refresh_cache-82be1ace-dc06-42dd-8660-02439941fa00" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:56.660578 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a26cba9c-d982-4938-8bea-32490e7c6eff req-7e577673-e660-4c55-91dd-ef9c0007940d service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Refreshing network info cache for port dd748286-2659-4519-a5d7-5a24424d66f5 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:57:56.673965 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-579d85f5-b135-440e-b524-83178d50b886 req-898198b2-5404-450d-b00f-f108bf9d2cb3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-changed-72bf3a93-7d2a-4507-940a-d8e5fcf51f41 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:56.677642 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-579d85f5-b135-440e-b524-83178d50b886 req-898198b2-5404-450d-b00f-f108bf9d2cb3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Refreshing instance network info cache due to event network-changed-72bf3a93-7d2a-4507-940a-d8e5fcf51f41. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:57:56.680628 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-579d85f5-b135-440e-b524-83178d50b886 req-898198b2-5404-450d-b00f-f108bf9d2cb3 service nova] Acquiring lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:56.680628 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-579d85f5-b135-440e-b524-83178d50b886 req-898198b2-5404-450d-b00f-f108bf9d2cb3 service nova] Acquired lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:56.680628 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-579d85f5-b135-440e-b524-83178d50b886 req-898198b2-5404-450d-b00f-f108bf9d2cb3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Refreshing network info cache for port 72bf3a93-7d2a-4507-940a-d8e5fcf51f41 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:57:56.880627 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Successfully updated port: cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:57:56.944372 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850676.9438272, 09039461-93a4-458a-886e-9783f6edaf45 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:56.944372 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 09039461-93a4-458a-886e-9783f6edaf45] VM Resumed (Lifecycle Event)
May 27 02:57:57.059140 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:57.130098 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-de25a4d4-ebf9-456d-ab3e-67926d620c0d req-c970e876-e64c-4b79-a3ef-20f22e1bbf52 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:57.164990 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-a26cba9c-d982-4938-8bea-32490e7c6eff req-7e577673-e660-4c55-91dd-ef9c0007940d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:57.184117 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-579d85f5-b135-440e-b524-83178d50b886 req-898198b2-5404-450d-b00f-f108bf9d2cb3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:57.238182 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Booting with volume 876cc28e-8f99-46f5-9732-e221b4c5467e at /dev/vdc
May 27 02:57:57.347888 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:57:57.372537 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 02:57:57.379325 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-579d85f5-b135-440e-b524-83178d50b886 req-898198b2-5404-450d-b00f-f108bf9d2cb3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:57:57.423099 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:57.453593 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:57.461352 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:57:57.469077 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 02:57:57.470203 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 02:57:57.485709 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 02:57:57.490088 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe13:801f', 'fe80::2083:28ff:fee3:52ac', 'fe80::fc16:3eff:fee1:4af7', 'fe80::2088:d9ff:fe30:a71f', 'fe80::fc16:3eff:fea8:2e10', 'fe80::989d:c8ff:fee6:da02', 'fe80::fc16:3eff:fec9:82f2', 'fe80::8c31:51ff:fe45:f0e7', 'fe80::fc16:3eff:fef0:b17a', 'fe80::fc16:3eff:fe0e:547', 'fe80::807d:e5ff:fe89:3c7a', 'fe80::fc16:3eff:fe26:2ceb', 'fe80::dc63:41ff:fe48:d91a'] 
May 27 02:57:57.490088 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 02:57:57.490088 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 02:57:57.490088 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:57:57.490088 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Updating existing volume attachment record: 2dd51e07-3740-423b-9324-711086b12ef2 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 02:57:57.733924 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-579d85f5-b135-440e-b524-83178d50b886 req-898198b2-5404-450d-b00f-f108bf9d2cb3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:57.973111 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850677.9695723, 7c0291f5-62af-417b-9418-41d808856a8d => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:57:57.973111 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] VM Resumed (Lifecycle Event)
May 27 02:57:58.176727 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Successfully updated port: 8eaa84fe-02ca-447a-8993-74f9a4fc8e8f {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:57:58.191982 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:58.206312 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-de25a4d4-ebf9-456d-ab3e-67926d620c0d req-c970e876-e64c-4b79-a3ef-20f22e1bbf52 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:58.243853 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-a26cba9c-d982-4938-8bea-32490e7c6eff req-7e577673-e660-4c55-91dd-ef9c0007940d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:58.247466 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-579d85f5-b135-440e-b524-83178d50b886 req-898198b2-5404-450d-b00f-f108bf9d2cb3 service nova] Releasing lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:58.478499 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:57:58.479972 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:57:58.560460 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-de25a4d4-ebf9-456d-ab3e-67926d620c0d req-c970e876-e64c-4b79-a3ef-20f22e1bbf52 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Updated VIF entry in instance network info cache for port 85ecf3fb-ef43-44a6-836b-a5e5da02646a. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 02:57:58.560858 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-de25a4d4-ebf9-456d-ab3e-67926d620c0d req-c970e876-e64c-4b79-a3ef-20f22e1bbf52 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Updating instance_info_cache with network_info: [{"id": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "address": "fa:16:3e:f0:b1:7a", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf3fb-ef", "ovs_interfaceid": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:58.572487 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Acquiring lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:58.572757 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:58.573140 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Attaching volume 38d49fb5-6aab-4ae0-9d71-44e53f4b2987 to /dev/vdb
May 27 02:57:58.658014 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a26cba9c-d982-4938-8bea-32490e7c6eff req-7e577673-e660-4c55-91dd-ef9c0007940d service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Updated VIF entry in instance network info cache for port dd748286-2659-4519-a5d7-5a24424d66f5. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 02:57:58.658014 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a26cba9c-d982-4938-8bea-32490e7c6eff req-7e577673-e660-4c55-91dd-ef9c0007940d service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Updating instance_info_cache with network_info: [{"id": "dd748286-2659-4519-a5d7-5a24424d66f5", "address": "fa:16:3e:e1:4a:f7", "network": {"id": "3122ca85-812a-4888-92a6-8aeababd262d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1174494551-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3143b7b9c4034100aa249427ea1f1115", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd748286-26", "ovs_interfaceid": "dd748286-2659-4519-a5d7-5a24424d66f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:58.665370 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:57:58.685921 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 02:57:58.712884 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:57:58.734445 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 02:57:58.737255 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 02:57:58.747120 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2c33172-989e-41a9-800b-82f25c44a7a3 req-468a7f5c-bfb0-4b57-93d9-cb8a8287584b service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received event network-changed-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:58.748235 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2c33172-989e-41a9-800b-82f25c44a7a3 req-468a7f5c-bfb0-4b57-93d9-cb8a8287584b service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Refreshing instance network info cache due to event network-changed-51f6cb37-5c11-47c2-bf1c-d072ecfff71a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:57:58.748235 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2c33172-989e-41a9-800b-82f25c44a7a3 req-468a7f5c-bfb0-4b57-93d9-cb8a8287584b service nova] Acquiring lock "refresh_cache-7c0291f5-62af-417b-9418-41d808856a8d" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:58.748235 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2c33172-989e-41a9-800b-82f25c44a7a3 req-468a7f5c-bfb0-4b57-93d9-cb8a8287584b service nova] Acquired lock "refresh_cache-7c0291f5-62af-417b-9418-41d808856a8d" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:58.748393 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f2c33172-989e-41a9-800b-82f25c44a7a3 req-468a7f5c-bfb0-4b57-93d9-cb8a8287584b service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Refreshing network info cache for port 51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:57:58.751928 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 02:57:58.753297 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe13:801f', 'fe80::2083:28ff:fee3:52ac', 'fe80::fc16:3eff:fee1:4af7', 'fe80::2088:d9ff:fe30:a71f', 'fe80::fc16:3eff:fea8:2e10', 'fe80::989d:c8ff:fee6:da02', 'fe80::fc16:3eff:fec9:82f2', 'fe80::8c31:51ff:fe45:f0e7', 'fe80::fc16:3eff:fef0:b17a', 'fe80::fc16:3eff:fe0e:547', 'fe80::807d:e5ff:fe89:3c7a', 'fe80::fc16:3eff:fe26:2ceb', 'fe80::dc63:41ff:fe48:d91a'] 
May 27 02:57:58.753415 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 02:57:58.753491 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 02:57:58.753753 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:57:58.754002 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Updating existing volume attachment record: 8936a17a-07cc-43eb-b8ff-583097138eab {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 02:57:58.859333 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:58.947597 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-02e9c694-7901-41f6-b5cd-70e77bbe68ab req-ddb4d8a7-ea1d-48ab-ad8e-d6a4067ef517 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-changed-cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:57:58.947597 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-02e9c694-7901-41f6-b5cd-70e77bbe68ab req-ddb4d8a7-ea1d-48ab-ad8e-d6a4067ef517 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Refreshing instance network info cache due to event network-changed-cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:57:58.947715 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-02e9c694-7901-41f6-b5cd-70e77bbe68ab req-ddb4d8a7-ea1d-48ab-ad8e-d6a4067ef517 service nova] Acquiring lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:57:58.947715 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-02e9c694-7901-41f6-b5cd-70e77bbe68ab req-ddb4d8a7-ea1d-48ab-ad8e-d6a4067ef517 service nova] Acquired lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:58.947849 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-02e9c694-7901-41f6-b5cd-70e77bbe68ab req-ddb4d8a7-ea1d-48ab-ad8e-d6a4067ef517 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Refreshing network info cache for port cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:57:59.038527 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Acquiring lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:59.038527 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:59.042095 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Acquiring lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:59.042095 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:59.042095 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:59.042095 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Terminating instance
May 27 02:57:59.065050 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-de25a4d4-ebf9-456d-ab3e-67926d620c0d req-c970e876-e64c-4b79-a3ef-20f22e1bbf52 service nova] Releasing lock "refresh_cache-a6c0c0f0-846a-4ffb-8f02-d43af196da22" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:59.167001 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a26cba9c-d982-4938-8bea-32490e7c6eff req-7e577673-e660-4c55-91dd-ef9c0007940d service nova] Releasing lock "refresh_cache-82be1ace-dc06-42dd-8660-02439941fa00" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:59.217861 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:59.240366 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Successfully updated port: 538a6aad-d866-4a39-85f1-ec6544f540ff {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:57:59.258339 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f2c33172-989e-41a9-800b-82f25c44a7a3 req-468a7f5c-bfb0-4b57-93d9-cb8a8287584b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:59.317004 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 02:57:59.317362 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987', 'iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38d49fb5-6aab-4ae0-9d71-44e53f4b2987', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:57:59.317540 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:57:59.320304 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:57:59.320626 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987', 'iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38d49fb5-6aab-4ae0-9d71-44e53f4b2987', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 02:57:59.336492 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:57:59.337542 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:57:59.338157 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:57:59.338429 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:57:59.339527 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:57:59.340222 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:57:59.357208 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:57:59.357208 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:57:59.363341 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:57:59.363341 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:57:59.372096 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987] added
May 27 02:57:59.372096 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:57:59.372096 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:57:59.372096 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:57:59.372096 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:57:59.372096 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:57:59.372096 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:57:59.372312 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:57:59.372568 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.034(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:57:59.372568 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:57:59.377634 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987] added
May 27 02:57:59.377634 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:57:59.377634 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:57:59.377634 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:57:59.377634 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:57:59.377634 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:57:59.377634 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:57:59.377877 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:57:59.378131 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.038(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:57:59.378501 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:57:59.399293 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Updating instance_info_cache with network_info: [{"id": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "address": "fa:16:3e:ac:85:cd", "network": {"id": "dd9e8c55-e5da-45f7-a13f-470957854c45", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2089100123-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3c8c8-e0", "ovs_interfaceid": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "address": "fa:16:3e:b3:c1:c6", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fafd7a-ad", "ovs_interfaceid": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "address": "fa:16:3e:0a:53:41", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91efaab4-fe", "ovs_interfaceid": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65194802-b80c-4a1f-855a-69a13e0abadb", "address": "fa:16:3e:83:10:2d", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65194802-b8", "ovs_interfaceid": "65194802-b80c-4a1f-855a-69a13e0abadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74a2c471-0365-423f-b184-a314411fe9d3", "address": "fa:16:3e:99:74:e2", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a2c471-03", "ovs_interfaceid": "74a2c471-0365-423f-b184-a314411fe9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "address": "fa:16:3e:b7:c7:a8", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed880fe-1d", "ovs_interfaceid": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "address": "fa:16:3e:51:3d:37", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95be436-ee", "ovs_interfaceid": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:59.453202 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-02e9c694-7901-41f6-b5cd-70e77bbe68ab req-ddb4d8a7-ea1d-48ab-ad8e-d6a4067ef517 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:59.546218 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 02:57:59.575321 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:59.577652 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:59.594658 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-02e9c694-7901-41f6-b5cd-70e77bbe68ab req-ddb4d8a7-ea1d-48ab-ad8e-d6a4067ef517 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:57:59.599827 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:59.615993 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:59.644242 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:57:59.680249 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 02:57:59.682799 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 02:57:59.682955 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Creating image(s)
May 27 02:57:59.683307 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 02:57:59.683456 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Ensure instance console log exists: /opt/stack/data/nova/instances/27b7be13-fa61-4916-a350-a2370d4430bb/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 02:57:59.684201 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:57:59.684201 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:57:59.684201 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:57:59.751649 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f2c33172-989e-41a9-800b-82f25c44a7a3 req-468a7f5c-bfb0-4b57-93d9-cb8a8287584b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:57:59.893847 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999027376999948 future=<Future at 0x75572c139850 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:57:59.894282 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.998626232999868 future=<Future at 0x75572c139850 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:57:59.894407 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.998440979999941 future=<Future at 0x75572c139850 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:57:59.896576 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Instance destroyed successfully.
May 27 02:57:59.897080 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Lazy-loading 'resources' on Instance uuid 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:57:59.901585 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Releasing lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:57:59.902043 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Instance network_info: |[{"id": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "address": "fa:16:3e:ac:85:cd", "network": {"id": "dd9e8c55-e5da-45f7-a13f-470957854c45", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2089100123-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3c8c8-e0", "ovs_interfaceid": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "address": "fa:16:3e:b3:c1:c6", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fafd7a-ad", "ovs_interfaceid": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "address": "fa:16:3e:0a:53:41", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91efaab4-fe", "ovs_interfaceid": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65194802-b80c-4a1f-855a-69a13e0abadb", "address": "fa:16:3e:83:10:2d", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65194802-b8", "ovs_interfaceid": "65194802-b80c-4a1f-855a-69a13e0abadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74a2c471-0365-423f-b184-a314411fe9d3", "address": "fa:16:3e:99:74:e2", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a2c471-03", "ovs_interfaceid": "74a2c471-0365-423f-b184-a314411fe9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "address": "fa:16:3e:b7:c7:a8", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed880fe-1d", "ovs_interfaceid": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "address": "fa:16:3e:51:3d:37", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95be436-ee", "ovs_interfaceid": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 02:57:59.903718 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Start _get_guest_xml network_info=[{"id": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "address": "fa:16:3e:ac:85:cd", "network": {"id": "dd9e8c55-e5da-45f7-a13f-470957854c45", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2089100123-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3c8c8-e0", "ovs_interfaceid": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "address": "fa:16:3e:b3:c1:c6", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fafd7a-ad", "ovs_interfaceid": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "address": "fa:16:3e:0a:53:41", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91efaab4-fe", "ovs_interfaceid": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65194802-b80c-4a1f-855a-69a13e0abadb", "address": "fa:16:3e:83:10:2d", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65194802-b8", "ovs_interfaceid": "65194802-b80c-4a1f-855a-69a13e0abadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74a2c471-0365-423f-b184-a314411fe9d3", "address": "fa:16:3e:99:74:e2", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a2c471-03", "ovs_interfaceid": "74a2c471-0365-423f-b184-a314411fe9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "address": "fa:16:3e:b7:c7:a8", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed880fe-1d", "ovs_interfaceid": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "address": "fa:16:3e:51:3d:37", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95be436-ee", "ovs_interfaceid": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65b881ec-6fab-4885-9b21-011dc2650d9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '8b048373-2f8d-454a-9ad5-888403e8ee5f', 'attached_at': '', 'detached_at': '', 'volume_id': '65b881ec-6fab-4885-9b21-011dc2650d9e', 'serial': '65b881ec-6fab-4885-9b21-011dc2650d9e'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '64727d2e-b0b2-4810-a3aa-c1f12b2a3d99', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '953364d7-cec1-4e74-99f1-263c29a519bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '8b048373-2f8d-454a-9ad5-888403e8ee5f', 'attached_at': '', 'detached_at': '', 'volume_id': '953364d7-cec1-4e74-99f1-263c29a519bd', 'serial': '953364d7-cec1-4e74-99f1-263c29a519bd'}, 'mount_device': '/dev/vdb', 'boot_index': 1, 'attachment_id': 'b69ab72a-0caa-4025-86de-8184c1c176a4', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '8b048373-2f8d-454a-9ad5-888403e8ee5f', 'attached_at': '', 'detached_at': '', 'volume_id': 'caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 'serial': 'caaa9313-7a2a-4d2c-9c2f-0693b05d3daf'}, 'mount_device': '/dev/vdc', 'boot_index': 2, 'attachment_id': '0ec70891-fe75-41e6-9f11-e89b4062ed41', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 02:57:59.906998 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b687487c-2073-4c15-91b6-9a9aa2286d33 req-ca452278-bb93-4da6-a359-05e6613c6704 service nova] Acquired lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:57:59.907234 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-b687487c-2073-4c15-91b6-9a9aa2286d33 req-ca452278-bb93-4da6-a359-05e6613c6704 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Refreshing network info cache for port f95be436-eeae-44d9-94cd-0f361c1beb5b {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:57:59.911406 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 02:57:59.913627 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-634850796', uuid='8b048373-2f8d-454a-9ad5-888403e8ee5f'), owner=OwnerMeta(userid='4fa9534d56bc4598916f1bb64d785832', username='tempest-TaggedBootDevicesTest_v242-1214928212-project-member', projectid='73947699c9fc4e078220ba0dbcaa9cf9', projectname='tempest-TaggedBootDevicesTest_v242-1214928212'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "address": "fa:16:3e:ac:85:cd", "network": {"id": "dd9e8c55-e5da-45f7-a13f-470957854c45", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2089100123-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3c8c8-e0", "ovs_interfaceid": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "address": "fa:16:3e:b3:c1:c6", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fafd7a-ad", "ovs_interfaceid": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "address": "fa:16:3e:0a:53:41", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91efaab4-fe", "ovs_interfaceid": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65194802-b80c-4a1f-855a-69a13e0abadb", "address": "fa:16:3e:83:10:2d", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65194802-b8", "ovs_interfaceid": "65194802-b80c-4a1f-855a-69a13e0abadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74a2c471-0365-423f-b184-a314411fe9d3", "address": "fa:16:3e:99:74:e2", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a2c471-03", "ovs_interfaceid": "74a2c471-0365-423f-b184-a314411fe9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "address": "fa:16:3e:b7:c7:a8", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed880fe-1d", "ovs_interfaceid": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "address": "fa:16:3e:51:3d:37", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95be436-ee", "ovs_interfaceid": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850679.9128997) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 02:57:59.916358 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 02:57:59.917415 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 02:57:59.922796 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 02:57:59.922796 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 02:57:59.922796 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 02:57:59.922796 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 02:57:59.922796 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 02:57:59.922796 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 02:57:59.922796 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 02:57:59.922796 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 02:57:59.922796 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 02:57:59.922796 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 02:57:59.922796 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 02:57:59.922796 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 02:57:59.923768 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 02:57:59.924079 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 02:57:59.935192 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-02e9c694-7901-41f6-b5cd-70e77bbe68ab req-ddb4d8a7-ea1d-48ab-ad8e-d6a4067ef517 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:57:59.948063 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 02:57:59.948783 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65b881ec-6fab-4885-9b21-011dc2650d9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:57:59.950217 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:57:59.960788 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f2c33172-989e-41a9-800b-82f25c44a7a3 req-468a7f5c-bfb0-4b57-93d9-cb8a8287584b service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Updated VIF entry in instance network info cache for port 51f6cb37-5c11-47c2-bf1c-d072ecfff71a. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 02:57:59.961045 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f2c33172-989e-41a9-800b-82f25c44a7a3 req-468a7f5c-bfb0-4b57-93d9-cb8a8287584b service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Updating instance_info_cache with network_info: [{"id": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "address": "fa:16:3e:26:2c:eb", "network": {"id": "c7f25d43-cc3f-4be2-b8f5-311363bbd4ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1793934555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36131e6324ff45ddb65932f4ade9a1a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f6cb37-5c", "ovs_interfaceid": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:00.276900 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Successfully updated port: fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:58:00.373012 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:58:00.378896 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:00.384501 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:00.384501 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:00.394354 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:00.394354 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:00.398622 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:00.400458 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-24137274',display_name='tempest-VolumesAdminNegativeTest-server-24137274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesadminnegativetest-server-24137274',id=3,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:57:52Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ece615dc6a9547cc849be4c1d0f45636',ramdisk_id='',reservation_id='r-d0ypw61n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2074834210',owner_user_name='tempest-VolumesAdminNegativeTest-2074834210-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:57:53Z,user_data=None,user_id='0ffeea9297304ecaaf2b2a69dac6e7ee',uuid=7ccb28d3-b43c-44bd-93d6-7dfb12b6a858,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb928353-bed5-4524-83af-a0f2f19dafad", "address": "fa:16:3e:a8:2e:10", "network": {"id": "ba582098-1dc2-4a13-9479-4e40d17cba1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-926668277-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ece615dc6a9547cc849be4c1d0f45636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb928353-be", "ovs_interfaceid": "fb928353-bed5-4524-83af-a0f2f19dafad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:58:00.400714 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Converting VIF {"id": "fb928353-bed5-4524-83af-a0f2f19dafad", "address": "fa:16:3e:a8:2e:10", "network": {"id": "ba582098-1dc2-4a13-9479-4e40d17cba1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-926668277-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ece615dc6a9547cc849be4c1d0f45636", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb928353-be", "ovs_interfaceid": "fb928353-bed5-4524-83af-a0f2f19dafad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:00.402103 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2e:10,bridge_name='br-int',has_traffic_filtering=True,id=fb928353-bed5-4524-83af-a0f2f19dafad,network=Network(ba582098-1dc2-4a13-9479-4e40d17cba1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb928353-be') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:00.402266 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2e:10,bridge_name='br-int',has_traffic_filtering=True,id=fb928353-bed5-4524-83af-a0f2f19dafad,network=Network(ba582098-1dc2-4a13-9479-4e40d17cba1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb928353-be') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:58:00.405012 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:00.405344 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb928353-be, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:00.407728 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:00.408723 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:00.409648 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:00.410636 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:00.413127 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:00.413127 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b192e873-ea35-457c-966e-4574a57047f5) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:00.413127 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:00.413506 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:00.415007 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-b687487c-2073-4c15-91b6-9a9aa2286d33 req-ca452278-bb93-4da6-a359-05e6613c6704 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:00.417279 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:00.418011 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:00.418011 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:00.418011 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:00.418229 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:00.418229 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:00.418229 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:00.425557 np0000001475 nova-compute[98471]: INFO os_vif [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:2e:10,bridge_name='br-int',has_traffic_filtering=True,id=fb928353-bed5-4524-83af-a0f2f19dafad,network=Network(ba582098-1dc2-4a13-9479-4e40d17cba1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb928353-be')
May 27 02:58:00.425952 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Deleting instance files /opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858_del
May 27 02:58:00.426996 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Deletion of /opt/stack/data/nova/instances/7ccb28d3-b43c-44bd-93d6-7dfb12b6a858_del complete
May 27 02:58:00.430491 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:00.430491 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:00.430491 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:00.430491 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:00.430491 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:00.430491 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:00.447848 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-02e9c694-7901-41f6-b5cd-70e77bbe68ab req-ddb4d8a7-ea1d-48ab-ad8e-d6a4067ef517 service nova] Releasing lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:58:00.447848 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-02e9c694-7901-41f6-b5cd-70e77bbe68ab req-ddb4d8a7-ea1d-48ab-ad8e-d6a4067ef517 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Received event network-changed-897240c0-5223-4d8f-b4dd-e3c9e51e849a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:00.447848 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-02e9c694-7901-41f6-b5cd-70e77bbe68ab req-ddb4d8a7-ea1d-48ab-ad8e-d6a4067ef517 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Refreshing instance network info cache due to event network-changed-897240c0-5223-4d8f-b4dd-e3c9e51e849a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:58:00.447848 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-02e9c694-7901-41f6-b5cd-70e77bbe68ab req-ddb4d8a7-ea1d-48ab-ad8e-d6a4067ef517 service nova] Acquiring lock "refresh_cache-09039461-93a4-458a-886e-9783f6edaf45" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:58:00.448122 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-02e9c694-7901-41f6-b5cd-70e77bbe68ab req-ddb4d8a7-ea1d-48ab-ad8e-d6a4067ef517 service nova] Acquired lock "refresh_cache-09039461-93a4-458a-886e-9783f6edaf45" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:58:00.448122 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-02e9c694-7901-41f6-b5cd-70e77bbe68ab req-ddb4d8a7-ea1d-48ab-ad8e-d6a4067ef517 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Refreshing network info cache for port 897240c0-5223-4d8f-b4dd-e3c9e51e849a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:58:00.454616 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987, portal: 192.168.40.100,3260]
May 27 02:58:00.454616 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987, portal: 192.168.40.100,3260] successful.
May 27 02:58:00.454616 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:00.466482 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2c33172-989e-41a9-800b-82f25c44a7a3 req-468a7f5c-bfb0-4b57-93d9-cb8a8287584b service nova] Releasing lock "refresh_cache-7c0291f5-62af-417b-9418-41d808856a8d" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:58:00.466692 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2c33172-989e-41a9-800b-82f25c44a7a3 req-468a7f5c-bfb0-4b57-93d9-cb8a8287584b service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-changed-8eaa84fe-02ca-447a-8993-74f9a4fc8e8f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:00.468011 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2c33172-989e-41a9-800b-82f25c44a7a3 req-468a7f5c-bfb0-4b57-93d9-cb8a8287584b service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Refreshing instance network info cache due to event network-changed-8eaa84fe-02ca-447a-8993-74f9a4fc8e8f. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:58:00.468298 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2c33172-989e-41a9-800b-82f25c44a7a3 req-468a7f5c-bfb0-4b57-93d9-cb8a8287584b service nova] Acquiring lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:58:00.468474 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2c33172-989e-41a9-800b-82f25c44a7a3 req-468a7f5c-bfb0-4b57-93d9-cb8a8287584b service nova] Acquired lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:58:00.468622 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f2c33172-989e-41a9-800b-82f25c44a7a3 req-468a7f5c-bfb0-4b57-93d9-cb8a8287584b service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Refreshing network info cache for port 8eaa84fe-02ca-447a-8993-74f9a4fc8e8f {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:58:00.472852 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:00.473909 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987, portal: 192.168.50.100,3260]
May 27 02:58:00.473909 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987, portal: 192.168.50.100,3260] successful.
May 27 02:58:00.473909 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:00.493697 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:00.502262 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:00.502262 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:00.502262 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:00.502262 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:00.502262 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:00.502513 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:00.502513 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:00.502513 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:00.502513 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:00.502513 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:00.503683 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:00.503875 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:00.505667 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] HCTL ('9', '-', '-', 0) found on session 7 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:00.505667 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:00.524858 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:00.524858 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:00.524858 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:00.524858 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:00.524858 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:00.524858 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:00.524858 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:00.524858 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:00.524858 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:00.524858 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:00.524858 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:00.524858 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:00.532690 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] HCTL ('10', '-', '-', 0) found on session 8 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:00.532690 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:00.532690 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Searching for a device in session 7 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:00.532864 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38d49fb5-6aab-4ae0-9d71-44e53f4b2987', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:00.553783 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Searching for a device in session 8 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:00.553783 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '38d49fb5-6aab-4ae0-9d71-44e53f4b2987', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:00.695136 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:00.827852 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d6b27f14-6eee-43fc-a7d8-9ef112c5dded req-c40ef3e9-e3f6-48a1-bc85-79422d95e612 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-changed-538a6aad-d866-4a39-85f1-ec6544f540ff {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:00.827852 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d6b27f14-6eee-43fc-a7d8-9ef112c5dded req-c40ef3e9-e3f6-48a1-bc85-79422d95e612 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Refreshing instance network info cache due to event network-changed-538a6aad-d866-4a39-85f1-ec6544f540ff. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:58:00.827852 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d6b27f14-6eee-43fc-a7d8-9ef112c5dded req-c40ef3e9-e3f6-48a1-bc85-79422d95e612 service nova] Acquiring lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:58:00.851755 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-b687487c-2073-4c15-91b6-9a9aa2286d33 req-ca452278-bb93-4da6-a359-05e6613c6704 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:00.935158 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Took 1.39 seconds to destroy the instance on the hypervisor.
May 27 02:58:00.938334 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 02:58:00.938334 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 02:58:00.938524 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 02:58:00.938641 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:00.956814 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-02e9c694-7901-41f6-b5cd-70e77bbe68ab req-ddb4d8a7-ea1d-48ab-ad8e-d6a4067ef517 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:00.973977 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f2c33172-989e-41a9-800b-82f25c44a7a3 req-468a7f5c-bfb0-4b57-93d9-cb8a8287584b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:01.001444 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-b687487c-2073-4c15-91b6-9a9aa2286d33 req-ca452278-bb93-4da6-a359-05e6613c6704 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Updated VIF entry in instance network info cache for port f95be436-eeae-44d9-94cd-0f361c1beb5b. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 02:58:01.002136 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-b687487c-2073-4c15-91b6-9a9aa2286d33 req-ca452278-bb93-4da6-a359-05e6613c6704 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Updating instance_info_cache with network_info: [{"id": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "address": "fa:16:3e:ac:85:cd", "network": {"id": "dd9e8c55-e5da-45f7-a13f-470957854c45", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2089100123-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3c8c8-e0", "ovs_interfaceid": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "address": "fa:16:3e:b3:c1:c6", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fafd7a-ad", "ovs_interfaceid": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "address": "fa:16:3e:0a:53:41", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91efaab4-fe", "ovs_interfaceid": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65194802-b80c-4a1f-855a-69a13e0abadb", "address": "fa:16:3e:83:10:2d", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65194802-b8", "ovs_interfaceid": "65194802-b80c-4a1f-855a-69a13e0abadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74a2c471-0365-423f-b184-a314411fe9d3", "address": "fa:16:3e:99:74:e2", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a2c471-03", "ovs_interfaceid": "74a2c471-0365-423f-b184-a314411fe9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "address": "fa:16:3e:b7:c7:a8", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed880fe-1d", "ovs_interfaceid": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "address": "fa:16:3e:51:3d:37", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95be436-ee", "ovs_interfaceid": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:01.050519 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8f17f0b3-84fc-4ef5-8bf8-fcfb331bd75b req-46b32ad6-49e8-4dfb-89f6-af24aa70c074 service nova] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Received event network-vif-unplugged-fb928353-bed5-4524-83af-a0f2f19dafad {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:01.051501 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8f17f0b3-84fc-4ef5-8bf8-fcfb331bd75b req-46b32ad6-49e8-4dfb-89f6-af24aa70c074 service nova] Acquiring lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:01.051693 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8f17f0b3-84fc-4ef5-8bf8-fcfb331bd75b req-46b32ad6-49e8-4dfb-89f6-af24aa70c074 service nova] Lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:01.051866 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8f17f0b3-84fc-4ef5-8bf8-fcfb331bd75b req-46b32ad6-49e8-4dfb-89f6-af24aa70c074 service nova] Lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:01.052093 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8f17f0b3-84fc-4ef5-8bf8-fcfb331bd75b req-46b32ad6-49e8-4dfb-89f6-af24aa70c074 service nova] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] No waiting events found dispatching network-vif-unplugged-fb928353-bed5-4524-83af-a0f2f19dafad {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:58:01.052250 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8f17f0b3-84fc-4ef5-8bf8-fcfb331bd75b req-46b32ad6-49e8-4dfb-89f6-af24aa70c074 service nova] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Received event network-vif-unplugged-fb928353-bed5-4524-83af-a0f2f19dafad for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:58:01.052378 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8f17f0b3-84fc-4ef5-8bf8-fcfb331bd75b req-46b32ad6-49e8-4dfb-89f6-af24aa70c074 service nova] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Received event network-vif-unplugged-fb928353-bed5-4524-83af-a0f2f19dafad {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:01.052532 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8f17f0b3-84fc-4ef5-8bf8-fcfb331bd75b req-46b32ad6-49e8-4dfb-89f6-af24aa70c074 service nova] Acquiring lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:01.052691 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8f17f0b3-84fc-4ef5-8bf8-fcfb331bd75b req-46b32ad6-49e8-4dfb-89f6-af24aa70c074 service nova] Lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:01.052956 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8f17f0b3-84fc-4ef5-8bf8-fcfb331bd75b req-46b32ad6-49e8-4dfb-89f6-af24aa70c074 service nova] Lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:01.052956 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8f17f0b3-84fc-4ef5-8bf8-fcfb331bd75b req-46b32ad6-49e8-4dfb-89f6-af24aa70c074 service nova] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] No waiting events found dispatching network-vif-unplugged-fb928353-bed5-4524-83af-a0f2f19dafad {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:58:01.053158 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8f17f0b3-84fc-4ef5-8bf8-fcfb331bd75b req-46b32ad6-49e8-4dfb-89f6-af24aa70c074 service nova] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Received event network-vif-unplugged-fb928353-bed5-4524-83af-a0f2f19dafad for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:58:01.156915 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:01.195507 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f2c33172-989e-41a9-800b-82f25c44a7a3 req-468a7f5c-bfb0-4b57-93d9-cb8a8287584b service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:58:01.341879 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 02:58:01.422615 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Successfully updated port: ad76a2d7-6ae6-45c6-b51f-5967a5392afa {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:58:01.493190 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8d80de42-372c-4d2b-8f1b-5b258c69c9f9 req-7235c7a4-f935-4b23-b3dc-2b85b383c4b3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-changed-ad76a2d7-6ae6-45c6-b51f-5967a5392afa {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:01.494140 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8d80de42-372c-4d2b-8f1b-5b258c69c9f9 req-7235c7a4-f935-4b23-b3dc-2b85b383c4b3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Refreshing instance network info cache due to event network-changed-ad76a2d7-6ae6-45c6-b51f-5967a5392afa. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:58:01.494395 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8d80de42-372c-4d2b-8f1b-5b258c69c9f9 req-7235c7a4-f935-4b23-b3dc-2b85b383c4b3 service nova] Acquiring lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:58:01.504644 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b687487c-2073-4c15-91b6-9a9aa2286d33 req-ca452278-bb93-4da6-a359-05e6613c6704 service nova] Releasing lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:58:01.514173 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-02e9c694-7901-41f6-b5cd-70e77bbe68ab req-ddb4d8a7-ea1d-48ab-ad8e-d6a4067ef517 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:01.533810 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f2c33172-989e-41a9-800b-82f25c44a7a3 req-468a7f5c-bfb0-4b57-93d9-cb8a8287584b service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:01.702599 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-02e9c694-7901-41f6-b5cd-70e77bbe68ab req-ddb4d8a7-ea1d-48ab-ad8e-d6a4067ef517 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Updated VIF entry in instance network info cache for port 897240c0-5223-4d8f-b4dd-e3c9e51e849a. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 02:58:01.702868 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-02e9c694-7901-41f6-b5cd-70e77bbe68ab req-ddb4d8a7-ea1d-48ab-ad8e-d6a4067ef517 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Updating instance_info_cache with network_info: [{"id": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "address": "fa:16:3e:0e:05:47", "network": {"id": "d7d2098f-0324-469b-a994-bde15b0c7538", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1155020550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce2779cce722472da45319e6a0faa7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap897240c0-52", "ovs_interfaceid": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:01.927705 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:58:02.036719 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2c33172-989e-41a9-800b-82f25c44a7a3 req-468a7f5c-bfb0-4b57-93d9-cb8a8287584b service nova] Releasing lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:58:02.037115 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d6b27f14-6eee-43fc-a7d8-9ef112c5dded req-c40ef3e9-e3f6-48a1-bc85-79422d95e612 service nova] Acquired lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:58:02.037315 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-d6b27f14-6eee-43fc-a7d8-9ef112c5dded req-c40ef3e9-e3f6-48a1-bc85-79422d95e612 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Refreshing network info cache for port 538a6aad-d866-4a39-85f1-ec6544f540ff {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:58:02.078063 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:02.299262 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-02e9c694-7901-41f6-b5cd-70e77bbe68ab req-ddb4d8a7-ea1d-48ab-ad8e-d6a4067ef517 service nova] Releasing lock "refresh_cache-09039461-93a4-458a-886e-9783f6edaf45" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:58:02.357580 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Found WWN 330000000384f675e for multipath device dm-3 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 02:58:02.357580 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:02.357580 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000384f675e', 'path': '/dev/dm-3', 'multipath_id': '330000000384f675e'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:02.357580 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000384f675e', 'path': '/dev/dm-3', 'multipath_id': '330000000384f675e'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 02:58:02.359506 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.410s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:02.359506 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65b881ec-6fab-4885-9b21-011dc2650d9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 02:58:02.365801 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lazy-loading 'flavor' on Instance uuid b69fd9f2-86d9-4dab-9bae-60e4e27e9f38 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:58:02.375883 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:02.376253 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:02.377082 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:02.377241 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:58:02.377609 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:02.377709 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:58:02.390333 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:58:02.390333 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:02.394764 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:58:02.394764 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:02.400966 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e] added
May 27 02:58:02.400966 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:58:02.400966 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:02.400966 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:02.400966 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:02.400966 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:02.400966 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:02.401324 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:58:02.401324 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.024(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:58:02.401871 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:58:02.407990 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e] added
May 27 02:58:02.407990 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:58:02.407990 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:02.407990 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:02.407990 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:02.407990 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:02.407990 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:02.408340 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:58:02.408340 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:58:02.408511 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:58:02.539264 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-d6b27f14-6eee-43fc-a7d8-9ef112c5dded req-c40ef3e9-e3f6-48a1-bc85-79422d95e612 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:02.579960 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Took 1.64 seconds to deallocate network for instance.
May 27 02:58:02.636576 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-d6b27f14-6eee-43fc-a7d8-9ef112c5dded req-c40ef3e9-e3f6-48a1-bc85-79422d95e612 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:58:02.792884 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-d6b27f14-6eee-43fc-a7d8-9ef112c5dded req-c40ef3e9-e3f6-48a1-bc85-79422d95e612 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:02.868091 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Attempting to attach volume 38d49fb5-6aab-4ae0-9d71-44e53f4b2987 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 02:58:02.869545 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] attach device xml: <disk type="block" device="disk">
May 27 02:58:02.869545 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:58:02.869545 np0000001475 nova-compute[98471]:   <alias name="ua-38d49fb5-6aab-4ae0-9d71-44e53f4b2987"/>
May 27 02:58:02.869545 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 02:58:02.869545 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 02:58:02.869545 np0000001475 nova-compute[98471]:   <serial>38d49fb5-6aab-4ae0-9d71-44e53f4b2987</serial>
May 27 02:58:02.869545 np0000001475 nova-compute[98471]: </disk>
May 27 02:58:02.869545 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 02:58:02.895055 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a58fd8d6-c404-4cbc-881c-9a1f10495824 req-c9bad894-1948-468e-b4e6-25ce40818687 service nova] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Received event network-vif-deleted-fb928353-bed5-4524-83af-a0f2f19dafad {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:03.090530 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:03.090641 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:03.295366 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d6b27f14-6eee-43fc-a7d8-9ef112c5dded req-c40ef3e9-e3f6-48a1-bc85-79422d95e612 service nova] Releasing lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:58:03.295585 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d6b27f14-6eee-43fc-a7d8-9ef112c5dded req-c40ef3e9-e3f6-48a1-bc85-79422d95e612 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-changed-fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:03.296003 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8d80de42-372c-4d2b-8f1b-5b258c69c9f9 req-7235c7a4-f935-4b23-b3dc-2b85b383c4b3 service nova] Acquired lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:58:03.296256 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d6b27f14-6eee-43fc-a7d8-9ef112c5dded req-c40ef3e9-e3f6-48a1-bc85-79422d95e612 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Refreshing instance network info cache due to event network-changed-fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:58:03.296505 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-8d80de42-372c-4d2b-8f1b-5b258c69c9f9 req-7235c7a4-f935-4b23-b3dc-2b85b383c4b3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Refreshing network info cache for port ad76a2d7-6ae6-45c6-b51f-5967a5392afa {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:58:03.297404 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d6b27f14-6eee-43fc-a7d8-9ef112c5dded req-c40ef3e9-e3f6-48a1-bc85-79422d95e612 service nova] Acquiring lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:58:03.401990 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:58:03.408987 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:03.417760 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:03.417760 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:03.423540 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:03.423540 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:03.435278 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:03.440613 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:03.452311 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:03.452311 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:03.452311 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:03.452311 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:03.452311 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:03.452534 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:03.452534 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:03.452534 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:03.452534 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:03.452534 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:03.461151 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:03.461151 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:03.461151 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:03.461151 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:03.461151 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:03.461151 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:03.461151 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:03.461151 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:03.461151 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:03.461151 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:03.492891 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e, portal: 192.168.40.100,3260]
May 27 02:58:03.492891 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e, portal: 192.168.40.100,3260] successful.
May 27 02:58:03.492891 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:03.510169 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e, portal: 192.168.50.100,3260]
May 27 02:58:03.510169 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e, portal: 192.168.50.100,3260] successful.
May 27 02:58:03.510169 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:03.511182 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:03.529875 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:03.535112 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:03.535112 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:03.535112 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:03.535112 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:03.535112 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:03.535112 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:03.535112 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:03.536799 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:03.536799 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:03.536799 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:03.536799 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:03.536799 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:03.536799 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:03.536799 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:03.540455 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:03.544510 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:03.546424 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] HCTL ('11', '-', '-', 0) found on session 9 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:03.546527 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:03.547603 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:03.547603 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:03.547603 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:03.547603 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:03.547603 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:03.547603 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:03.547603 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:03.547796 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:03.547796 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:03.547796 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:03.547796 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:03.547796 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:03.547796 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:03.547796 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:03.548048 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:03.548182 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:03.549015 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] HCTL ('12', '-', '-', 0) found on session 10 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:03.549105 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:03.564357 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Searching for a device in session 9 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:03.564357 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65b881ec-6fab-4885-9b21-011dc2650d9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:03.571949 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Searching for a device in session 10 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:03.571949 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '65b881ec-6fab-4885-9b21-011dc2650d9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:03.612060 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:58:03.612323 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:58:03.798768 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-8d80de42-372c-4d2b-8f1b-5b258c69c9f9 req-7235c7a4-f935-4b23-b3dc-2b85b383c4b3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:03.908121 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-8d80de42-372c-4d2b-8f1b-5b258c69c9f9 req-7235c7a4-f935-4b23-b3dc-2b85b383c4b3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:58:04.101931 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-8d80de42-372c-4d2b-8f1b-5b258c69c9f9 req-7235c7a4-f935-4b23-b3dc-2b85b383c4b3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:04.115561 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:58:04.378213 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 02:58:04.564922 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:04.565369 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:04.565369 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:04.565473 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] No VIF found with MAC fa:16:3e:13:80:1f, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:58:04.603986 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8d80de42-372c-4d2b-8f1b-5b258c69c9f9 req-7235c7a4-f935-4b23-b3dc-2b85b383c4b3 service nova] Releasing lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:58:04.604315 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquired lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:58:04.604506 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 02:58:04.626772 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.534s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:04.683109 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Deleted allocations for instance 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858
May 27 02:58:05.197707 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:58:05.377021 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:05.395896 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Found WWN 1StorPooliSCSI_DISK_1034578903445798921 for multipath device dm-4 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 02:58:05.396293 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:05.396532 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] <== connect_volume: return (5447ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798921', 'path': '/dev/dm-4', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798921'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:05.396685 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798921', 'path': '/dev/dm-4', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798921'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 02:58:05.413265 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:05.696867 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:05.700492 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c500bfb3-ad0c-4e12-a50f-8f8eaaa03ce7 tempest-VolumesAdminNegativeTest-2074834210 tempest-VolumesAdminNegativeTest-2074834210-project-member] Lock "7ccb28d3-b43c-44bd-93d6-7dfb12b6a858" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.662s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:05.753345 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:05.901608 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 02:58:05.901608 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '953364d7-cec1-4e74-99f1-263c29a519bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:58:05.901608 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:05.901608 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:05.901848 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '953364d7-cec1-4e74-99f1-263c29a519bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 02:58:05.915841 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:05.915841 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:05.915841 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:05.915841 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:58:05.916973 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:05.917543 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:58:05.931779 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:58:05.931779 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:05.943543 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd] added
May 27 02:58:05.943543 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:58:05.943543 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:05.943543 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:05.943543 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:05.943543 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:05.943543 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:05.943543 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:58:05.943543 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:58:05.946710 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:58:05.947713 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:58:05.947713 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:05.963657 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd] added
May 27 02:58:05.963657 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:58:05.963657 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:05.963657 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:05.963657 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:05.963657 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:05.963657 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:05.964117 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:58:05.966663 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0466(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:58:05.966663 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:58:06.168535 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f4f50c6f-b509-4f80-98ae-969bf0d8e76c tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.596s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:06.182339 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:06.533019 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:06.668551 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Acquiring lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:06.669855 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:06.670427 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Acquiring lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:06.670784 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:06.671015 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:06.674801 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Terminating instance
May 27 02:58:06.853576 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:06.944224 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:06.955722 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:06.955722 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:06.965213 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:58:06.975177 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:06.977899 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:06.977899 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:06.993239 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:06.995878 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:06.995878 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:06.995878 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:06.995878 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:06.995878 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:06.995878 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:06.995878 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:06.995878 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:06.995878 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:06.995878 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:06.995878 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:06.995878 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:06.995878 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:06.995878 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:07.008302 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:07.008302 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:07.008302 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:07.008302 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:07.008302 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:07.008302 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:07.008302 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:07.009558 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:07.009558 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:07.009558 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:07.009558 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:07.009558 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:07.009558 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:07.009558 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:07.042219 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd, portal: 192.168.40.100,3260]
May 27 02:58:07.042219 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd, portal: 192.168.40.100,3260] successful.
May 27 02:58:07.042219 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:07.050066 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd, portal: 192.168.50.100,3260]
May 27 02:58:07.050066 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd, portal: 192.168.50.100,3260] successful.
May 27 02:58:07.050066 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:07.055500 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:07.066777 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:07.073572 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:07.073572 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:07.073572 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:07.073572 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:07.073572 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:07.073572 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:07.073572 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:07.073572 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:07.073572 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:07.073815 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:07.073815 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:07.073815 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:07.073815 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:07.073815 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:07.073815 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:07.073815 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:07.073815 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:07.073815 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:07.074004 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:07.074061 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:07.074814 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] HCTL ('13', '-', '-', 0) found on session 11 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:07.074911 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:07.085522 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:07.085522 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:07.085522 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:07.085522 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:07.085522 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:07.085522 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:07.085522 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:07.085522 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:07.085522 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:07.085522 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:07.085522 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:07.085522 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:07.085522 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:07.085522 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:07.085522 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:07.085522 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:07.085522 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:07.085522 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:07.085941 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:07.086063 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:07.087121 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] HCTL ('14', '-', '-', 0) found on session 12 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:07.087368 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:07.098239 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Searching for a device in session 11 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:07.098418 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '953364d7-cec1-4e74-99f1-263c29a519bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:07.114211 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Searching for a device in session 12 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:07.114211 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '953364d7-cec1-4e74-99f1-263c29a519bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:07.192020 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 02:58:07.220909 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:07.242576 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:07.255948 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:07.281828 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:07.287406 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:07.389765 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:07.521629 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:07.528092 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:07.542268 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-72c9457e-18e6-4dff-852e-86866d3d9e8b req-ce5c4d93-d315-416a-b382-e8958b6ce785 service nova] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Received event network-vif-unplugged-daedba8a-0db5-40e8-a99a-bdfe0324387c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:07.542513 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-72c9457e-18e6-4dff-852e-86866d3d9e8b req-ce5c4d93-d315-416a-b382-e8958b6ce785 service nova] Acquiring lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:07.549302 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-72c9457e-18e6-4dff-852e-86866d3d9e8b req-ce5c4d93-d315-416a-b382-e8958b6ce785 service nova] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:07.549302 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-72c9457e-18e6-4dff-852e-86866d3d9e8b req-ce5c4d93-d315-416a-b382-e8958b6ce785 service nova] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:07.549302 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-72c9457e-18e6-4dff-852e-86866d3d9e8b req-ce5c4d93-d315-416a-b382-e8958b6ce785 service nova] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] No waiting events found dispatching network-vif-unplugged-daedba8a-0db5-40e8-a99a-bdfe0324387c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:58:07.549302 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-72c9457e-18e6-4dff-852e-86866d3d9e8b req-ce5c4d93-d315-416a-b382-e8958b6ce785 service nova] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Received event network-vif-unplugged-daedba8a-0db5-40e8-a99a-bdfe0324387c for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:58:07.555103 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999684515000126 future=<Future at 0x75572c127200 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:58:07.566630 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Instance destroyed successfully.
May 27 02:58:07.567212 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lazy-loading 'resources' on Instance uuid b69fd9f2-86d9-4dab-9bae-60e4e27e9f38 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:58:07.916466 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 02:58:07.959340 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:08.074206 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1401556361',display_name='tempest-DeleteServersTestJSON-server-1401556361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-deleteserverstestjson-server-1401556361',id=1,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:57:52Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfd98ab6915e41e38c307ad09c795d82',ramdisk_id='',reservation_id='r-qm2z4tx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1346066477',owner_user_name='tempest-DeleteServersTestJSON-1346066477-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:57:53Z,user_data=None,user_id='b3ddfa3ebacf44829d4caf8767fcc602',uuid=b69fd9f2-86d9-4dab-9bae-60e4e27e9f38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "address": "fa:16:3e:13:80:1f", "network": {"id": "5ab3067a-935a-455e-8b66-8ffc4661c70a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93250037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfd98ab6915e41e38c307ad09c795d82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaedba8a-0d", "ovs_interfaceid": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:58:08.074206 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Converting VIF {"id": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "address": "fa:16:3e:13:80:1f", "network": {"id": "5ab3067a-935a-455e-8b66-8ffc4661c70a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-93250037-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfd98ab6915e41e38c307ad09c795d82", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaedba8a-0d", "ovs_interfaceid": "daedba8a-0db5-40e8-a99a-bdfe0324387c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:08.074670 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:80:1f,bridge_name='br-int',has_traffic_filtering=True,id=daedba8a-0db5-40e8-a99a-bdfe0324387c,network=Network(5ab3067a-935a-455e-8b66-8ffc4661c70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaedba8a-0d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:08.074944 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:80:1f,bridge_name='br-int',has_traffic_filtering=True,id=daedba8a-0db5-40e8-a99a-bdfe0324387c,network=Network(5ab3067a-935a-455e-8b66-8ffc4661c70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaedba8a-0d') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:58:08.082951 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:08.086012 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaedba8a-0d, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:08.086012 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:08.086595 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:08.090491 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:08.091225 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c7c2e6b-170f-4f58-a3f2-e793ef395a84) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:08.091574 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:08.096079 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:08.099232 np0000001475 nova-compute[98471]: INFO os_vif [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:80:1f,bridge_name='br-int',has_traffic_filtering=True,id=daedba8a-0db5-40e8-a99a-bdfe0324387c,network=Network(5ab3067a-935a-455e-8b66-8ffc4661c70a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaedba8a-0d')
May 27 02:58:08.099829 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 02:58:08.101238 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987', 'iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38d49fb5-6aab-4ae0-9d71-44e53f4b2987', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:58:08.101839 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:08.161043 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Updating instance_info_cache with network_info: [{"id": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "address": "fa:16:3e:81:11:62", "network": {"id": "7552b8e6-0e85-4f88-9104-5524c033e9f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-38877104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c38424-43", "ovs_interfaceid": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "address": "fa:16:3e:62:4b:bd", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72bf3a93-7d", "ovs_interfaceid": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "address": "fa:16:3e:2e:6d:18", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbdd2d0b-2f", "ovs_interfaceid": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "address": "fa:16:3e:66:2b:5e", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaa84fe-02", "ovs_interfaceid": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "538a6aad-d866-4a39-85f1-ec6544f540ff", "address": "fa:16:3e:0f:1d:12", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap538a6aad-d8", "ovs_interfaceid": "538a6aad-d866-4a39-85f1-ec6544f540ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "address": "fa:16:3e:28:9b:06", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdaf3b03-8e", "ovs_interfaceid": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "address": "fa:16:3e:0f:78:c6", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad76a2d7-6a", "ovs_interfaceid": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:08.237879 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:08.666061 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Releasing lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:58:08.668176 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Instance network_info: |[{"id": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "address": "fa:16:3e:81:11:62", "network": {"id": "7552b8e6-0e85-4f88-9104-5524c033e9f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-38877104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c38424-43", "ovs_interfaceid": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "address": "fa:16:3e:62:4b:bd", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72bf3a93-7d", "ovs_interfaceid": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "address": "fa:16:3e:2e:6d:18", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbdd2d0b-2f", "ovs_interfaceid": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "address": "fa:16:3e:66:2b:5e", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaa84fe-02", "ovs_interfaceid": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "538a6aad-d866-4a39-85f1-ec6544f540ff", "address": "fa:16:3e:0f:1d:12", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap538a6aad-d8", "ovs_interfaceid": "538a6aad-d866-4a39-85f1-ec6544f540ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "address": "fa:16:3e:28:9b:06", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdaf3b03-8e", "ovs_interfaceid": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "address": "fa:16:3e:0f:78:c6", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad76a2d7-6a", "ovs_interfaceid": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 02:58:08.670090 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d6b27f14-6eee-43fc-a7d8-9ef112c5dded req-c40ef3e9-e3f6-48a1-bc85-79422d95e612 service nova] Acquired lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:58:08.672438 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-d6b27f14-6eee-43fc-a7d8-9ef112c5dded req-c40ef3e9-e3f6-48a1-bc85-79422d95e612 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Refreshing network info cache for port fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:58:08.673870 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Start _get_guest_xml network_info=[{"id": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "address": "fa:16:3e:81:11:62", "network": {"id": "7552b8e6-0e85-4f88-9104-5524c033e9f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-38877104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c38424-43", "ovs_interfaceid": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "address": "fa:16:3e:62:4b:bd", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72bf3a93-7d", "ovs_interfaceid": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "address": "fa:16:3e:2e:6d:18", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbdd2d0b-2f", "ovs_interfaceid": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "address": "fa:16:3e:66:2b:5e", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaa84fe-02", "ovs_interfaceid": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "538a6aad-d866-4a39-85f1-ec6544f540ff", "address": "fa:16:3e:0f:1d:12", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap538a6aad-d8", "ovs_interfaceid": "538a6aad-d866-4a39-85f1-ec6544f540ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "address": "fa:16:3e:28:9b:06", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdaf3b03-8e", "ovs_interfaceid": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "address": "fa:16:3e:0f:78:c6", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad76a2d7-6a", "ovs_interfaceid": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5ffa6ef1-5054-4e50-b2d9-79430a736c19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '27b7be13-fa61-4916-a350-a2370d4430bb', 'attached_at': '', 'detached_at': '', 'volume_id': '5ffa6ef1-5054-4e50-b2d9-79430a736c19', 'serial': '5ffa6ef1-5054-4e50-b2d9-79430a736c19'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'ed2824ea-ca4b-410f-8a1b-5aea2ad42ea8', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '16fec4f6-6aec-4a56-9937-69c00d6e904e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '27b7be13-fa61-4916-a350-a2370d4430bb', 'attached_at': '', 'detached_at': '', 'volume_id': '16fec4f6-6aec-4a56-9937-69c00d6e904e', 'serial': '16fec4f6-6aec-4a56-9937-69c00d6e904e'}, 'mount_device': '/dev/vdb', 'boot_index': 1, 'attachment_id': 'd1b153b8-c1d8-4e53-b514-558f594eb309', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '876cc28e-8f99-46f5-9732-e221b4c5467e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '27b7be13-fa61-4916-a350-a2370d4430bb', 'attached_at': '', 'detached_at': '', 'volume_id': '876cc28e-8f99-46f5-9732-e221b4c5467e', 'serial': '876cc28e-8f99-46f5-9732-e221b4c5467e'}, 'mount_device': '/dev/vdc', 'boot_index': 2, 'attachment_id': '2dd51e07-3740-423b-9324-711086b12ef2', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 02:58:08.677491 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 02:58:08.680009 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-597581258', uuid='27b7be13-fa61-4916-a350-a2370d4430bb'), owner=OwnerMeta(userid='53592b383294428a94c52288ed87629d', username='tempest-TaggedBootDevicesTest-763075040-project-member', projectid='faa29a06cd694e828f6bc5146d9f7339', projectname='tempest-TaggedBootDevicesTest-763075040'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "address": "fa:16:3e:81:11:62", "network": {"id": "7552b8e6-0e85-4f88-9104-5524c033e9f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-38877104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c38424-43", "ovs_interfaceid": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "address": "fa:16:3e:62:4b:bd", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72bf3a93-7d", "ovs_interfaceid": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "address": "fa:16:3e:2e:6d:18", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbdd2d0b-2f", "ovs_interfaceid": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "address": "fa:16:3e:66:2b:5e", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaa84fe-02", "ovs_interfaceid": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "538a6aad-d866-4a39-85f1-ec6544f540ff", "address": "fa:16:3e:0f:1d:12", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap538a6aad-d8", "ovs_interfaceid": "538a6aad-d866-4a39-85f1-ec6544f540ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "address": "fa:16:3e:28:9b:06", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdaf3b03-8e", "ovs_interfaceid": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "address": "fa:16:3e:0f:78:c6", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad76a2d7-6a", "ovs_interfaceid": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850688.679266) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 02:58:08.685126 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 02:58:08.685126 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 02:58:08.685126 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 02:58:08.685459 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 02:58:08.686856 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 02:58:08.687234 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 02:58:08.687373 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 02:58:08.687524 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 02:58:08.687863 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 02:58:08.687863 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 02:58:08.687863 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 02:58:08.689327 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 02:58:08.692792 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 02:58:08.692792 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 02:58:08.692792 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 02:58:08.692792 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 02:58:08.700875 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 02:58:08.701885 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5ffa6ef1-5054-4e50-b2d9-79430a736c19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:58:08.701885 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:08.933983 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Found WWN 330000000d6552ad0 for multipath device dm-7 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 02:58:08.934436 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:08.934512 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000d6552ad0', 'path': '/dev/dm-7', 'multipath_id': '330000000d6552ad0'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:08.934623 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d6552ad0', 'path': '/dev/dm-7', 'multipath_id': '330000000d6552ad0'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 02:58:08.934985 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.833s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:08.935226 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987', 'iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38d49fb5-6aab-4ae0-9d71-44e53f4b2987', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 02:58:08.935436 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 02:58:08.963543 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:08.963543 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:08.963543 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:08.963543 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:08.963543 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:08.963543 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:08.963543 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:08.963543 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:08.963543 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:08.963975 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:08.963975 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:08.963975 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:08.963975 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:08.963975 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:08.963975 np0000001475 nova-compute[98471]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:08.963975 np0000001475 nova-compute[98471]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987 (non-flash)
May 27 02:58:08.963975 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:08.963975 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:08.963975 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', '9')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 02:58:08.964317 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987', '7')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:58:08.965294 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987', '8')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:58:08.966330 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7557247899e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987'): ({'sde'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 02:58:08.966485 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Removing multipathed devices sdd, sde {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 02:58:08.966720 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Flush multipath device 330000000384f675e {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 02:58:08.997943 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:58:09.035687 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:58:09.087941 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 02:58:09.088092 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 02:58:09.089776 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 02:58:09.106197 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 02:58:09.106410 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 02:58:09.121224 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:09.149922 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987, portal: 192.168.40.100,3260]
May 27 02:58:09.149922 np0000001475 nova-compute[98471]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987, portal: 192.168.40.100,3260] successful.
May 27 02:58:09.149922 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:09.168442 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:09.180778 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-d6b27f14-6eee-43fc-a7d8-9ef112c5dded req-c40ef3e9-e3f6-48a1-bc85-79422d95e612 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:09.181324 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:09.223681 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987, portal: 192.168.50.100,3260]
May 27 02:58:09.223681 np0000001475 nova-compute[98471]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-38d49fb5-6aab-4ae0-9d71-44e53f4b2987, portal: 192.168.50.100,3260] successful.
May 27 02:58:09.223681 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:09.243521 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:09.244117 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:09.244387 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] <== disconnect_volume: return (1142ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:09.244537 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 02:58:09.244724 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.543s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:09.244971 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5ffa6ef1-5054-4e50-b2d9-79430a736c19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 02:58:09.245510 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Deleting instance files /opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38_del
May 27 02:58:09.246242 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Deletion of /opt/stack/data/nova/instances/b69fd9f2-86d9-4dab-9bae-60e4e27e9f38_del complete
May 27 02:58:09.258871 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:09.259719 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:09.260354 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:09.260849 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:09.261279 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:58:09.261565 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:58:09.278155 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:58:09.278155 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:09.281154 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:58:09.281154 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:09.292823 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19] added
May 27 02:58:09.292823 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:58:09.292823 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:09.292823 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:09.292823 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:09.292823 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:09.292823 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:09.293059 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:58:09.293225 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:58:09.294078 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:58:09.298095 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19] added
May 27 02:58:09.298095 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:58:09.298095 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:09.298095 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:09.298095 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:09.298095 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:09.298095 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:09.298517 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:58:09.298517 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0377(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:58:09.298517 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:58:09.441182 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 02:58:09.441182 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:58:09.441182 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:09.615024 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ccd29ad0-538b-48f6-a2c4-f2f447c9ac0d req-da8e5ab3-887b-422c-980f-c0220b355eb5 service nova] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Received event network-vif-unplugged-daedba8a-0db5-40e8-a99a-bdfe0324387c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:09.615201 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ccd29ad0-538b-48f6-a2c4-f2f447c9ac0d req-da8e5ab3-887b-422c-980f-c0220b355eb5 service nova] Acquiring lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:09.615342 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ccd29ad0-538b-48f6-a2c4-f2f447c9ac0d req-da8e5ab3-887b-422c-980f-c0220b355eb5 service nova] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:09.615449 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ccd29ad0-538b-48f6-a2c4-f2f447c9ac0d req-da8e5ab3-887b-422c-980f-c0220b355eb5 service nova] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:09.615583 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ccd29ad0-538b-48f6-a2c4-f2f447c9ac0d req-da8e5ab3-887b-422c-980f-c0220b355eb5 service nova] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] No waiting events found dispatching network-vif-unplugged-daedba8a-0db5-40e8-a99a-bdfe0324387c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:58:09.615706 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ccd29ad0-538b-48f6-a2c4-f2f447c9ac0d req-da8e5ab3-887b-422c-980f-c0220b355eb5 service nova] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Received event network-vif-unplugged-daedba8a-0db5-40e8-a99a-bdfe0324387c for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:58:09.657267 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-d6b27f14-6eee-43fc-a7d8-9ef112c5dded req-c40ef3e9-e3f6-48a1-bc85-79422d95e612 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:09.757777 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Took 2.57 seconds to destroy the instance on the hypervisor.
May 27 02:58:09.758524 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 02:58:09.758813 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 02:58:09.759016 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 02:58:09.759221 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:09.865425 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:09.878675 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-d6b27f14-6eee-43fc-a7d8-9ef112c5dded req-c40ef3e9-e3f6-48a1-bc85-79422d95e612 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Updated VIF entry in instance network info cache for port fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 02:58:09.879397 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-d6b27f14-6eee-43fc-a7d8-9ef112c5dded req-c40ef3e9-e3f6-48a1-bc85-79422d95e612 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Updating instance_info_cache with network_info: [{"id": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "address": "fa:16:3e:81:11:62", "network": {"id": "7552b8e6-0e85-4f88-9104-5524c033e9f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-38877104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c38424-43", "ovs_interfaceid": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "address": "fa:16:3e:62:4b:bd", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72bf3a93-7d", "ovs_interfaceid": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "address": "fa:16:3e:2e:6d:18", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbdd2d0b-2f", "ovs_interfaceid": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "address": "fa:16:3e:66:2b:5e", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaa84fe-02", "ovs_interfaceid": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "538a6aad-d866-4a39-85f1-ec6544f540ff", "address": "fa:16:3e:0f:1d:12", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap538a6aad-d8", "ovs_interfaceid": "538a6aad-d866-4a39-85f1-ec6544f540ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "address": "fa:16:3e:28:9b:06", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdaf3b03-8e", "ovs_interfaceid": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "address": "fa:16:3e:0f:78:c6", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad76a2d7-6a", "ovs_interfaceid": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:10.294047 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:58:10.298864 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:10.310286 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:10.310286 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:10.316632 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:10.316632 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:10.326662 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:10.332635 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:10.344821 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:10.344821 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:10.344821 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:10.344821 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:10.344821 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:10.344821 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:10.344821 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:10.345086 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:10.345086 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:10.345086 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:10.345086 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:10.345086 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:10.345086 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:10.345086 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:10.354186 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:10.354186 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:10.354186 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:10.354186 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:10.354186 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:10.354186 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:10.354186 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:10.354186 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:10.354186 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:10.354186 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:10.354186 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:10.354186 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:10.354186 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:10.354186 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:10.384315 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d6b27f14-6eee-43fc-a7d8-9ef112c5dded req-c40ef3e9-e3f6-48a1-bc85-79422d95e612 service nova] Releasing lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:58:10.389178 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19, portal: 192.168.50.100,3260]
May 27 02:58:10.389178 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19, portal: 192.168.50.100,3260] successful.
May 27 02:58:10.389178 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:10.389806 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19, portal: 192.168.40.100,3260]
May 27 02:58:10.389806 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19, portal: 192.168.40.100,3260] successful.
May 27 02:58:10.389806 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:10.404985 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:10.408162 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:10.428222 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:10.428222 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:10.428222 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:10.428222 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:10.428222 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:10.428222 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:10.428222 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:10.428222 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:10.428222 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:10.428493 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:10.428493 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:10.428493 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:10.428493 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:10.428493 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:10.428493 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:10.428493 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:10.428493 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:10.428493 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:10.428959 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:10.428959 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:10.429940 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] HCTL ('9', '-', '-', 0) found on session 13 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:10.430081 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:10.433041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:10.433041 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:10.433041 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:10.433041 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:10.433041 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:10.433041 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:10.433041 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:10.433041 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:10.433041 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:10.433041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:10.433041 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:10.433041 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:10.433041 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:10.433041 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:10.433041 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:10.433041 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:10.433041 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:10.433041 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:10.433041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:10.433041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:10.433041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] HCTL ('10', '-', '-', 0) found on session 14 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:10.433041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:10.455887 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Searching for a device in session 13 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:10.455887 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5ffa6ef1-5054-4e50-b2d9-79430a736c19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:10.458120 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Searching for a device in session 14 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:10.458120 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5ffa6ef1-5054-4e50-b2d9-79430a736c19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:10.636145 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:10.696014 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:11.140503 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Took 1.38 seconds to deallocate network for instance.
May 27 02:58:11.222597 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:11.261470 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 02:58:11.715303 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-de626a29-48c4-43ce-a7c7-08313bac2e5e req-ebd34033-96bd-4f98-9d80-4ba65f33195e service nova] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Received event network-vif-deleted-daedba8a-0db5-40e8-a99a-bdfe0324387c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:11.732367 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Took 0.59 seconds to detach 1 volumes for instance.
May 27 02:58:12.239986 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:12.240232 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:12.280362 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Found WWN 3300000006738a34f for multipath device dm-3 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 02:58:12.280728 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:12.281113 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] <== connect_volume: return (3579ms) {'type': 'block', 'scsi_wwn': '3300000006738a34f', 'path': '/dev/dm-3', 'multipath_id': '3300000006738a34f'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:12.281360 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006738a34f', 'path': '/dev/dm-3', 'multipath_id': '3300000006738a34f'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 02:58:12.282335 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.841s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:12.282572 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 02:58:12.298662 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:12.299286 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:12.302173 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:12.303060 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:12.303213 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:58:12.303497 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:58:12.314651 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:58:12.314651 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:12.319965 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:58:12.319965 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:12.328356 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf] added
May 27 02:58:12.328356 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:58:12.328356 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:12.328356 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:12.328356 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:12.328356 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:12.328356 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:12.328605 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:58:12.328782 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0255(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:58:12.328984 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:58:12.334395 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf] added
May 27 02:58:12.334395 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:58:12.334395 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:12.334395 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:12.334395 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:12.334395 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:12.334395 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:12.334641 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:58:12.334763 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0322(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:58:12.334909 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:58:12.787535 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 02:58:12.788057 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '16fec4f6-6aec-4a56-9937-69c00d6e904e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:58:12.788644 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:12.795255 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:58:12.795505 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:58:13.094453 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:13.298719 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:58:13.329392 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:58:13.338391 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:13.350639 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:13.350639 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:13.365791 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:13.365791 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:13.374673 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:13.381331 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:13.396769 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:13.396769 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:13.396769 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:13.396769 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:13.396769 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:13.396769 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:13.396769 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:13.396769 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:13.396769 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:13.396769 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:13.396769 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:13.396769 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:13.396769 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:13.396769 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:13.396769 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:13.396769 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:13.396769 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:13.396769 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:13.403014 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:13.403014 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:13.403014 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:13.403014 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:13.403014 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:13.403014 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:13.403014 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:13.403014 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:13.403014 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:13.403343 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:13.403343 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:13.403343 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:13.403343 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:13.403343 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:13.403343 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:13.403343 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:13.403343 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:13.403343 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:13.426874 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:13.438617 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf, portal: 192.168.40.100,3260]
May 27 02:58:13.438617 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf, portal: 192.168.40.100,3260] successful.
May 27 02:58:13.438617 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:13.455823 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:13.460613 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf, portal: 192.168.50.100,3260]
May 27 02:58:13.460613 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf, portal: 192.168.50.100,3260] successful.
May 27 02:58:13.460613 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:13.473770 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:13.473770 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:13.473770 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:13.473770 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:13.473770 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:13.473770 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:13.473770 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:13.473770 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:13.473770 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:13.473770 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:13.473770 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:13.474222 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:13.474222 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:13.474222 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:13.474222 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:13.474222 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:13.474222 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:13.474222 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:13.474222 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:13.474222 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:13.474222 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:13.474222 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:13.474540 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:13.474620 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:13.476036 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:13.478477 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] HCTL ('15', '-', '-', 0) found on session 15 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:13.478659 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:13.499915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Searching for a device in session 15 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:13.499915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:13.500278 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:13.500278 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:13.500278 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:13.500278 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:13.500278 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:13.500278 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:13.500278 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:13.500278 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:13.500278 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:13.500278 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:13.500278 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:13.500504 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:13.500504 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:13.500504 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:13.500504 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:13.500504 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:13.500504 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:13.500504 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:13.500504 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:13.500504 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:13.500504 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:13.500504 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:13.500708 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:13.500867 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:13.502052 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] HCTL ('16', '-', '-', 0) found on session 16 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:13.502134 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:13.521085 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Searching for a device in session 16 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:13.521085 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:13.806191 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.566s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:13.893306 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Deleted allocations for instance b69fd9f2-86d9-4dab-9bae-60e4e27e9f38
May 27 02:58:14.305583 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 02:58:14.893953 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.000996303000192711 future=<Future at 0x75572c139850 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:58:14.894399 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:58:14.894399 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=7.659693269999934 future=<Future at 0x75572c127200 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:58:14.894497 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=7.659608212999956 future=<Future at 0x75572c127200 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:58:14.895895 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Emitting event <LifecycleEvent: 1779850679.8926806, 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:58:14.895895 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] VM Stopped (Lifecycle Event)
May 27 02:58:14.904599 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cd2b69ec-6964-4c3b-b556-a9e6271fa2bd tempest-DeleteServersTestJSON-1346066477 tempest-DeleteServersTestJSON-1346066477-project-member] Lock "b69fd9f2-86d9-4dab-9bae-60e4e27e9f38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.235s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:15.320455 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Found WWN 330000000e87f0a69 for multipath device dm-10 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 02:58:15.320683 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:15.320854 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] <== connect_volume: return (5880ms) {'type': 'block', 'scsi_wwn': '330000000e87f0a69', 'path': '/dev/dm-10', 'multipath_id': '330000000e87f0a69'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:15.321093 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e87f0a69', 'path': '/dev/dm-10', 'multipath_id': '330000000e87f0a69'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 02:58:15.321325 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.533s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:15.321494 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '16fec4f6-6aec-4a56-9937-69c00d6e904e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 02:58:15.333059 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:15.333762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:15.334335 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:15.334613 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:58:15.335529 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:15.335529 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:58:15.345191 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:58:15.345191 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:15.350683 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:58:15.350683 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:15.356790 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e] added
May 27 02:58:15.356790 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:58:15.356790 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:15.356790 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:15.356790 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:15.356790 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:15.356790 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:15.356999 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:58:15.357259 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0227(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:58:15.357444 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:58:15.360901 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e] added
May 27 02:58:15.360901 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:58:15.360901 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:15.360901 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:15.360901 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:15.360901 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:15.360901 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:15.360901 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:58:15.360901 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0254(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:58:15.360901 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:58:15.405759 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 7ccb28d3-b43c-44bd-93d6-7dfb12b6a858] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:58:15.698466 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:15.834476 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "address": "fa:16:3e:ac:85:cd", "network": {"id": "dd9e8c55-e5da-45f7-a13f-470957854c45", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2089100123-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3c8c8-e0", "ovs_interfaceid": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:58:15.834476 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "address": "fa:16:3e:ac:85:cd", "network": {"id": "dd9e8c55-e5da-45f7-a13f-470957854c45", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2089100123-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3c8c8-e0", "ovs_interfaceid": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:15.834476 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:85:cd,bridge_name='br-int',has_traffic_filtering=True,id=85e3c8c8-e081-465f-aeb5-dd4eeccd64eb,network=Network(dd9e8c55-e5da-45f7-a13f-470957854c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e3c8c8-e0') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:15.834476 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "address": "fa:16:3e:b3:c1:c6", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fafd7a-ad", "ovs_interfaceid": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:58:15.834476 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "address": "fa:16:3e:b3:c1:c6", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fafd7a-ad", "ovs_interfaceid": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:15.834476 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c1:c6,bridge_name='br-int',has_traffic_filtering=True,id=e6fafd7a-ad8c-4d3f-83c1-93e0bc017695,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6fafd7a-ad') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:15.835163 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "address": "fa:16:3e:0a:53:41", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91efaab4-fe", "ovs_interfaceid": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:58:15.835163 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "address": "fa:16:3e:0a:53:41", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91efaab4-fe", "ovs_interfaceid": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:15.836190 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:53:41,bridge_name='br-int',has_traffic_filtering=True,id=91efaab4-fe42-47f8-af98-c6ad87c5dc25,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91efaab4-fe') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:15.837638 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65194802-b80c-4a1f-855a-69a13e0abadb", "address": "fa:16:3e:83:10:2d", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65194802-b8", "ovs_interfaceid": "65194802-b80c-4a1f-855a-69a13e0abadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:58:15.837823 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "65194802-b80c-4a1f-855a-69a13e0abadb", "address": "fa:16:3e:83:10:2d", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65194802-b8", "ovs_interfaceid": "65194802-b80c-4a1f-855a-69a13e0abadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:15.838216 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:10:2d,bridge_name='br-int',has_traffic_filtering=True,id=65194802-b80c-4a1f-855a-69a13e0abadb,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65194802-b8') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:15.838774 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74a2c471-0365-423f-b184-a314411fe9d3", "address": "fa:16:3e:99:74:e2", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a2c471-03", "ovs_interfaceid": "74a2c471-0365-423f-b184-a314411fe9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:58:15.838930 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "74a2c471-0365-423f-b184-a314411fe9d3", "address": "fa:16:3e:99:74:e2", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a2c471-03", "ovs_interfaceid": "74a2c471-0365-423f-b184-a314411fe9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:15.839302 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:74:e2,bridge_name='br-int',has_traffic_filtering=True,id=74a2c471-0365-423f-b184-a314411fe9d3,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74a2c471-03') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:15.839955 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "address": "fa:16:3e:b7:c7:a8", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed880fe-1d", "ovs_interfaceid": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:58:15.840209 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "address": "fa:16:3e:b7:c7:a8", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed880fe-1d", "ovs_interfaceid": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:15.841094 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c7:a8,bridge_name='br-int',has_traffic_filtering=True,id=eed880fe-1d2b-42cd-98fc-a00da6b63892,network=Network(c61a3137-c131-4077-8bc7-1e7b8fb59cb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed880fe-1d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:15.841236 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "address": "fa:16:3e:51:3d:37", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95be436-ee", "ovs_interfaceid": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:58:15.841417 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "address": "fa:16:3e:51:3d:37", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95be436-ee", "ovs_interfaceid": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:15.843339 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=f95be436-eeae-44d9-94cd-0f361c1beb5b,network=Network(c61a3137-c131-4077-8bc7-1e7b8fb59cb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf95be436-ee') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:15.843813 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b048373-2f8d-454a-9ad5-888403e8ee5f {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:58:16.346755 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] End _get_guest_xml xml=<domain type="qemu">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:   <uuid>8b048373-2f8d-454a-9ad5-888403e8ee5f</uuid>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:   <name>instance-00000008</name>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:   <metadata>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <nova:name>tempest-device-tagging-server-634850796</nova:name>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 02:57:59</nova:creationTime>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       </nova:image>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         <nova:user uuid="4fa9534d56bc4598916f1bb64d785832">tempest-TaggedBootDevicesTest_v242-1214928212-project-member</nova:user>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         <nova:project uuid="73947699c9fc4e078220ba0dbcaa9cf9">tempest-TaggedBootDevicesTest_v242-1214928212</nova:project>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         <nova:port uuid="85e3c8c8-e081-465f-aeb5-dd4eeccd64eb">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         <nova:port uuid="e6fafd7a-ad8c-4d3f-83c1-93e0bc017695">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.1.143" ipVersion="4"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         <nova:port uuid="91efaab4-fe42-47f8-af98-c6ad87c5dc25">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.1.103" ipVersion="4"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         <nova:port uuid="65194802-b80c-4a1f-855a-69a13e0abadb">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.1.227" ipVersion="4"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         <nova:port uuid="74a2c471-0365-423f-b184-a314411fe9d3">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.1.130" ipVersion="4"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         <nova:port uuid="eed880fe-1d2b-42cd-98fc-a00da6b63892">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         <nova:port uuid="f95be436-eeae-44d9-94cd-0f361c1beb5b">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:   </metadata>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <system>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <entry name="serial">8b048373-2f8d-454a-9ad5-888403e8ee5f</entry>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <entry name="uuid">8b048373-2f8d-454a-9ad5-888403e8ee5f</entry>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     </system>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:   <os>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:   </os>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:   <features>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <acpi/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <tcg>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     </tcg>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:   </features>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:   <devices>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/8b048373-2f8d-454a-9ad5-888403e8ee5f/disk.config"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     </disk>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <alias name="ua-65b881ec-6fab-4885-9b21-011dc2650d9e"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-4"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <serial>65b881ec-6fab-4885-9b21-011dc2650d9e</serial>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     </disk>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <alias name="ua-953364d7-cec1-4e74-99f1-263c29a519bd"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-7"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <target dev="vdb" bus="virtio"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <serial>953364d7-cec1-4e74-99f1-263c29a519bd</serial>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     </disk>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <alias name="ua-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-10"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <target dev="vdc" bus="virtio"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <serial>caaa9313-7a2a-4d2c-9c2f-0693b05d3daf</serial>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     </disk>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:ac:85:cd"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <target dev="tap85e3c8c8-e0"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     </interface>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:b3:c1:c6"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <target dev="tape6fafd7a-ad"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     </interface>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:0a:53:41"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <target dev="tap91efaab4-fe"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     </interface>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:83:10:2d"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <target dev="tap65194802-b8"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     </interface>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:99:74:e2"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <target dev="tap74a2c471-03"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     </interface>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:b7:c7:a8"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <target dev="tapeed880fe-1d"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     </interface>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:51:3d:37"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <target dev="tapf95be436-ee"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     </interface>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/8b048373-2f8d-454a-9ad5-888403e8ee5f/console.log" append="off"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     </serial>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <video>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     </video>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     </rng>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:     </memballoon>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:   </devices>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]: </domain>
May 27 02:58:16.346755 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Preparing to wait for external event network-vif-plugged-85e3c8c8-e081-465f-aeb5-dd4eeccd64eb {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Preparing to wait for external event network-vif-plugged-e6fafd7a-ad8c-4d3f-83c1-93e0bc017695 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Preparing to wait for external event network-vif-plugged-91efaab4-fe42-47f8-af98-c6ad87c5dc25 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Preparing to wait for external event network-vif-plugged-65194802-b80c-4a1f-855a-69a13e0abadb {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Preparing to wait for external event network-vif-plugged-74a2c471-0365-423f-b184-a314411fe9d3 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Preparing to wait for external event network-vif-plugged-eed880fe-1d2b-42cd-98fc-a00da6b63892 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Preparing to wait for external event network-vif-plugged-f95be436-eeae-44d9-94cd-0f361c1beb5b {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:16.350254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:16.351121 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "address": "fa:16:3e:ac:85:cd", "network": {"id": "dd9e8c55-e5da-45f7-a13f-470957854c45", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2089100123-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3c8c8-e0", "ovs_interfaceid": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:58:16.351121 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "address": "fa:16:3e:ac:85:cd", "network": {"id": "dd9e8c55-e5da-45f7-a13f-470957854c45", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2089100123-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3c8c8-e0", "ovs_interfaceid": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:16.351501 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:85:cd,bridge_name='br-int',has_traffic_filtering=True,id=85e3c8c8-e081-465f-aeb5-dd4eeccd64eb,network=Network(dd9e8c55-e5da-45f7-a13f-470957854c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e3c8c8-e0') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:16.351825 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:85:cd,bridge_name='br-int',has_traffic_filtering=True,id=85e3c8c8-e081-465f-aeb5-dd4eeccd64eb,network=Network(dd9e8c55-e5da-45f7-a13f-470957854c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e3c8c8-e0') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:58:16.352265 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.352559 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.352849 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:58:16.353622 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.353865 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c45e9a46-eb93-5180-8aa5-902fb5220282', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.354700 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.356211 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:16.356211 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.357789 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:58:16.361111 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.361529 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85e3c8c8-e0, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.362408 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85e3c8c8-e0, col_values=(('qos', UUID('e9e357b3-0618-420e-9cf6-364470775aa1')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.362710 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85e3c8c8-e0, col_values=(('external_ids', {'iface-id': '85e3c8c8-e081-465f-aeb5-dd4eeccd64eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:85:cd', 'vm-uuid': '8b048373-2f8d-454a-9ad5-888403e8ee5f'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.363629 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:58:16.366851 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:16.371813 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.374409 np0000001475 nova-compute[98471]: INFO os_vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:85:cd,bridge_name='br-int',has_traffic_filtering=True,id=85e3c8c8-e081-465f-aeb5-dd4eeccd64eb,network=Network(dd9e8c55-e5da-45f7-a13f-470957854c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e3c8c8-e0')
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "address": "fa:16:3e:b3:c1:c6", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fafd7a-ad", "ovs_interfaceid": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "address": "fa:16:3e:b3:c1:c6", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fafd7a-ad", "ovs_interfaceid": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c1:c6,bridge_name='br-int',has_traffic_filtering=True,id=e6fafd7a-ad8c-4d3f-83c1-93e0bc017695,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6fafd7a-ad') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c1:c6,bridge_name='br-int',has_traffic_filtering=True,id=e6fafd7a-ad8c-4d3f-83c1-93e0bc017695,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6fafd7a-ad') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:16.377792 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.377792 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:58:16.381185 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.381185 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4795108a-6fef-5e02-9721-3d94f7155fa6', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.381185 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.382810 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:16.386328 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:16.386328 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:16.389861 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.394596 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.394798 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6fafd7a-ad, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.395143 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6fafd7a-ad, col_values=(('qos', UUID('cd13d792-dd64-4071-bf6a-e804b50e99cf')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.395663 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:16.395876 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6fafd7a-ad, col_values=(('external_ids', {'iface-id': 'e6fafd7a-ad8c-4d3f-83c1-93e0bc017695', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:c1:c6', 'vm-uuid': '8b048373-2f8d-454a-9ad5-888403e8ee5f'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.399165 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:16.402725 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:16.408579 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.409691 np0000001475 nova-compute[98471]: INFO os_vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c1:c6,bridge_name='br-int',has_traffic_filtering=True,id=e6fafd7a-ad8c-4d3f-83c1-93e0bc017695,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6fafd7a-ad')
May 27 02:58:16.410544 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "address": "fa:16:3e:0a:53:41", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91efaab4-fe", "ovs_interfaceid": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:58:16.410774 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "address": "fa:16:3e:0a:53:41", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91efaab4-fe", "ovs_interfaceid": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:16.411282 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:53:41,bridge_name='br-int',has_traffic_filtering=True,id=91efaab4-fe42-47f8-af98-c6ad87c5dc25,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91efaab4-fe') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:16.411525 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:53:41,bridge_name='br-int',has_traffic_filtering=True,id=91efaab4-fe42-47f8-af98-c6ad87c5dc25,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91efaab4-fe') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:58:16.412144 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.412211 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.412380 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:58:16.413175 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.413358 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d801816-13f1-599a-8355-a2d650af9078', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.414053 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:16.414053 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:16.414053 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:16.414053 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:16.414053 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:16.414053 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:16.414053 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:16.414053 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:16.414053 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:16.414053 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:16.414053 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:16.414434 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:16.414434 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:16.414434 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:16.414434 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:16.414434 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:16.414434 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:16.414434 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:16.414434 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:16.414434 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:16.414434 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:16.414434 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:16.415382 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:16.420722 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:16.420722 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:16.420722 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:16.420722 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:16.420722 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:16.420722 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:16.420722 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:16.420722 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:16.420722 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:16.420722 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:16.420722 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:16.421229 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:16.421229 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:16.421229 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:16.421229 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:16.421229 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:16.421229 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:16.421229 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:16.421229 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:16.421229 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:16.421229 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:16.421229 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:16.425949 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.430623 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.430847 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91efaab4-fe, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.431201 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91efaab4-fe, col_values=(('qos', UUID('49a66c03-1d77-48b5-b5cd-046aa4b19444')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.431372 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91efaab4-fe, col_values=(('external_ids', {'iface-id': '91efaab4-fe42-47f8-af98-c6ad87c5dc25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:53:41', 'vm-uuid': '8b048373-2f8d-454a-9ad5-888403e8ee5f'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.433392 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.434956 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:16.449400 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.450545 np0000001475 nova-compute[98471]: INFO os_vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:53:41,bridge_name='br-int',has_traffic_filtering=True,id=91efaab4-fe42-47f8-af98-c6ad87c5dc25,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91efaab4-fe')
May 27 02:58:16.451262 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65194802-b80c-4a1f-855a-69a13e0abadb", "address": "fa:16:3e:83:10:2d", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65194802-b8", "ovs_interfaceid": "65194802-b80c-4a1f-855a-69a13e0abadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:58:16.451441 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "65194802-b80c-4a1f-855a-69a13e0abadb", "address": "fa:16:3e:83:10:2d", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65194802-b8", "ovs_interfaceid": "65194802-b80c-4a1f-855a-69a13e0abadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:16.451738 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:10:2d,bridge_name='br-int',has_traffic_filtering=True,id=65194802-b80c-4a1f-855a-69a13e0abadb,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65194802-b8') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:16.452070 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:10:2d,bridge_name='br-int',has_traffic_filtering=True,id=65194802-b80c-4a1f-855a-69a13e0abadb,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65194802-b8') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:58:16.452660 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.452832 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.453047 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:58:16.453783 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.453892 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2fc91236-da96-5b51-b301-ff1d0ab1bfaa', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.454939 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.455153 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:16.466567 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e, portal: 192.168.50.100,3260]
May 27 02:58:16.466567 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e, portal: 192.168.50.100,3260] successful.
May 27 02:58:16.466567 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:16.469539 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.472723 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.473023 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65194802-b8, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.473859 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65194802-b8, col_values=(('qos', UUID('d2ec3779-c0ea-4699-af43-483308cd83de')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.473859 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65194802-b8, col_values=(('external_ids', {'iface-id': '65194802-b80c-4a1f-855a-69a13e0abadb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:10:2d', 'vm-uuid': '8b048373-2f8d-454a-9ad5-888403e8ee5f'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.474917 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.476299 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:16.478133 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e, portal: 192.168.40.100,3260]
May 27 02:58:16.478133 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e, portal: 192.168.40.100,3260] successful.
May 27 02:58:16.478133 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:16.481956 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:16.492629 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:16.497803 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.499498 np0000001475 nova-compute[98471]: INFO os_vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:10:2d,bridge_name='br-int',has_traffic_filtering=True,id=65194802-b80c-4a1f-855a-69a13e0abadb,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65194802-b8')
May 27 02:58:16.499975 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74a2c471-0365-423f-b184-a314411fe9d3", "address": "fa:16:3e:99:74:e2", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a2c471-03", "ovs_interfaceid": "74a2c471-0365-423f-b184-a314411fe9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:58:16.500190 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "74a2c471-0365-423f-b184-a314411fe9d3", "address": "fa:16:3e:99:74:e2", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a2c471-03", "ovs_interfaceid": "74a2c471-0365-423f-b184-a314411fe9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:16.500692 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:74:e2,bridge_name='br-int',has_traffic_filtering=True,id=74a2c471-0365-423f-b184-a314411fe9d3,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74a2c471-03') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:16.501064 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:74:e2,bridge_name='br-int',has_traffic_filtering=True,id=74a2c471-0365-423f-b184-a314411fe9d3,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74a2c471-03') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:58:16.501237 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.501524 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.501676 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:58:16.502840 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.503158 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '389f126f-d432-5e5b-bbff-f9b451cfb9f2', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.503676 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:16.503676 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:16.503676 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:16.503676 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:16.503676 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:16.503676 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:16.503676 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:16.503676 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:16.503676 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:16.503676 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:16.503676 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:16.503676 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:16.503676 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:16.504092 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:16.504092 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:16.504092 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:16.504092 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:16.504092 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:16.504092 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:16.504092 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:16.504092 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:16.504092 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:16.504092 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:16.504092 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:16.504092 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:16.504092 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:16.504402 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:16.504402 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:16.505552 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] HCTL ('17', '-', '-', 0) found on session 17 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:16.505552 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:16.505753 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.506591 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:16.515013 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:16.515464 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:16.515464 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:16.520954 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] HCTL ('18', '-', '-', 0) found on session 18 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:16.520954 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:16.520954 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Searching for a device in session 17 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:16.521121 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '16fec4f6-6aec-4a56-9937-69c00d6e904e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:16.525686 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.528137 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.528409 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74a2c471-03, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.528823 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74a2c471-03, col_values=(('qos', UUID('d29a8255-6325-42f7-b41f-4671cab868f8')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.529049 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74a2c471-03, col_values=(('external_ids', {'iface-id': '74a2c471-0365-423f-b184-a314411fe9d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:74:e2', 'vm-uuid': '8b048373-2f8d-454a-9ad5-888403e8ee5f'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.530068 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.531451 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:16.536895 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Searching for a device in session 18 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:16.536895 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '16fec4f6-6aec-4a56-9937-69c00d6e904e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:16.559137 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.559979 np0000001475 nova-compute[98471]: INFO os_vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:74:e2,bridge_name='br-int',has_traffic_filtering=True,id=74a2c471-0365-423f-b184-a314411fe9d3,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74a2c471-03')
May 27 02:58:16.561428 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "address": "fa:16:3e:b7:c7:a8", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed880fe-1d", "ovs_interfaceid": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:58:16.561701 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "address": "fa:16:3e:b7:c7:a8", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed880fe-1d", "ovs_interfaceid": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:16.562797 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c7:a8,bridge_name='br-int',has_traffic_filtering=True,id=eed880fe-1d2b-42cd-98fc-a00da6b63892,network=Network(c61a3137-c131-4077-8bc7-1e7b8fb59cb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed880fe-1d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:16.563362 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c7:a8,bridge_name='br-int',has_traffic_filtering=True,id=eed880fe-1d2b-42cd-98fc-a00da6b63892,network=Network(c61a3137-c131-4077-8bc7-1e7b8fb59cb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed880fe-1d') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:58:16.564988 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.565306 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.565558 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:58:16.567488 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.567762 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62d14073-ef64-577b-935b-0022a38757af', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.568797 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.569878 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:16.598162 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.603048 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.603397 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeed880fe-1d, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.603633 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeed880fe-1d, col_values=(('qos', UUID('9de6492a-d68e-484d-b1e4-c14257d243a5')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.603859 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeed880fe-1d, col_values=(('external_ids', {'iface-id': 'eed880fe-1d2b-42cd-98fc-a00da6b63892', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:c7:a8', 'vm-uuid': '8b048373-2f8d-454a-9ad5-888403e8ee5f'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.604809 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.606072 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:16.640442 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.642016 np0000001475 nova-compute[98471]: INFO os_vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c7:a8,bridge_name='br-int',has_traffic_filtering=True,id=eed880fe-1d2b-42cd-98fc-a00da6b63892,network=Network(c61a3137-c131-4077-8bc7-1e7b8fb59cb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed880fe-1d')
May 27 02:58:16.642634 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "address": "fa:16:3e:51:3d:37", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95be436-ee", "ovs_interfaceid": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:58:16.643665 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "address": "fa:16:3e:51:3d:37", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95be436-ee", "ovs_interfaceid": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:16.644328 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=f95be436-eeae-44d9-94cd-0f361c1beb5b,network=Network(c61a3137-c131-4077-8bc7-1e7b8fb59cb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf95be436-ee') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:16.644667 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=f95be436-eeae-44d9-94cd-0f361c1beb5b,network=Network(c61a3137-c131-4077-8bc7-1e7b8fb59cb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf95be436-ee') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:58:16.644917 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.645127 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.645288 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:58:16.646192 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.646261 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f491b8e-7139-5786-be25-dd53cea7cca9', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.647715 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.648353 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:16.681552 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.684816 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.685083 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf95be436-ee, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.685600 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf95be436-ee, col_values=(('qos', UUID('1226b47b-588b-4962-ac92-c7003e70b2d7')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.685600 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf95be436-ee, col_values=(('external_ids', {'iface-id': 'f95be436-eeae-44d9-94cd-0f361c1beb5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:3d:37', 'vm-uuid': '8b048373-2f8d-454a-9ad5-888403e8ee5f'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:16.686462 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.687867 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:16.722575 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:16.723535 np0000001475 nova-compute[98471]: INFO os_vif [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=f95be436-eeae-44d9-94cd-0f361c1beb5b,network=Network(c61a3137-c131-4077-8bc7-1e7b8fb59cb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf95be436-ee')
May 27 02:58:17.334285 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 02:58:17.899285 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:18.244456 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:18.246630 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:18.246630 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] No VIF found with MAC fa:16:3e:ac:85:cd, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:58:18.246630 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] No VIF found with MAC fa:16:3e:99:74:e2, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:58:18.246630 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Using config drive
May 27 02:58:18.353687 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Found WWN 33000000099fbf1bc for multipath device dm-11 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 02:58:18.353964 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:18.354114 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] <== connect_volume: return (5565ms) {'type': 'block', 'scsi_wwn': '33000000099fbf1bc', 'path': '/dev/dm-11', 'multipath_id': '33000000099fbf1bc'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:18.354251 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000099fbf1bc', 'path': '/dev/dm-11', 'multipath_id': '33000000099fbf1bc'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 02:58:18.753636 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:18.861088 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 02:58:18.861448 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '876cc28e-8f99-46f5-9732-e221b4c5467e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:58:18.861655 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:18.862249 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:18.862542 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '876cc28e-8f99-46f5-9732-e221b4c5467e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 02:58:18.876067 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:18.876810 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:18.877424 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:18.877630 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:58:18.878684 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:18.879534 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:58:18.891264 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:58:18.891264 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:18.896609 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:58:18.896609 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:18.903706 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e] added
May 27 02:58:18.903706 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:58:18.903706 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:18.903706 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:18.903706 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:18.903706 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:18.903706 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:18.904434 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:58:18.904434 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0265(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:58:18.904434 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:58:18.908629 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e] added
May 27 02:58:18.908629 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:58:18.908629 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:18.908629 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:18.908629 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:18.908629 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:18.908629 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:18.908874 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:58:18.909193 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:58:18.909333 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:58:18.932805 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Creating config drive at /opt/stack/data/nova/instances/8b048373-2f8d-454a-9ad5-888403e8ee5f/disk.config
May 27 02:58:18.936900 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8b048373-2f8d-454a-9ad5-888403e8ee5f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpctdmh5t_ {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:18.979523 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8b048373-2f8d-454a-9ad5-888403e8ee5f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpctdmh5t_" returned: 0 in 0.042s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:19.425150 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:19.483847 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:19.538481 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:19.570773 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:19.650438 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:19.684483 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:19.684483 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:19.738698 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:19.774783 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:19.778517 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:19.785969 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:19.816491 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:19.827787 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:19.853181 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1c52f88f-8edb-4820-ba77-5604a7735525 req-8ac1bc2e-3bd8-4a7d-8fbf-37e55a8e6d80 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-plugged-85e3c8c8-e081-465f-aeb5-dd4eeccd64eb {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:19.854423 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1c52f88f-8edb-4820-ba77-5604a7735525 req-8ac1bc2e-3bd8-4a7d-8fbf-37e55a8e6d80 service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:19.857951 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1c52f88f-8edb-4820-ba77-5604a7735525 req-8ac1bc2e-3bd8-4a7d-8fbf-37e55a8e6d80 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:19.858370 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1c52f88f-8edb-4820-ba77-5604a7735525 req-8ac1bc2e-3bd8-4a7d-8fbf-37e55a8e6d80 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:19.858562 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1c52f88f-8edb-4820-ba77-5604a7735525 req-8ac1bc2e-3bd8-4a7d-8fbf-37e55a8e6d80 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Processing event network-vif-plugged-85e3c8c8-e081-465f-aeb5-dd4eeccd64eb {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:58:19.864074 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:19.877325 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:19.906172 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:58:19.909769 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:58:19.915786 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:19.929439 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:19.929439 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:19.937937 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:19.937937 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:19.948806 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:19.955065 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:19.957475 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:19.976674 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:19.976674 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:19.976674 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:19.976674 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:19.976674 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:19.976674 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:19.976674 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:19.976674 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:19.976674 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:19.976674 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:19.976674 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:19.976674 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:19.976674 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:19.977107 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:19.977107 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:19.977107 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:19.977107 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:19.977107 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:19.977107 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:19.977107 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:19.977107 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:19.977107 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:19.977107 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:19.977107 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:19.977107 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:19.977107 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:19.985454 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:20.059536 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:20.061934 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:20.062429 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e, portal: 192.168.40.100,3260]
May 27 02:58:20.062429 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e, portal: 192.168.40.100,3260] successful.
May 27 02:58:20.062429 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:20.075928 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e, portal: 192.168.50.100,3260]
May 27 02:58:20.075928 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e, portal: 192.168.50.100,3260] successful.
May 27 02:58:20.075928 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:20.079001 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:20.100638 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:20.129060 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:20.129060 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:20.129060 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:20.129060 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:20.129060 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:20.129060 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:20.129060 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:20.129060 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:20.129060 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:20.129060 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:20.129060 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:20.129060 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:20.129060 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:20.129060 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:20.129060 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:20.129575 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:20.129575 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:20.129575 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:20.129575 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:20.129575 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:20.129575 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:20.129575 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:20.129575 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:20.129575 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:20.129575 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:20.129575 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:20.129575 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:20.129575 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:20.129575 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:20.129575 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:20.129974 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.252s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:20.129974 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:20.131770 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] HCTL ('19', '-', '-', 0) found on session 19 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:20.133850 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:20.144308 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.265s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:20.144308 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:20.149516 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:20.161501 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] HCTL ('20', '-', '-', 0) found on session 20 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:20.161501 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:20.161501 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:20.166515 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Searching for a device in session 19 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:20.166515 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '876cc28e-8f99-46f5-9732-e221b4c5467e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:20.196881 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Searching for a device in session 20 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:20.196881 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '876cc28e-8f99-46f5-9732-e221b4c5467e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:20.203895 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:20.205133 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:20.230836 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:20.234276 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:20.254074 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-16291bad-bc29-4155-bdc3-84ff75ddc5f7 req-8619ec49-3d47-477c-9491-db4d02ff9416 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-plugged-91efaab4-fe42-47f8-af98-c6ad87c5dc25 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:20.254720 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-16291bad-bc29-4155-bdc3-84ff75ddc5f7 req-8619ec49-3d47-477c-9491-db4d02ff9416 service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:20.254720 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-16291bad-bc29-4155-bdc3-84ff75ddc5f7 req-8619ec49-3d47-477c-9491-db4d02ff9416 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:20.254860 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-16291bad-bc29-4155-bdc3-84ff75ddc5f7 req-8619ec49-3d47-477c-9491-db4d02ff9416 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:20.255026 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-16291bad-bc29-4155-bdc3-84ff75ddc5f7 req-8619ec49-3d47-477c-9491-db4d02ff9416 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Processing event network-vif-plugged-91efaab4-fe42-47f8-af98-c6ad87c5dc25 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:58:20.348931 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:20.460450 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:20.470556 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:20.471655 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:20.492228 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:20.705155 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:20.790001 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:20.791561 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:20.880819 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 02:58:20.992522 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:20.994248 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:21.197914 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:21.198082 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:21.487656 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850701.4872465, 8b048373-2f8d-454a-9ad5-888403e8ee5f => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:58:21.487886 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] VM Started (Lifecycle Event)
May 27 02:58:21.655010 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:21.659995 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:21.662231 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:21.687129 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:21.689903 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:21.908032 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Found WWN 3300000001485b7f7 for multipath device dm-12 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 02:58:21.908202 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:21.908453 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '3300000001485b7f7', 'path': '/dev/dm-12', 'multipath_id': '3300000001485b7f7'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:21.908622 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001485b7f7', 'path': '/dev/dm-12', 'multipath_id': '3300000001485b7f7'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 02:58:21.978692 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-plugged-85e3c8c8-e081-465f-aeb5-dd4eeccd64eb {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:21.978981 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:21.979223 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:21.979426 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:21.979625 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No event matching network-vif-plugged-85e3c8c8-e081-465f-aeb5-dd4eeccd64eb in dict_keys([('network-vif-plugged', 'e6fafd7a-ad8c-4d3f-83c1-93e0bc017695'), ('network-vif-plugged', '65194802-b80c-4a1f-855a-69a13e0abadb'), ('network-vif-plugged', '74a2c471-0365-423f-b184-a314411fe9d3'), ('network-vif-plugged', 'eed880fe-1d2b-42cd-98fc-a00da6b63892'), ('network-vif-plugged', 'f95be436-eeae-44d9-94cd-0f361c1beb5b')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 02:58:21.981696 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received unexpected event network-vif-plugged-85e3c8c8-e081-465f-aeb5-dd4eeccd64eb for instance with vm_state building and task_state spawning.
May 27 02:58:21.982060 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-plugged-65194802-b80c-4a1f-855a-69a13e0abadb {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:21.982623 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:21.982966 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:21.983239 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:21.983332 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Processing event network-vif-plugged-65194802-b80c-4a1f-855a-69a13e0abadb {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:58:21.983799 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-plugged-65194802-b80c-4a1f-855a-69a13e0abadb {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:21.984065 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:21.984203 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:21.984383 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:21.984591 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No event matching network-vif-plugged-65194802-b80c-4a1f-855a-69a13e0abadb in dict_keys([('network-vif-plugged', 'e6fafd7a-ad8c-4d3f-83c1-93e0bc017695'), ('network-vif-plugged', '74a2c471-0365-423f-b184-a314411fe9d3'), ('network-vif-plugged', 'eed880fe-1d2b-42cd-98fc-a00da6b63892'), ('network-vif-plugged', 'f95be436-eeae-44d9-94cd-0f361c1beb5b')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 02:58:21.984776 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received unexpected event network-vif-plugged-65194802-b80c-4a1f-855a-69a13e0abadb for instance with vm_state building and task_state spawning.
May 27 02:58:21.985011 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-plugged-eed880fe-1d2b-42cd-98fc-a00da6b63892 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:21.985286 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:21.985435 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:21.985776 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:21.985776 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Processing event network-vif-plugged-eed880fe-1d2b-42cd-98fc-a00da6b63892 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:58:21.990234 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-plugged-eed880fe-1d2b-42cd-98fc-a00da6b63892 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:21.990511 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:21.994098 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:21.994783 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:21.996085 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No event matching network-vif-plugged-eed880fe-1d2b-42cd-98fc-a00da6b63892 in dict_keys([('network-vif-plugged', 'e6fafd7a-ad8c-4d3f-83c1-93e0bc017695'), ('network-vif-plugged', '74a2c471-0365-423f-b184-a314411fe9d3'), ('network-vif-plugged', 'f95be436-eeae-44d9-94cd-0f361c1beb5b')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 02:58:21.996975 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received unexpected event network-vif-plugged-eed880fe-1d2b-42cd-98fc-a00da6b63892 for instance with vm_state building and task_state spawning.
May 27 02:58:21.999099 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-plugged-f95be436-eeae-44d9-94cd-0f361c1beb5b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:22.000679 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:58:22.000932 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:22.001316 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:22.001627 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:22.001752 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Processing event network-vif-plugged-f95be436-eeae-44d9-94cd-0f361c1beb5b {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:58:22.002029 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-plugged-f95be436-eeae-44d9-94cd-0f361c1beb5b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:22.002167 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:22.002295 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:22.004031 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:22.004214 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850702.003919, 8b048373-2f8d-454a-9ad5-888403e8ee5f => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:58:22.004376 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] VM Paused (Lifecycle Event)
May 27 02:58:22.005698 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No event matching network-vif-plugged-f95be436-eeae-44d9-94cd-0f361c1beb5b in dict_keys([('network-vif-plugged', 'e6fafd7a-ad8c-4d3f-83c1-93e0bc017695'), ('network-vif-plugged', '74a2c471-0365-423f-b184-a314411fe9d3')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 02:58:22.005822 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-6f5385bf-1b15-4ec6-94be-97e198ea405f req-5b328d2d-ed6c-4f63-8b85-13cc4e92b021 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received unexpected event network-vif-plugged-f95be436-eeae-44d9-94cd-0f361c1beb5b for instance with vm_state building and task_state spawning.
May 27 02:58:22.009695 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:22.011354 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:22.370963 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-58dfb910-abe2-40e1-990c-1e1e4960dc78 req-5523c174-162b-4d3d-bc23-7470018640d6 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-plugged-91efaab4-fe42-47f8-af98-c6ad87c5dc25 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:22.372131 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-58dfb910-abe2-40e1-990c-1e1e4960dc78 req-5523c174-162b-4d3d-bc23-7470018640d6 service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:22.372131 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-58dfb910-abe2-40e1-990c-1e1e4960dc78 req-5523c174-162b-4d3d-bc23-7470018640d6 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:22.372131 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-58dfb910-abe2-40e1-990c-1e1e4960dc78 req-5523c174-162b-4d3d-bc23-7470018640d6 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:22.372131 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-58dfb910-abe2-40e1-990c-1e1e4960dc78 req-5523c174-162b-4d3d-bc23-7470018640d6 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No event matching network-vif-plugged-91efaab4-fe42-47f8-af98-c6ad87c5dc25 in dict_keys([('network-vif-plugged', 'e6fafd7a-ad8c-4d3f-83c1-93e0bc017695'), ('network-vif-plugged', '74a2c471-0365-423f-b184-a314411fe9d3')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 02:58:22.372131 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-58dfb910-abe2-40e1-990c-1e1e4960dc78 req-5523c174-162b-4d3d-bc23-7470018640d6 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received unexpected event network-vif-plugged-91efaab4-fe42-47f8-af98-c6ad87c5dc25 for instance with vm_state building and task_state spawning.
May 27 02:58:22.373758 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-58dfb910-abe2-40e1-990c-1e1e4960dc78 req-5523c174-162b-4d3d-bc23-7470018640d6 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-plugged-74a2c471-0365-423f-b184-a314411fe9d3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:22.373758 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-58dfb910-abe2-40e1-990c-1e1e4960dc78 req-5523c174-162b-4d3d-bc23-7470018640d6 service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:22.373758 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-58dfb910-abe2-40e1-990c-1e1e4960dc78 req-5523c174-162b-4d3d-bc23-7470018640d6 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:22.373988 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-58dfb910-abe2-40e1-990c-1e1e4960dc78 req-5523c174-162b-4d3d-bc23-7470018640d6 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:22.374088 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-58dfb910-abe2-40e1-990c-1e1e4960dc78 req-5523c174-162b-4d3d-bc23-7470018640d6 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Processing event network-vif-plugged-74a2c471-0365-423f-b184-a314411fe9d3 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:58:22.420384 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "address": "fa:16:3e:81:11:62", "network": {"id": "7552b8e6-0e85-4f88-9104-5524c033e9f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-38877104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c38424-43", "ovs_interfaceid": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:58:22.420384 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "address": "fa:16:3e:81:11:62", "network": {"id": "7552b8e6-0e85-4f88-9104-5524c033e9f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-38877104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c38424-43", "ovs_interfaceid": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:22.421311 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:62,bridge_name='br-int',has_traffic_filtering=True,id=f7c38424-435e-481a-b1a2-6b3e7f8c7d42,network=Network(7552b8e6-0e85-4f88-9104-5524c033e9f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7c38424-43') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:22.425309 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "address": "fa:16:3e:62:4b:bd", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72bf3a93-7d", "ovs_interfaceid": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:58:22.425519 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "address": "fa:16:3e:62:4b:bd", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72bf3a93-7d", "ovs_interfaceid": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:22.426055 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:4b:bd,bridge_name='br-int',has_traffic_filtering=True,id=72bf3a93-7d2a-4507-940a-d8e5fcf51f41,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72bf3a93-7d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:22.426732 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "address": "fa:16:3e:2e:6d:18", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbdd2d0b-2f", "ovs_interfaceid": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:58:22.427020 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "address": "fa:16:3e:2e:6d:18", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbdd2d0b-2f", "ovs_interfaceid": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:22.427348 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:6d:18,bridge_name='br-int',has_traffic_filtering=True,id=cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbdd2d0b-2f') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:22.431816 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "address": "fa:16:3e:66:2b:5e", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaa84fe-02", "ovs_interfaceid": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:58:22.431816 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "address": "fa:16:3e:66:2b:5e", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaa84fe-02", "ovs_interfaceid": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:22.431816 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:2b:5e,bridge_name='br-int',has_traffic_filtering=True,id=8eaa84fe-02ca-447a-8993-74f9a4fc8e8f,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eaa84fe-02') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:22.431816 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "538a6aad-d866-4a39-85f1-ec6544f540ff", "address": "fa:16:3e:0f:1d:12", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap538a6aad-d8", "ovs_interfaceid": "538a6aad-d866-4a39-85f1-ec6544f540ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:58:22.431816 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "538a6aad-d866-4a39-85f1-ec6544f540ff", "address": "fa:16:3e:0f:1d:12", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap538a6aad-d8", "ovs_interfaceid": "538a6aad-d866-4a39-85f1-ec6544f540ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:22.435264 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:1d:12,bridge_name='br-int',has_traffic_filtering=True,id=538a6aad-d866-4a39-85f1-ec6544f540ff,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538a6aad-d8') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:22.436332 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "address": "fa:16:3e:28:9b:06", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdaf3b03-8e", "ovs_interfaceid": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:58:22.436332 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "address": "fa:16:3e:28:9b:06", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdaf3b03-8e", "ovs_interfaceid": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:22.436838 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:06,bridge_name='br-int',has_traffic_filtering=True,id=fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1,network=Network(c8afdec5-859c-40e9-b374-2590771ff168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdaf3b03-8e') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:22.437785 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "address": "fa:16:3e:0f:78:c6", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad76a2d7-6a", "ovs_interfaceid": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:58:22.440677 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "address": "fa:16:3e:0f:78:c6", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad76a2d7-6a", "ovs_interfaceid": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:22.440677 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:78:c6,bridge_name='br-int',has_traffic_filtering=True,id=ad76a2d7-6ae6-45c6-b51f-5967a5392afa,network=Network(c8afdec5-859c-40e9-b374-2590771ff168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad76a2d7-6a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:22.440677 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lazy-loading 'pci_devices' on Instance uuid 27b7be13-fa61-4916-a350-a2370d4430bb {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:58:22.508657 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:58:22.512105 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:58:22.554629 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0005260890000045038 future=<Future at 0x75572c127200 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:58:22.555471 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:58:22.557104 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Emitting event <LifecycleEvent: 1779850687.5539577, b69fd9f2-86d9-4dab-9bae-60e4e27e9f38 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:58:22.557363 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] VM Stopped (Lifecycle Event)
May 27 02:58:22.592625 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d1c6e3cb-2cbd-4a12-8906-d254cb04c9a5 req-9ae57bde-d4db-4d17-a0b7-dccabfc984ba service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-plugged-e6fafd7a-ad8c-4d3f-83c1-93e0bc017695 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:22.592625 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d1c6e3cb-2cbd-4a12-8906-d254cb04c9a5 req-9ae57bde-d4db-4d17-a0b7-dccabfc984ba service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:22.592821 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d1c6e3cb-2cbd-4a12-8906-d254cb04c9a5 req-9ae57bde-d4db-4d17-a0b7-dccabfc984ba service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:22.593900 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d1c6e3cb-2cbd-4a12-8906-d254cb04c9a5 req-9ae57bde-d4db-4d17-a0b7-dccabfc984ba service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:22.594169 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d1c6e3cb-2cbd-4a12-8906-d254cb04c9a5 req-9ae57bde-d4db-4d17-a0b7-dccabfc984ba service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Processing event network-vif-plugged-e6fafd7a-ad8c-4d3f-83c1-93e0bc017695 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:58:22.595313 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Instance event wait completed in 1 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 02:58:22.600201 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 02:58:22.605651 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Instance spawned successfully.
May 27 02:58:22.606129 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 02:58:22.944003 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] End _get_guest_xml xml=<domain type="qemu">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:   <uuid>27b7be13-fa61-4916-a350-a2370d4430bb</uuid>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:   <name>instance-00000009</name>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:   <metadata>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <nova:name>tempest-device-tagging-server-597581258</nova:name>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 02:58:08</nova:creationTime>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       </nova:image>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         <nova:user uuid="53592b383294428a94c52288ed87629d">tempest-TaggedBootDevicesTest-763075040-project-member</nova:user>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         <nova:project uuid="faa29a06cd694e828f6bc5146d9f7339">tempest-TaggedBootDevicesTest-763075040</nova:project>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         <nova:port uuid="f7c38424-435e-481a-b1a2-6b3e7f8c7d42">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         <nova:port uuid="72bf3a93-7d2a-4507-940a-d8e5fcf51f41">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.1.153" ipVersion="4"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         <nova:port uuid="cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.1.208" ipVersion="4"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         <nova:port uuid="8eaa84fe-02ca-447a-8993-74f9a4fc8e8f">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.1.240" ipVersion="4"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         <nova:port uuid="538a6aad-d866-4a39-85f1-ec6544f540ff">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.1.216" ipVersion="4"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         <nova:port uuid="fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         <nova:port uuid="ad76a2d7-6ae6-45c6-b51f-5967a5392afa">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:   </metadata>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <system>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <entry name="serial">27b7be13-fa61-4916-a350-a2370d4430bb</entry>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <entry name="uuid">27b7be13-fa61-4916-a350-a2370d4430bb</entry>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     </system>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:   <os>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:   </os>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:   <features>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <acpi/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <tcg>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     </tcg>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:   </features>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:   <devices>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/27b7be13-fa61-4916-a350-a2370d4430bb/disk.config"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     </disk>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <alias name="ua-5ffa6ef1-5054-4e50-b2d9-79430a736c19"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-3"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <serial>5ffa6ef1-5054-4e50-b2d9-79430a736c19</serial>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     </disk>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <alias name="ua-16fec4f6-6aec-4a56-9937-69c00d6e904e"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-11"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <target dev="vdb" bus="virtio"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <serial>16fec4f6-6aec-4a56-9937-69c00d6e904e</serial>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     </disk>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <alias name="ua-876cc28e-8f99-46f5-9732-e221b4c5467e"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-12"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <target dev="vdc" bus="virtio"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <serial>876cc28e-8f99-46f5-9732-e221b4c5467e</serial>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     </disk>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:81:11:62"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <target dev="tapf7c38424-43"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     </interface>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:62:4b:bd"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <target dev="tap72bf3a93-7d"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     </interface>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:2e:6d:18"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <target dev="tapcbdd2d0b-2f"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     </interface>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:66:2b:5e"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <target dev="tap8eaa84fe-02"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     </interface>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:0f:1d:12"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <target dev="tap538a6aad-d8"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     </interface>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:28:9b:06"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <target dev="tapfdaf3b03-8e"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     </interface>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:0f:78:c6"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <target dev="tapad76a2d7-6a"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     </interface>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/27b7be13-fa61-4916-a350-a2370d4430bb/console.log" append="off"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     </serial>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <video>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     </video>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     </rng>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:     </memballoon>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:   </devices>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]: </domain>
May 27 02:58:22.944003 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Preparing to wait for external event network-vif-plugged-f7c38424-435e-481a-b1a2-6b3e7f8c7d42 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Preparing to wait for external event network-vif-plugged-72bf3a93-7d2a-4507-940a-d8e5fcf51f41 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Preparing to wait for external event network-vif-plugged-cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Preparing to wait for external event network-vif-plugged-8eaa84fe-02ca-447a-8993-74f9a4fc8e8f {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Preparing to wait for external event network-vif-plugged-538a6aad-d866-4a39-85f1-ec6544f540ff {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Preparing to wait for external event network-vif-plugged-fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Preparing to wait for external event network-vif-plugged-ad76a2d7-6ae6-45c6-b51f-5967a5392afa {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:22.951437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:22.952164 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "address": "fa:16:3e:81:11:62", "network": {"id": "7552b8e6-0e85-4f88-9104-5524c033e9f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-38877104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c38424-43", "ovs_interfaceid": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:58:22.952164 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "address": "fa:16:3e:81:11:62", "network": {"id": "7552b8e6-0e85-4f88-9104-5524c033e9f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-38877104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c38424-43", "ovs_interfaceid": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:22.952164 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:62,bridge_name='br-int',has_traffic_filtering=True,id=f7c38424-435e-481a-b1a2-6b3e7f8c7d42,network=Network(7552b8e6-0e85-4f88-9104-5524c033e9f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7c38424-43') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:22.952164 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:62,bridge_name='br-int',has_traffic_filtering=True,id=f7c38424-435e-481a-b1a2-6b3e7f8c7d42,network=Network(7552b8e6-0e85-4f88-9104-5524c033e9f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7c38424-43') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:58:22.953502 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:22.953502 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:22.953502 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:58:22.954833 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:22.954833 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49baaafb-7188-535a-bc69-caf4f3cb96af', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:22.955357 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:22.956044 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:22.959401 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:22.959712 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7c38424-43, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:22.960254 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7c38424-43, col_values=(('qos', UUID('b4758fa1-0933-45a2-a711-0d067d9d2f80')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:22.960479 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7c38424-43, col_values=(('external_ids', {'iface-id': 'f7c38424-435e-481a-b1a2-6b3e7f8c7d42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:11:62', 'vm-uuid': '27b7be13-fa61-4916-a350-a2370d4430bb'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:22.961379 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:22.963022 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:22.971778 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:22.973847 np0000001475 nova-compute[98471]: INFO os_vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:11:62,bridge_name='br-int',has_traffic_filtering=True,id=f7c38424-435e-481a-b1a2-6b3e7f8c7d42,network=Network(7552b8e6-0e85-4f88-9104-5524c033e9f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7c38424-43')
May 27 02:58:22.974092 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "address": "fa:16:3e:62:4b:bd", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72bf3a93-7d", "ovs_interfaceid": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:58:22.975098 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "address": "fa:16:3e:62:4b:bd", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72bf3a93-7d", "ovs_interfaceid": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:22.975773 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:4b:bd,bridge_name='br-int',has_traffic_filtering=True,id=72bf3a93-7d2a-4507-940a-d8e5fcf51f41,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72bf3a93-7d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:22.975773 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:4b:bd,bridge_name='br-int',has_traffic_filtering=True,id=72bf3a93-7d2a-4507-940a-d8e5fcf51f41,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72bf3a93-7d') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:58:22.975773 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:22.976668 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:22.976668 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:58:22.977599 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:22.977819 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dfecd78d-abff-5974-8b14-5a486251c583', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:22.978565 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:22.979567 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:22.989419 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:22.991784 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:22.992181 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72bf3a93-7d, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:22.992917 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72bf3a93-7d, col_values=(('qos', UUID('43213d24-697b-4283-a974-6b60352a4c8e')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:22.993195 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72bf3a93-7d, col_values=(('external_ids', {'iface-id': '72bf3a93-7d2a-4507-940a-d8e5fcf51f41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:4b:bd', 'vm-uuid': '27b7be13-fa61-4916-a350-a2370d4430bb'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:22.994515 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:22.997057 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:23.009808 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.012464 np0000001475 nova-compute[98471]: INFO os_vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:4b:bd,bridge_name='br-int',has_traffic_filtering=True,id=72bf3a93-7d2a-4507-940a-d8e5fcf51f41,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72bf3a93-7d')
May 27 02:58:23.012464 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "address": "fa:16:3e:2e:6d:18", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbdd2d0b-2f", "ovs_interfaceid": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:58:23.012464 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "address": "fa:16:3e:2e:6d:18", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbdd2d0b-2f", "ovs_interfaceid": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:23.012865 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:6d:18,bridge_name='br-int',has_traffic_filtering=True,id=cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbdd2d0b-2f') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:23.013272 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:6d:18,bridge_name='br-int',has_traffic_filtering=True,id=cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbdd2d0b-2f') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:58:23.013761 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.014114 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.014320 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:58:23.015383 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.015602 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3837ba82-ea2c-5fdf-b70d-6e1bb1c677a4', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.019201 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:23.020140 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 02:58:23.020406 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850703.0202177, 8b048373-2f8d-454a-9ad5-888403e8ee5f => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:58:23.020557 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] VM Resumed (Lifecycle Event)
May 27 02:58:23.031113 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.036458 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.036718 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbdd2d0b-2f, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.037248 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcbdd2d0b-2f, col_values=(('qos', UUID('a6adfd6f-a6d3-4491-93c7-1aea79d870c8')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.037416 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcbdd2d0b-2f, col_values=(('external_ids', {'iface-id': 'cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:6d:18', 'vm-uuid': '27b7be13-fa61-4916-a350-a2370d4430bb'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.039824 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.042334 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:23.058471 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.061458 np0000001475 nova-compute[98471]: INFO os_vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:6d:18,bridge_name='br-int',has_traffic_filtering=True,id=cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbdd2d0b-2f')
May 27 02:58:23.061458 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "address": "fa:16:3e:66:2b:5e", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaa84fe-02", "ovs_interfaceid": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:58:23.061458 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "address": "fa:16:3e:66:2b:5e", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaa84fe-02", "ovs_interfaceid": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:23.062581 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:2b:5e,bridge_name='br-int',has_traffic_filtering=True,id=8eaa84fe-02ca-447a-8993-74f9a4fc8e8f,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eaa84fe-02') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:23.063753 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:2b:5e,bridge_name='br-int',has_traffic_filtering=True,id=8eaa84fe-02ca-447a-8993-74f9a4fc8e8f,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eaa84fe-02') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:58:23.064287 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.064535 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.064756 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:58:23.066469 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: b69fd9f2-86d9-4dab-9bae-60e4e27e9f38] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:58:23.067869 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.068134 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1fb7f39-5955-5d7a-b9e8-fde9c5aee143', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.070222 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:23.092080 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.094797 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.094993 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8eaa84fe-02, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.095410 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8eaa84fe-02, col_values=(('qos', UUID('0c4db594-28ba-469b-9b76-a4dad399ecc0')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.095555 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8eaa84fe-02, col_values=(('external_ids', {'iface-id': '8eaa84fe-02ca-447a-8993-74f9a4fc8e8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:2b:5e', 'vm-uuid': '27b7be13-fa61-4916-a350-a2370d4430bb'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.098605 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.099572 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:23.118553 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:23.119482 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:23.120110 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:23.120445 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:23.120922 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:23.121407 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:23.125698 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.127954 np0000001475 nova-compute[98471]: INFO os_vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:2b:5e,bridge_name='br-int',has_traffic_filtering=True,id=8eaa84fe-02ca-447a-8993-74f9a4fc8e8f,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eaa84fe-02')
May 27 02:58:23.127954 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "538a6aad-d866-4a39-85f1-ec6544f540ff", "address": "fa:16:3e:0f:1d:12", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap538a6aad-d8", "ovs_interfaceid": "538a6aad-d866-4a39-85f1-ec6544f540ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:58:23.127954 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "538a6aad-d866-4a39-85f1-ec6544f540ff", "address": "fa:16:3e:0f:1d:12", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap538a6aad-d8", "ovs_interfaceid": "538a6aad-d866-4a39-85f1-ec6544f540ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:23.128394 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:1d:12,bridge_name='br-int',has_traffic_filtering=True,id=538a6aad-d866-4a39-85f1-ec6544f540ff,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538a6aad-d8') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:23.128694 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:1d:12,bridge_name='br-int',has_traffic_filtering=True,id=538a6aad-d866-4a39-85f1-ec6544f540ff,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538a6aad-d8') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:58:23.129099 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.129288 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.129462 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:58:23.130697 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.130893 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d4f33ad-a83f-57dc-acbe-2676bbec2d22', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.134788 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:23.158319 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.159967 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.160120 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap538a6aad-d8, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.161203 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap538a6aad-d8, col_values=(('qos', UUID('5328f695-6536-4b6e-8256-9fdc1c1c006e')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.161321 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap538a6aad-d8, col_values=(('external_ids', {'iface-id': '538a6aad-d866-4a39-85f1-ec6544f540ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:1d:12', 'vm-uuid': '27b7be13-fa61-4916-a350-a2370d4430bb'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.165119 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.168144 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:23.197659 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.199789 np0000001475 nova-compute[98471]: INFO os_vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:1d:12,bridge_name='br-int',has_traffic_filtering=True,id=538a6aad-d866-4a39-85f1-ec6544f540ff,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538a6aad-d8')
May 27 02:58:23.201234 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "address": "fa:16:3e:28:9b:06", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdaf3b03-8e", "ovs_interfaceid": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:58:23.201234 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "address": "fa:16:3e:28:9b:06", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdaf3b03-8e", "ovs_interfaceid": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:23.203200 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:06,bridge_name='br-int',has_traffic_filtering=True,id=fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1,network=Network(c8afdec5-859c-40e9-b374-2590771ff168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdaf3b03-8e') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:23.203556 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:06,bridge_name='br-int',has_traffic_filtering=True,id=fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1,network=Network(c8afdec5-859c-40e9-b374-2590771ff168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdaf3b03-8e') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:58:23.203928 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.204142 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.204338 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:58:23.207095 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.207283 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6175fa9-986c-56ec-b1c0-316be9c2a904', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.208496 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.209311 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:23.240836 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.243022 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.243148 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdaf3b03-8e, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.243384 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfdaf3b03-8e, col_values=(('qos', UUID('4e253703-e3b9-4f6f-acaf-c20f8244638e')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.243902 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfdaf3b03-8e, col_values=(('external_ids', {'iface-id': 'fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:9b:06', 'vm-uuid': '27b7be13-fa61-4916-a350-a2370d4430bb'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.245657 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.246798 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:23.280618 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.283280 np0000001475 nova-compute[98471]: INFO os_vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:06,bridge_name='br-int',has_traffic_filtering=True,id=fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1,network=Network(c8afdec5-859c-40e9-b374-2590771ff168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdaf3b03-8e')
May 27 02:58:23.284231 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:57:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "address": "fa:16:3e:0f:78:c6", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad76a2d7-6a", "ovs_interfaceid": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:58:23.285394 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "address": "fa:16:3e:0f:78:c6", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad76a2d7-6a", "ovs_interfaceid": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:23.285394 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:78:c6,bridge_name='br-int',has_traffic_filtering=True,id=ad76a2d7-6ae6-45c6-b51f-5967a5392afa,network=Network(c8afdec5-859c-40e9-b374-2590771ff168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad76a2d7-6a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:23.286244 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:78:c6,bridge_name='br-int',has_traffic_filtering=True,id=ad76a2d7-6ae6-45c6-b51f-5967a5392afa,network=Network(c8afdec5-859c-40e9-b374-2590771ff168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad76a2d7-6a') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:58:23.289363 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.289363 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.289363 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:58:23.290580 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.290810 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7ce9f18-45e5-5d5b-b345-ee8ba371bc71', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.292936 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:23.327186 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.333403 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.333403 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad76a2d7-6a, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.333403 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad76a2d7-6a, col_values=(('qos', UUID('12c95a98-3dd8-4f99-9688-23eddc46065c')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.333403 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad76a2d7-6a, col_values=(('external_ids', {'iface-id': 'ad76a2d7-6ae6-45c6-b51f-5967a5392afa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:78:c6', 'vm-uuid': '27b7be13-fa61-4916-a350-a2370d4430bb'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:23.336767 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:23.382655 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:23.385081 np0000001475 nova-compute[98471]: INFO os_vif [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:78:c6,bridge_name='br-int',has_traffic_filtering=True,id=ad76a2d7-6ae6-45c6-b51f-5967a5392afa,network=Network(c8afdec5-859c-40e9-b374-2590771ff168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad76a2d7-6a')
May 27 02:58:23.523030 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:58:23.529385 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:58:23.633978 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Took 32.55 seconds to spawn the instance on the hypervisor.
May 27 02:58:23.634216 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:58:24.032355 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 02:58:24.151837 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Took 44.41 seconds to build instance.
May 27 02:58:24.430524 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:24.478202 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-35f059f4-1682-479a-a58b-40d6727500f7 req-ec9a5ef7-cd03-4c0e-9fee-3189e73e358a service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-plugged-74a2c471-0365-423f-b184-a314411fe9d3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:24.478413 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-35f059f4-1682-479a-a58b-40d6727500f7 req-ec9a5ef7-cd03-4c0e-9fee-3189e73e358a service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:24.479010 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-35f059f4-1682-479a-a58b-40d6727500f7 req-ec9a5ef7-cd03-4c0e-9fee-3189e73e358a service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:24.479204 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-35f059f4-1682-479a-a58b-40d6727500f7 req-ec9a5ef7-cd03-4c0e-9fee-3189e73e358a service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:24.479351 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-35f059f4-1682-479a-a58b-40d6727500f7 req-ec9a5ef7-cd03-4c0e-9fee-3189e73e358a service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No waiting events found dispatching network-vif-plugged-74a2c471-0365-423f-b184-a314411fe9d3 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:58:24.479504 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-35f059f4-1682-479a-a58b-40d6727500f7 req-ec9a5ef7-cd03-4c0e-9fee-3189e73e358a service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received unexpected event network-vif-plugged-74a2c471-0365-423f-b184-a314411fe9d3 for instance with vm_state active and task_state None.
May 27 02:58:24.657770 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 45.916s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:24.731366 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b97a3b6a-ddfd-4e9c-ae4a-d15bcbe87901 req-cd9dd121-3d5e-403d-b2c6-840dd6f474f3 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-plugged-e6fafd7a-ad8c-4d3f-83c1-93e0bc017695 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:24.731366 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b97a3b6a-ddfd-4e9c-ae4a-d15bcbe87901 req-cd9dd121-3d5e-403d-b2c6-840dd6f474f3 service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:24.731366 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b97a3b6a-ddfd-4e9c-ae4a-d15bcbe87901 req-cd9dd121-3d5e-403d-b2c6-840dd6f474f3 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:24.731366 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b97a3b6a-ddfd-4e9c-ae4a-d15bcbe87901 req-cd9dd121-3d5e-403d-b2c6-840dd6f474f3 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:24.731366 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b97a3b6a-ddfd-4e9c-ae4a-d15bcbe87901 req-cd9dd121-3d5e-403d-b2c6-840dd6f474f3 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No waiting events found dispatching network-vif-plugged-e6fafd7a-ad8c-4d3f-83c1-93e0bc017695 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:58:24.731366 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-b97a3b6a-ddfd-4e9c-ae4a-d15bcbe87901 req-cd9dd121-3d5e-403d-b2c6-840dd6f474f3 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received unexpected event network-vif-plugged-e6fafd7a-ad8c-4d3f-83c1-93e0bc017695 for instance with vm_state active and task_state None.
May 27 02:58:24.936036 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:24.936262 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:24.936397 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] No VIF found with MAC fa:16:3e:81:11:62, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:58:24.936670 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] No VIF found with MAC fa:16:3e:0f:1d:12, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:58:24.937467 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Using config drive
May 27 02:58:25.448658 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:25.666008 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Creating config drive at /opt/stack/data/nova/instances/27b7be13-fa61-4916-a350-a2370d4430bb/disk.config
May 27 02:58:25.669940 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/27b7be13-fa61-4916-a350-a2370d4430bb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_cs7_d4k {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:25.711928 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:25.722340 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/27b7be13-fa61-4916-a350-a2370d4430bb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_cs7_d4k" returned: 0 in 0.052s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:26.267844 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:26.344717 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:26.404523 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:26.468672 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:26.613802 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:26.626934 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:26.650024 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:26.711305 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:26.744467 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:26.797299 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:26.797299 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:26.863729 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:26.870144 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-21db67eb-dc17-4bb0-908a-2507714af103 req-119acd88-5be1-4745-9fec-8c8681f94963 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-changed-85e3c8c8-e081-465f-aeb5-dd4eeccd64eb {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:26.870480 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-21db67eb-dc17-4bb0-908a-2507714af103 req-119acd88-5be1-4745-9fec-8c8681f94963 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Refreshing instance network info cache due to event network-changed-85e3c8c8-e081-465f-aeb5-dd4eeccd64eb. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:58:26.874132 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-21db67eb-dc17-4bb0-908a-2507714af103 req-119acd88-5be1-4745-9fec-8c8681f94963 service nova] Acquiring lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:58:26.875334 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-21db67eb-dc17-4bb0-908a-2507714af103 req-119acd88-5be1-4745-9fec-8c8681f94963 service nova] Acquired lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:58:26.875334 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-21db67eb-dc17-4bb0-908a-2507714af103 req-119acd88-5be1-4745-9fec-8c8681f94963 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Refreshing network info cache for port 85e3c8c8-e081-465f-aeb5-dd4eeccd64eb {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:58:26.883451 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:26.890786 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:26.927318 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:26.951597 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:26.977088 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:27.018956 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:27.089299 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:27.103281 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:27.185715 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:27.280603 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:27.318548 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:27.387524 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-21db67eb-dc17-4bb0-908a-2507714af103 req-119acd88-5be1-4745-9fec-8c8681f94963 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:27.458769 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:27.613614 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:27.621313 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:27.643356 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:28.048481 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:28.050945 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:28.237628 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-21db67eb-dc17-4bb0-908a-2507714af103 req-119acd88-5be1-4745-9fec-8c8681f94963 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:28.317716 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:28.320182 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:28.331961 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:28.566009 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:28.570769 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:28.674091 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850708.673603, 27b7be13-fa61-4916-a350-a2370d4430bb => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:58:28.675145 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] VM Started (Lifecycle Event)
May 27 02:58:28.777781 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-21db67eb-dc17-4bb0-908a-2507714af103 req-119acd88-5be1-4745-9fec-8c8681f94963 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Updated VIF entry in instance network info cache for port 85e3c8c8-e081-465f-aeb5-dd4eeccd64eb. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 02:58:28.779407 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-21db67eb-dc17-4bb0-908a-2507714af103 req-119acd88-5be1-4745-9fec-8c8681f94963 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Updating instance_info_cache with network_info: [{"id": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "address": "fa:16:3e:ac:85:cd", "network": {"id": "dd9e8c55-e5da-45f7-a13f-470957854c45", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2089100123-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3c8c8-e0", "ovs_interfaceid": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "address": "fa:16:3e:b3:c1:c6", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fafd7a-ad", "ovs_interfaceid": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "address": "fa:16:3e:0a:53:41", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91efaab4-fe", "ovs_interfaceid": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65194802-b80c-4a1f-855a-69a13e0abadb", "address": "fa:16:3e:83:10:2d", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65194802-b8", "ovs_interfaceid": "65194802-b80c-4a1f-855a-69a13e0abadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74a2c471-0365-423f-b184-a314411fe9d3", "address": "fa:16:3e:99:74:e2", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a2c471-03", "ovs_interfaceid": "74a2c471-0365-423f-b184-a314411fe9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "address": "fa:16:3e:b7:c7:a8", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed880fe-1d", "ovs_interfaceid": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "address": "fa:16:3e:51:3d:37", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95be436-ee", "ovs_interfaceid": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:28.978066 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-plugged-fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:28.978372 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:28.978590 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:28.978875 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:28.979111 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Processing event network-vif-plugged-fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:58:28.979393 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-plugged-fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:28.980375 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:28.980640 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:28.983663 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:28.984151 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] No event matching network-vif-plugged-fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1 in dict_keys([('network-vif-plugged', 'f7c38424-435e-481a-b1a2-6b3e7f8c7d42'), ('network-vif-plugged', '72bf3a93-7d2a-4507-940a-d8e5fcf51f41'), ('network-vif-plugged', 'cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3'), ('network-vif-plugged', '8eaa84fe-02ca-447a-8993-74f9a4fc8e8f'), ('network-vif-plugged', '538a6aad-d866-4a39-85f1-ec6544f540ff'), ('network-vif-plugged', 'ad76a2d7-6ae6-45c6-b51f-5967a5392afa')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 02:58:28.984587 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received unexpected event network-vif-plugged-fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1 for instance with vm_state building and task_state spawning.
May 27 02:58:28.984849 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-plugged-ad76a2d7-6ae6-45c6-b51f-5967a5392afa {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:28.985089 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:28.985330 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:28.985522 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:28.985720 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Processing event network-vif-plugged-ad76a2d7-6ae6-45c6-b51f-5967a5392afa {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:58:28.986008 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-plugged-ad76a2d7-6ae6-45c6-b51f-5967a5392afa {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:28.986337 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:28.987059 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:28.987059 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:28.987059 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] No event matching network-vif-plugged-ad76a2d7-6ae6-45c6-b51f-5967a5392afa in dict_keys([('network-vif-plugged', 'f7c38424-435e-481a-b1a2-6b3e7f8c7d42'), ('network-vif-plugged', '72bf3a93-7d2a-4507-940a-d8e5fcf51f41'), ('network-vif-plugged', 'cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3'), ('network-vif-plugged', '8eaa84fe-02ca-447a-8993-74f9a4fc8e8f'), ('network-vif-plugged', '538a6aad-d866-4a39-85f1-ec6544f540ff')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 02:58:28.987059 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-846546f9-f99b-4957-afa2-f2dc4f6ad743 req-30b7322c-3b82-410f-8d80-c11446e48baa service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received unexpected event network-vif-plugged-ad76a2d7-6ae6-45c6-b51f-5967a5392afa for instance with vm_state building and task_state spawning.
May 27 02:58:29.009101 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:29.011701 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:29.015074 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:29.035024 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:29.142705 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:29.179462 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:58:29.183689 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850709.1833339, 27b7be13-fa61-4916-a350-a2370d4430bb => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:58:29.183964 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] VM Paused (Lifecycle Event)
May 27 02:58:29.286234 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-21db67eb-dc17-4bb0-908a-2507714af103 req-119acd88-5be1-4745-9fec-8c8681f94963 service nova] Releasing lock "refresh_cache-8b048373-2f8d-454a-9ad5-888403e8ee5f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:58:29.368225 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:29.510549 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-cbd67824-e71a-4228-a71b-89c6e9dc9c07 req-14ed6dd0-fac0-4ec9-97c2-89c3f5607d0a service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-plugged-f7c38424-435e-481a-b1a2-6b3e7f8c7d42 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:29.510549 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cbd67824-e71a-4228-a71b-89c6e9dc9c07 req-14ed6dd0-fac0-4ec9-97c2-89c3f5607d0a service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:29.510549 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cbd67824-e71a-4228-a71b-89c6e9dc9c07 req-14ed6dd0-fac0-4ec9-97c2-89c3f5607d0a service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:29.510839 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cbd67824-e71a-4228-a71b-89c6e9dc9c07 req-14ed6dd0-fac0-4ec9-97c2-89c3f5607d0a service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:29.510839 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-cbd67824-e71a-4228-a71b-89c6e9dc9c07 req-14ed6dd0-fac0-4ec9-97c2-89c3f5607d0a service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Processing event network-vif-plugged-f7c38424-435e-481a-b1a2-6b3e7f8c7d42 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:58:29.689850 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:58:29.689850 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:58:30.001158 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "60418cf4-cd7f-4256-ad92-cc8336802816" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:30.001158 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "60418cf4-cd7f-4256-ad92-cc8336802816" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:30.196772 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 02:58:30.503728 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 02:58:30.712005 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:31.074033 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:31.074550 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:31.077995 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 02:58:31.078185 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Claim successful on node np0000001475
May 27 02:58:31.596917 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d6a66e87-1684-435c-ad8a-85901b1f25d0 req-813a2a9e-5cb7-4822-9a7a-560c343be564 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-plugged-f7c38424-435e-481a-b1a2-6b3e7f8c7d42 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:31.596978 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d6a66e87-1684-435c-ad8a-85901b1f25d0 req-813a2a9e-5cb7-4822-9a7a-560c343be564 service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:31.597149 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d6a66e87-1684-435c-ad8a-85901b1f25d0 req-813a2a9e-5cb7-4822-9a7a-560c343be564 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:31.597860 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d6a66e87-1684-435c-ad8a-85901b1f25d0 req-813a2a9e-5cb7-4822-9a7a-560c343be564 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:31.599541 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d6a66e87-1684-435c-ad8a-85901b1f25d0 req-813a2a9e-5cb7-4822-9a7a-560c343be564 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] No event matching network-vif-plugged-f7c38424-435e-481a-b1a2-6b3e7f8c7d42 in dict_keys([('network-vif-plugged', '72bf3a93-7d2a-4507-940a-d8e5fcf51f41'), ('network-vif-plugged', 'cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3'), ('network-vif-plugged', '8eaa84fe-02ca-447a-8993-74f9a4fc8e8f'), ('network-vif-plugged', '538a6aad-d866-4a39-85f1-ec6544f540ff')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 02:58:31.599716 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-d6a66e87-1684-435c-ad8a-85901b1f25d0 req-813a2a9e-5cb7-4822-9a7a-560c343be564 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received unexpected event network-vif-plugged-f7c38424-435e-481a-b1a2-6b3e7f8c7d42 for instance with vm_state building and task_state spawning.
May 27 02:58:31.653838 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ecc0fdb9-2be8-44ce-8176-5c006a073769 req-d4ff7d6e-5a62-4834-b50e-712ab6ed3f6a service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-plugged-72bf3a93-7d2a-4507-940a-d8e5fcf51f41 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:31.654013 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ecc0fdb9-2be8-44ce-8176-5c006a073769 req-d4ff7d6e-5a62-4834-b50e-712ab6ed3f6a service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:31.654218 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ecc0fdb9-2be8-44ce-8176-5c006a073769 req-d4ff7d6e-5a62-4834-b50e-712ab6ed3f6a service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:31.654353 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ecc0fdb9-2be8-44ce-8176-5c006a073769 req-d4ff7d6e-5a62-4834-b50e-712ab6ed3f6a service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:31.654488 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ecc0fdb9-2be8-44ce-8176-5c006a073769 req-d4ff7d6e-5a62-4834-b50e-712ab6ed3f6a service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Processing event network-vif-plugged-72bf3a93-7d2a-4507-940a-d8e5fcf51f41 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:58:32.533493 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:58:32.533981 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:58:33.037526 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:58:33.335732 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:33.546839 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.472s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:33.549112 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 02:58:33.626623 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "8d762a67-82b6-40d3-b625-0731ea01c45b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:33.626851 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "8d762a67-82b6-40d3-b625-0731ea01c45b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:33.685004 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Acquiring lock "82be1ace-dc06-42dd-8660-02439941fa00" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:33.686148 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "82be1ace-dc06-42dd-8660-02439941fa00" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:33.731316 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-plugged-72bf3a93-7d2a-4507-940a-d8e5fcf51f41 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:33.731316 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:33.731316 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:33.731316 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:33.731316 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] No event matching network-vif-plugged-72bf3a93-7d2a-4507-940a-d8e5fcf51f41 in dict_keys([('network-vif-plugged', 'cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3'), ('network-vif-plugged', '8eaa84fe-02ca-447a-8993-74f9a4fc8e8f'), ('network-vif-plugged', '538a6aad-d866-4a39-85f1-ec6544f540ff')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 02:58:33.731316 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received unexpected event network-vif-plugged-72bf3a93-7d2a-4507-940a-d8e5fcf51f41 for instance with vm_state building and task_state spawning.
May 27 02:58:33.731316 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-plugged-cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:33.731316 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:33.731894 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:33.733090 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:33.733090 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Processing event network-vif-plugged-cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:58:33.733090 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-plugged-cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:33.733090 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:33.733397 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:33.733645 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:33.733914 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] No event matching network-vif-plugged-cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3 in dict_keys([('network-vif-plugged', '8eaa84fe-02ca-447a-8993-74f9a4fc8e8f'), ('network-vif-plugged', '538a6aad-d866-4a39-85f1-ec6544f540ff')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 02:58:33.734148 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received unexpected event network-vif-plugged-cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3 for instance with vm_state building and task_state spawning.
May 27 02:58:33.734337 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-plugged-8eaa84fe-02ca-447a-8993-74f9a4fc8e8f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:33.734703 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:33.734988 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:33.735169 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:33.735774 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Processing event network-vif-plugged-8eaa84fe-02ca-447a-8993-74f9a4fc8e8f {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:58:33.735774 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-plugged-8eaa84fe-02ca-447a-8993-74f9a4fc8e8f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:33.735774 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:33.735774 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:33.735994 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:33.736229 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] No event matching network-vif-plugged-8eaa84fe-02ca-447a-8993-74f9a4fc8e8f in dict_keys([('network-vif-plugged', '538a6aad-d866-4a39-85f1-ec6544f540ff')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 02:58:33.736411 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received unexpected event network-vif-plugged-8eaa84fe-02ca-447a-8993-74f9a4fc8e8f for instance with vm_state building and task_state spawning.
May 27 02:58:33.736786 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Received event network-changed-85ecf3fb-ef43-44a6-836b-a5e5da02646a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:33.736786 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Refreshing instance network info cache due to event network-changed-85ecf3fb-ef43-44a6-836b-a5e5da02646a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:58:33.737071 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Acquiring lock "refresh_cache-a6c0c0f0-846a-4ffb-8f02-d43af196da22" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:58:33.737232 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Acquired lock "refresh_cache-a6c0c0f0-846a-4ffb-8f02-d43af196da22" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:58:33.738102 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Refreshing network info cache for port 85ecf3fb-ef43-44a6-836b-a5e5da02646a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:58:34.055679 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 02:58:34.055679 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 02:58:34.055679 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:34.055679 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:34.130141 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 02:58:34.141450 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1358d6b48fbe42159155175cf488804b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bb33ad146843308b381f8379c70094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 02:58:34.189573 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lazy-loading 'flavor' on Instance uuid 82be1ace-dc06-42dd-8660-02439941fa00 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:58:34.241785 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:34.556208 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 02:58:34.604264 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:34.726571 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:34.726923 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:34.730698 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 02:58:34.733776 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Claim successful on node np0000001475
May 27 02:58:34.762183 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Successfully created port: 920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:58:34.824187 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Updated VIF entry in instance network info cache for port 85ecf3fb-ef43-44a6-836b-a5e5da02646a. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 02:58:34.824507 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Updating instance_info_cache with network_info: [{"id": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "address": "fa:16:3e:f0:b1:7a", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf3fb-ef", "ovs_interfaceid": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:34.956231 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Acquiring lock "09039461-93a4-458a-886e-9783f6edaf45" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:34.956406 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Lock "09039461-93a4-458a-886e-9783f6edaf45" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:35.059222 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 02:58:35.195391 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "82be1ace-dc06-42dd-8660-02439941fa00" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:35.328636 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Releasing lock "refresh_cache-a6c0c0f0-846a-4ffb-8f02-d43af196da22" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:58:35.328636 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Received event network-changed-abb5cffe-8cbc-49eb-8f62-0014bcc3d411 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:35.328636 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Refreshing instance network info cache due to event network-changed-abb5cffe-8cbc-49eb-8f62-0014bcc3d411. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:58:35.328636 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Acquiring lock "refresh_cache-63151241-1b03-4b3c-9ecd-27703137e752" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:58:35.328636 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Acquired lock "refresh_cache-63151241-1b03-4b3c-9ecd-27703137e752" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:58:35.328636 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Refreshing network info cache for port abb5cffe-8cbc-49eb-8f62-0014bcc3d411 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:58:35.331926 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Successfully updated port: 920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:58:35.462494 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Lazy-loading 'flavor' on Instance uuid 09039461-93a4-458a-886e-9783f6edaf45 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:58:35.716513 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:35.832692 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:35.833956 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:58:35.835773 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquired lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:58:35.835773 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 02:58:36.069069 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 02:58:36.071517 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 02:58:36.072017 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Creating image(s)
May 27 02:58:36.073633 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "/opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:36.074955 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "/opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:36.076802 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "/opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:36.077624 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:58:36.084190 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:58:36.085404 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:36.180103 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.094s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:36.180103 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:36.185331 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:36.185331 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:58:36.185331 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:58:36.185595 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:36.223965 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4b039a16-881d-45c2-b80c-1de5bf776536 req-4671e21c-25aa-4f13-a9f4-39ef00eed02c service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received event network-changed-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:36.224783 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4b039a16-881d-45c2-b80c-1de5bf776536 req-4671e21c-25aa-4f13-a9f4-39ef00eed02c service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Refreshing instance network info cache due to event network-changed-920f5752-8d06-40e8-90e8-53fa42f5488d. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:58:36.227781 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b039a16-881d-45c2-b80c-1de5bf776536 req-4671e21c-25aa-4f13-a9f4-39ef00eed02c service nova] Acquiring lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:58:36.281288 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:36.283565 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.098s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:36.284116 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:36.322609 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Acquiring lock "82be1ace-dc06-42dd-8660-02439941fa00" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:36.322916 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "82be1ace-dc06-42dd-8660-02439941fa00" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:36.323071 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Attaching volume a66bfb77-3671-4de0-8ddd-0a90012d65dd to /dev/sdc
May 27 02:58:36.336843 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk 1073741824" returned: 0 in 0.050s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:36.336843 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.153s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:36.336843 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:36.412817 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:58:36.413321 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:58:36.416284 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.081s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:36.419446 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 02:58:36.421846 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:58:36.423810 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:36.444680 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 02:58:36.464952 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:58:36.471540 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Lock "09039461-93a4-458a-886e-9783f6edaf45" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:36.472967 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:36.512385 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 02:58:36.512688 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 02:58:36.518778 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:36.518778 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Cannot resize image /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 02:58:36.519106 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 02:58:36.519246 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Ensure instance console log exists: /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 02:58:36.519512 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:36.521356 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:36.521356 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:36.523614 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 02:58:36.528391 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fee1:4af7', 'fe80::2088:d9ff:fe30:a71f', 'fe80::fc16:3eff:fec9:82f2', 'fe80::8c31:51ff:fe45:f0e7', 'fe80::fc16:3eff:fef0:b17a', 'fe80::fc16:3eff:fe0e:547', 'fe80::807d:e5ff:fe89:3c7a', 'fe80::fc16:3eff:fe26:2ceb', 'fe80::dc63:41ff:fe48:d91a', 'fe80::fc16:3eff:feac:85cd', 'fe80::6cd9:f3ff:fedb:46b5', 'fe80::fc16:3eff:feb3:c1c6', 'fe80::fc16:3eff:fe0a:5341', 'fe80::fc16:3eff:fe83:102d', 'fe80::fc16:3eff:fe99:74e2', 'fe80::fc16:3eff:feb7:c7a8', 'fe80::b411:aaff:fe22:aa93', 'fe80::fc16:3eff:fe51:3d37', 'fe80::fc40:cdff:febb:ab70', 'fe80::fc16:3eff:fe81:1162', 'fe80::ac86:83ff:fe2f:8c85', 'fe80::fc16:3eff:fe62:4bbd', 'fe80::fc16:3eff:fe2e:6d18', 'fe80::fc16:3eff:fe66:2b5e', 'fe80::fc16:3eff:fe0f:1d12', 'fe80::fc16:3eff:fe28:9b06', 'fe80::905a:63ff:fe3f:a285', 'fe80::fc16:3eff:fe0f:78c6', 'fe80::304d:48ff:fe5e:ff03'] 
May 27 02:58:36.528630 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 02:58:36.528836 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 02:58:36.529149 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:36.529573 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Updating existing volume attachment record: b83171cd-0827-45d8-b6ad-de593edbed4f {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 02:58:36.559879 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Updated VIF entry in instance network info cache for port abb5cffe-8cbc-49eb-8f62-0014bcc3d411. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 02:58:36.560374 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Updating instance_info_cache with network_info: [{"id": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "address": "fa:16:3e:c9:82:f2", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb5cffe-8c", "ovs_interfaceid": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:36.704776 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:36.845984 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Updating instance_info_cache with network_info: [{"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:36.917048 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:58:36.947734 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "63151241-1b03-4b3c-9ecd-27703137e752" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:36.947944 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "63151241-1b03-4b3c-9ecd-27703137e752" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:37.065078 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Releasing lock "refresh_cache-63151241-1b03-4b3c-9ecd-27703137e752" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:58:37.065302 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-plugged-538a6aad-d866-4a39-85f1-ec6544f540ff {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:37.065493 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:37.065630 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:37.065783 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:37.065906 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Processing event network-vif-plugged-538a6aad-d866-4a39-85f1-ec6544f540ff {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:58:37.066062 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-plugged-538a6aad-d866-4a39-85f1-ec6544f540ff {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:37.066179 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:37.066304 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:37.066403 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:37.066628 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] No waiting events found dispatching network-vif-plugged-538a6aad-d866-4a39-85f1-ec6544f540ff {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:58:37.066778 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c801c4f1-372b-405e-973d-319ca8919db7 req-fcf29363-a47c-4ac2-b932-32cc53d89504 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received unexpected event network-vif-plugged-538a6aad-d866-4a39-85f1-ec6544f540ff for instance with vm_state building and task_state spawning.
May 27 02:58:37.067669 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Instance event wait completed in 8 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 02:58:37.071323 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 02:58:37.072083 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850717.0716586, 27b7be13-fa61-4916-a350-a2370d4430bb => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:58:37.072267 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] VM Resumed (Lifecycle Event)
May 27 02:58:37.075064 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Instance spawned successfully.
May 27 02:58:37.075483 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 02:58:37.107073 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 02:58:37.107397 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd', 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a66bfb77-3671-4de0-8ddd-0a90012d65dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:58:37.107702 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:37.108269 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:37.108468 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd', 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a66bfb77-3671-4de0-8ddd-0a90012d65dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 02:58:37.122624 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:37.123169 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:37.123954 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:37.126097 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:58:37.126522 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:37.126706 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:58:37.145870 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:58:37.145870 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:37.150264 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:58:37.150264 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:37.159918 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd] added
May 27 02:58:37.159918 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:58:37.159918 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:37.159918 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:37.159918 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:37.159918 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:37.159918 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:37.160242 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:58:37.160359 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0362(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:58:37.161124 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:58:37.161561 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd] added
May 27 02:58:37.161561 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:58:37.161561 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:37.161561 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:37.161561 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:37.161561 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:37.161561 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:37.161833 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:58:37.161894 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0351(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:58:37.162062 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:58:37.348725 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Releasing lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:58:37.348725 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Instance network_info: |[{"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 02:58:37.348978 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b039a16-881d-45c2-b80c-1de5bf776536 req-4671e21c-25aa-4f13-a9f4-39ef00eed02c service nova] Acquired lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:58:37.349025 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4b039a16-881d-45c2-b80c-1de5bf776536 req-4671e21c-25aa-4f13-a9f4-39ef00eed02c service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Refreshing network info cache for port 920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:58:37.351174 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Start _get_guest_xml network_info=[{"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 02:58:37.355802 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 02:58:37.356965 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-2003998951', uuid='60418cf4-cd7f-4256-ad92-cc8336802816'), owner=OwnerMeta(userid='1358d6b48fbe42159155175cf488804b', username='tempest-ServerActionsTestOtherB-1490236880-project-member', projectid='88bb33ad146843308b381f8379c70094', projectname='tempest-ServerActionsTestOtherB-1490236880'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850717.3565927) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 02:58:37.357827 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 02:58:37.358223 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 02:58:37.359357 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 02:58:37.359583 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 02:58:37.360514 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 02:58:37.360866 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 02:58:37.361017 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 02:58:37.361106 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 02:58:37.361237 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 02:58:37.361324 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 02:58:37.361417 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 02:58:37.361551 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 02:58:37.361661 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 02:58:37.361797 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 02:58:37.361899 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 02:58:37.362010 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 02:58:37.375350 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T02:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2003998951',display_name='tempest-ServerActionsTestOtherB-server-2003998951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serveractionstestotherb-server-2003998951',id=10,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg7MMihIxBG1QGB6QSTA9rrk5T7Na9nzECiQ6YZKa+5mhSSqtwAjACf4ZBO/nNtoXKyk5k1Psoc+8lMf/kcUG6+ibFAACUX2UpjW+QvgPhfAshXB22uMHukoxMZ4AS6zw==',key_name='tempest-keypair-1292561843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88bb33ad146843308b381f8379c70094',ramdisk_id='',reservation_id='r-cw0r0f6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1490236880',owner_user_name='tempest-ServerActionsTestOtherB-1490236880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1358d6b48fbe42159155175cf488804b',uuid=60418cf4-cd7f-4256-ad92-cc8336802816,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:58:37.375554 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Converting VIF {"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:37.376517 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:37.378104 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lazy-loading 'pci_devices' on Instance uuid 60418cf4-cd7f-4256-ad92-cc8336802816 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:58:37.394011 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Rebuilding instance
May 27 02:58:37.428961 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.702s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:37.429537 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 02:58:37.452420 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lazy-loading 'flavor' on Instance uuid 63151241-1b03-4b3c-9ecd-27703137e752 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:58:37.574776 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:58:37.576626 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:58:37.595630 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:58:37.597230 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:37.598510 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:37.598510 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:37.598949 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:37.599491 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:37.599904 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:37.854859 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-4b039a16-881d-45c2-b80c-1de5bf776536 req-4671e21c-25aa-4f13-a9f4-39ef00eed02c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:37.881292 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] End _get_guest_xml xml=<domain type="qemu">
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:   <uuid>60418cf4-cd7f-4256-ad92-cc8336802816</uuid>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:   <name>instance-0000000a</name>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:   <metadata>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerActionsTestOtherB-server-2003998951</nova:name>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 02:58:37</nova:creationTime>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       </nova:image>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:         <nova:user uuid="1358d6b48fbe42159155175cf488804b">tempest-ServerActionsTestOtherB-1490236880-project-member</nova:user>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:         <nova:project uuid="88bb33ad146843308b381f8379c70094">tempest-ServerActionsTestOtherB-1490236880</nova:project>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:         <nova:port uuid="920f5752-8d06-40e8-90e8-53fa42f5488d">
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:   </metadata>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     <system>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <entry name="serial">60418cf4-cd7f-4256-ad92-cc8336802816</entry>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <entry name="uuid">60418cf4-cd7f-4256-ad92-cc8336802816</entry>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     </system>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:   <os>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:   </os>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:   <features>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     <acpi/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     <tcg>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     </tcg>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:   </features>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:   <devices>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     </disk>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.config"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     </disk>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:8f:94:b9"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <target dev="tap920f5752-8d"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     </interface>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/console.log" append="off"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     </serial>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     <video>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     </video>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     </rng>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:     </memballoon>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:   </devices>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]: </domain>
May 27 02:58:37.881292 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 02:58:37.883607 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Preparing to wait for external event network-vif-plugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:58:37.883607 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:37.883607 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:37.883607 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:37.883607 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T02:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2003998951',display_name='tempest-ServerActionsTestOtherB-server-2003998951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serveractionstestotherb-server-2003998951',id=10,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg7MMihIxBG1QGB6QSTA9rrk5T7Na9nzECiQ6YZKa+5mhSSqtwAjACf4ZBO/nNtoXKyk5k1Psoc+8lMf/kcUG6+ibFAACUX2UpjW+QvgPhfAshXB22uMHukoxMZ4AS6zw==',key_name='tempest-keypair-1292561843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88bb33ad146843308b381f8379c70094',ramdisk_id='',reservation_id='r-cw0r0f6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1490236880',owner_user_name='tempest-ServerActionsTestOtherB-1490236880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1358d6b48fbe42159155175cf488804b',uuid=60418cf4-cd7f-4256-ad92-cc8336802816,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:58:37.883607 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Converting VIF {"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:37.884007 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:37.885235 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:58:37.885235 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:37.885235 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:37.885421 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:58:37.886962 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:37.887170 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03b8b391-d626-5e3d-8a47-dc389f134820', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:37.894574 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:37.899327 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:37.899555 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap920f5752-8d, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:37.899971 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap920f5752-8d, col_values=(('qos', UUID('1133e929-3cbc-4d5f-b553-7ec4eda77a15')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:37.900134 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap920f5752-8d, col_values=(('external_ids', {'iface-id': '920f5752-8d06-40e8-90e8-53fa42f5488d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:94:b9', 'vm-uuid': '60418cf4-cd7f-4256-ad92-cc8336802816'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:37.903816 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:37.909827 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:37.913123 np0000001475 nova-compute[98471]: INFO os_vif [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d')
May 27 02:58:37.941310 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 02:58:37.942961 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 02:58:37.942961 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:37.942961 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:37.975422 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Acquiring lock "09039461-93a4-458a-886e-9783f6edaf45" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:37.975422 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Lock "09039461-93a4-458a-886e-9783f6edaf45" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:37.975816 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Attaching volume 38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d to /dev/vdb
May 27 02:58:38.039593 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:58:38.052279 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 02:58:38.064690 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4a93dfe76ab455d8aa6e691b1fa34c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d191c03874150880aca259ffd3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 02:58:38.079056 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:38.095381 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 02:58:38.106489 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 02:58:38.106826 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 02:58:38.115618 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Took 38.43 seconds to spawn the instance on the hypervisor.
May 27 02:58:38.116722 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:58:38.120011 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 02:58:38.122161 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fee1:4af7', 'fe80::2088:d9ff:fe30:a71f', 'fe80::fc16:3eff:fec9:82f2', 'fe80::8c31:51ff:fe45:f0e7', 'fe80::fc16:3eff:fef0:b17a', 'fe80::fc16:3eff:fe0e:547', 'fe80::807d:e5ff:fe89:3c7a', 'fe80::fc16:3eff:fe26:2ceb', 'fe80::dc63:41ff:fe48:d91a', 'fe80::fc16:3eff:feac:85cd', 'fe80::6cd9:f3ff:fedb:46b5', 'fe80::fc16:3eff:feb3:c1c6', 'fe80::fc16:3eff:fe0a:5341', 'fe80::fc16:3eff:fe83:102d', 'fe80::fc16:3eff:fe99:74e2', 'fe80::fc16:3eff:feb7:c7a8', 'fe80::b411:aaff:fe22:aa93', 'fe80::fc16:3eff:fe51:3d37', 'fe80::fc40:cdff:febb:ab70', 'fe80::fc16:3eff:fe81:1162', 'fe80::ac86:83ff:fe2f:8c85', 'fe80::fc16:3eff:fe62:4bbd', 'fe80::fc16:3eff:fe2e:6d18', 'fe80::fc16:3eff:fe66:2b5e', 'fe80::fc16:3eff:fe0f:1d12', 'fe80::fc16:3eff:fe28:9b06', 'fe80::905a:63ff:fe3f:a285', 'fe80::fc16:3eff:fe0f:78c6', 'fe80::304d:48ff:fe5e:ff03'] 
May 27 02:58:38.125506 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 02:58:38.125765 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 02:58:38.126061 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:38.127559 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Updating existing volume attachment record: 84f89797-a1ca-4a1d-918d-aa8ec35ffe92 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 02:58:38.161891 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:58:38.162638 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:38.184069 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:38.184069 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:38.192053 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:38.192053 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:38.200788 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:38.211814 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:38.233223 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:38.239020 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:38.298533 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd, portal: 192.168.50.100,3260]
May 27 02:58:38.298533 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd, portal: 192.168.50.100,3260] successful.
May 27 02:58:38.298533 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:38.309829 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd, portal: 192.168.40.100,3260]
May 27 02:58:38.309829 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd, portal: 192.168.40.100,3260] successful.
May 27 02:58:38.309829 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:38.312309 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:38.325470 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-4b039a16-881d-45c2-b80c-1de5bf776536 req-4671e21c-25aa-4f13-a9f4-39ef00eed02c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:38.327944 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:38.341109 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:38.341109 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:38.341109 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:38.341109 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:38.341109 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:38.341109 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:38.341109 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:38.341109 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:38.341109 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:38.341109 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:38.341109 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:38.341109 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:38.341109 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:38.341109 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:38.341109 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:38.341109 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:38.341109 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:38.341647 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:38.341647 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:38.341647 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:38.341647 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:38.341647 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:38.341647 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:38.341647 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:38.341647 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:38.341647 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:38.341647 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:38.341647 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:38.341647 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:38.341647 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:38.341647 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:38.341647 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:38.341647 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:38.341647 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:38.341647 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:38.342222 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:38.344408 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] HCTL ('21', '-', '-', 0) found on session 21 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:38.344499 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:38.356693 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:38.359360 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.233s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:38.359360 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:38.363932 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Searching for a device in session 21 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:38.364137 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a66bfb77-3671-4de0-8ddd-0a90012d65dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:38.366405 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] HCTL ('22', '-', '-', 0) found on session 22 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:38.367221 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:38.385800 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Searching for a device in session 22 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:38.385800 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a66bfb77-3671-4de0-8ddd-0a90012d65dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:38.441980 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 02:58:38.467514 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "63151241-1b03-4b3c-9ecd-27703137e752" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.519s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:38.560064 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4b039a16-881d-45c2-b80c-1de5bf776536 req-4671e21c-25aa-4f13-a9f4-39ef00eed02c service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Updated VIF entry in instance network info cache for port 920f5752-8d06-40e8-90e8-53fa42f5488d. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 02:58:38.560341 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4b039a16-881d-45c2-b80c-1de5bf776536 req-4671e21c-25aa-4f13-a9f4-39ef00eed02c service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Updating instance_info_cache with network_info: [{"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:38.640025 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Took 51.78 seconds to build instance.
May 27 02:58:38.655935 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:38.688956 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:38.695467 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:38.721456 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 02:58:38.721456 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:58:38.721456 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:38.728037 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:38.912821 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Successfully created port: 2104125d-e30e-4450-8186-54d776011dcd {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:58:38.946489 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 02:58:38.966048 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999597143000074 future=<Future at 0x7557247bbdd0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:58:38.968996 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.996769263000033 future=<Future at 0x7557247bbdd0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:58:38.969082 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.996550036999906 future=<Future at 0x7557247bbdd0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:58:38.979221 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-06ad8ead-2f97-4be8-a0b4-c3ee277c3fa8 req-648e1a48-8825-4a55-84d0-75ecd58f5c25 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received event network-vif-unplugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:38.982089 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Instance destroyed successfully.
May 27 02:58:38.982089 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-06ad8ead-2f97-4be8-a0b4-c3ee277c3fa8 req-648e1a48-8825-4a55-84d0-75ecd58f5c25 service nova] Acquiring lock "7c0291f5-62af-417b-9418-41d808856a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:38.982089 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-06ad8ead-2f97-4be8-a0b4-c3ee277c3fa8 req-648e1a48-8825-4a55-84d0-75ecd58f5c25 service nova] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:38.982089 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-06ad8ead-2f97-4be8-a0b4-c3ee277c3fa8 req-648e1a48-8825-4a55-84d0-75ecd58f5c25 service nova] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:38.982089 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-06ad8ead-2f97-4be8-a0b4-c3ee277c3fa8 req-648e1a48-8825-4a55-84d0-75ecd58f5c25 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] No waiting events found dispatching network-vif-unplugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:58:38.982089 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-06ad8ead-2f97-4be8-a0b4-c3ee277c3fa8 req-648e1a48-8825-4a55-84d0-75ecd58f5c25 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received unexpected event network-vif-unplugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a for instance with vm_state active and task_state rebuilding.
May 27 02:58:38.991022 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Instance destroyed successfully.
May 27 02:58:38.992004 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-424293934',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serveractionsv293testjson-server-1629751309',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD01cBGq/IkOVvMiNNSEzke/Ew4L0jaQY97yIGPfSv1JXwnxRa+HmYDFmBWFxgN0p371J80Ye8vuUhMxKGiaH6IKyRaiveYFSXCzEZJC6BeRyymyWvE7WXoWHiN9My+zCA==',key_name='tempest-keypair-795165112',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:57:55Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='36131e6324ff45ddb65932f4ade9a1a8',ramdisk_id='',reservation_id='r-hxvg0h83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48155fdd-4ef0-4719-a052-7861f417b7f0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-450650320',owner_user_name='tempest-ServerActionsV293TestJSON-450650320-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d4ecd608df47c6b6057f74772ef553',uuid=7c0291f5-62af-417b-9418-41d808856a8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "address": "fa:16:3e:26:2c:eb", "network": {"id": "c7f25d43-cc3f-4be2-b8f5-311363bbd4ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1793934555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36131e6324ff45ddb65932f4ade9a1a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f6cb37-5c", "ovs_interfaceid": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:58:38.992173 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Converting VIF {"id": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "address": "fa:16:3e:26:2c:eb", "network": {"id": "c7f25d43-cc3f-4be2-b8f5-311363bbd4ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1793934555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36131e6324ff45ddb65932f4ade9a1a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f6cb37-5c", "ovs_interfaceid": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:38.992644 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:2c:eb,bridge_name='br-int',has_traffic_filtering=True,id=51f6cb37-5c11-47c2-bf1c-d072ecfff71a,network=Network(c7f25d43-cc3f-4be2-b8f5-311363bbd4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f6cb37-5c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:38.992968 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:2c:eb,bridge_name='br-int',has_traffic_filtering=True,id=51f6cb37-5c11-47c2-bf1c-d072ecfff71a,network=Network(c7f25d43-cc3f-4be2-b8f5-311363bbd4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f6cb37-5c') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:58:38.995818 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:38.996472 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51f6cb37-5c, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:38.999931 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:39.007779 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:39.010058 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:39.010262 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2bc35210-6bdb-466a-b73f-9bccb803eada) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:39.015399 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:39.023677 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:39.026527 np0000001475 nova-compute[98471]: INFO os_vif [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:2c:eb,bridge_name='br-int',has_traffic_filtering=True,id=51f6cb37-5c11-47c2-bf1c-d072ecfff71a,network=Network(c7f25d43-cc3f-4be2-b8f5-311363bbd4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f6cb37-5c')
May 27 02:58:39.029671 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 02:58:39.030060 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:58:39.030180 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:39.063108 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b039a16-881d-45c2-b80c-1de5bf776536 req-4671e21c-25aa-4f13-a9f4-39ef00eed02c service nova] Releasing lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:58:39.128936 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 02:58:39.141347 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77830800-58de-4621-8f06-2ead89791a5e tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "27b7be13-fa61-4916-a350-a2370d4430bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 53.286s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:39.441628 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:39.441834 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:39.441961 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] No VIF found with MAC fa:16:3e:8f:94:b9, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:58:39.442505 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Using config drive
May 27 02:58:39.573617 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Successfully updated port: 2104125d-e30e-4450-8186-54d776011dcd {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:58:39.580616 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "63151241-1b03-4b3c-9ecd-27703137e752" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:39.580908 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "63151241-1b03-4b3c-9ecd-27703137e752" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:39.581266 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Attaching volume a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd to /dev/vdb
May 27 02:58:39.646975 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:58:39.660519 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 02:58:39.685823 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:39.716610 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 02:58:39.717359 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 02:58:39.728603 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 02:58:39.732108 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fee1:4af7', 'fe80::2088:d9ff:fe30:a71f', 'fe80::fc16:3eff:fec9:82f2', 'fe80::8c31:51ff:fe45:f0e7', 'fe80::fc16:3eff:fef0:b17a', 'fe80::fc16:3eff:fe0e:547', 'fe80::807d:e5ff:fe89:3c7a', 'fe80::fc16:3eff:feac:85cd', 'fe80::6cd9:f3ff:fedb:46b5', 'fe80::fc16:3eff:feb3:c1c6', 'fe80::fc16:3eff:fe0a:5341', 'fe80::fc16:3eff:fe83:102d', 'fe80::fc16:3eff:fe99:74e2', 'fe80::fc16:3eff:feb7:c7a8', 'fe80::b411:aaff:fe22:aa93', 'fe80::fc16:3eff:fe51:3d37', 'fe80::fc40:cdff:febb:ab70', 'fe80::fc16:3eff:fe81:1162', 'fe80::ac86:83ff:fe2f:8c85', 'fe80::fc16:3eff:fe62:4bbd', 'fe80::fc16:3eff:fe2e:6d18', 'fe80::fc16:3eff:fe66:2b5e', 'fe80::fc16:3eff:fe0f:1d12', 'fe80::fc16:3eff:fe28:9b06', 'fe80::905a:63ff:fe3f:a285', 'fe80::fc16:3eff:fe0f:78c6', 'fe80::304d:48ff:fe5e:ff03'] 
May 27 02:58:39.732235 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 02:58:39.732373 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 02:58:39.733320 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:39.733647 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Updating existing volume attachment record: a72d6aeb-2b5c-45d1-ab01-878146e3439a {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 02:58:39.744901 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a72b959a-700e-44d4-bd3d-5973568ceb2d req-752f988d-220b-4725-b7db-106f77c87d00 service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Received event network-changed-2104125d-e30e-4450-8186-54d776011dcd {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:39.744901 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a72b959a-700e-44d4-bd3d-5973568ceb2d req-752f988d-220b-4725-b7db-106f77c87d00 service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Refreshing instance network info cache due to event network-changed-2104125d-e30e-4450-8186-54d776011dcd. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:58:39.746837 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a72b959a-700e-44d4-bd3d-5973568ceb2d req-752f988d-220b-4725-b7db-106f77c87d00 service nova] Acquiring lock "refresh_cache-8d762a67-82b6-40d3-b625-0731ea01c45b" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:58:39.746837 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a72b959a-700e-44d4-bd3d-5973568ceb2d req-752f988d-220b-4725-b7db-106f77c87d00 service nova] Acquired lock "refresh_cache-8d762a67-82b6-40d3-b625-0731ea01c45b" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:58:39.746837 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a72b959a-700e-44d4-bd3d-5973568ceb2d req-752f988d-220b-4725-b7db-106f77c87d00 service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Refreshing network info cache for port 2104125d-e30e-4450-8186-54d776011dcd {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:58:39.954178 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:39.959080 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 02:58:39.960505 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 02:58:39.960802 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Creating image(s)
May 27 02:58:39.961380 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:39.961573 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "/opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:39.962104 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "/opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:39.962625 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:58:39.966262 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:58:39.970294 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:40.048463 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.078s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:40.049165 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:40.049588 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:40.050022 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:58:40.052760 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:58:40.053123 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:40.077843 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "refresh_cache-8d762a67-82b6-40d3-b625-0731ea01c45b" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:58:40.127523 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Creating config drive at /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.config
May 27 02:58:40.132757 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyq26li5n {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:40.145220 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Found WWN 330000000377611a0 for multipath device dm-13 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 02:58:40.146244 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:40.146518 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000377611a0', 'path': '/dev/dm-13', 'multipath_id': '330000000377611a0'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:40.146811 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000377611a0', 'path': '/dev/dm-13', 'multipath_id': '330000000377611a0'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 02:58:40.148769 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.427s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:40.149152 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 02:58:40.150194 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.096s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:40.151968 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:40.172434 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:40.173814 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyq26li5n" returned: 0 in 0.041s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:40.175529 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:40.177120 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:40.177546 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:58:40.178193 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:40.178477 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:58:40.179207 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lazy-loading 'flavor' on Instance uuid 82be1ace-dc06-42dd-8660-02439941fa00 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:58:40.188822 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:58:40.188822 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:40.192225 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk 1073741824" returned: 0 in 0.040s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:40.192660 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.143s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:40.193073 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:40.211231 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d] added
May 27 02:58:40.211231 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:58:40.211231 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:40.211231 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:40.211231 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:40.211231 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:40.211231 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:40.211231 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:58:40.211231 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:58:40.211231 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:58:40.211612 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:58:40.211612 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:40.222448 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d] added
May 27 02:58:40.222448 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:58:40.222448 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:40.222448 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:40.222448 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:40.222448 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:40.222448 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:40.222649 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:58:40.222798 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0443(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:58:40.222924 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:58:40.248635 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-a72b959a-700e-44d4-bd3d-5973568ceb2d req-752f988d-220b-4725-b7db-106f77c87d00 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:40.285880 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.093s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:40.286280 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 02:58:40.286552 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:40.307136 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 02:58:40.307642 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:58:40.307933 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:40.337280 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a72b959a-700e-44d4-bd3d-5973568ceb2d req-752f988d-220b-4725-b7db-106f77c87d00 service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:58:40.390382 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:40.390586 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Cannot resize image /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 02:58:40.390994 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 02:58:40.391154 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Ensure instance console log exists: /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 02:58:40.391403 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:40.391559 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:40.391684 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:40.481126 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-de20a6c2-e2b0-442a-a6ce-8e72283b7441 req-c5e604ee-3514-4d9a-ae1e-45cdbbf0c114 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-changed-f7c38424-435e-481a-b1a2-6b3e7f8c7d42 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:40.481336 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-de20a6c2-e2b0-442a-a6ce-8e72283b7441 req-c5e604ee-3514-4d9a-ae1e-45cdbbf0c114 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Refreshing instance network info cache due to event network-changed-f7c38424-435e-481a-b1a2-6b3e7f8c7d42. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:58:40.481954 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-de20a6c2-e2b0-442a-a6ce-8e72283b7441 req-c5e604ee-3514-4d9a-ae1e-45cdbbf0c114 service nova] Acquiring lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:58:40.481992 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-de20a6c2-e2b0-442a-a6ce-8e72283b7441 req-c5e604ee-3514-4d9a-ae1e-45cdbbf0c114 service nova] Acquired lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:58:40.482142 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-de20a6c2-e2b0-442a-a6ce-8e72283b7441 req-c5e604ee-3514-4d9a-ae1e-45cdbbf0c114 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Refreshing network info cache for port f7c38424-435e-481a-b1a2-6b3e7f8c7d42 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:58:40.522375 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a72b959a-700e-44d4-bd3d-5973568ceb2d req-752f988d-220b-4725-b7db-106f77c87d00 service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:40.631856 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:40.672389 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:40.687972 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] attach device xml: <disk type="block" device="disk">
May 27 02:58:40.687972 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:58:40.687972 np0000001475 nova-compute[98471]:   <alias name="ua-a66bfb77-3671-4de0-8ddd-0a90012d65dd"/>
May 27 02:58:40.687972 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-13"/>
May 27 02:58:40.687972 np0000001475 nova-compute[98471]:   <target dev="sdc" bus="scsi"/>
May 27 02:58:40.687972 np0000001475 nova-compute[98471]:   <serial>a66bfb77-3671-4de0-8ddd-0a90012d65dd</serial>
May 27 02:58:40.687972 np0000001475 nova-compute[98471]:   <address type="drive" controller="0" unit="2"/>
May 27 02:58:40.687972 np0000001475 nova-compute[98471]: </disk>
May 27 02:58:40.687972 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 02:58:40.719960 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:40.774218 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:40.988766 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-de20a6c2-e2b0-442a-a6ce-8e72283b7441 req-c5e604ee-3514-4d9a-ae1e-45cdbbf0c114 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:41.024195 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a72b959a-700e-44d4-bd3d-5973568ceb2d req-752f988d-220b-4725-b7db-106f77c87d00 service nova] Releasing lock "refresh_cache-8d762a67-82b6-40d3-b625-0731ea01c45b" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:58:41.024699 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquired lock "refresh_cache-8d762a67-82b6-40d3-b625-0731ea01c45b" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:58:41.025107 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 02:58:41.032981 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:41.041417 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:41.067439 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:41.082671 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-92a48bf9-7a0b-4a67-8c09-28eb4132549d req-e2e15536-7b5b-4016-ac96-64c3cafff662 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received event network-vif-unplugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:41.082671 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-92a48bf9-7a0b-4a67-8c09-28eb4132549d req-e2e15536-7b5b-4016-ac96-64c3cafff662 service nova] Acquiring lock "7c0291f5-62af-417b-9418-41d808856a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:41.082984 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-92a48bf9-7a0b-4a67-8c09-28eb4132549d req-e2e15536-7b5b-4016-ac96-64c3cafff662 service nova] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:41.083413 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-92a48bf9-7a0b-4a67-8c09-28eb4132549d req-e2e15536-7b5b-4016-ac96-64c3cafff662 service nova] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:41.083782 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-92a48bf9-7a0b-4a67-8c09-28eb4132549d req-e2e15536-7b5b-4016-ac96-64c3cafff662 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] No waiting events found dispatching network-vif-unplugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:58:41.084006 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-92a48bf9-7a0b-4a67-8c09-28eb4132549d req-e2e15536-7b5b-4016-ac96-64c3cafff662 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received unexpected event network-vif-unplugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a for instance with vm_state active and task_state rebuilding.
May 27 02:58:41.211086 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:58:41.223869 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:41.225823 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:41.225823 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:41.236660 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:41.236660 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:41.244465 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:41.251777 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:41.267569 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:41.267569 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:41.267569 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:41.267569 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:41.267569 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:41.267569 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:41.267569 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:41.267569 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:41.267569 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:41.267569 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:41.267569 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:41.267569 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:41.267569 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:41.267569 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:41.267569 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:41.267569 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:41.267569 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:41.270508 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:41.270508 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:41.270508 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:41.270508 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:41.270508 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:41.270508 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:41.270508 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:41.270508 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:41.270508 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:41.270508 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:41.270508 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:41.270508 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:41.270508 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:41.270508 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:41.270508 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:41.270508 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:41.270508 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:41.280080 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:41.280080 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:41.280080 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:41.280080 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:41.280080 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:41.280080 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:41.280080 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:41.280080 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:41.280080 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:41.280080 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:41.280080 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:41.280080 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:41.280080 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:41.280080 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:41.280080 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:41.280080 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:41.280080 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:41.280488 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:41.280488 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:41.280488 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:41.280488 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:41.280488 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:41.280488 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:41.280488 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:41.280488 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:41.280488 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:41.280488 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:41.280488 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:41.280488 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:41.280488 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:41.280488 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:41.280488 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:41.280488 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:41.280488 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:41.338822 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d, portal: 192.168.40.100,3260]
May 27 02:58:41.338822 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d, portal: 192.168.40.100,3260] successful.
May 27 02:58:41.338822 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:41.351373 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:41.355525 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d, portal: 192.168.50.100,3260]
May 27 02:58:41.355525 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d, portal: 192.168.50.100,3260] successful.
May 27 02:58:41.355525 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:41.373869 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:41.381271 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:41.381271 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:41.381271 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:41.381271 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:41.381271 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:41.381271 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:41.381271 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:41.381271 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:41.381271 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:41.381271 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:41.381271 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:41.381271 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:41.381271 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:41.381271 np0000001475 nova-compute[98471]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:41.381271 np0000001475 nova-compute[98471]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:41.381271 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:41.381271 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:41.381271 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:41.381271 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:41.381948 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:41.381948 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:41.381948 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:41.381948 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:41.381948 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:41.381948 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:41.381948 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:41.381948 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:41.381948 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:41.381948 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:41.381948 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:41.381948 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:41.381948 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:41.381948 np0000001475 nova-compute[98471]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:41.381948 np0000001475 nova-compute[98471]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:41.381948 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:41.381948 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:41.381948 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:41.381948 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:41.382612 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.208s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:41.382916 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:41.385275 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] HCTL ('23', '-', '-', 0) found on session 23 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:41.385435 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Scanning host 23 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:41.401579 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:41.401579 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:41.401579 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:41.401579 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:41.401579 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:41.401579 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:41.401579 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:41.401579 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:41.401579 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:41.401579 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:41.401579 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:41.401579 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:41.401579 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:41.401579 np0000001475 nova-compute[98471]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:41.401579 np0000001475 nova-compute[98471]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:41.401579 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:41.401579 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:41.401579 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:41.401579 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:41.402058 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:41.402058 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:41.402058 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:41.402058 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:41.402058 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:41.402058 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:41.402058 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:41.402058 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:41.402058 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:41.402058 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:41.402058 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:41.402058 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:41.402058 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:41.402058 np0000001475 nova-compute[98471]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:41.402058 np0000001475 nova-compute[98471]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:41.402058 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:41.402058 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:41.402058 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:41.402058 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:41.402383 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.224s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:41.402383 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:41.406429 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Searching for a device in session 23 and hctl ['23', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:41.407311 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] HCTL ('24', '-', '-', 0) found on session 24 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:41.407496 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Scanning host 24 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:41.431496 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Searching for a device in session 24 and hctl ['24', '*', '*', 0] yield: sds {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:41.431654 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Connected to sds using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:41.457565 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-de20a6c2-e2b0-442a-a6ce-8e72283b7441 req-c5e604ee-3514-4d9a-ae1e-45cdbbf0c114 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:41.627146 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:58:41.659552 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-de20a6c2-e2b0-442a-a6ce-8e72283b7441 req-c5e604ee-3514-4d9a-ae1e-45cdbbf0c114 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Updated VIF entry in instance network info cache for port f7c38424-435e-481a-b1a2-6b3e7f8c7d42. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 02:58:41.660248 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-de20a6c2-e2b0-442a-a6ce-8e72283b7441 req-c5e604ee-3514-4d9a-ae1e-45cdbbf0c114 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Updating instance_info_cache with network_info: [{"id": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "address": "fa:16:3e:81:11:62", "network": {"id": "7552b8e6-0e85-4f88-9104-5524c033e9f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-38877104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c38424-43", "ovs_interfaceid": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "address": "fa:16:3e:62:4b:bd", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72bf3a93-7d", "ovs_interfaceid": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "address": "fa:16:3e:2e:6d:18", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbdd2d0b-2f", "ovs_interfaceid": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "address": "fa:16:3e:66:2b:5e", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaa84fe-02", "ovs_interfaceid": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "538a6aad-d866-4a39-85f1-ec6544f540ff", "address": "fa:16:3e:0f:1d:12", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap538a6aad-d8", "ovs_interfaceid": "538a6aad-d866-4a39-85f1-ec6544f540ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "address": "fa:16:3e:28:9b:06", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdaf3b03-8e", "ovs_interfaceid": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "address": "fa:16:3e:0f:78:c6", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad76a2d7-6a", "ovs_interfaceid": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:41.799451 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:41.803062 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850721.8026814, 60418cf4-cd7f-4256-ad92-cc8336802816 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:58:41.803406 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] VM Started (Lifecycle Event)
May 27 02:58:41.819336 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2dd20cca-0020-4073-b52f-c5b0e6df04eb req-96fb9a1f-36ba-442d-9cbc-fbd76246dd4e service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received event network-vif-plugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:41.823054 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2dd20cca-0020-4073-b52f-c5b0e6df04eb req-96fb9a1f-36ba-442d-9cbc-fbd76246dd4e service nova] Acquiring lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:41.823238 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2dd20cca-0020-4073-b52f-c5b0e6df04eb req-96fb9a1f-36ba-442d-9cbc-fbd76246dd4e service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:41.823372 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2dd20cca-0020-4073-b52f-c5b0e6df04eb req-96fb9a1f-36ba-442d-9cbc-fbd76246dd4e service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:41.823495 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2dd20cca-0020-4073-b52f-c5b0e6df04eb req-96fb9a1f-36ba-442d-9cbc-fbd76246dd4e service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Processing event network-vif-plugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:58:41.823667 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2dd20cca-0020-4073-b52f-c5b0e6df04eb req-96fb9a1f-36ba-442d-9cbc-fbd76246dd4e service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received event network-vif-plugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:41.823857 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2dd20cca-0020-4073-b52f-c5b0e6df04eb req-96fb9a1f-36ba-442d-9cbc-fbd76246dd4e service nova] Acquiring lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:41.824096 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2dd20cca-0020-4073-b52f-c5b0e6df04eb req-96fb9a1f-36ba-442d-9cbc-fbd76246dd4e service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:41.824196 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2dd20cca-0020-4073-b52f-c5b0e6df04eb req-96fb9a1f-36ba-442d-9cbc-fbd76246dd4e service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:41.824297 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2dd20cca-0020-4073-b52f-c5b0e6df04eb req-96fb9a1f-36ba-442d-9cbc-fbd76246dd4e service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] No waiting events found dispatching network-vif-plugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:58:41.824398 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-2dd20cca-0020-4073-b52f-c5b0e6df04eb req-96fb9a1f-36ba-442d-9cbc-fbd76246dd4e service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received unexpected event network-vif-plugged-920f5752-8d06-40e8-90e8-53fa42f5488d for instance with vm_state building and task_state spawning.
May 27 02:58:41.825931 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 02:58:41.828541 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 02:58:41.831189 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Instance spawned successfully.
May 27 02:58:41.831583 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 02:58:41.947231 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Updating instance_info_cache with network_info: [{"id": "2104125d-e30e-4450-8186-54d776011dcd", "address": "fa:16:3e:9d:6d:1f", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2104125d-e3", "ovs_interfaceid": "2104125d-e30e-4450-8186-54d776011dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:42.163897 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-de20a6c2-e2b0-442a-a6ce-8e72283b7441 req-c5e604ee-3514-4d9a-ae1e-45cdbbf0c114 service nova] Releasing lock "refresh_cache-27b7be13-fa61-4916-a350-a2370d4430bb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:58:42.305954 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:58:42.307366 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:58:42.341106 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:42.341106 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:42.341106 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:42.341106 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:42.341264 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:42.341462 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:42.407908 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Searching for a device in session 23 and hctl ['23', '*', '*', 0] yield: sdr {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:42.407908 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:42.449120 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Releasing lock "refresh_cache-8d762a67-82b6-40d3-b625-0731ea01c45b" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:58:42.449394 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Instance network_info: |[{"id": "2104125d-e30e-4450-8186-54d776011dcd", "address": "fa:16:3e:9d:6d:1f", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2104125d-e3", "ovs_interfaceid": "2104125d-e30e-4450-8186-54d776011dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 02:58:42.451058 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Start _get_guest_xml network_info=[{"id": "2104125d-e30e-4450-8186-54d776011dcd", "address": "fa:16:3e:9d:6d:1f", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2104125d-e3", "ovs_interfaceid": "2104125d-e30e-4450-8186-54d776011dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 02:58:42.452551 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 02:58:42.453633 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-519260389', uuid='8d762a67-82b6-40d3-b625-0731ea01c45b'), owner=OwnerMeta(userid='d4a93dfe76ab455d8aa6e691b1fa34c5', username='tempest-ServerActionsTestOtherA-569974590-project-member', projectid='233d191c03874150880aca259ffd3e21', projectname='tempest-ServerActionsTestOtherA-569974590'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2104125d-e30e-4450-8186-54d776011dcd", "address": "fa:16:3e:9d:6d:1f", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2104125d-e3", "ovs_interfaceid": "2104125d-e30e-4450-8186-54d776011dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850722.4532845) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 02:58:42.454432 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 02:58:42.454817 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 02:58:42.455496 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 02:58:42.455689 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 02:58:42.456730 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 02:58:42.457082 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 02:58:42.457252 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 02:58:42.457362 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 02:58:42.457516 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 02:58:42.457620 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 02:58:42.457736 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 02:58:42.457928 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 02:58:42.458046 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 02:58:42.458151 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 02:58:42.458246 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 02:58:42.458358 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 02:58:42.469352 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T02:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-519260389',display_name='tempest-ServerActionsTestOtherA-server-519260389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serveractionstestothera-server-519260389',id=11,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVtCwqB5huD2R7WzeA2srtQrNLcY+5mh0PDFl9uXrLaNb8RbC2WmzNWR2uyfN3usptF21zcnp9tnWTIUBUOIX7SXlA+BK0+YEfHYyX09pbtKTE7qcopOd9351hytyFXVA==',key_name='tempest-keypair-2100360487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='233d191c03874150880aca259ffd3e21',ramdisk_id='',reservation_id='r-9nyx1hox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-569974590',owner_user_name='tempest-ServerActionsTestOtherA-569974590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:58:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a93dfe76ab455d8aa6e691b1fa34c5',uuid=8d762a67-82b6-40d3-b625-0731ea01c45b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2104125d-e30e-4450-8186-54d776011dcd", "address": "fa:16:3e:9d:6d:1f", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2104125d-e3", "ovs_interfaceid": "2104125d-e30e-4450-8186-54d776011dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:58:42.469940 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converting VIF {"id": "2104125d-e30e-4450-8186-54d776011dcd", "address": "fa:16:3e:9d:6d:1f", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2104125d-e3", "ovs_interfaceid": "2104125d-e30e-4450-8186-54d776011dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:42.470402 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:6d:1f,bridge_name='br-int',has_traffic_filtering=True,id=2104125d-e30e-4450-8186-54d776011dcd,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2104125d-e3') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:42.470578 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d762a67-82b6-40d3-b625-0731ea01c45b {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:58:42.509950 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] No BDM found with device name sda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:42.510141 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:42.510215 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] No BDM found with device name sdc, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:42.510322 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] No VIF found with MAC fa:16:3e:e1:4a:f7, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:58:42.809953 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 02:58:42.810202 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850722.8099988, 60418cf4-cd7f-4256-ad92-cc8336802816 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:58:42.810311 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] VM Paused (Lifecycle Event)
May 27 02:58:42.850354 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Took 6.78 seconds to spawn the instance on the hypervisor.
May 27 02:58:42.850565 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:58:42.973167 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] End _get_guest_xml xml=<domain type="qemu">
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:   <uuid>8d762a67-82b6-40d3-b625-0731ea01c45b</uuid>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:   <name>instance-0000000b</name>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:   <metadata>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerActionsTestOtherA-server-519260389</nova:name>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 02:58:42</nova:creationTime>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       </nova:image>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:         <nova:user uuid="d4a93dfe76ab455d8aa6e691b1fa34c5">tempest-ServerActionsTestOtherA-569974590-project-member</nova:user>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:         <nova:project uuid="233d191c03874150880aca259ffd3e21">tempest-ServerActionsTestOtherA-569974590</nova:project>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:         <nova:port uuid="2104125d-e30e-4450-8186-54d776011dcd">
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:   </metadata>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     <system>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <entry name="serial">8d762a67-82b6-40d3-b625-0731ea01c45b</entry>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <entry name="uuid">8d762a67-82b6-40d3-b625-0731ea01c45b</entry>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     </system>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:   <os>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:   </os>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:   <features>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     <acpi/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     <tcg>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     </tcg>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:   </features>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:   <devices>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     </disk>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk.config"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     </disk>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:9d:6d:1f"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <target dev="tap2104125d-e3"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     </interface>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/console.log" append="off"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     </serial>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     <video>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     </video>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     </rng>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:     </memballoon>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:   </devices>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]: </domain>
May 27 02:58:42.973167 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 02:58:42.975542 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Preparing to wait for external event network-vif-plugged-2104125d-e30e-4450-8186-54d776011dcd {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:58:42.975542 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "8d762a67-82b6-40d3-b625-0731ea01c45b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:42.975542 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "8d762a67-82b6-40d3-b625-0731ea01c45b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:42.975542 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "8d762a67-82b6-40d3-b625-0731ea01c45b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:42.975542 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T02:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-519260389',display_name='tempest-ServerActionsTestOtherA-server-519260389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serveractionstestothera-server-519260389',id=11,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVtCwqB5huD2R7WzeA2srtQrNLcY+5mh0PDFl9uXrLaNb8RbC2WmzNWR2uyfN3usptF21zcnp9tnWTIUBUOIX7SXlA+BK0+YEfHYyX09pbtKTE7qcopOd9351hytyFXVA==',key_name='tempest-keypair-2100360487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='233d191c03874150880aca259ffd3e21',ramdisk_id='',reservation_id='r-9nyx1hox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-569974590',owner_user_name='tempest-ServerActionsTestOtherA-569974590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:58:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a93dfe76ab455d8aa6e691b1fa34c5',uuid=8d762a67-82b6-40d3-b625-0731ea01c45b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2104125d-e30e-4450-8186-54d776011dcd", "address": "fa:16:3e:9d:6d:1f", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2104125d-e3", "ovs_interfaceid": "2104125d-e30e-4450-8186-54d776011dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:58:42.975542 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converting VIF {"id": "2104125d-e30e-4450-8186-54d776011dcd", "address": "fa:16:3e:9d:6d:1f", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2104125d-e3", "ovs_interfaceid": "2104125d-e30e-4450-8186-54d776011dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:42.975542 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:6d:1f,bridge_name='br-int',has_traffic_filtering=True,id=2104125d-e30e-4450-8186-54d776011dcd,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2104125d-e3') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:42.975542 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:6d:1f,bridge_name='br-int',has_traffic_filtering=True,id=2104125d-e30e-4450-8186-54d776011dcd,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2104125d-e3') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:58:42.975542 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:42.976058 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:42.976058 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:58:42.979403 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:42.979572 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '845b89f8-ed1f-5e43-bf0e-ad7c132a19c2', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:42.981339 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:42.982101 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:42.986013 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:42.986256 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2104125d-e3, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:42.986793 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2104125d-e3, col_values=(('qos', UUID('8422aec0-1198-4926-80e5-7cb061735ed2')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:42.987025 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2104125d-e3, col_values=(('external_ids', {'iface-id': '2104125d-e30e-4450-8186-54d776011dcd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:6d:1f', 'vm-uuid': '8d762a67-82b6-40d3-b625-0731ea01c45b'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:42.989290 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:42.995589 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:42.996707 np0000001475 nova-compute[98471]: INFO os_vif [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:6d:1f,bridge_name='br-int',has_traffic_filtering=True,id=2104125d-e30e-4450-8186-54d776011dcd,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2104125d-e3')
May 27 02:58:43.197546 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Found WWN 3300000007000e5ad for multipath device dm-14 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 02:58:43.198099 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.049s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:43.198099 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] <== connect_volume: return (4476ms) {'type': 'block', 'scsi_wwn': '3300000007000e5ad', 'path': '/dev/dm-14', 'multipath_id': '3300000007000e5ad'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:43.198481 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007000e5ad', 'path': '/dev/dm-14', 'multipath_id': '3300000007000e5ad'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 02:58:43.199036 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 4.169s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:43.201522 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 02:58:43.201522 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 02:58:43.204048 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Lazy-loading 'flavor' on Instance uuid 09039461-93a4-458a-886e-9783f6edaf45 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:58:43.239671 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:43.239671 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:43.239671 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:43.239671 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:43.239671 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:43.239671 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:43.239671 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:43.239671 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:43.239671 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:43.239671 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:43.239671 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:43.239671 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:43.239671 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:43.239671 np0000001475 nova-compute[98471]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:43.239671 np0000001475 nova-compute[98471]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:43.239671 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:43.239671 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:43.239671 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:43.239671 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:43.240140 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:43.240140 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:43.240140 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:43.240140 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:43.240140 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:43.240140 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:43.240140 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:43.240140 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:43.240140 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:43.240140 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:43.240140 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:43.240140 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:43.240140 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:43.240140 np0000001475 nova-compute[98471]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:43.240140 np0000001475 nova-compute[98471]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:43.240140 np0000001475 nova-compute[98471]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:43.240140 np0000001475 nova-compute[98471]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:43.240140 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:43.240140 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:43.240140 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', '9')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 02:58:43.240505 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '5')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:58:43.242302 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '6')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:58:43.243940 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755724788900>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41'): ({'sdc'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 02:58:43.244232 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Removing multipathed devices sdb, sdc {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 02:58:43.244517 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Flush multipath device 330000000dfd8a205 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 02:58:43.305082 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:58:43.313016 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:58:43.315334 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850723.3149796, 60418cf4-cd7f-4256-ad92-cc8336802816 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:58:43.315982 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] VM Resumed (Lifecycle Event)
May 27 02:58:43.354481 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:58:43.362266 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Took 12.35 seconds to build instance.
May 27 02:58:43.396498 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 02:58:43.396725 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 02:58:43.399120 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 02:58:43.412484 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 02:58:43.412781 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 02:58:43.428351 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:43.473213 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, portal: 192.168.40.100,3260]
May 27 02:58:43.473213 np0000001475 nova-compute[98471]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, portal: 192.168.40.100,3260] successful.
May 27 02:58:43.473213 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:43.501042 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:43.516475 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:43.579229 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, portal: 192.168.50.100,3260]
May 27 02:58:43.579229 np0000001475 nova-compute[98471]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, portal: 192.168.50.100,3260] successful.
May 27 02:58:43.579229 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:43.622542 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:43.623168 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.424s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:43.623363 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] <== disconnect_volume: return (4592ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:43.623533 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 02:58:43.624397 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.316s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:43.624397 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 02:58:43.624628 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Deleting instance files /opt/stack/data/nova/instances/7c0291f5-62af-417b-9418-41d808856a8d_del
May 27 02:58:43.625273 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Deletion of /opt/stack/data/nova/instances/7c0291f5-62af-417b-9418-41d808856a8d_del complete
May 27 02:58:43.638466 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:43.639060 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:43.639540 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:43.639726 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:58:43.640147 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:43.640383 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:58:43.658393 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:58:43.658393 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:43.671055 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:58:43.671055 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:43.673400 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd] added
May 27 02:58:43.673400 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:58:43.673400 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:43.673400 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:43.673400 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:43.673400 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:43.673400 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:43.673400 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:58:43.673400 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0334(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:58:43.673400 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:58:43.683272 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd] added
May 27 02:58:43.683272 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:58:43.683272 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:43.683272 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:43.683272 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:58:43.683272 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:58:43.683272 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:43.683545 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:58:43.683671 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0433(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:58:43.683872 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:58:43.711141 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Attempting to attach volume 38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 02:58:43.713271 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] attach device xml: <disk type="block" device="disk">
May 27 02:58:43.713271 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:58:43.713271 np0000001475 nova-compute[98471]:   <alias name="ua-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d"/>
May 27 02:58:43.713271 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-14"/>
May 27 02:58:43.713271 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 02:58:43.713271 np0000001475 nova-compute[98471]:   <serial>38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d</serial>
May 27 02:58:43.713271 np0000001475 nova-compute[98471]: </disk>
May 27 02:58:43.713271 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 02:58:43.822391 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:58:43.829842 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:58:43.864960 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "60418cf4-cd7f-4256-ad92-cc8336802816" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.864s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:44.087996 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc932acd-cfd1-49d2-a708-5605f8db808e tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "82be1ace-dc06-42dd-8660-02439941fa00" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.765s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:44.217079 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 7c0291f5-62af-417b-9418-41d808856a8d could not be found.
May 27 02:58:44.218178 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 02:58:44.218664 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:58:44.218909 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:44.443694 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Acquiring lock "82be1ace-dc06-42dd-8660-02439941fa00" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:44.443913 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "82be1ace-dc06-42dd-8660-02439941fa00" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:44.520820 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:44.521004 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:44.521246 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No VIF found with MAC fa:16:3e:9d:6d:1f, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:58:44.521877 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Using config drive
May 27 02:58:44.535269 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2db5e001-83f8-4208-bdaa-8a1e1e0a22b3 req-f58f47ce-7967-42b7-ae50-b0707e4406aa service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received event network-changed-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:44.535458 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2db5e001-83f8-4208-bdaa-8a1e1e0a22b3 req-f58f47ce-7967-42b7-ae50-b0707e4406aa service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Refreshing instance network info cache due to event network-changed-920f5752-8d06-40e8-90e8-53fa42f5488d. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:58:44.535674 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2db5e001-83f8-4208-bdaa-8a1e1e0a22b3 req-f58f47ce-7967-42b7-ae50-b0707e4406aa service nova] Acquiring lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:58:44.535878 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2db5e001-83f8-4208-bdaa-8a1e1e0a22b3 req-f58f47ce-7967-42b7-ae50-b0707e4406aa service nova] Acquired lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:58:44.536022 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-2db5e001-83f8-4208-bdaa-8a1e1e0a22b3 req-f58f47ce-7967-42b7-ae50-b0707e4406aa service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Refreshing network info cache for port 920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:58:44.674039 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:58:44.684433 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:44.691999 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:44.691999 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:44.700898 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:44.700898 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:44.712772 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:44.717932 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:44.733694 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:44.733694 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:44.733694 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:44.733694 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:44.733694 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:44.733694 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:44.733694 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:44.733694 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:44.733694 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:44.733694 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:44.733694 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:44.733694 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:44.733694 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:44.733694 np0000001475 nova-compute[98471]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:44.733694 np0000001475 nova-compute[98471]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:44.733694 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:44.733694 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:44.734235 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:44.734235 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:44.734235 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:44.734235 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:44.734235 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:44.734235 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:44.734235 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:44.734235 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:44.734235 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:44.734235 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:44.734235 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:44.734235 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:44.734235 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:44.734235 np0000001475 nova-compute[98471]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:44.734235 np0000001475 nova-compute[98471]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:44.734235 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:44.734235 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:44.742296 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:44.803970 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd, portal: 192.168.50.100,3260]
May 27 02:58:44.803970 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd, portal: 192.168.50.100,3260] successful.
May 27 02:58:44.803970 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:44.816494 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:44.817812 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd, portal: 192.168.40.100,3260]
May 27 02:58:44.817812 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd, portal: 192.168.40.100,3260] successful.
May 27 02:58:44.817812 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:44.835472 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:44.841830 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:44.841830 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:44.841830 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:44.841830 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:44.841830 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:44.841830 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:44.841830 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:44.841830 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:44.841830 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:44.841830 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:44.841830 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:44.841830 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:44.841830 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:44.841830 np0000001475 nova-compute[98471]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:44.841830 np0000001475 nova-compute[98471]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:44.841830 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:44.841830 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:44.841830 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:44.841830 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:44.842292 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:44.842292 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:44.842292 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:44.842292 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:44.842292 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:44.842292 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:44.842292 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:44.842292 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:44.842292 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:44.842292 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:44.842292 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:44.842292 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:44.842292 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:44.842292 np0000001475 nova-compute[98471]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:44.842292 np0000001475 nova-compute[98471]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:44.842292 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:44.842292 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:44.842292 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:44.842292 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:44.842292 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:44.842646 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:44.843893 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] HCTL ('7', '-', '-', 0) found on session 25 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:44.843994 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:44.858021 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Searching for a device in session 25 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:44.858021 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:44.866126 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.224s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] HCTL ('8', '-', '-', 0) found on session 26 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:44.866126 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:44.883331 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Searching for a device in session 26 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:44.884789 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:44.948512 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Detaching volume a66bfb77-3671-4de0-8ddd-0a90012d65dd
May 27 02:58:45.016785 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Attempting to driver detach volume a66bfb77-3671-4de0-8ddd-0a90012d65dd from mountpoint /dev/sdc
May 27 02:58:45.034989 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:45.037914 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Found disk sdc by alias ua-a66bfb77-3671-4de0-8ddd-0a90012d65dd {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 02:58:45.039519 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Found disk sdc by alias ua-a66bfb77-3671-4de0-8ddd-0a90012d65dd {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 02:58:45.040192 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-2db5e001-83f8-4208-bdaa-8a1e1e0a22b3 req-f58f47ce-7967-42b7-ae50-b0707e4406aa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:45.041810 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Attempting to detach device sdc from instance 82be1ace-dc06-42dd-8660-02439941fa00 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 02:58:45.042103 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] detach device xml: <disk type="block" device="disk">
May 27 02:58:45.042103 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:58:45.042103 np0000001475 nova-compute[98471]:   <alias name="ua-a66bfb77-3671-4de0-8ddd-0a90012d65dd"/>
May 27 02:58:45.042103 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-13"/>
May 27 02:58:45.042103 np0000001475 nova-compute[98471]:   <target dev="sdc" bus="scsi"/>
May 27 02:58:45.042103 np0000001475 nova-compute[98471]:   <serial>a66bfb77-3671-4de0-8ddd-0a90012d65dd</serial>
May 27 02:58:45.042103 np0000001475 nova-compute[98471]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 27 02:58:45.042103 np0000001475 nova-compute[98471]: </disk>
May 27 02:58:45.042103 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 02:58:45.052088 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Successfully detached device sdc from instance 82be1ace-dc06-42dd-8660-02439941fa00 from the persistent domain config.
May 27 02:58:45.052088 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] (1/8): Attempting to detach device sdc with device alias ua-a66bfb77-3671-4de0-8ddd-0a90012d65dd from instance 82be1ace-dc06-42dd-8660-02439941fa00 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 02:58:45.052657 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] detach device xml: <disk type="block" device="disk">
May 27 02:58:45.052657 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:58:45.052657 np0000001475 nova-compute[98471]:   <alias name="ua-a66bfb77-3671-4de0-8ddd-0a90012d65dd"/>
May 27 02:58:45.052657 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-13"/>
May 27 02:58:45.052657 np0000001475 nova-compute[98471]:   <target dev="sdc" bus="scsi"/>
May 27 02:58:45.052657 np0000001475 nova-compute[98471]:   <serial>a66bfb77-3671-4de0-8ddd-0a90012d65dd</serial>
May 27 02:58:45.052657 np0000001475 nova-compute[98471]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 27 02:58:45.052657 np0000001475 nova-compute[98471]: </disk>
May 27 02:58:45.052657 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 02:58:45.213646 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Creating config drive at /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk.config
May 27 02:58:45.214756 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779850725.2136376, 82be1ace-dc06-42dd-8660-02439941fa00 => ua-a66bfb77-3671-4de0-8ddd-0a90012d65dd> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 02:58:45.217114 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-a66bfb77-3671-4de0-8ddd-0a90012d65dd for instance 82be1ace-dc06-42dd-8660-02439941fa00 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 02:58:45.218805 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Successfully detached device sdc from instance 82be1ace-dc06-42dd-8660-02439941fa00 from the live domain config.
May 27 02:58:45.219702 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 02:58:45.219968 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd', 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a66bfb77-3671-4de0-8ddd-0a90012d65dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-13'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:58:45.220164 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:45.220528 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgv8631ci {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:45.256097 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgv8631ci" returned: 0 in 0.035s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:45.387434 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:45.387634 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:45.387856 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:45.388019 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] No VIF found with MAC fa:16:3e:0e:05:47, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:58:45.438125 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-2db5e001-83f8-4208-bdaa-8a1e1e0a22b3 req-f58f47ce-7967-42b7-ae50-b0707e4406aa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:45.598963 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-2db5e001-83f8-4208-bdaa-8a1e1e0a22b3 req-f58f47ce-7967-42b7-ae50-b0707e4406aa service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Updated VIF entry in instance network info cache for port 920f5752-8d06-40e8-90e8-53fa42f5488d. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 02:58:45.598963 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-2db5e001-83f8-4208-bdaa-8a1e1e0a22b3 req-f58f47ce-7967-42b7-ae50-b0707e4406aa service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Updating instance_info_cache with network_info: [{"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:45.641622 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 02:58:45.701258 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:45.734900 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:45.738909 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:45.741540 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:45.863329 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:45.962923 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5cd85bf7-37df-4545-a81e-4f89af38ba9a req-d52a5fb7-c178-4e56-9fa6-fbc49a8f49bb service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Received event network-vif-plugged-2104125d-e30e-4450-8186-54d776011dcd {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:45.963465 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5cd85bf7-37df-4545-a81e-4f89af38ba9a req-d52a5fb7-c178-4e56-9fa6-fbc49a8f49bb service nova] Acquiring lock "8d762a67-82b6-40d3-b625-0731ea01c45b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:45.963465 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5cd85bf7-37df-4545-a81e-4f89af38ba9a req-d52a5fb7-c178-4e56-9fa6-fbc49a8f49bb service nova] Lock "8d762a67-82b6-40d3-b625-0731ea01c45b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:45.963465 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5cd85bf7-37df-4545-a81e-4f89af38ba9a req-d52a5fb7-c178-4e56-9fa6-fbc49a8f49bb service nova] Lock "8d762a67-82b6-40d3-b625-0731ea01c45b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:45.963638 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5cd85bf7-37df-4545-a81e-4f89af38ba9a req-d52a5fb7-c178-4e56-9fa6-fbc49a8f49bb service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Processing event network-vif-plugged-2104125d-e30e-4450-8186-54d776011dcd {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:58:46.101694 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2db5e001-83f8-4208-bdaa-8a1e1e0a22b3 req-f58f47ce-7967-42b7-ae50-b0707e4406aa service nova] Releasing lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:58:46.138880 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:46.142817 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:46.147781 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:46.170683 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:46.203905 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:58:46.204168 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:58:46.204359 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:58:46.204527 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:58:46.204715 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:58:46.204865 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:58:46.205018 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:58:46.205172 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:58:46.205278 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 02:58:46.205444 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:58:46.593394 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850726.5929375, 8d762a67-82b6-40d3-b625-0731ea01c45b => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:58:46.593959 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 02:58:46.594011 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] VM Started (Lifecycle Event)
May 27 02:58:46.596494 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 02:58:46.598151 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Instance spawned successfully.
May 27 02:58:46.598437 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 02:58:46.656457 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Found WWN 3300000003c6ac048 for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 02:58:46.656944 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:46.657706 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] <== connect_volume: return (6349ms) {'type': 'block', 'scsi_wwn': '3300000003c6ac048', 'path': '/dev/dm-0', 'multipath_id': '3300000003c6ac048'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:46.657865 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003c6ac048', 'path': '/dev/dm-0', 'multipath_id': '3300000003c6ac048'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 02:58:46.658285 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.439s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:46.658760 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 02:58:46.659287 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 02:58:46.661249 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lazy-loading 'flavor' on Instance uuid 63151241-1b03-4b3c-9ecd-27703137e752 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:58:46.695941 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:46.695941 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:46.695941 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:46.695941 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:46.695941 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:46.695941 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:46.695941 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:46.695941 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:46.695941 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:46.695941 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:46.695941 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:46.695941 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:46.695941 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:46.695941 np0000001475 nova-compute[98471]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:46.695941 np0000001475 nova-compute[98471]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:46.695941 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:46.695941 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:46.695941 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:46.695941 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:46.696535 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:46.696535 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:46.696535 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:46.696535 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:46.696535 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:46.696535 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:46.696535 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:46.696535 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:46.696535 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:46.696535 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:46.696535 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:46.696535 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:46.696535 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:46.696535 np0000001475 nova-compute[98471]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:46.696535 np0000001475 nova-compute[98471]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:46.696535 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:46.696535 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:46.696535 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:46.696535 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:46.696535 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', '9')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 02:58:46.696535 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, 0): [] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:58:46.697167 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41') {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 02:58:46.697258 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, 0): [] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:58:46.697398 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41') {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 02:58:46.697534 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c51b920>, {}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 02:58:46.697713 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Disconnecting from: [] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 02:58:46.697948 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.040s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:46.698087 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] <== disconnect_volume: return (2479ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:46.698231 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 02:58:46.700405 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.480s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:46.701494 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd', 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a66bfb77-3671-4de0-8ddd-0a90012d65dd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-13'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 02:58:46.701494 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 02:58:46.711365 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:46.711365 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:46.711586 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:46.711632 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 02:58:46.737528 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:46.737528 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:46.737528 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:46.737528 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:46.737528 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:46.737528 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:46.737528 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:46.737528 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:46.737528 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:46.737528 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:46.737528 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:46.737528 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:46.737528 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:46.737528 np0000001475 nova-compute[98471]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:46.737528 np0000001475 nova-compute[98471]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:46.737528 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:46.737528 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:46.737528 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:46.737528 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:46.738292 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:46.738292 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:46.738292 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:46.738292 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:46.738292 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:46.738292 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:46.738292 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:46.738292 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:46.738292 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:46.738292 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:46.738292 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:46.738292 np0000001475 nova-compute[98471]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:46.738292 np0000001475 nova-compute[98471]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd (non-flash)
May 27 02:58:46.738292 np0000001475 nova-compute[98471]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:46.738292 np0000001475 nova-compute[98471]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:46.738292 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:46.738292 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:46.738292 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:46.738292 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:46.738292 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', '9')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 02:58:46.738292 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd', '22')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:58:46.740357 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd', '21')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:58:46.741612 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c111580>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd'): ({'sdq'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd'): ({'sdp'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 02:58:46.741837 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Removing multipathed devices sdp, sdq {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 02:58:46.742054 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Flush multipath device 330000000377611a0 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 02:58:46.779036 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:58:46.832943 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:58:46.880171 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Checking to see if SCSI volumes sdp, sdq have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 02:58:46.880305 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] SCSI volumes sdp, sdq have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 02:58:46.882300 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Checking to see if device paths {'sdp', 'sdq'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 02:58:46.894766 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Device paths {'sdp', 'sdq'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 02:58:46.894936 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 02:58:46.908412 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:46.948316 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fedaf903-bcf7-41b5-97b1-65fcd774711a tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Lock "09039461-93a4-458a-886e-9783f6edaf45" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.973s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:46.957464 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd, portal: 192.168.40.100,3260]
May 27 02:58:46.957464 np0000001475 nova-compute[98471]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd, portal: 192.168.40.100,3260] successful.
May 27 02:58:46.957464 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:46.985512 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:46.999913 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:47.046290 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd, portal: 192.168.50.100,3260]
May 27 02:58:47.046290 np0000001475 nova-compute[98471]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-a66bfb77-3671-4de0-8ddd-0a90012d65dd, portal: 192.168.50.100,3260] successful.
May 27 02:58:47.046290 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:47.071432 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:47.071651 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:47.071830 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] <== disconnect_volume: return (1851ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:47.071979 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 02:58:47.096586 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:58:47.099005 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:58:47.105782 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:47.105782 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:47.105782 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:47.105782 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:47.105782 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:47.105782 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:58:47.164269 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Attempting to attach volume a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 02:58:47.165379 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] attach device xml: <disk type="block" device="disk">
May 27 02:58:47.165379 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:58:47.165379 np0000001475 nova-compute[98471]:   <alias name="ua-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd"/>
May 27 02:58:47.165379 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-0"/>
May 27 02:58:47.165379 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 02:58:47.165379 np0000001475 nova-compute[98471]:   <serial>a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd</serial>
May 27 02:58:47.165379 np0000001475 nova-compute[98471]:   <shareable/>
May 27 02:58:47.165379 np0000001475 nova-compute[98471]: </disk>
May 27 02:58:47.165379 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 02:58:47.602308 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 02:58:47.602874 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850727.6024048, 8d762a67-82b6-40d3-b625-0731ea01c45b => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:58:47.602874 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] VM Paused (Lifecycle Event)
May 27 02:58:47.612368 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Took 7.65 seconds to spawn the instance on the hypervisor.
May 27 02:58:47.612368 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:58:47.649526 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lazy-loading 'flavor' on Instance uuid 82be1ace-dc06-42dd-8660-02439941fa00 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:58:47.750863 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:47.851477 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:47.852112 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:47.945605 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Preparing to wait for external event volume-reimaged-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:58:47.945878 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "7c0291f5-62af-417b-9418-41d808856a8d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:47.946021 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:47.946156 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:47.962130 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b586ae48-0f7e-4baa-b433-a0a8006f0b3e tempest-VolumesAssistedSnapshotsTest-1309799175 tempest-VolumesAssistedSnapshotsTest-1309799175-project] [instance: 09039461-93a4-458a-886e-9783f6edaf45] volume_snapshot_create: create_info: {'snapshot_id': 'aec9e6e5-a770-40b1-8a92-d3a6caa381c4', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=98471) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3769}}
May 27 02:58:47.965410 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:47.966786 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b586ae48-0f7e-4baa-b433-a0a8006f0b3e tempest-VolumesAssistedSnapshotsTest-1309799175 tempest-VolumesAssistedSnapshotsTest-1309799175-project] [instance: 09039461-93a4-458a-886e-9783f6edaf45] snap xml: <domainsnapshot>
May 27 02:58:47.966786 np0000001475 nova-compute[98471]:   <disks>
May 27 02:58:47.966786 np0000001475 nova-compute[98471]:     <disk name="/dev/dm-14" snapshot="external" type="file">
May 27 02:58:47.966786 np0000001475 nova-compute[98471]:       <source file="/dev/new_file"/>
May 27 02:58:47.966786 np0000001475 nova-compute[98471]:     </disk>
May 27 02:58:47.966786 np0000001475 nova-compute[98471]:     <disk name="vda" snapshot="no"/>
May 27 02:58:47.966786 np0000001475 nova-compute[98471]:     <disk name="hda" snapshot="no"/>
May 27 02:58:47.966786 np0000001475 nova-compute[98471]:   </disks>
May 27 02:58:47.966786 np0000001475 nova-compute[98471]: </domainsnapshot>
May 27 02:58:47.966786 np0000001475 nova-compute[98471]:  {{(pid=98471) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3710}}
May 27 02:58:47.969070 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-b586ae48-0f7e-4baa-b433-a0a8006f0b3e tempest-VolumesAssistedSnapshotsTest-1309799175 tempest-VolumesAssistedSnapshotsTest-1309799175-project] Lazy-loading 'system_metadata' on Instance uuid 09039461-93a4-458a-886e-9783f6edaf45 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:58:47.974585 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:47.994288 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:48.033876 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-32df4e2e-3a32-4c27-aa30-78a6a8961d1b tempest-VolumesAssistedSnapshotsTest-1309799175 tempest-VolumesAssistedSnapshotsTest-1309799175-project] [instance: 09039461-93a4-458a-886e-9783f6edaf45] volume_snapshot_delete: delete_info: {'volume_id': '38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d'} {{(pid=98471) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3877}}
May 27 02:58:48.040318 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [None req-32df4e2e-3a32-4c27-aa30-78a6a8961d1b tempest-VolumesAssistedSnapshotsTest-1309799175 tempest-VolumesAssistedSnapshotsTest-1309799175-project] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
May 27 02:58:48.040318 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45] Traceback (most recent call last):
May 27 02:58:48.040318 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 27 02:58:48.040318 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45]     self._volume_snapshot_delete(context, instance, volume_id,
May 27 02:58:48.040318 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 27 02:58:48.040318 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45]     if delete_info['type'] != 'qcow2':
May 27 02:58:48.040318 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45]        ~~~~~~~~~~~^^^^^^^^
May 27 02:58:48.040318 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45] KeyError: 'type'
May 27 02:58:48.040318 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45] 
May 27 02:58:48.053943 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0cbf3364-ebfa-42c3-9c8a-2a77ae024428 req-1ca84c02-3f6c-4c8f-aea3-e6a1689c758b service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Received event network-vif-plugged-2104125d-e30e-4450-8186-54d776011dcd {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:48.058086 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0cbf3364-ebfa-42c3-9c8a-2a77ae024428 req-1ca84c02-3f6c-4c8f-aea3-e6a1689c758b service nova] Acquiring lock "8d762a67-82b6-40d3-b625-0731ea01c45b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:48.058425 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0cbf3364-ebfa-42c3-9c8a-2a77ae024428 req-1ca84c02-3f6c-4c8f-aea3-e6a1689c758b service nova] Lock "8d762a67-82b6-40d3-b625-0731ea01c45b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:48.058543 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0cbf3364-ebfa-42c3-9c8a-2a77ae024428 req-1ca84c02-3f6c-4c8f-aea3-e6a1689c758b service nova] Lock "8d762a67-82b6-40d3-b625-0731ea01c45b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:48.058721 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0cbf3364-ebfa-42c3-9c8a-2a77ae024428 req-1ca84c02-3f6c-4c8f-aea3-e6a1689c758b service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] No waiting events found dispatching network-vif-plugged-2104125d-e30e-4450-8186-54d776011dcd {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:58:48.058892 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-0cbf3364-ebfa-42c3-9c8a-2a77ae024428 req-1ca84c02-3f6c-4c8f-aea3-e6a1689c758b service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Received unexpected event network-vif-plugged-2104125d-e30e-4450-8186-54d776011dcd for instance with vm_state active and task_state None.
May 27 02:58:48.066355 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:48.067048 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [None req-32df4e2e-3a32-4c27-aa30-78a6a8961d1b tempest-VolumesAssistedSnapshotsTest-1309799175 tempest-VolumesAssistedSnapshotsTest-1309799175-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver        ~~~~~~~~~~~^^^^^^^^
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver KeyError: 'type'
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver 
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver 
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-4eea1193-c689-4cd3-b3d2-9ea98fc3f0e1)
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver 
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver 
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 27 02:58:48.091256 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver 
May 27 02:58:48.105429 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:58:48.109335 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850728.1090615, 8d762a67-82b6-40d3-b625-0731ea01c45b => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:58:48.109482 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] VM Resumed (Lifecycle Event)
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server [None req-32df4e2e-3a32-4c27-aa30-78a6a8961d1b tempest-VolumesAssistedSnapshotsTest-1309799175 tempest-VolumesAssistedSnapshotsTest-1309799175-project] Exception during message handling: KeyError: 'type'
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     raise self.value
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4053, in volume_snapshot_delete
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     raise self.value
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server        ~~~~~~~~~~~^^^^^^^^
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server KeyError: 'type'
May 27 02:58:48.113127 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server 
May 27 02:58:48.128191 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Took 13.48 seconds to build instance.
May 27 02:58:48.173192 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:48.177538 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:48.273589 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:48.274306 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:48.373780 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:48.374205 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 02:58:48.376934 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 02:58:48.377041 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 02:58:48.377360 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-10 (vdc) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 02:58:48.380562 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:48.464935 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:48.465476 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:48.496609 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-b586ae48-0f7e-4baa-b433-a0a8006f0b3e tempest-VolumesAssistedSnapshotsTest-1309799175 tempest-VolumesAssistedSnapshotsTest-1309799175-project] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Skipping quiescing instance: QEMU guest agent is not enabled.
May 27 02:58:48.504287 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [None req-b586ae48-0f7e-4baa-b433-a0a8006f0b3e tempest-VolumesAssistedSnapshotsTest-1309799175 tempest-VolumesAssistedSnapshotsTest-1309799175-project] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 27 02:58:48.504287 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45] Traceback (most recent call last):
May 27 02:58:48.504287 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 27 02:58:48.504287 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 27 02:58:48.504287 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 27 02:58:48.504287 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 27 02:58:48.504287 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 27 02:58:48.504287 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 27 02:58:48.504287 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 27 02:58:48.504287 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45] 
May 27 02:58:48.505115 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [None req-b586ae48-0f7e-4baa-b433-a0a8006f0b3e tempest-VolumesAssistedSnapshotsTest-1309799175 tempest-VolumesAssistedSnapshotsTest-1309799175-project] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 27 02:58:48.505115 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45] Traceback (most recent call last):
May 27 02:58:48.505115 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 27 02:58:48.505115 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45]     self._volume_snapshot_create(context, instance, guest,
May 27 02:58:48.505115 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 27 02:58:48.505115 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 27 02:58:48.505115 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 27 02:58:48.505115 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 27 02:58:48.505115 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 27 02:58:48.505115 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 27 02:58:48.505115 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 27 02:58:48.505115 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [instance: 09039461-93a4-458a-886e-9783f6edaf45] 
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver [None req-b586ae48-0f7e-4baa-b433-a0a8006f0b3e tempest-VolumesAssistedSnapshotsTest-1309799175 tempest-VolumesAssistedSnapshotsTest-1309799175-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot aec9e6e5-a770-40b1-8a92-d3a6caa381c4 could not be found.
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver 
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver 
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot aec9e6e5-a770-40b1-8a92-d3a6caa381c4 could not be found. (HTTP 404) (Request-ID: req-67a80e6d-1848-4b55-9aa4-49158a2c6332)
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver 
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver 
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot aec9e6e5-a770-40b1-8a92-d3a6caa381c4 could not be found.
May 27 02:58:48.545572 np0000001475 nova-compute[98471]: ERROR nova.virt.libvirt.driver 
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server [None req-b586ae48-0f7e-4baa-b433-a0a8006f0b3e tempest-VolumesAssistedSnapshotsTest-1309799175 tempest-VolumesAssistedSnapshotsTest-1309799175-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     raise self.value
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3790, in volume_snapshot_create
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     raise self.value
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 27 02:58:48.550667 np0000001475 nova-compute[98471]: ERROR oslo_messaging.rpc.server 
May 27 02:58:48.574060 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:48.576848 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 02:58:48.577180 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 02:58:48.577382 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-12 (vdc) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 02:58:48.578626 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:48.614507 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:58:48.618445 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:58:48.634053 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-40d8386e-b4c7-4a5b-b2ec-fad702c84508 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "8d762a67-82b6-40d3-b625-0731ea01c45b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.007s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:48.660271 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-efa7258d-1ed4-45d2-b041-99de34bc5eb5 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "82be1ace-dc06-42dd-8660-02439941fa00" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.216s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:48.677316 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:48.677837 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:48.771674 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:48.773832 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-14 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 02:58:48.776580 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:48.809038 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Acquiring lock "09039461-93a4-458a-886e-9783f6edaf45" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:48.809038 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Lock "09039461-93a4-458a-886e-9783f6edaf45" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:48.853095 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:48.853273 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:48.853438 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:48.853615 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] No VIF found with MAC fa:16:3e:c9:82:f2, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:58:48.862380 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:48.862919 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:48.977420 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:48.983800 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 02:58:48.983800 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:49.012769 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.031s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:58:49.015907 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=12357MB free_disk=74.57989120483398GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 02:58:49.015907 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:49.015907 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:49.043234 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Acquiring lock "82be1ace-dc06-42dd-8660-02439941fa00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:49.043499 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "82be1ace-dc06-42dd-8660-02439941fa00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:49.043870 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Acquiring lock "82be1ace-dc06-42dd-8660-02439941fa00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:49.044073 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "82be1ace-dc06-42dd-8660-02439941fa00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:49.044245 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "82be1ace-dc06-42dd-8660-02439941fa00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:49.049851 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Terminating instance
May 27 02:58:49.312503 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Detaching volume 38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d
May 27 02:58:49.369380 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Attempting to driver detach volume 38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d from mountpoint /dev/vdb
May 27 02:58:49.382517 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Found disk vdb by alias ua-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 02:58:49.384398 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Found disk vdb by alias ua-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 02:58:49.384605 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Attempting to detach device vdb from instance 09039461-93a4-458a-886e-9783f6edaf45 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 02:58:49.385449 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] detach device xml: <disk type="block" device="disk">
May 27 02:58:49.385449 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:58:49.385449 np0000001475 nova-compute[98471]:   <alias name="ua-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d"/>
May 27 02:58:49.385449 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-14"/>
May 27 02:58:49.385449 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 02:58:49.385449 np0000001475 nova-compute[98471]:   <serial>38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d</serial>
May 27 02:58:49.385449 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 02:58:49.385449 np0000001475 nova-compute[98471]: </disk>
May 27 02:58:49.385449 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 02:58:49.391251 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Successfully detached device vdb from instance 09039461-93a4-458a-886e-9783f6edaf45 from the persistent domain config.
May 27 02:58:49.393959 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] (1/8): Attempting to detach device vdb with device alias ua-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d from instance 09039461-93a4-458a-886e-9783f6edaf45 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 02:58:49.393959 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] detach device xml: <disk type="block" device="disk">
May 27 02:58:49.393959 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:58:49.393959 np0000001475 nova-compute[98471]:   <alias name="ua-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d"/>
May 27 02:58:49.393959 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-14"/>
May 27 02:58:49.393959 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 02:58:49.393959 np0000001475 nova-compute[98471]:   <serial>38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d</serial>
May 27 02:58:49.393959 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 02:58:49.393959 np0000001475 nova-compute[98471]: </disk>
May 27 02:58:49.393959 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 02:58:49.556603 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 02:58:49.590881 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:49.601175 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:49.629009 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:49.657343 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:49.658711 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:49.801972 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-28888725-376f-4ae9-a6f0-26841dbd84d4 req-498590ef-a566-479b-8e79-a60e7533cffb service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Received event network-changed-2104125d-e30e-4450-8186-54d776011dcd {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:49.803209 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-28888725-376f-4ae9-a6f0-26841dbd84d4 req-498590ef-a566-479b-8e79-a60e7533cffb service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Refreshing instance network info cache due to event network-changed-2104125d-e30e-4450-8186-54d776011dcd. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:58:49.803583 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-28888725-376f-4ae9-a6f0-26841dbd84d4 req-498590ef-a566-479b-8e79-a60e7533cffb service nova] Acquiring lock "refresh_cache-8d762a67-82b6-40d3-b625-0731ea01c45b" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:58:49.803786 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-28888725-376f-4ae9-a6f0-26841dbd84d4 req-498590ef-a566-479b-8e79-a60e7533cffb service nova] Acquired lock "refresh_cache-8d762a67-82b6-40d3-b625-0731ea01c45b" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:58:49.804135 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-28888725-376f-4ae9-a6f0-26841dbd84d4 req-498590ef-a566-479b-8e79-a60e7533cffb service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Refreshing network info cache for port 2104125d-e30e-4450-8186-54d776011dcd {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:58:49.911785 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999630605999982 future=<Future at 0x755724423410 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:58:49.918958 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Instance destroyed successfully.
May 27 02:58:49.919711 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lazy-loading 'resources' on Instance uuid 82be1ace-dc06-42dd-8660-02439941fa00 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:58:50.058974 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779850730.05851, 09039461-93a4-458a-886e-9783f6edaf45 => ua-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 02:58:50.061079 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d for instance 09039461-93a4-458a-886e-9783f6edaf45 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 02:58:50.065285 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Successfully detached device vdb from instance 09039461-93a4-458a-886e-9783f6edaf45 from the live domain config.
May 27 02:58:50.067513 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] [instance: 09039461-93a4-458a-886e-9783f6edaf45] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 02:58:50.068007 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:58:50.068293 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:50.095948 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 82be1ace-dc06-42dd-8660-02439941fa00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:58:50.096089 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 63151241-1b03-4b3c-9ecd-27703137e752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:58:50.096242 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance a6c0c0f0-846a-4ffb-8f02-d43af196da22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:58:50.096386 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 7c0291f5-62af-417b-9418-41d808856a8d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:58:50.096527 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 09039461-93a4-458a-886e-9783f6edaf45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:58:50.096711 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 8b048373-2f8d-454a-9ad5-888403e8ee5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:58:50.096869 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 27b7be13-fa61-4916-a350-a2370d4430bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:58:50.099821 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 60418cf4-cd7f-4256-ad92-cc8336802816 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:58:50.099821 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 8d762a67-82b6-40d3-b625-0731ea01c45b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:58:50.099821 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 02:58:50.099821 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=2240MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:58:49 up 30 min,  2 users,  load average: 8.65, 4.00, 1.81\n', 'num_instances': '9', 'num_vm_active': '9', 'num_task_deleting': '1', 'num_os_type_None': '9', 'num_proj_3143b7b9c4034100aa249427ea1f1115': '1', 'io_workload': '1', 'num_task_None': '7', 'num_proj_2254e04d10914b0d9b3768ba32b8559d': '2', 'num_task_rebuilding': '1', 'num_proj_36131e6324ff45ddb65932f4ade9a1a8': '1', 'num_proj_ce2779cce722472da45319e6a0faa7e1': '1', 'num_proj_73947699c9fc4e078220ba0dbcaa9cf9': '1', 'num_proj_faa29a06cd694e828f6bc5146d9f7339': '1', 'num_proj_88bb33ad146843308b381f8379c70094': '1', 'num_proj_233d191c03874150880aca259ffd3e21': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 02:58:50.132148 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:50.132348 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:50.151583 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-38f09ae3-d5ff-48d8-9273-59a1f736c8a9 req-66fb3ce8-43d1-47e3-ac30-cddb4a682675 service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Received event network-vif-unplugged-dd748286-2659-4519-a5d7-5a24424d66f5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:50.155557 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-38f09ae3-d5ff-48d8-9273-59a1f736c8a9 req-66fb3ce8-43d1-47e3-ac30-cddb4a682675 service nova] Acquiring lock "82be1ace-dc06-42dd-8660-02439941fa00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:50.155557 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-38f09ae3-d5ff-48d8-9273-59a1f736c8a9 req-66fb3ce8-43d1-47e3-ac30-cddb4a682675 service nova] Lock "82be1ace-dc06-42dd-8660-02439941fa00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:50.155557 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-38f09ae3-d5ff-48d8-9273-59a1f736c8a9 req-66fb3ce8-43d1-47e3-ac30-cddb4a682675 service nova] Lock "82be1ace-dc06-42dd-8660-02439941fa00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:50.155557 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-38f09ae3-d5ff-48d8-9273-59a1f736c8a9 req-66fb3ce8-43d1-47e3-ac30-cddb4a682675 service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] No waiting events found dispatching network-vif-unplugged-dd748286-2659-4519-a5d7-5a24424d66f5 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:58:50.155557 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-38f09ae3-d5ff-48d8-9273-59a1f736c8a9 req-66fb3ce8-43d1-47e3-ac30-cddb4a682675 service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Received event network-vif-unplugged-dd748286-2659-4519-a5d7-5a24424d66f5 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:58:50.155557 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-38f09ae3-d5ff-48d8-9273-59a1f736c8a9 req-66fb3ce8-43d1-47e3-ac30-cddb4a682675 service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Received event network-vif-unplugged-dd748286-2659-4519-a5d7-5a24424d66f5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:50.155557 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-38f09ae3-d5ff-48d8-9273-59a1f736c8a9 req-66fb3ce8-43d1-47e3-ac30-cddb4a682675 service nova] Acquiring lock "82be1ace-dc06-42dd-8660-02439941fa00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:50.155557 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-38f09ae3-d5ff-48d8-9273-59a1f736c8a9 req-66fb3ce8-43d1-47e3-ac30-cddb4a682675 service nova] Lock "82be1ace-dc06-42dd-8660-02439941fa00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:50.155557 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-38f09ae3-d5ff-48d8-9273-59a1f736c8a9 req-66fb3ce8-43d1-47e3-ac30-cddb4a682675 service nova] Lock "82be1ace-dc06-42dd-8660-02439941fa00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:50.155557 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-38f09ae3-d5ff-48d8-9273-59a1f736c8a9 req-66fb3ce8-43d1-47e3-ac30-cddb4a682675 service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] No waiting events found dispatching network-vif-unplugged-dd748286-2659-4519-a5d7-5a24424d66f5 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:58:50.155557 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-38f09ae3-d5ff-48d8-9273-59a1f736c8a9 req-66fb3ce8-43d1-47e3-ac30-cddb4a682675 service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Received event network-vif-unplugged-dd748286-2659-4519-a5d7-5a24424d66f5 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:58:50.312320 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-28888725-376f-4ae9-a6f0-26841dbd84d4 req-498590ef-a566-479b-8e79-a60e7533cffb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:50.424472 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1093428290',display_name='tempest-AttachSCSIVolumeTestJSON-server-1093428290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachscsivolumetestjson-server-1093428290',id=2,image_ref='61e040ca-4dc7-4069-bedc-1677643361fc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcYC4E5oslIwBpUJjq6LsoNJUSOV9DuFR7ZS7Uzg33JqWqO1PU/8wdQTmKFTSU00Cufa+/XU/Rw04Vkgh/alYmsRgY3cZ8+wmpuaX6el9t62wYLH956lKjmCFSKszRQoA==',key_name='tempest-keypair-693312116',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:57:52Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3143b7b9c4034100aa249427ea1f1115',ramdisk_id='',reservation_id='r-hle01r5n',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61e040ca-4dc7-4069-bedc-1677643361fc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1060946454',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1060946454-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:57:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6306920125540b790ddb7ba260e1910',uuid=82be1ace-dc06-42dd-8660-02439941fa00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd748286-2659-4519-a5d7-5a24424d66f5", "address": "fa:16:3e:e1:4a:f7", "network": {"id": "3122ca85-812a-4888-92a6-8aeababd262d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1174494551-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3143b7b9c4034100aa249427ea1f1115", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd748286-26", "ovs_interfaceid": "dd748286-2659-4519-a5d7-5a24424d66f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:58:50.424472 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Converting VIF {"id": "dd748286-2659-4519-a5d7-5a24424d66f5", "address": "fa:16:3e:e1:4a:f7", "network": {"id": "3122ca85-812a-4888-92a6-8aeababd262d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1174494551-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3143b7b9c4034100aa249427ea1f1115", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd748286-26", "ovs_interfaceid": "dd748286-2659-4519-a5d7-5a24424d66f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:50.424861 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:4a:f7,bridge_name='br-int',has_traffic_filtering=True,id=dd748286-2659-4519-a5d7-5a24424d66f5,network=Network(3122ca85-812a-4888-92a6-8aeababd262d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd748286-26') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:50.425002 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:4a:f7,bridge_name='br-int',has_traffic_filtering=True,id=dd748286-2659-4519-a5d7-5a24424d66f5,network=Network(3122ca85-812a-4888-92a6-8aeababd262d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd748286-26') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:58:50.429350 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:50.429722 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd748286-26, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:50.432534 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:50.433197 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:50.435501 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:50.435669 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c11bb982-9aa3-48dd-8c2b-61c90a9569b9) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:50.439584 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:50.441177 np0000001475 nova-compute[98471]: INFO os_vif [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:4a:f7,bridge_name='br-int',has_traffic_filtering=True,id=dd748286-2659-4519-a5d7-5a24424d66f5,network=Network(3122ca85-812a-4888-92a6-8aeababd262d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd748286-26')
May 27 02:58:50.443005 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Deleting instance files /opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00_del
May 27 02:58:50.443005 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Deletion of /opt/stack/data/nova/instances/82be1ace-dc06-42dd-8660-02439941fa00_del complete
May 27 02:58:50.451592 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4327171d-181c-4516-a229-ae58a68e40cc tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "63151241-1b03-4b3c-9ecd-27703137e752" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.871s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:50.638911 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lazy-loading 'flavor' on Instance uuid a6c0c0f0-846a-4ffb-8f02-d43af196da22 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:58:50.746088 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:50.770533 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:58:50.771131 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:58:50.834970 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-28888725-376f-4ae9-a6f0-26841dbd84d4 req-498590ef-a566-479b-8e79-a60e7533cffb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:50.956037 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Took 1.40 seconds to destroy the instance on the hypervisor.
May 27 02:58:50.958671 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 02:58:50.958671 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 02:58:50.958877 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 02:58:50.959140 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:51.017256 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-28888725-376f-4ae9-a6f0-26841dbd84d4 req-498590ef-a566-479b-8e79-a60e7533cffb service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Updated VIF entry in instance network info cache for port 2104125d-e30e-4450-8186-54d776011dcd. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 02:58:51.020106 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-28888725-376f-4ae9-a6f0-26841dbd84d4 req-498590ef-a566-479b-8e79-a60e7533cffb service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Updating instance_info_cache with network_info: [{"id": "2104125d-e30e-4450-8186-54d776011dcd", "address": "fa:16:3e:9d:6d:1f", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2104125d-e3", "ovs_interfaceid": "2104125d-e30e-4450-8186-54d776011dcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:51.108398 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:51.274389 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:58:51.522998 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-28888725-376f-4ae9-a6f0-26841dbd84d4 req-498590ef-a566-479b-8e79-a60e7533cffb service nova] Releasing lock "refresh_cache-8d762a67-82b6-40d3-b625-0731ea01c45b" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:58:51.646178 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:51.729988 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:51.784928 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 02:58:51.785110 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.771s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:51.785470 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.41 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 02:58:52.240093 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9dec6921-4eb6-4667-adc5-24a8a3f5a83d req-aa17d2ce-641c-4315-83de-fc9df2a70dfe service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Received event network-vif-deleted-dd748286-2659-4519-a5d7-5a24424d66f5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:52.240536 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-9dec6921-4eb6-4667-adc5-24a8a3f5a83d req-aa17d2ce-641c-4315-83de-fc9df2a70dfe service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Neutron deleted interface dd748286-2659-4519-a5d7-5a24424d66f5; detaching it from the instance and deleting it from the info cache
May 27 02:58:52.240715 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-9dec6921-4eb6-4667-adc5-24a8a3f5a83d req-aa17d2ce-641c-4315-83de-fc9df2a70dfe service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:52.263875 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:52.331478 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.263s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:52.331795 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 02:58:52.331966 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 02:58:52.373573 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:52.373573 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:52.373573 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:52.373573 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:52.373573 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:52.373573 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:52.373573 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:52.373573 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:52.373573 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:52.373573 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:52.373573 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:52.373573 np0000001475 nova-compute[98471]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:52.373573 np0000001475 nova-compute[98471]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:52.373573 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:52.373573 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:52.373573 np0000001475 nova-compute[98471]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:52.373573 np0000001475 nova-compute[98471]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:52.373573 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:52.373573 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:52.374194 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:52.374194 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:52.374194 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:52.374194 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:52.374194 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:52.374194 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:52.374194 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:52.374194 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:52.374194 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:52.374194 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:52.374194 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:52.374194 np0000001475 nova-compute[98471]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:52.374194 np0000001475 nova-compute[98471]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d (non-flash)
May 27 02:58:52.374194 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:52.374194 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:52.374194 np0000001475 nova-compute[98471]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:52.374194 np0000001475 nova-compute[98471]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:52.374194 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:52.374194 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:52.374194 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', '9')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 02:58:52.374194 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', '23')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:58:52.375683 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d', '24')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:58:52.376882 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7557247cb060>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d'): ({'sdr'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d'): ({'sds'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 02:58:52.377152 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Removing multipathed devices sds, sdr {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 02:58:52.377383 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Flush multipath device 3300000007000e5ad {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 02:58:52.414590 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Remove SCSI device /dev/sds with /sys/block/sds/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:58:52.460302 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Remove SCSI device /dev/sdr with /sys/block/sdr/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:58:52.507034 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Checking to see if SCSI volumes sds, sdr have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 02:58:52.508416 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] SCSI volumes sds, sdr have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 02:58:52.513002 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Checking to see if device paths {'sds', 'sdr'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 02:58:52.528778 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Device paths {'sds', 'sdr'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 02:58:52.529540 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 02:58:52.544994 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:52.591945 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d, portal: 192.168.40.100,3260]
May 27 02:58:52.591945 np0000001475 nova-compute[98471]: Logout of [sid: 23, target: iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d, portal: 192.168.40.100,3260] successful.
May 27 02:58:52.591945 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:52.628238 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:52.646638 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:52.698447 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d, portal: 192.168.50.100,3260]
May 27 02:58:52.698447 np0000001475 nova-compute[98471]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-38c7d213-d0c1-4997-b7b5-bdf49b7d5e4d, portal: 192.168.50.100,3260] successful.
May 27 02:58:52.698447 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:52.731777 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:52.731777 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:52.731777 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] <== disconnect_volume: return (2660ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:52.731777 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 02:58:52.744449 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9dec6921-4eb6-4667-adc5-24a8a3f5a83d req-aa17d2ce-641c-4315-83de-fc9df2a70dfe service nova] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Detach interface failed, port_id=dd748286-2659-4519-a5d7-5a24424d66f5, reason: Instance 82be1ace-dc06-42dd-8660-02439941fa00 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 02:58:52.749326 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:52.749517 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:52.749779 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Attaching volume a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd to /dev/vdb
May 27 02:58:52.766291 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Took 1.81 seconds to deallocate network for instance.
May 27 02:58:52.814682 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:58:52.828304 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 02:58:52.850335 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:52.877435 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 02:58:52.877813 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 02:58:52.886454 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 02:58:52.888540 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fec9:82f2', 'fe80::8c31:51ff:fe45:f0e7', 'fe80::fc16:3eff:fef0:b17a', 'fe80::fc16:3eff:fe0e:547', 'fe80::807d:e5ff:fe89:3c7a', 'fe80::fc16:3eff:feac:85cd', 'fe80::6cd9:f3ff:fedb:46b5', 'fe80::fc16:3eff:feb3:c1c6', 'fe80::fc16:3eff:fe0a:5341', 'fe80::fc16:3eff:fe83:102d', 'fe80::fc16:3eff:fe99:74e2', 'fe80::fc16:3eff:feb7:c7a8', 'fe80::b411:aaff:fe22:aa93', 'fe80::fc16:3eff:fe51:3d37', 'fe80::fc40:cdff:febb:ab70', 'fe80::fc16:3eff:fe81:1162', 'fe80::ac86:83ff:fe2f:8c85', 'fe80::fc16:3eff:fe62:4bbd', 'fe80::fc16:3eff:fe2e:6d18', 'fe80::fc16:3eff:fe66:2b5e', 'fe80::fc16:3eff:fe0f:1d12', 'fe80::fc16:3eff:fe28:9b06', 'fe80::905a:63ff:fe3f:a285', 'fe80::fc16:3eff:fe0f:78c6', 'fe80::304d:48ff:fe5e:ff03', 'fe80::fc16:3eff:fe8f:94b9', 'fe80::b820:35ff:fe01:438d', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b'] 
May 27 02:58:52.888764 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 02:58:52.888904 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 02:58:52.889065 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] <== get_connector_properties: return (74ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:52.889368 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Updating existing volume attachment record: 9f7f4e52-efa9-4068-88be-79a10021dd65 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 02:58:53.273221 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:53.273418 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:53.315139 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Lazy-loading 'flavor' on Instance uuid 09039461-93a4-458a-886e-9783f6edaf45 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:58:53.449084 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 02:58:53.449587 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:58:53.449783 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:53.451157 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:53.451449 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 02:58:53.476376 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:53.477631 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:53.478475 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:58:53.480121 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:58:53.480121 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:58:53.480121 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.startup = automatic
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.scan = manual
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:53.496171 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:53.496171 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.startup = automatic
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.scan = manual
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:58:53.500817 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:58:53.500817 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:53.517320 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:53.522892 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:53.542848 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:53.542848 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.065s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:53.546231 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:53.546231 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] HCTL ('8', '0', '0', 0) found on session 26 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:53.546231 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:53.554262 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:53.554262 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:53.554262 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:53.554262 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:53.554262 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:53.554262 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:53.554262 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:53.554262 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:53.554262 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:53.554262 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:53.554262 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:53.554262 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:53.554262 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:53.554262 np0000001475 nova-compute[98471]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:53.554262 np0000001475 nova-compute[98471]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:53.554262 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:53.554262 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:58:53.554924 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:53.554924 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:53.554924 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:58:53.554924 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:53.554924 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:58:53.554924 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:53.554924 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:58:53.554924 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:53.554924 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:58:53.554924 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:53.554924 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:58:53.554924 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:53.554924 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:58:53.554924 np0000001475 nova-compute[98471]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:53.554924 np0000001475 nova-compute[98471]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:58:53.554924 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:58:53.554924 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:58:53.554924 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.076s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:53.554924 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:58:53.556983 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Searching for a device in session 26 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:53.556983 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:53.557287 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] HCTL ('7', '0', '0', 0) found on session 25 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:58:53.557466 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:58:53.568964 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Searching for a device in session 25 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:58:53.569178 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:58:53.901801 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:58:53.902230 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:58:53.966635 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0005543879999549972 future=<Future at 0x7557247bbdd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:58:53.966635 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:58:53.966635 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=10.94370925499993 future=<Future at 0x755724423410 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:58:53.966635 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=10.94360358899985 future=<Future at 0x755724423410 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:58:53.967275 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Emitting event <LifecycleEvent: 1779850718.9655476, 7c0291f5-62af-417b-9418-41d808856a8d => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:58:53.967494 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] VM Stopped (Lifecycle Event)
May 27 02:58:54.322229 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-629d302a-9911-48d7-8b70-a05cc07f4168 tempest-VolumesAssistedSnapshotsTest-12214696 tempest-VolumesAssistedSnapshotsTest-12214696-project-admin] Lock "09039461-93a4-458a-886e-9783f6edaf45" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.513s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:54.405801 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:58:54.472101 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:58:54.479298 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 02:58:54.914670 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.641s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:54.988169 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Deleted allocations for instance 82be1ace-dc06-42dd-8660-02439941fa00
May 27 02:58:55.437452 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:55.496548 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Found WWN 3300000003c6ac048 for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 02:58:55.496938 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.046s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:58:55.497168 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] <== connect_volume: return (2047ms) {'type': 'block', 'scsi_wwn': '3300000003c6ac048', 'path': '/dev/dm-0', 'multipath_id': '3300000003c6ac048'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:55.497335 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003c6ac048', 'path': '/dev/dm-0', 'multipath_id': '3300000003c6ac048'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 02:58:55.500207 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lazy-loading 'flavor' on Instance uuid a6c0c0f0-846a-4ffb-8f02-d43af196da22 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:58:55.745870 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:56.000590 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-56d39cbc-142f-4b6c-b363-a7cdbec6a115 tempest-AttachSCSIVolumeTestJSON-1060946454 tempest-AttachSCSIVolumeTestJSON-1060946454-project-member] Lock "82be1ace-dc06-42dd-8660-02439941fa00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.957s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:56.005529 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Attempting to attach volume a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 02:58:56.008858 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] attach device xml: <disk type="block" device="disk">
May 27 02:58:56.008858 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:58:56.008858 np0000001475 nova-compute[98471]:   <alias name="ua-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd"/>
May 27 02:58:56.008858 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-0"/>
May 27 02:58:56.008858 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 02:58:56.008858 np0000001475 nova-compute[98471]:   <serial>a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd</serial>
May 27 02:58:56.008858 np0000001475 nova-compute[98471]:   <shareable/>
May 27 02:58:56.008858 np0000001475 nova-compute[98471]: </disk>
May 27 02:58:56.008858 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 02:58:56.566775 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Acquiring lock "09039461-93a4-458a-886e-9783f6edaf45" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:56.566775 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Lock "09039461-93a4-458a-886e-9783f6edaf45" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:56.566775 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Acquiring lock "09039461-93a4-458a-886e-9783f6edaf45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:56.566775 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Lock "09039461-93a4-458a-886e-9783f6edaf45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:56.566775 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Lock "09039461-93a4-458a-886e-9783f6edaf45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:56.568834 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Terminating instance
May 27 02:58:57.074704 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 02:58:57.108989 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:57.115269 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:57.138347 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:57.157148 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:57.195837 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:57.340254 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9eaf9a35-c418-44cd-9a1b-47fdbf353343 req-10ab27dd-2b42-49a9-af82-82f28fd5a71b service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Received event network-vif-unplugged-897240c0-5223-4d8f-b4dd-e3c9e51e849a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:57.344788 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9eaf9a35-c418-44cd-9a1b-47fdbf353343 req-10ab27dd-2b42-49a9-af82-82f28fd5a71b service nova] Acquiring lock "09039461-93a4-458a-886e-9783f6edaf45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:57.344788 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9eaf9a35-c418-44cd-9a1b-47fdbf353343 req-10ab27dd-2b42-49a9-af82-82f28fd5a71b service nova] Lock "09039461-93a4-458a-886e-9783f6edaf45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:57.345988 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9eaf9a35-c418-44cd-9a1b-47fdbf353343 req-10ab27dd-2b42-49a9-af82-82f28fd5a71b service nova] Lock "09039461-93a4-458a-886e-9783f6edaf45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:57.346242 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9eaf9a35-c418-44cd-9a1b-47fdbf353343 req-10ab27dd-2b42-49a9-af82-82f28fd5a71b service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] No waiting events found dispatching network-vif-unplugged-897240c0-5223-4d8f-b4dd-e3c9e51e849a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:58:57.346419 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9eaf9a35-c418-44cd-9a1b-47fdbf353343 req-10ab27dd-2b42-49a9-af82-82f28fd5a71b service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Received event network-vif-unplugged-897240c0-5223-4d8f-b4dd-e3c9e51e849a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:58:57.422001 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:57.439606 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:57.457809 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Instance destroyed successfully.
May 27 02:58:57.458363 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Lazy-loading 'resources' on Instance uuid 09039461-93a4-458a-886e-9783f6edaf45 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:58:57.463882 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999580573000003 future=<Future at 0x7557241933b0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:58:57.730214 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:57.730362 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:57.730466 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:58:57.730592 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] No VIF found with MAC fa:16:3e:f0:b1:7a, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:58:57.961512 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1095595740',display_name='tempest-VolumesAssistedSnapshotsTest-server-1095595740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesassistedsnapshotstest-server-1095595740',id=7,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqZvogiAMkt/fZUwOoh2XI0OVMEpZfVKfy3b5cAonbft5xj1LYsxTthreuUpoeXXwQKQV3UXus+6lfq7OdV5Vuu5jN2/a/Hg241OTA9slRPfTkSMwMotjADjkQW9SBSsQ==',key_name='tempest-keypair-2107810849',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:57:55Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce2779cce722472da45319e6a0faa7e1',ramdisk_id='',reservation_id='r-h3p5wp2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1998652501',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1998652501-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:57:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4409687dc6c64de9b9b3926cd5f1a3c3',uuid=09039461-93a4-458a-886e-9783f6edaf45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "address": "fa:16:3e:0e:05:47", "network": {"id": "d7d2098f-0324-469b-a994-bde15b0c7538", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1155020550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce2779cce722472da45319e6a0faa7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap897240c0-52", "ovs_interfaceid": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:58:57.961813 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Converting VIF {"id": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "address": "fa:16:3e:0e:05:47", "network": {"id": "d7d2098f-0324-469b-a994-bde15b0c7538", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1155020550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ce2779cce722472da45319e6a0faa7e1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap897240c0-52", "ovs_interfaceid": "897240c0-5223-4d8f-b4dd-e3c9e51e849a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:58:57.962492 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:05:47,bridge_name='br-int',has_traffic_filtering=True,id=897240c0-5223-4d8f-b4dd-e3c9e51e849a,network=Network(d7d2098f-0324-469b-a994-bde15b0c7538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap897240c0-52') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:58:57.962717 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:05:47,bridge_name='br-int',has_traffic_filtering=True,id=897240c0-5223-4d8f-b4dd-e3c9e51e849a,network=Network(d7d2098f-0324-469b-a994-bde15b0c7538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap897240c0-52') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:58:57.964336 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:57.966909 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap897240c0-52, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:57.968842 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:57.971168 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:57.972777 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:57.973806 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=238c1dad-b4e4-472b-9826-3524f8a2dbe1) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:58:57.975274 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:58:57.976602 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:58:57.978537 np0000001475 nova-compute[98471]: INFO os_vif [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:05:47,bridge_name='br-int',has_traffic_filtering=True,id=897240c0-5223-4d8f-b4dd-e3c9e51e849a,network=Network(d7d2098f-0324-469b-a994-bde15b0c7538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap897240c0-52')
May 27 02:58:57.978894 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Deleting instance files /opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45_del
May 27 02:58:57.979762 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Deletion of /opt/stack/data/nova/instances/09039461-93a4-458a-886e-9783f6edaf45_del complete
May 27 02:58:58.439197 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-15d33e61-7740-4648-8e50-ffb6b64e9293 req-73c6a330-ebdc-4a18-abec-36645b0f1d92 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received event volume-reimaged-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:58.439663 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-15d33e61-7740-4648-8e50-ffb6b64e9293 req-73c6a330-ebdc-4a18-abec-36645b0f1d92 service nova] Acquiring lock "7c0291f5-62af-417b-9418-41d808856a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:58.439663 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-15d33e61-7740-4648-8e50-ffb6b64e9293 req-73c6a330-ebdc-4a18-abec-36645b0f1d92 service nova] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:58.442732 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-15d33e61-7740-4648-8e50-ffb6b64e9293 req-73c6a330-ebdc-4a18-abec-36645b0f1d92 service nova] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:58.442732 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-15d33e61-7740-4648-8e50-ffb6b64e9293 req-73c6a330-ebdc-4a18-abec-36645b0f1d92 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Processing event volume-reimaged-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:58:58.442732 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Instance event wait completed in 9 seconds for volume-reimaged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 02:58:58.490064 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Took 1.42 seconds to destroy the instance on the hypervisor.
May 27 02:58:58.491692 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 02:58:58.491933 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 02:58:58.492063 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 09039461-93a4-458a-886e-9783f6edaf45] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 02:58:58.492328 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:58.571048 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:58:58.944881 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Booting with volume dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 at /dev/vda
May 27 02:58:59.009760 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:58:59.023421 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 02:58:59.053201 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:58:59.100891 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 02:58:59.100891 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 02:58:59.115994 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 02:58:59.120374 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fec9:82f2', 'fe80::8c31:51ff:fe45:f0e7', 'fe80::fc16:3eff:fef0:b17a', 'fe80::fc16:3eff:feac:85cd', 'fe80::6cd9:f3ff:fedb:46b5', 'fe80::fc16:3eff:feb3:c1c6', 'fe80::fc16:3eff:fe0a:5341', 'fe80::fc16:3eff:fe83:102d', 'fe80::fc16:3eff:fe99:74e2', 'fe80::fc16:3eff:feb7:c7a8', 'fe80::b411:aaff:fe22:aa93', 'fe80::fc16:3eff:fe51:3d37', 'fe80::fc40:cdff:febb:ab70', 'fe80::fc16:3eff:fe81:1162', 'fe80::ac86:83ff:fe2f:8c85', 'fe80::fc16:3eff:fe62:4bbd', 'fe80::fc16:3eff:fe2e:6d18', 'fe80::fc16:3eff:fe66:2b5e', 'fe80::fc16:3eff:fe0f:1d12', 'fe80::fc16:3eff:fe28:9b06', 'fe80::905a:63ff:fe3f:a285', 'fe80::fc16:3eff:fe0f:78c6', 'fe80::304d:48ff:fe5e:ff03', 'fe80::fc16:3eff:fe8f:94b9', 'fe80::b820:35ff:fe01:438d', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b'] 
May 27 02:58:59.120568 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 02:58:59.120611 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 02:58:59.122884 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:58:59.122884 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Updating existing volume attachment record: 13d61888-f5d7-421f-b22c-7dec4770be6e {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 02:58:59.313379 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b1ad3ae9-6494-45d9-8147-77d0cbbf6ac8 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.564s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:59.419994 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fa972188-874c-4274-b687-f42971fbd8c1 req-63e9fd4d-d2a0-47c3-9dad-277522e73d48 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Received event network-vif-unplugged-897240c0-5223-4d8f-b4dd-e3c9e51e849a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:59.421457 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fa972188-874c-4274-b687-f42971fbd8c1 req-63e9fd4d-d2a0-47c3-9dad-277522e73d48 service nova] Acquiring lock "09039461-93a4-458a-886e-9783f6edaf45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:58:59.422399 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fa972188-874c-4274-b687-f42971fbd8c1 req-63e9fd4d-d2a0-47c3-9dad-277522e73d48 service nova] Lock "09039461-93a4-458a-886e-9783f6edaf45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:58:59.422399 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fa972188-874c-4274-b687-f42971fbd8c1 req-63e9fd4d-d2a0-47c3-9dad-277522e73d48 service nova] Lock "09039461-93a4-458a-886e-9783f6edaf45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:58:59.422399 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fa972188-874c-4274-b687-f42971fbd8c1 req-63e9fd4d-d2a0-47c3-9dad-277522e73d48 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] No waiting events found dispatching network-vif-unplugged-897240c0-5223-4d8f-b4dd-e3c9e51e849a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:58:59.422808 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fa972188-874c-4274-b687-f42971fbd8c1 req-63e9fd4d-d2a0-47c3-9dad-277522e73d48 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Received event network-vif-unplugged-897240c0-5223-4d8f-b4dd-e3c9e51e849a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:58:59.423161 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fa972188-874c-4274-b687-f42971fbd8c1 req-63e9fd4d-d2a0-47c3-9dad-277522e73d48 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Received event network-vif-deleted-897240c0-5223-4d8f-b4dd-e3c9e51e849a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:58:59.423480 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-fa972188-874c-4274-b687-f42971fbd8c1 req-63e9fd4d-d2a0-47c3-9dad-277522e73d48 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Neutron deleted interface 897240c0-5223-4d8f-b4dd-e3c9e51e849a; detaching it from the instance and deleting it from the info cache
May 27 02:58:59.423821 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-fa972188-874c-4274-b687-f42971fbd8c1 req-63e9fd4d-d2a0-47c3-9dad-277522e73d48 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:59.612896 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:58:59.934410 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fa972188-874c-4274-b687-f42971fbd8c1 req-63e9fd4d-d2a0-47c3-9dad-277522e73d48 service nova] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Detach interface failed, port_id=897240c0-5223-4d8f-b4dd-e3c9e51e849a, reason: Instance 09039461-93a4-458a-886e-9783f6edaf45 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 02:59:00.116253 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Took 1.62 seconds to deallocate network for instance.
May 27 02:59:00.403154 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:00.425702 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-56f3da7e-9836-47f8-8267-fee4c428caa6 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:00.425964 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-56f3da7e-9836-47f8-8267-fee4c428caa6 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:00.622110 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:00.623243 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:00.748675 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:00.929218 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-56f3da7e-9836-47f8-8267-fee4c428caa6 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Detaching volume a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd
May 27 02:59:00.990193 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-56f3da7e-9836-47f8-8267-fee4c428caa6 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Attempting to driver detach volume a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd from mountpoint /dev/vdb
May 27 02:59:00.997075 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-56f3da7e-9836-47f8-8267-fee4c428caa6 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Found disk vdb by alias ua-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 02:59:01.001384 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-56f3da7e-9836-47f8-8267-fee4c428caa6 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Found disk vdb by alias ua-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 02:59:01.001384 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-56f3da7e-9836-47f8-8267-fee4c428caa6 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Attempting to detach device vdb from instance a6c0c0f0-846a-4ffb-8f02-d43af196da22 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 02:59:01.001384 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-56f3da7e-9836-47f8-8267-fee4c428caa6 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] detach device xml: <disk type="block" device="disk">
May 27 02:59:01.001384 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:59:01.001384 np0000001475 nova-compute[98471]:   <alias name="ua-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd"/>
May 27 02:59:01.001384 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-0"/>
May 27 02:59:01.001384 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 02:59:01.001384 np0000001475 nova-compute[98471]:   <serial>a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd</serial>
May 27 02:59:01.001384 np0000001475 nova-compute[98471]:   <shareable/>
May 27 02:59:01.001384 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 02:59:01.001384 np0000001475 nova-compute[98471]: </disk>
May 27 02:59:01.001384 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 02:59:01.008430 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-56f3da7e-9836-47f8-8267-fee4c428caa6 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Successfully detached device vdb from instance a6c0c0f0-846a-4ffb-8f02-d43af196da22 from the persistent domain config.
May 27 02:59:01.008615 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-56f3da7e-9836-47f8-8267-fee4c428caa6 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] (1/8): Attempting to detach device vdb with device alias ua-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd from instance a6c0c0f0-846a-4ffb-8f02-d43af196da22 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 02:59:01.008985 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-56f3da7e-9836-47f8-8267-fee4c428caa6 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] detach device xml: <disk type="block" device="disk">
May 27 02:59:01.008985 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:59:01.008985 np0000001475 nova-compute[98471]:   <alias name="ua-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd"/>
May 27 02:59:01.008985 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-0"/>
May 27 02:59:01.008985 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 02:59:01.008985 np0000001475 nova-compute[98471]:   <serial>a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd</serial>
May 27 02:59:01.008985 np0000001475 nova-compute[98471]:   <shareable/>
May 27 02:59:01.008985 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 02:59:01.008985 np0000001475 nova-compute[98471]: </disk>
May 27 02:59:01.008985 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 02:59:01.092460 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:59:01.092698 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:59:01.179881 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 02:59:01.276431 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 02:59:01.276884 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Creating image(s)
May 27 02:59:01.278329 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 02:59:01.278329 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Ensure instance console log exists: /opt/stack/data/nova/instances/7c0291f5-62af-417b-9418-41d808856a8d/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 02:59:01.278638 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:01.278879 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:01.279095 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:01.282357 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Start _get_guest_xml network_info=[{"id": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "address": "fa:16:3e:26:2c:eb", "network": {"id": "c7f25d43-cc3f-4be2-b8f5-311363bbd4ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1793934555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36131e6324ff45ddb65932f4ade9a1a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f6cb37-5c", "ovs_interfaceid": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-27T02:54:58Z,direct_url=<?>,disk_format='qcow2',id=48155fdd-4ef0-4719-a052-7861f417b7f0,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-27T02:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7c0291f5-62af-417b-9418-41d808856a8d', 'attached_at': '', 'detached_at': '', 'volume_id': 'dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'serial': 'dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '13d61888-f5d7-421f-b22c-7dec4770be6e', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 02:59:01.285918 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 27 02:59:01.287137 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='48155fdd-4ef0-4719-a052-7861f417b7f0', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-424293934', uuid='7c0291f5-62af-417b-9418-41d808856a8d'), owner=OwnerMeta(userid='34d4ecd608df47c6b6057f74772ef553', username='tempest-ServerActionsV293TestJSON-450650320-project-member', projectid='36131e6324ff45ddb65932f4ade9a1a8', projectname='tempest-ServerActionsV293TestJSON-450650320'), image=ImageMeta(id='', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "address": "fa:16:3e:26:2c:eb", "network": {"id": "c7f25d43-cc3f-4be2-b8f5-311363bbd4ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1793934555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36131e6324ff45ddb65932f4ade9a1a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f6cb37-5c", "ovs_interfaceid": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850741.28676) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 02:59:01.288461 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 02:59:01.289049 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 02:59:01.290598 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 02:59:01.290791 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 02:59:01.292086 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 02:59:01.292566 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-27T02:54:58Z,direct_url=<?>,disk_format='qcow2',id=48155fdd-4ef0-4719-a052-7861f417b7f0,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-27T02:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 02:59:01.292731 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 02:59:01.292909 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 02:59:01.293098 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 02:59:01.293235 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 02:59:01.293394 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 02:59:01.293782 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 02:59:01.293782 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 02:59:01.293903 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 02:59:01.294004 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 02:59:01.294221 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 02:59:01.294301 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7c0291f5-62af-417b-9418-41d808856a8d {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:59:01.601771 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:59:01.644111 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779850741.6435857, a6c0c0f0-846a-4ffb-8f02-d43af196da22 => ua-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 02:59:01.647303 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-56f3da7e-9836-47f8-8267-fee4c428caa6 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd for instance a6c0c0f0-846a-4ffb-8f02-d43af196da22 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 02:59:01.650206 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-56f3da7e-9836-47f8-8267-fee4c428caa6 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Successfully detached device vdb from instance a6c0c0f0-846a-4ffb-8f02-d43af196da22 from the live domain config.
May 27 02:59:01.807056 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 02:59:01.807406 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:59:01.807586 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:59:01.808112 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:59:01.808312 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 02:59:01.821246 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:59:01.822037 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:59:01.822598 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:59:01.822900 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:59:01.823574 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:59:01.824153 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:59:01.838028 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:59:01.838028 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:01.848236 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:59:01.848236 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:01.862889 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41] added
May 27 02:59:01.862889 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:59:01.862889 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:59:01.862889 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:59:01.862889 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:59:01.862889 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:59:01.862889 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:01.863140 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41] added
May 27 02:59:01.863140 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:59:01.863140 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:59:01.863140 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:59:01.863140 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:59:01.863140 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:59:01.863140 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:01.863349 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:59:01.863568 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:59:01.863846 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0406(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:59:01.864112 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0398(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:59:01.864714 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:59:01.864714 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:59:02.108793 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.486s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:02.177991 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Deleted allocations for instance 09039461-93a4-458a-886e-9783f6edaf45
May 27 02:59:02.190214 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-56f3da7e-9836-47f8-8267-fee4c428caa6 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Detected multiple connections on this host for volume: a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd, skipping target disconnect.
May 27 02:59:02.756689 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:02.760899 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-56f3da7e-9836-47f8-8267-fee4c428caa6 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lazy-loading 'flavor' on Instance uuid a6c0c0f0-846a-4ffb-8f02-d43af196da22 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:59:02.864971 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:59:02.865461 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:59:02.880160 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:59:02.880160 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:59:02.885888 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:59:02.885888 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:02.897774 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:02.902131 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:02.918282 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:02.918282 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:02.918282 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:02.918282 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:02.918282 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:02.918282 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:02.918282 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:02.918282 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:02.918282 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:02.918282 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:02.918282 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:02.918282 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:59:02.918282 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:59:02.918282 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:02.918282 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:02.918733 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:02.918733 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:02.918733 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:02.918733 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:02.918733 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:02.918733 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:02.918733 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:02.918733 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:02.918733 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:02.918733 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:02.918733 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:02.918733 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:59:02.918733 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:59:02.918733 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:02.918733 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:02.933178 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:02.933178 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:02.933178 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:02.933178 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:02.933178 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:02.933178 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:02.933178 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:02.933178 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:02.933178 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:02.933178 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:02.933178 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:02.933178 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:59:02.933178 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:59:02.933178 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:02.933178 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:02.933875 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:02.933875 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:02.933875 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:02.933875 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:02.933875 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:02.933875 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:02.933875 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:02.933875 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:02.933875 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:02.933875 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:02.933875 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:02.933875 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:59:02.933875 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:59:02.933875 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:02.933875 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:02.975018 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:02.977725 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, portal: 192.168.50.100,3260]
May 27 02:59:02.977725 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, portal: 192.168.50.100,3260] successful.
May 27 02:59:02.977725 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:02.994269 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:03.004212 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, portal: 192.168.40.100,3260]
May 27 02:59:03.004212 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, portal: 192.168.40.100,3260] successful.
May 27 02:59:03.004212 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:03.015705 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:03.016528 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:03.018610 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:59:03.018610 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:59:03.018610 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] HCTL ('21', '-', '-', 0) found on session 29 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:59:03.018610 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:59:03.038956 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Searching for a device in session 29 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:59:03.038956 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:59:03.056073 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:03.056073 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:03.056073 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:03.056073 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:03.056073 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:03.056073 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:03.056073 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:03.056073 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:03.056073 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:03.056073 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:03.056073 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:03.056073 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:59:03.056073 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:59:03.056073 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:03.056073 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:03.056073 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:03.056073 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:03.056592 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:03.056592 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:03.056592 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:03.056592 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:03.056592 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:03.056592 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:03.056592 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:03.056592 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:03.056592 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:03.056592 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:03.056592 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:03.056592 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:59:03.056592 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:59:03.056592 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:03.056592 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:03.056592 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:03.056592 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:03.057155 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.233s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:59:03.057155 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:59:03.058068 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] HCTL ('22', '-', '-', 0) found on session 30 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:59:03.058154 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:59:03.077975 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Searching for a device in session 30 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:59:03.077975 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:59:03.192084 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ffe8bd8c-b7b5-451b-8565-835fd24a5737 tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Lock "09039461-93a4-458a-886e-9783f6edaf45" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.625s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:03.773825 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-56f3da7e-9836-47f8-8267-fee4c428caa6 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.348s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:03.824775 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 02:59:04.842824 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Found WWN 330000000dfd8a205 for multipath device dm-1 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 02:59:04.843247 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:59:04.843247 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000dfd8a205', 'path': '/dev/dm-1', 'multipath_id': '330000000dfd8a205'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:59:04.843407 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000dfd8a205', 'path': '/dev/dm-1', 'multipath_id': '330000000dfd8a205'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 02:59:04.913498 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.003063917000190486 future=<Future at 0x755724423410 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:04.913601 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:04.913654 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=7.549660044999882 future=<Future at 0x7557241933b0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:04.915563 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=7.549555952999981 future=<Future at 0x7557241933b0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:04.915563 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Emitting event <LifecycleEvent: 1779850729.9101133, 82be1ace-dc06-42dd-8660-02439941fa00 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:59:04.915563 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] VM Stopped (Lifecycle Event)
May 27 02:59:04.925675 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "63151241-1b03-4b3c-9ecd-27703137e752" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:04.925675 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "63151241-1b03-4b3c-9ecd-27703137e752" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:05.347997 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-424293934',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serveractionsv293testjson-server-1629751309',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD01cBGq/IkOVvMiNNSEzke/Ew4L0jaQY97yIGPfSv1JXwnxRa+HmYDFmBWFxgN0p371J80Ye8vuUhMxKGiaH6IKyRaiveYFSXCzEZJC6BeRyymyWvE7WXoWHiN9My+zCA==',key_name='tempest-keypair-795165112',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:57:55Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='36131e6324ff45ddb65932f4ade9a1a8',ramdisk_id='',reservation_id='r-hxvg0h83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='48155fdd-4ef0-4719-a052-7861f417b7f0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-450650320',owner_user_name='tempest-ServerActionsV293TestJSON-450650320-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:58:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d4ecd608df47c6b6057f74772ef553',uuid=7c0291f5-62af-417b-9418-41d808856a8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "address": "fa:16:3e:26:2c:eb", "network": {"id": "c7f25d43-cc3f-4be2-b8f5-311363bbd4ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1793934555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36131e6324ff45ddb65932f4ade9a1a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f6cb37-5c", "ovs_interfaceid": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:59:05.348265 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Converting VIF {"id": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "address": "fa:16:3e:26:2c:eb", "network": {"id": "c7f25d43-cc3f-4be2-b8f5-311363bbd4ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1793934555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36131e6324ff45ddb65932f4ade9a1a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f6cb37-5c", "ovs_interfaceid": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:05.349043 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:2c:eb,bridge_name='br-int',has_traffic_filtering=True,id=51f6cb37-5c11-47c2-bf1c-d072ecfff71a,network=Network(c7f25d43-cc3f-4be2-b8f5-311363bbd4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f6cb37-5c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:05.351918 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] End _get_guest_xml xml=<domain type="qemu">
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:   <uuid>7c0291f5-62af-417b-9418-41d808856a8d</uuid>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:   <name>instance-00000006</name>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:   <metadata>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerActionsV293TestJSON-server-424293934</nova:name>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 02:59:01</nova:creationTime>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <nova:image uuid="48155fdd-4ef0-4719-a052-7861f417b7f0">
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       </nova:image>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:         <nova:user uuid="34d4ecd608df47c6b6057f74772ef553">tempest-ServerActionsV293TestJSON-450650320-project-member</nova:user>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:         <nova:project uuid="36131e6324ff45ddb65932f4ade9a1a8">tempest-ServerActionsV293TestJSON-450650320</nova:project>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid="48155fdd-4ef0-4719-a052-7861f417b7f0"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:         <nova:port uuid="51f6cb37-5c11-47c2-bf1c-d072ecfff71a">
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:   </metadata>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     <system>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <entry name="serial">7c0291f5-62af-417b-9418-41d808856a8d</entry>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <entry name="uuid">7c0291f5-62af-417b-9418-41d808856a8d</entry>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     </system>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:   <os>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:   </os>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:   <features>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     <acpi/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     <tcg>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     </tcg>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:   </features>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:   <devices>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/7c0291f5-62af-417b-9418-41d808856a8d/disk.config"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     </disk>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <alias name="ua-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-1"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <serial>dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41</serial>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     </disk>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:26:2c:eb"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <target dev="tap51f6cb37-5c"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     </interface>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/7c0291f5-62af-417b-9418-41d808856a8d/console.log" append="off"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     </serial>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     <video>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     </video>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     </rng>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:     </memballoon>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:   </devices>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]: </domain>
May 27 02:59:05.351918 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 02:59:05.354690 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-424293934',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serveractionsv293testjson-server-1629751309',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD01cBGq/IkOVvMiNNSEzke/Ew4L0jaQY97yIGPfSv1JXwnxRa+HmYDFmBWFxgN0p371J80Ye8vuUhMxKGiaH6IKyRaiveYFSXCzEZJC6BeRyymyWvE7WXoWHiN9My+zCA==',key_name='tempest-keypair-795165112',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:57:55Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='36131e6324ff45ddb65932f4ade9a1a8',ramdisk_id='',reservation_id='r-hxvg0h83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='48155fdd-4ef0-4719-a052-7861f417b7f0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-450650320',owner_user_name='tempest-ServerActionsV293TestJSON-450650320-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:58:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d4ecd608df47c6b6057f74772ef553',uuid=7c0291f5-62af-417b-9418-41d808856a8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "address": "fa:16:3e:26:2c:eb", "network": {"id": "c7f25d43-cc3f-4be2-b8f5-311363bbd4ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1793934555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36131e6324ff45ddb65932f4ade9a1a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f6cb37-5c", "ovs_interfaceid": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:59:05.355394 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Converting VIF {"id": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "address": "fa:16:3e:26:2c:eb", "network": {"id": "c7f25d43-cc3f-4be2-b8f5-311363bbd4ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1793934555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36131e6324ff45ddb65932f4ade9a1a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f6cb37-5c", "ovs_interfaceid": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:05.355515 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:2c:eb,bridge_name='br-int',has_traffic_filtering=True,id=51f6cb37-5c11-47c2-bf1c-d072ecfff71a,network=Network(c7f25d43-cc3f-4be2-b8f5-311363bbd4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f6cb37-5c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:05.356153 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:2c:eb,bridge_name='br-int',has_traffic_filtering=True,id=51f6cb37-5c11-47c2-bf1c-d072ecfff71a,network=Network(c7f25d43-cc3f-4be2-b8f5-311363bbd4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f6cb37-5c') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:59:05.356450 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:05.356791 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:05.357322 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:59:05.359139 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:05.359378 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f01475d1-1f38-5fb0-8416-61f7631cdba3', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:05.360225 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:05.361117 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:05.362215 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:05.365488 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:05.365754 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51f6cb37-5c, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:05.366384 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51f6cb37-5c, col_values=(('qos', UUID('a0891a80-ed52-4ca4-be1f-3ebeeaafb687')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:05.366609 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51f6cb37-5c, col_values=(('external_ids', {'iface-id': '51f6cb37-5c11-47c2-bf1c-d072ecfff71a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:2c:eb', 'vm-uuid': '7c0291f5-62af-417b-9418-41d808856a8d'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:05.367660 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:05.369377 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:05.374754 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:05.375809 np0000001475 nova-compute[98471]: INFO os_vif [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:2c:eb,bridge_name='br-int',has_traffic_filtering=True,id=51f6cb37-5c11-47c2-bf1c-d072ecfff71a,network=Network(c7f25d43-cc3f-4be2-b8f5-311363bbd4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f6cb37-5c')
May 27 02:59:05.418814 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 82be1ace-dc06-42dd-8660-02439941fa00] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:59:05.431420 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Detaching volume a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd
May 27 02:59:05.500368 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Attempting to driver detach volume a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd from mountpoint /dev/vdb
May 27 02:59:05.506362 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Found disk vdb by alias ua-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 02:59:05.507805 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Found disk vdb by alias ua-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 02:59:05.507957 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Attempting to detach device vdb from instance 63151241-1b03-4b3c-9ecd-27703137e752 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 02:59:05.510063 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] detach device xml: <disk type="block" device="disk">
May 27 02:59:05.510063 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:59:05.510063 np0000001475 nova-compute[98471]:   <alias name="ua-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd"/>
May 27 02:59:05.510063 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-0"/>
May 27 02:59:05.510063 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 02:59:05.510063 np0000001475 nova-compute[98471]:   <serial>a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd</serial>
May 27 02:59:05.510063 np0000001475 nova-compute[98471]:   <shareable/>
May 27 02:59:05.510063 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 02:59:05.510063 np0000001475 nova-compute[98471]: </disk>
May 27 02:59:05.510063 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 02:59:05.520328 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Successfully detached device vdb from instance 63151241-1b03-4b3c-9ecd-27703137e752 from the persistent domain config.
May 27 02:59:05.520522 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] (1/8): Attempting to detach device vdb with device alias ua-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd from instance 63151241-1b03-4b3c-9ecd-27703137e752 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 02:59:05.520827 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] detach device xml: <disk type="block" device="disk">
May 27 02:59:05.520827 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:59:05.520827 np0000001475 nova-compute[98471]:   <alias name="ua-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd"/>
May 27 02:59:05.520827 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-0"/>
May 27 02:59:05.520827 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 02:59:05.520827 np0000001475 nova-compute[98471]:   <serial>a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd</serial>
May 27 02:59:05.520827 np0000001475 nova-compute[98471]:   <shareable/>
May 27 02:59:05.520827 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 02:59:05.520827 np0000001475 nova-compute[98471]: </disk>
May 27 02:59:05.520827 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 02:59:05.753430 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:05.888210 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:06.891031 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:59:06.891415 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:59:06.891415 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] No VIF found with MAC fa:16:3e:26:2c:eb, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:59:06.891791 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Using config drive
May 27 02:59:07.396277 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lazy-loading 'ec2_ids' on Instance uuid 7c0291f5-62af-417b-9418-41d808856a8d {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:59:07.578003 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779850747.5776153, 63151241-1b03-4b3c-9ecd-27703137e752 => ua-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 02:59:07.579733 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd for instance 63151241-1b03-4b3c-9ecd-27703137e752 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 02:59:07.584322 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Successfully detached device vdb from instance 63151241-1b03-4b3c-9ecd-27703137e752 from the live domain config.
May 27 02:59:07.626656 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 02:59:07.626798 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:59:07.626924 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:59:07.627278 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:59:07.629693 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 02:59:07.629693 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 02:59:07.666089 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:07.666089 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:07.666089 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:07.666089 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:07.666089 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:07.666089 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:07.666089 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:07.666089 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:07.666089 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:07.666089 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:07.666089 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:07.666089 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:59:07.666089 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:59:07.666089 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:07.666089 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:07.666089 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:07.666089 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:07.668799 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:07.668799 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:07.668799 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:07.668799 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:07.668799 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:07.668799 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:07.668799 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:07.668799 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:07.668799 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:07.668799 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:07.668799 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:07.668799 np0000001475 nova-compute[98471]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:59:07.668799 np0000001475 nova-compute[98471]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd (non-flash)
May 27 02:59:07.668799 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:07.668799 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:07.668799 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:07.668799 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:07.668799 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', '9')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 02:59:07.668799 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', '26')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:59:07.669482 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd', '25')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:59:07.671247 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755724646480>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd'): ({'sdb'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 02:59:07.671477 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Removing multipathed devices sdc, sdb {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 02:59:07.671759 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Flush multipath device 3300000003c6ac048 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 02:59:07.706279 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:59:07.753536 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:59:07.800894 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 02:59:07.801098 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 02:59:07.803375 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 02:59:07.817059 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 02:59:07.817503 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 02:59:07.834108 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:07.885606 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd, portal: 192.168.40.100,3260]
May 27 02:59:07.885606 np0000001475 nova-compute[98471]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd, portal: 192.168.40.100,3260] successful.
May 27 02:59:07.885606 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:07.901103 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Object Instance<7c0291f5-62af-417b-9418-41d808856a8d> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 02:59:07.901537 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lazy-loading 'keypairs' on Instance uuid 7c0291f5-62af-417b-9418-41d808856a8d {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:59:07.914907 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:07.931984 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:08.022589 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:08.031966 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd, portal: 192.168.50.100,3260]
May 27 02:59:08.031966 np0000001475 nova-compute[98471]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-a2a2d0b5-f90a-4e5b-8440-c5f3cab027cd, portal: 192.168.50.100,3260] successful.
May 27 02:59:08.031966 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:08.056779 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:08.057009 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:59:08.057133 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] <== disconnect_volume: return (430ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:59:08.057295 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 02:59:08.405065 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Object Instance<7c0291f5-62af-417b-9418-41d808856a8d> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 02:59:08.407770 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 27 02:59:08.572481 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Creating config drive at /opt/stack/data/nova/instances/7c0291f5-62af-417b-9418-41d808856a8d/disk.config
May 27 02:59:08.579706 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7c0291f5-62af-417b-9418-41d808856a8d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb09po8wl {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:08.624930 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7c0291f5-62af-417b-9418-41d808856a8d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb09po8wl" returned: 0 in 0.045s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:08.630174 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lazy-loading 'flavor' on Instance uuid 63151241-1b03-4b3c-9ecd-27703137e752 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:59:09.161643 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:09.200989 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:09.200989 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:09.289395 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:09.413711 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-dea8fe05-62e5-45bf-b3fb-3517ecd94c80 req-520b4990-bbec-4b43-8f6a-0e2cd06de5e4 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received event network-vif-plugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:09.414639 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-dea8fe05-62e5-45bf-b3fb-3517ecd94c80 req-520b4990-bbec-4b43-8f6a-0e2cd06de5e4 service nova] Acquiring lock "7c0291f5-62af-417b-9418-41d808856a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:09.414639 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-dea8fe05-62e5-45bf-b3fb-3517ecd94c80 req-520b4990-bbec-4b43-8f6a-0e2cd06de5e4 service nova] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:09.414639 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-dea8fe05-62e5-45bf-b3fb-3517ecd94c80 req-520b4990-bbec-4b43-8f6a-0e2cd06de5e4 service nova] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:09.414639 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-dea8fe05-62e5-45bf-b3fb-3517ecd94c80 req-520b4990-bbec-4b43-8f6a-0e2cd06de5e4 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] No waiting events found dispatching network-vif-plugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:09.414639 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-dea8fe05-62e5-45bf-b3fb-3517ecd94c80 req-520b4990-bbec-4b43-8f6a-0e2cd06de5e4 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received unexpected event network-vif-plugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a for instance with vm_state active and task_state rebuild_spawning.
May 27 02:59:09.539780 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:09.541617 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:09.547016 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:09.570152 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:09.644941 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d103e10e-e2f3-4d6f-b000-c3d5e434b59c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "63151241-1b03-4b3c-9ecd-27703137e752" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.719s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:10.088960 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850750.0879374, 7c0291f5-62af-417b-9418-41d808856a8d => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:59:10.089128 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] VM Resumed (Lifecycle Event)
May 27 02:59:10.091452 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Instance event wait completed in 0 seconds for  {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 02:59:10.091452 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 02:59:10.093776 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Instance spawned successfully.
May 27 02:59:10.094517 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 02:59:10.343626 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "63151241-1b03-4b3c-9ecd-27703137e752" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:10.344460 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "63151241-1b03-4b3c-9ecd-27703137e752" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:10.344460 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "63151241-1b03-4b3c-9ecd-27703137e752-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:10.344460 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "63151241-1b03-4b3c-9ecd-27703137e752-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:10.344460 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "63151241-1b03-4b3c-9ecd-27703137e752-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:10.347294 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Terminating instance
May 27 02:59:10.368584 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:10.379572 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:10.436431 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:10.481905 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:10.482184 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:10.482632 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:10.482718 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:10.483890 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:10.486960 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Terminating instance
May 27 02:59:10.592487 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:59:10.593955 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:59:10.599809 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:59:10.599971 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:59:10.600300 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:59:10.600553 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:59:10.600833 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:59:10.601117 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:59:10.760854 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:10.851938 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 02:59:10.891227 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:10.897951 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:10.921273 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:10.993955 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 02:59:11.033657 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:11.043354 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:11.066038 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:11.096754 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 27 02:59:11.097257 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850751.096831, 7c0291f5-62af-417b-9418-41d808856a8d => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:59:11.098050 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] VM Started (Lifecycle Event)
May 27 02:59:11.108763 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:59:11.130879 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:11.145992 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:11.174363 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:11.200978 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:11.215933 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:11.363527 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Instance destroyed successfully.
May 27 02:59:11.363527 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lazy-loading 'resources' on Instance uuid 63151241-1b03-4b3c-9ecd-27703137e752 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:59:11.379217 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Instance destroyed successfully.
May 27 02:59:11.379819 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lazy-loading 'resources' on Instance uuid a6c0c0f0-846a-4ffb-8f02-d43af196da22 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:59:11.553077 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received event network-vif-plugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:11.553457 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] Acquiring lock "7c0291f5-62af-417b-9418-41d808856a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:11.553546 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:11.553938 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:11.553938 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] No waiting events found dispatching network-vif-plugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:11.554184 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received unexpected event network-vif-plugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a for instance with vm_state active and task_state None.
May 27 02:59:11.554184 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Received event network-vif-unplugged-abb5cffe-8cbc-49eb-8f62-0014bcc3d411 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:11.556851 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] Acquiring lock "63151241-1b03-4b3c-9ecd-27703137e752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:11.556851 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] Lock "63151241-1b03-4b3c-9ecd-27703137e752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:11.556851 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] Lock "63151241-1b03-4b3c-9ecd-27703137e752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:11.556851 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] No waiting events found dispatching network-vif-unplugged-abb5cffe-8cbc-49eb-8f62-0014bcc3d411 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:11.556851 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Received event network-vif-unplugged-abb5cffe-8cbc-49eb-8f62-0014bcc3d411 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:11.556851 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Received event network-vif-unplugged-abb5cffe-8cbc-49eb-8f62-0014bcc3d411 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:11.556851 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] Acquiring lock "63151241-1b03-4b3c-9ecd-27703137e752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:11.556851 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] Lock "63151241-1b03-4b3c-9ecd-27703137e752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:11.556851 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] Lock "63151241-1b03-4b3c-9ecd-27703137e752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:11.556851 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] No waiting events found dispatching network-vif-unplugged-abb5cffe-8cbc-49eb-8f62-0014bcc3d411 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:11.556851 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Received event network-vif-unplugged-abb5cffe-8cbc-49eb-8f62-0014bcc3d411 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:11.556851 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Received event network-vif-unplugged-85ecf3fb-ef43-44a6-836b-a5e5da02646a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:11.556851 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] Acquiring lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:11.556851 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:11.556851 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:11.556851 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] No waiting events found dispatching network-vif-unplugged-85ecf3fb-ef43-44a6-836b-a5e5da02646a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:11.558647 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9f9105ae-3f3a-4646-a24e-da121a838231 req-92874b47-d6ce-4123-b701-166d154a34e8 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Received event network-vif-unplugged-85ecf3fb-ef43-44a6-836b-a5e5da02646a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:11.607340 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:59:11.612474 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:59:11.628058 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:11.629447 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:11.629447 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98471) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 27 02:59:11.867615 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-35889191-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testmultiattachvolumeswap-server-35889191-1',id=4,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlRtMXwXqxxfCfk2wyrdM1hVxwG04jAUqbKrwT0tKGr215eYb70ufBC6UJCH08Wx1O2T2A6AmB32SehIkLbG1sWa6RBHWBcWk6dNyZtDA3quPSBXjFAUUg0eY2X8vP3HQ==',key_name='tempest-keypair-1968274056',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:57:52Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2254e04d10914b0d9b3768ba32b8559d',ramdisk_id='',reservation_id='r-3gu306zc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-90789856',owner_user_name='tempest-TestMultiAttachVolumeSwap-90789856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:57:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84dc8d0aa07e4080860c3b0ef5b1a6f8',uuid=63151241-1b03-4b3c-9ecd-27703137e752,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "address": "fa:16:3e:c9:82:f2", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb5cffe-8c", "ovs_interfaceid": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:59:11.867615 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Converting VIF {"id": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "address": "fa:16:3e:c9:82:f2", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb5cffe-8c", "ovs_interfaceid": "abb5cffe-8cbc-49eb-8f62-0014bcc3d411", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:11.868329 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=abb5cffe-8cbc-49eb-8f62-0014bcc3d411,network=Network(d665ed1b-f99c-428d-840a-3ab6ee008b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb5cffe-8c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:11.868609 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=abb5cffe-8cbc-49eb-8f62-0014bcc3d411,network=Network(d665ed1b-f99c-428d-840a-3ab6ee008b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb5cffe-8c') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:59:11.871067 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:11.871482 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabb5cffe-8c, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:11.872724 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:11.873679 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:11.880457 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:11.882446 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:11.884577 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-35889191-2',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testmultiattachvolumeswap-server-35889191-2',id=5,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlRtMXwXqxxfCfk2wyrdM1hVxwG04jAUqbKrwT0tKGr215eYb70ufBC6UJCH08Wx1O2T2A6AmB32SehIkLbG1sWa6RBHWBcWk6dNyZtDA3quPSBXjFAUUg0eY2X8vP3HQ==',key_name='tempest-keypair-1968274056',keypairs=<?>,launch_index=1,launched_at=2026-05-27T02:57:52Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2254e04d10914b0d9b3768ba32b8559d',ramdisk_id='',reservation_id='r-3gu306zc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-90789856',owner_user_name='tempest-TestMultiAttachVolumeSwap-90789856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:57:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84dc8d0aa07e4080860c3b0ef5b1a6f8',uuid=a6c0c0f0-846a-4ffb-8f02-d43af196da22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "address": "fa:16:3e:f0:b1:7a", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf3fb-ef", "ovs_interfaceid": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:59:11.885066 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9e31009-283c-431f-96ad-19e50f0b31d9) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:11.885555 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Converting VIF {"id": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "address": "fa:16:3e:f0:b1:7a", "network": {"id": "d665ed1b-f99c-428d-840a-3ab6ee008b5f", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1505923681-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2254e04d10914b0d9b3768ba32b8559d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ecf3fb-ef", "ovs_interfaceid": "85ecf3fb-ef43-44a6-836b-a5e5da02646a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:11.886517 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:b1:7a,bridge_name='br-int',has_traffic_filtering=True,id=85ecf3fb-ef43-44a6-836b-a5e5da02646a,network=Network(d665ed1b-f99c-428d-840a-3ab6ee008b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ecf3fb-ef') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:11.886790 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:b1:7a,bridge_name='br-int',has_traffic_filtering=True,id=85ecf3fb-ef43-44a6-836b-a5e5da02646a,network=Network(d665ed1b-f99c-428d-840a-3ab6ee008b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ecf3fb-ef') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:59:11.894096 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:11.894311 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:11.896264 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:11.896358 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85ecf3fb-ef, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:11.899246 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:11.901242 np0000001475 nova-compute[98471]: INFO os_vif [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:82:f2,bridge_name='br-int',has_traffic_filtering=True,id=abb5cffe-8cbc-49eb-8f62-0014bcc3d411,network=Network(d665ed1b-f99c-428d-840a-3ab6ee008b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb5cffe-8c')
May 27 02:59:11.904946 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:11.905492 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Deleting instance files /opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752_del
May 27 02:59:11.906494 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:11.906759 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a6886be-7f07-4b22-ac47-75f32bfe9e98) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:11.909772 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:11.909772 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:11.909772 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Deletion of /opt/stack/data/nova/instances/63151241-1b03-4b3c-9ecd-27703137e752_del complete
May 27 02:59:11.914584 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:11.930250 np0000001475 nova-compute[98471]: INFO os_vif [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:b1:7a,bridge_name='br-int',has_traffic_filtering=True,id=85ecf3fb-ef43-44a6-836b-a5e5da02646a,network=Network(d665ed1b-f99c-428d-840a-3ab6ee008b5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ecf3fb-ef')
May 27 02:59:11.930250 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Deleting instance files /opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22_del
May 27 02:59:11.930250 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Deletion of /opt/stack/data/nova/instances/a6c0c0f0-846a-4ffb-8f02-d43af196da22_del complete
May 27 02:59:12.117728 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99966735299995 future=<Future at 0x75572473a270 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:12.118432 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999810347999983 future=<Future at 0x75572473a180 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:12.420719 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Took 1.57 seconds to destroy the instance on the hypervisor.
May 27 02:59:12.422099 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 02:59:12.422234 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 02:59:12.422337 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 02:59:12.422633 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:12.434098 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Took 1.44 seconds to destroy the instance on the hypervisor.
May 27 02:59:12.436238 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 02:59:12.437093 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 02:59:12.437447 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 02:59:12.437447 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:12.464645 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0012455700000373326 future=<Future at 0x7557241933b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:12.464805 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:12.465829 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.652416683999945 future=<Future at 0x75572473a270 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:12.465829 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.652305648000038 future=<Future at 0x75572473a270 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:12.465829 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Emitting event <LifecycleEvent: 1779850737.4632568, 09039461-93a4-458a-886e-9783f6edaf45 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:59:12.465829 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] VM Stopped (Lifecycle Event)
May 27 02:59:12.559229 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:12.632561 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:12.647037 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15d33e61-7740-4648-8e50-ffb6b64e9293 tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.018s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:12.969976 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 09039461-93a4-458a-886e-9783f6edaf45] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:59:12.992915 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c54fdf9f-2576-44b4-baba-38f2ce2e2451 req-b11e0dde-1a39-4885-a966-a163ae163131 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Received event network-vif-deleted-85ecf3fb-ef43-44a6-836b-a5e5da02646a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:12.994103 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-c54fdf9f-2576-44b4-baba-38f2ce2e2451 req-b11e0dde-1a39-4885-a966-a163ae163131 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Neutron deleted interface 85ecf3fb-ef43-44a6-836b-a5e5da02646a; detaching it from the instance and deleting it from the info cache
May 27 02:59:12.995660 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c54fdf9f-2576-44b4-baba-38f2ce2e2451 req-b11e0dde-1a39-4885-a966-a163ae163131 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:59:13.413153 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:59:13.504713 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c54fdf9f-2576-44b4-baba-38f2ce2e2451 req-b11e0dde-1a39-4885-a966-a163ae163131 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Detach interface failed, port_id=85ecf3fb-ef43-44a6-836b-a5e5da02646a, reason: Instance a6c0c0f0-846a-4ffb-8f02-d43af196da22 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 02:59:13.649343 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9151bff9-e933-419b-b3fa-65cd52b8bf55 req-edd02a00-8313-4c90-8f2a-2391e6e30dc6 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Received event network-vif-unplugged-85ecf3fb-ef43-44a6-836b-a5e5da02646a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:13.649343 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9151bff9-e933-419b-b3fa-65cd52b8bf55 req-edd02a00-8313-4c90-8f2a-2391e6e30dc6 service nova] Acquiring lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:13.649343 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9151bff9-e933-419b-b3fa-65cd52b8bf55 req-edd02a00-8313-4c90-8f2a-2391e6e30dc6 service nova] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:13.649343 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9151bff9-e933-419b-b3fa-65cd52b8bf55 req-edd02a00-8313-4c90-8f2a-2391e6e30dc6 service nova] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:13.649343 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9151bff9-e933-419b-b3fa-65cd52b8bf55 req-edd02a00-8313-4c90-8f2a-2391e6e30dc6 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] No waiting events found dispatching network-vif-unplugged-85ecf3fb-ef43-44a6-836b-a5e5da02646a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:13.649343 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9151bff9-e933-419b-b3fa-65cd52b8bf55 req-edd02a00-8313-4c90-8f2a-2391e6e30dc6 service nova] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Received event network-vif-unplugged-85ecf3fb-ef43-44a6-836b-a5e5da02646a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:13.649343 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9151bff9-e933-419b-b3fa-65cd52b8bf55 req-edd02a00-8313-4c90-8f2a-2391e6e30dc6 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Received event network-vif-deleted-abb5cffe-8cbc-49eb-8f62-0014bcc3d411 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:13.653895 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-9151bff9-e933-419b-b3fa-65cd52b8bf55 req-edd02a00-8313-4c90-8f2a-2391e6e30dc6 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Neutron deleted interface abb5cffe-8cbc-49eb-8f62-0014bcc3d411; detaching it from the instance and deleting it from the info cache
May 27 02:59:13.653895 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-9151bff9-e933-419b-b3fa-65cd52b8bf55 req-edd02a00-8313-4c90-8f2a-2391e6e30dc6 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:59:13.670870 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:13.784318 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:59:13.915907 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Took 1.48 seconds to deallocate network for instance.
May 27 02:59:14.157334 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9151bff9-e933-419b-b3fa-65cd52b8bf55 req-edd02a00-8313-4c90-8f2a-2391e6e30dc6 service nova] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Detach interface failed, port_id=abb5cffe-8cbc-49eb-8f62-0014bcc3d411, reason: Instance 63151241-1b03-4b3c-9ecd-27703137e752 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 02:59:14.287347 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Took 1.86 seconds to deallocate network for instance.
May 27 02:59:14.424376 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:14.424572 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:14.802901 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:14.910898 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:59:14.911205 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:59:15.418821 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:59:15.762525 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:15.925724 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.501s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:15.927007 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.126s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:15.996206 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Deleted allocations for instance a6c0c0f0-846a-4ffb-8f02-d43af196da22
May 27 02:59:16.321023 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:59:16.321268 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:59:16.824611 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:59:16.909107 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:17.008577 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e17f9c73-113e-4b73-b684-e7591ff87a45 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "a6c0c0f0-846a-4ffb-8f02-d43af196da22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.526s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:17.239299 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:17.240001 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:17.240001 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:17.240001 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:17.240433 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:17.244921 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Terminating instance
May 27 02:59:17.285024 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:17.332237 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.405s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:17.420146 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Deleted allocations for instance 63151241-1b03-4b3c-9ecd-27703137e752
May 27 02:59:17.508082 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:17.751493 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 02:59:17.781208 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:17.787190 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:17.814931 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:17.817632 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:17.851090 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:17.863978 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:17.936950 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:18.029854 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:18.059835 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:18.106142 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:18.120789 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:18.152841 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:18.179998 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-cdbba269-0050-41ad-9eb8-f83710830a77 req-e6e57456-8ad2-4d4f-9d71-1f9665ba39ce service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-85e3c8c8-e081-465f-aeb5-dd4eeccd64eb {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:18.181145 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cdbba269-0050-41ad-9eb8-f83710830a77 req-e6e57456-8ad2-4d4f-9d71-1f9665ba39ce service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:18.181365 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cdbba269-0050-41ad-9eb8-f83710830a77 req-e6e57456-8ad2-4d4f-9d71-1f9665ba39ce service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:18.181530 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cdbba269-0050-41ad-9eb8-f83710830a77 req-e6e57456-8ad2-4d4f-9d71-1f9665ba39ce service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:18.181704 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-cdbba269-0050-41ad-9eb8-f83710830a77 req-e6e57456-8ad2-4d4f-9d71-1f9665ba39ce service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No waiting events found dispatching network-vif-unplugged-85e3c8c8-e081-465f-aeb5-dd4eeccd64eb {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:18.182224 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-cdbba269-0050-41ad-9eb8-f83710830a77 req-e6e57456-8ad2-4d4f-9d71-1f9665ba39ce service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-85e3c8c8-e081-465f-aeb5-dd4eeccd64eb for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:18.201411 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:18.249773 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:18.281380 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:18.326083 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:18.442873 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999620577000087 future=<Future at 0x75572c409a30 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:18.450788 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Instance destroyed successfully.
May 27 02:59:18.453099 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lazy-loading 'resources' on Instance uuid 8b048373-2f8d-454a-9ad5-888403e8ee5f {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:59:18.458112 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-42bdc0a8-3e87-4646-b52c-c95a3be6f4e7 tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Lock "63151241-1b03-4b3c-9ecd-27703137e752" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.114s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:18.965380 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:58:23Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:58:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "address": "fa:16:3e:ac:85:cd", "network": {"id": "dd9e8c55-e5da-45f7-a13f-470957854c45", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2089100123-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3c8c8-e0", "ovs_interfaceid": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:59:18.965616 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "address": "fa:16:3e:ac:85:cd", "network": {"id": "dd9e8c55-e5da-45f7-a13f-470957854c45", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2089100123-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3c8c8-e0", "ovs_interfaceid": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:18.966484 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:85:cd,bridge_name='br-int',has_traffic_filtering=True,id=85e3c8c8-e081-465f-aeb5-dd4eeccd64eb,network=Network(dd9e8c55-e5da-45f7-a13f-470957854c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e3c8c8-e0') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:18.966484 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:85:cd,bridge_name='br-int',has_traffic_filtering=True,id=85e3c8c8-e081-465f-aeb5-dd4eeccd64eb,network=Network(dd9e8c55-e5da-45f7-a13f-470957854c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e3c8c8-e0') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:59:18.969275 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:18.970790 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85e3c8c8-e0, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:18.974240 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:19.017760 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.019301 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.019591 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9e357b3-0618-420e-9cf6-364470775aa1) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:19.024174 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:19.057776 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.061538 np0000001475 nova-compute[98471]: INFO os_vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:85:cd,bridge_name='br-int',has_traffic_filtering=True,id=85e3c8c8-e081-465f-aeb5-dd4eeccd64eb,network=Network(dd9e8c55-e5da-45f7-a13f-470957854c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e3c8c8-e0')
May 27 02:59:19.061538 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:58:23Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:58:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "address": "fa:16:3e:b3:c1:c6", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fafd7a-ad", "ovs_interfaceid": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:59:19.061538 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "address": "fa:16:3e:b3:c1:c6", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fafd7a-ad", "ovs_interfaceid": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:19.062375 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c1:c6,bridge_name='br-int',has_traffic_filtering=True,id=e6fafd7a-ad8c-4d3f-83c1-93e0bc017695,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6fafd7a-ad') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:19.062697 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c1:c6,bridge_name='br-int',has_traffic_filtering=True,id=e6fafd7a-ad8c-4d3f-83c1-93e0bc017695,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6fafd7a-ad') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:59:19.065649 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.066504 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6fafd7a-ad, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:19.067374 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.068639 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:19.095496 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.097278 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.097434 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd13d792-dd64-4071-bf6a-e804b50e99cf) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:19.098574 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.100395 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:19.135632 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.140174 np0000001475 nova-compute[98471]: INFO os_vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c1:c6,bridge_name='br-int',has_traffic_filtering=True,id=e6fafd7a-ad8c-4d3f-83c1-93e0bc017695,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6fafd7a-ad')
May 27 02:59:19.141189 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:58:23Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:58:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "address": "fa:16:3e:0a:53:41", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91efaab4-fe", "ovs_interfaceid": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:59:19.141451 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "address": "fa:16:3e:0a:53:41", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91efaab4-fe", "ovs_interfaceid": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:19.142148 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:53:41,bridge_name='br-int',has_traffic_filtering=True,id=91efaab4-fe42-47f8-af98-c6ad87c5dc25,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91efaab4-fe') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:19.142444 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:53:41,bridge_name='br-int',has_traffic_filtering=True,id=91efaab4-fe42-47f8-af98-c6ad87c5dc25,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91efaab4-fe') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:59:19.144762 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.144865 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91efaab4-fe, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:19.147235 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.147235 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:19.177051 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.178490 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.178687 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49a66c03-1d77-48b5-b5cd-046aa4b19444) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:19.179539 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.183468 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:19.205671 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.210377 np0000001475 nova-compute[98471]: INFO os_vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:53:41,bridge_name='br-int',has_traffic_filtering=True,id=91efaab4-fe42-47f8-af98-c6ad87c5dc25,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91efaab4-fe')
May 27 02:59:19.210377 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:58:23Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:58:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65194802-b80c-4a1f-855a-69a13e0abadb", "address": "fa:16:3e:83:10:2d", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65194802-b8", "ovs_interfaceid": "65194802-b80c-4a1f-855a-69a13e0abadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:59:19.210377 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "65194802-b80c-4a1f-855a-69a13e0abadb", "address": "fa:16:3e:83:10:2d", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65194802-b8", "ovs_interfaceid": "65194802-b80c-4a1f-855a-69a13e0abadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:19.210377 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:10:2d,bridge_name='br-int',has_traffic_filtering=True,id=65194802-b80c-4a1f-855a-69a13e0abadb,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65194802-b8') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:19.210377 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:10:2d,bridge_name='br-int',has_traffic_filtering=True,id=65194802-b80c-4a1f-855a-69a13e0abadb,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65194802-b8') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:59:19.211463 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.211712 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65194802-b8, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:19.212724 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.213931 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:19.233320 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.234297 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.234573 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2ec3779-c0ea-4699-af43-483308cd83de) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:19.235247 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.236675 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:19.255858 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.261735 np0000001475 nova-compute[98471]: INFO os_vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:10:2d,bridge_name='br-int',has_traffic_filtering=True,id=65194802-b80c-4a1f-855a-69a13e0abadb,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65194802-b8')
May 27 02:59:19.261735 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:58:23Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:58:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74a2c471-0365-423f-b184-a314411fe9d3", "address": "fa:16:3e:99:74:e2", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a2c471-03", "ovs_interfaceid": "74a2c471-0365-423f-b184-a314411fe9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:59:19.261735 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "74a2c471-0365-423f-b184-a314411fe9d3", "address": "fa:16:3e:99:74:e2", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a2c471-03", "ovs_interfaceid": "74a2c471-0365-423f-b184-a314411fe9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:19.261735 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:74:e2,bridge_name='br-int',has_traffic_filtering=True,id=74a2c471-0365-423f-b184-a314411fe9d3,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74a2c471-03') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:19.261735 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:74:e2,bridge_name='br-int',has_traffic_filtering=True,id=74a2c471-0365-423f-b184-a314411fe9d3,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74a2c471-03') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:59:19.262212 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.262212 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74a2c471-03, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:19.264956 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.266284 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:19.276442 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.278497 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.278867 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d29a8255-6325-42f7-b41f-4671cab868f8) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:19.279528 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.282628 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:19.292511 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.296186 np0000001475 nova-compute[98471]: INFO os_vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:74:e2,bridge_name='br-int',has_traffic_filtering=True,id=74a2c471-0365-423f-b184-a314411fe9d3,network=Network(26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74a2c471-03')
May 27 02:59:19.298806 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:58:23Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:58:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "address": "fa:16:3e:b7:c7:a8", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed880fe-1d", "ovs_interfaceid": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:59:19.298806 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "address": "fa:16:3e:b7:c7:a8", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed880fe-1d", "ovs_interfaceid": "eed880fe-1d2b-42cd-98fc-a00da6b63892", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:19.298806 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c7:a8,bridge_name='br-int',has_traffic_filtering=True,id=eed880fe-1d2b-42cd-98fc-a00da6b63892,network=Network(c61a3137-c131-4077-8bc7-1e7b8fb59cb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed880fe-1d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:19.298806 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c7:a8,bridge_name='br-int',has_traffic_filtering=True,id=eed880fe-1d2b-42cd-98fc-a00da6b63892,network=Network(c61a3137-c131-4077-8bc7-1e7b8fb59cb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed880fe-1d') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:59:19.299576 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.299818 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeed880fe-1d, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:19.301028 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.302197 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:19.310669 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.311734 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.311974 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9de6492a-d68e-484d-b1e4-c14257d243a5) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:19.313195 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.314039 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:19.320911 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.329372 np0000001475 nova-compute[98471]: INFO os_vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:c7:a8,bridge_name='br-int',has_traffic_filtering=True,id=eed880fe-1d2b-42cd-98fc-a00da6b63892,network=Network(c61a3137-c131-4077-8bc7-1e7b8fb59cb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed880fe-1d')
May 27 02:59:19.329372 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-634850796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-634850796',id=8,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfuiLK9+m1tbprNYCrFsnNrUByPVmzfoyiRr8SzzzBe3TwtXd/b5OMp7MpwOvpFLLTNzE8TF0LUzlR7j7D/15ATz450xk6J+DBNDMm+N9pbQWlJ9QuS95NL0Eqmqyms7g==',key_name='tempest-keypair-1352410733',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:58:23Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73947699c9fc4e078220ba0dbcaa9cf9',ramdisk_id='',reservation_id='r-gkuwpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1214928212',owner_user_name='tempest-TaggedBootDevicesTest_v242-1214928212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:58:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fa9534d56bc4598916f1bb64d785832',uuid=8b048373-2f8d-454a-9ad5-888403e8ee5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "address": "fa:16:3e:51:3d:37", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95be436-ee", "ovs_interfaceid": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:59:19.329372 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converting VIF {"id": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "address": "fa:16:3e:51:3d:37", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95be436-ee", "ovs_interfaceid": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:19.329818 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=f95be436-eeae-44d9-94cd-0f361c1beb5b,network=Network(c61a3137-c131-4077-8bc7-1e7b8fb59cb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf95be436-ee') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:19.330015 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=f95be436-eeae-44d9-94cd-0f361c1beb5b,network=Network(c61a3137-c131-4077-8bc7-1e7b8fb59cb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf95be436-ee') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:59:19.330996 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.331298 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf95be436-ee, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:19.333630 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.336171 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:19.339887 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.339887 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1226b47b-588b-4962-ac92-c7003e70b2d7) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:19.343131 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.343284 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:19.344788 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:19.347455 np0000001475 nova-compute[98471]: INFO os_vif [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=f95be436-eeae-44d9-94cd-0f361c1beb5b,network=Network(c61a3137-c131-4077-8bc7-1e7b8fb59cb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf95be436-ee')
May 27 02:59:19.349713 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 02:59:19.349713 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65b881ec-6fab-4885-9b21-011dc2650d9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:59:19.349713 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:59:19.349713 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:59:19.350153 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '65b881ec-6fab-4885-9b21-011dc2650d9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 02:59:19.350233 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e (non-flash)
May 27 02:59:19.400788 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:19.401827 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', '9')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 02:59:19.402053 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', '9')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:59:19.403593 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e', '10')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:59:19.404872 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c285580>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e'): ({'sdg'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 02:59:19.405216 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Removing multipathed devices sdf, sdg {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 02:59:19.405657 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Flush multipath device 330000000b8d9c0bf {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 02:59:19.483964 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:59:19.532662 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:59:19.604442 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 02:59:19.604442 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 02:59:19.605026 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 02:59:19.622828 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 02:59:19.622828 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 02:59:19.639792 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:19.692397 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e, portal: 192.168.40.100,3260]
May 27 02:59:19.692397 np0000001475 nova-compute[98471]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e, portal: 192.168.40.100,3260] successful.
May 27 02:59:19.692397 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:19.718253 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:19.736433 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:19.788342 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e, portal: 192.168.50.100,3260]
May 27 02:59:19.788342 np0000001475 nova-compute[98471]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-65b881ec-6fab-4885-9b21-011dc2650d9e, portal: 192.168.50.100,3260] successful.
May 27 02:59:19.788342 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:19.815440 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:19.816264 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.466s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:59:19.816264 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] <== disconnect_volume: return (466ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:59:19.816264 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 02:59:19.821315 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 02:59:19.821315 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '953364d7-cec1-4e74-99f1-263c29a519bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:59:19.821315 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:59:19.821315 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:59:19.821315 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '953364d7-cec1-4e74-99f1-263c29a519bd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 02:59:19.821610 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:19.868379 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '30')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 02:59:19.868379 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', '11')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:59:19.869324 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd', '12')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:59:19.872065 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c285580>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd'): ({'sdi'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 02:59:19.872065 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Removing multipathed devices sdi, sdh {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 02:59:19.872065 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Flush multipath device 330000000d6552ad0 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 02:59:19.912536 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:59:19.958607 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:59:20.018197 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 02:59:20.018305 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 02:59:20.022215 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 02:59:20.037335 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 02:59:20.037335 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 02:59:20.056833 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:20.103046 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd, portal: 192.168.40.100,3260]
May 27 02:59:20.103046 np0000001475 nova-compute[98471]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd, portal: 192.168.40.100,3260] successful.
May 27 02:59:20.103046 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:20.128764 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:20.142855 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:20.183256 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd, portal: 192.168.50.100,3260]
May 27 02:59:20.183256 np0000001475 nova-compute[98471]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-953364d7-cec1-4e74-99f1-263c29a519bd, portal: 192.168.50.100,3260] successful.
May 27 02:59:20.183256 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:20.214109 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:20.214328 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:59:20.214436 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] <== disconnect_volume: return (393ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:59:20.214594 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 02:59:20.218735 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 02:59:20.219039 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:59:20.219183 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:59:20.219545 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:59:20.219848 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 02:59:20.219987 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 02:59:20.261380 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:20.261380 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:20.261380 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:20.261380 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:20.261380 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:20.261380 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:20.261380 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:20.261380 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:20.261380 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:20.261380 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:20.261380 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:20.261380 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:20.261380 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:20.261380 np0000001475 nova-compute[98471]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:20.261380 np0000001475 nova-compute[98471]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf (non-flash)
May 27 02:59:20.261380 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:20.261380 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:20.261380 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:20.261380 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:20.261380 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:20.261380 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:20.261380 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:20.262077 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '30')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 02:59:20.262077 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', '15')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:59:20.263117 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf', '16')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:59:20.263722 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7557246456c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf'): ({'sdk'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 02:59:20.263986 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Removing multipathed devices sdj, sdk {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 02:59:20.264179 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Flush multipath device 330000000e87f0a69 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 02:59:20.293882 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:59:20.299763 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e68f17b2-88d4-4f09-a9e4-3ce8005978a3 req-1658ff86-7af2-487e-ace2-99ee507b156d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-85e3c8c8-e081-465f-aeb5-dd4eeccd64eb {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:20.299763 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e68f17b2-88d4-4f09-a9e4-3ce8005978a3 req-1658ff86-7af2-487e-ace2-99ee507b156d service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:20.299763 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e68f17b2-88d4-4f09-a9e4-3ce8005978a3 req-1658ff86-7af2-487e-ace2-99ee507b156d service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:20.299946 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e68f17b2-88d4-4f09-a9e4-3ce8005978a3 req-1658ff86-7af2-487e-ace2-99ee507b156d service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:20.299985 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e68f17b2-88d4-4f09-a9e4-3ce8005978a3 req-1658ff86-7af2-487e-ace2-99ee507b156d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No waiting events found dispatching network-vif-unplugged-85e3c8c8-e081-465f-aeb5-dd4eeccd64eb {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:20.300134 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e68f17b2-88d4-4f09-a9e4-3ce8005978a3 req-1658ff86-7af2-487e-ace2-99ee507b156d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-85e3c8c8-e081-465f-aeb5-dd4eeccd64eb for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:20.300325 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e68f17b2-88d4-4f09-a9e4-3ce8005978a3 req-1658ff86-7af2-487e-ace2-99ee507b156d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-65194802-b80c-4a1f-855a-69a13e0abadb {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:20.300465 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e68f17b2-88d4-4f09-a9e4-3ce8005978a3 req-1658ff86-7af2-487e-ace2-99ee507b156d service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:20.300986 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e68f17b2-88d4-4f09-a9e4-3ce8005978a3 req-1658ff86-7af2-487e-ace2-99ee507b156d service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:20.302005 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e68f17b2-88d4-4f09-a9e4-3ce8005978a3 req-1658ff86-7af2-487e-ace2-99ee507b156d service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:20.302666 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e68f17b2-88d4-4f09-a9e4-3ce8005978a3 req-1658ff86-7af2-487e-ace2-99ee507b156d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No waiting events found dispatching network-vif-unplugged-65194802-b80c-4a1f-855a-69a13e0abadb {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:20.302666 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e68f17b2-88d4-4f09-a9e4-3ce8005978a3 req-1658ff86-7af2-487e-ace2-99ee507b156d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-65194802-b80c-4a1f-855a-69a13e0abadb for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:20.346550 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:59:20.395361 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 02:59:20.395509 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 02:59:20.397153 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 02:59:20.411753 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 02:59:20.412259 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 02:59:20.429709 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:20.473838 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf, portal: 192.168.40.100,3260]
May 27 02:59:20.473838 np0000001475 nova-compute[98471]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf, portal: 192.168.40.100,3260] successful.
May 27 02:59:20.473838 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:20.495323 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:20.511622 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:20.552462 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf, portal: 192.168.50.100,3260]
May 27 02:59:20.552462 np0000001475 nova-compute[98471]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-caaa9313-7a2a-4d2c-9c2f-0693b05d3daf, portal: 192.168.50.100,3260] successful.
May 27 02:59:20.552462 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:20.576755 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:20.577026 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:59:20.577145 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] <== disconnect_volume: return (357ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:59:20.577243 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 02:59:20.577529 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Deleting instance files /opt/stack/data/nova/instances/8b048373-2f8d-454a-9ad5-888403e8ee5f_del
May 27 02:59:20.578064 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Deletion of /opt/stack/data/nova/instances/8b048373-2f8d-454a-9ad5-888403e8ee5f_del complete
May 27 02:59:20.613431 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:20.766385 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:20.844932 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f6ff4744-ed15-4660-927f-3459f1a6f827 req-c8a3ff03-4dd4-4052-a942-16d168dbdfdf service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-e6fafd7a-ad8c-4d3f-83c1-93e0bc017695 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:20.845927 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6ff4744-ed15-4660-927f-3459f1a6f827 req-c8a3ff03-4dd4-4052-a942-16d168dbdfdf service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:20.846485 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6ff4744-ed15-4660-927f-3459f1a6f827 req-c8a3ff03-4dd4-4052-a942-16d168dbdfdf service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:20.846485 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6ff4744-ed15-4660-927f-3459f1a6f827 req-c8a3ff03-4dd4-4052-a942-16d168dbdfdf service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:20.846587 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f6ff4744-ed15-4660-927f-3459f1a6f827 req-c8a3ff03-4dd4-4052-a942-16d168dbdfdf service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No waiting events found dispatching network-vif-unplugged-e6fafd7a-ad8c-4d3f-83c1-93e0bc017695 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:20.846824 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f6ff4744-ed15-4660-927f-3459f1a6f827 req-c8a3ff03-4dd4-4052-a942-16d168dbdfdf service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-e6fafd7a-ad8c-4d3f-83c1-93e0bc017695 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:21.044007 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-dfe27579-a045-4d04-9d6a-cd60d7f65b12 req-a51729b0-0eb4-49fb-b916-47c2758bd4ee service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-74a2c471-0365-423f-b184-a314411fe9d3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:21.045140 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-dfe27579-a045-4d04-9d6a-cd60d7f65b12 req-a51729b0-0eb4-49fb-b916-47c2758bd4ee service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:21.045943 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-dfe27579-a045-4d04-9d6a-cd60d7f65b12 req-a51729b0-0eb4-49fb-b916-47c2758bd4ee service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:21.045943 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-dfe27579-a045-4d04-9d6a-cd60d7f65b12 req-a51729b0-0eb4-49fb-b916-47c2758bd4ee service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:21.046070 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-dfe27579-a045-4d04-9d6a-cd60d7f65b12 req-a51729b0-0eb4-49fb-b916-47c2758bd4ee service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No waiting events found dispatching network-vif-unplugged-74a2c471-0365-423f-b184-a314411fe9d3 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:21.046223 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-dfe27579-a045-4d04-9d6a-cd60d7f65b12 req-a51729b0-0eb4-49fb-b916-47c2758bd4ee service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-74a2c471-0365-423f-b184-a314411fe9d3 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:21.085996 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Took 3.33 seconds to destroy the instance on the hypervisor.
May 27 02:59:21.088393 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 02:59:21.088942 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 02:59:21.089128 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 02:59:21.089545 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:21.471046 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:22.356402 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:22.393827 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-65194802-b80c-4a1f-855a-69a13e0abadb {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:22.393984 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:22.394113 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:22.394243 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:22.394337 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No waiting events found dispatching network-vif-unplugged-65194802-b80c-4a1f-855a-69a13e0abadb {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:22.394446 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-65194802-b80c-4a1f-855a-69a13e0abadb for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:22.394543 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-eed880fe-1d2b-42cd-98fc-a00da6b63892 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:22.394658 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:22.394787 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:22.394884 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:22.395648 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No waiting events found dispatching network-vif-unplugged-eed880fe-1d2b-42cd-98fc-a00da6b63892 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:22.395767 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-eed880fe-1d2b-42cd-98fc-a00da6b63892 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:22.395871 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-eed880fe-1d2b-42cd-98fc-a00da6b63892 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:22.395983 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:22.396978 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:22.397043 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:22.397154 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No waiting events found dispatching network-vif-unplugged-eed880fe-1d2b-42cd-98fc-a00da6b63892 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:22.397250 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-eed880fe-1d2b-42cd-98fc-a00da6b63892 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:22.397441 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-f95be436-eeae-44d9-94cd-0f361c1beb5b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:22.399914 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:22.400045 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:22.400142 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:22.400250 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No waiting events found dispatching network-vif-unplugged-f95be436-eeae-44d9-94cd-0f361c1beb5b {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:22.400366 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-f95be436-eeae-44d9-94cd-0f361c1beb5b for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:22.400462 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-f95be436-eeae-44d9-94cd-0f361c1beb5b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:22.400582 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:22.401061 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:22.401178 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:22.401295 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No waiting events found dispatching network-vif-unplugged-f95be436-eeae-44d9-94cd-0f361c1beb5b {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:22.401738 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9ac157fb-23b7-4dbb-9192-1db038b205e9 req-a3b0b0c2-50dc-43d7-9c28-60b3a114913d service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-f95be436-eeae-44d9-94cd-0f361c1beb5b for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:22.946014 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-97bff39f-cc6c-490b-a802-e17acfc9e9e8 req-63378dfa-9686-4661-b7d0-a789775e9414 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-e6fafd7a-ad8c-4d3f-83c1-93e0bc017695 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:22.946379 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-97bff39f-cc6c-490b-a802-e17acfc9e9e8 req-63378dfa-9686-4661-b7d0-a789775e9414 service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:22.946590 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-97bff39f-cc6c-490b-a802-e17acfc9e9e8 req-63378dfa-9686-4661-b7d0-a789775e9414 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:22.946590 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-97bff39f-cc6c-490b-a802-e17acfc9e9e8 req-63378dfa-9686-4661-b7d0-a789775e9414 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:22.946686 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-97bff39f-cc6c-490b-a802-e17acfc9e9e8 req-63378dfa-9686-4661-b7d0-a789775e9414 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No waiting events found dispatching network-vif-unplugged-e6fafd7a-ad8c-4d3f-83c1-93e0bc017695 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:22.946820 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-97bff39f-cc6c-490b-a802-e17acfc9e9e8 req-63378dfa-9686-4661-b7d0-a789775e9414 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-e6fafd7a-ad8c-4d3f-83c1-93e0bc017695 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:23.128572 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f3f97fc-74d9-4729-977a-972273a719ba req-47e3d6a2-591f-4f91-a47a-dc87b37676c4 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-74a2c471-0365-423f-b184-a314411fe9d3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:23.128754 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f3f97fc-74d9-4729-977a-972273a719ba req-47e3d6a2-591f-4f91-a47a-dc87b37676c4 service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:23.128950 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f3f97fc-74d9-4729-977a-972273a719ba req-47e3d6a2-591f-4f91-a47a-dc87b37676c4 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:23.129103 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f3f97fc-74d9-4729-977a-972273a719ba req-47e3d6a2-591f-4f91-a47a-dc87b37676c4 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:23.129314 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f3f97fc-74d9-4729-977a-972273a719ba req-47e3d6a2-591f-4f91-a47a-dc87b37676c4 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No waiting events found dispatching network-vif-unplugged-74a2c471-0365-423f-b184-a314411fe9d3 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:23.129687 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f3f97fc-74d9-4729-977a-972273a719ba req-47e3d6a2-591f-4f91-a47a-dc87b37676c4 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-74a2c471-0365-423f-b184-a314411fe9d3 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:23.130330 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f3f97fc-74d9-4729-977a-972273a719ba req-47e3d6a2-591f-4f91-a47a-dc87b37676c4 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-91efaab4-fe42-47f8-af98-c6ad87c5dc25 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:23.130514 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f3f97fc-74d9-4729-977a-972273a719ba req-47e3d6a2-591f-4f91-a47a-dc87b37676c4 service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:23.130701 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f3f97fc-74d9-4729-977a-972273a719ba req-47e3d6a2-591f-4f91-a47a-dc87b37676c4 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:23.130839 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f3f97fc-74d9-4729-977a-972273a719ba req-47e3d6a2-591f-4f91-a47a-dc87b37676c4 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:23.130994 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f3f97fc-74d9-4729-977a-972273a719ba req-47e3d6a2-591f-4f91-a47a-dc87b37676c4 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No waiting events found dispatching network-vif-unplugged-91efaab4-fe42-47f8-af98-c6ad87c5dc25 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:23.131182 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f3f97fc-74d9-4729-977a-972273a719ba req-47e3d6a2-591f-4f91-a47a-dc87b37676c4 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-91efaab4-fe42-47f8-af98-c6ad87c5dc25 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:23.131335 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f3f97fc-74d9-4729-977a-972273a719ba req-47e3d6a2-591f-4f91-a47a-dc87b37676c4 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-91efaab4-fe42-47f8-af98-c6ad87c5dc25 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:23.131451 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f3f97fc-74d9-4729-977a-972273a719ba req-47e3d6a2-591f-4f91-a47a-dc87b37676c4 service nova] Acquiring lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:23.131610 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f3f97fc-74d9-4729-977a-972273a719ba req-47e3d6a2-591f-4f91-a47a-dc87b37676c4 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:23.131768 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f3f97fc-74d9-4729-977a-972273a719ba req-47e3d6a2-591f-4f91-a47a-dc87b37676c4 service nova] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:23.131960 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f3f97fc-74d9-4729-977a-972273a719ba req-47e3d6a2-591f-4f91-a47a-dc87b37676c4 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] No waiting events found dispatching network-vif-unplugged-91efaab4-fe42-47f8-af98-c6ad87c5dc25 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:23.132094 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f3f97fc-74d9-4729-977a-972273a719ba req-47e3d6a2-591f-4f91-a47a-dc87b37676c4 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-unplugged-91efaab4-fe42-47f8-af98-c6ad87c5dc25 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:23.177624 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "60418cf4-cd7f-4256-ad92-cc8336802816" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:23.177797 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "60418cf4-cd7f-4256-ad92-cc8336802816" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:23.682238 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lazy-loading 'flavor' on Instance uuid 60418cf4-cd7f-4256-ad92-cc8336802816 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:59:24.352010 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:24.497113 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fa1aa9c8-f4d8-4845-affb-7433104424fb req-dda42deb-b0ff-41e7-8635-26150c3cbfc4 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-deleted-eed880fe-1d2b-42cd-98fc-a00da6b63892 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:24.497113 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-fa1aa9c8-f4d8-4845-affb-7433104424fb req-dda42deb-b0ff-41e7-8635-26150c3cbfc4 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Neutron deleted interface eed880fe-1d2b-42cd-98fc-a00da6b63892; detaching it from the instance and deleting it from the info cache
May 27 02:59:24.497113 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-fa1aa9c8-f4d8-4845-affb-7433104424fb req-dda42deb-b0ff-41e7-8635-26150c3cbfc4 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Updating instance_info_cache with network_info: [{"id": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "address": "fa:16:3e:ac:85:cd", "network": {"id": "dd9e8c55-e5da-45f7-a13f-470957854c45", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2089100123-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3c8c8-e0", "ovs_interfaceid": "85e3c8c8-e081-465f-aeb5-dd4eeccd64eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "address": "fa:16:3e:b3:c1:c6", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape6fafd7a-ad", "ovs_interfaceid": "e6fafd7a-ad8c-4d3f-83c1-93e0bc017695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "address": "fa:16:3e:0a:53:41", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.103", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91efaab4-fe", "ovs_interfaceid": "91efaab4-fe42-47f8-af98-c6ad87c5dc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65194802-b80c-4a1f-855a-69a13e0abadb", "address": "fa:16:3e:83:10:2d", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65194802-b8", "ovs_interfaceid": "65194802-b80c-4a1f-855a-69a13e0abadb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74a2c471-0365-423f-b184-a314411fe9d3", "address": "fa:16:3e:99:74:e2", "network": {"id": "26ba9c77-bbc5-4248-a9e5-2d8b67dd6e15", "bridge": "br-int", "label": "tempest-device-tagging-net1-111509450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap74a2c471-03", "ovs_interfaceid": "74a2c471-0365-423f-b184-a314411fe9d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "address": "fa:16:3e:51:3d:37", "network": {"id": "c61a3137-c131-4077-8bc7-1e7b8fb59cb4", "bridge": "br-int", "label": "tempest-device-tagging-net2-61043496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73947699c9fc4e078220ba0dbcaa9cf9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95be436-ee", "ovs_interfaceid": "f95be436-eeae-44d9-94cd-0f361c1beb5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:59:24.688071 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "60418cf4-cd7f-4256-ad92-cc8336802816" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:25.002014 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fa1aa9c8-f4d8-4845-affb-7433104424fb req-dda42deb-b0ff-41e7-8635-26150c3cbfc4 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Detach interface failed, port_id=eed880fe-1d2b-42cd-98fc-a00da6b63892, reason: Instance 8b048373-2f8d-454a-9ad5-888403e8ee5f could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 02:59:25.171769 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:59:25.235970 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b6779f65-150c-45e0-8de0-0346d65b2732 req-181ccc5b-6667-4ee6-834b-cdd396bdd039 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-deleted-74a2c471-0365-423f-b184-a314411fe9d3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:25.236058 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b6779f65-150c-45e0-8de0-0346d65b2732 req-181ccc5b-6667-4ee6-834b-cdd396bdd039 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-deleted-85e3c8c8-e081-465f-aeb5-dd4eeccd64eb {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:25.236215 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b6779f65-150c-45e0-8de0-0346d65b2732 req-181ccc5b-6667-4ee6-834b-cdd396bdd039 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-deleted-f95be436-eeae-44d9-94cd-0f361c1beb5b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:25.236450 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b6779f65-150c-45e0-8de0-0346d65b2732 req-181ccc5b-6667-4ee6-834b-cdd396bdd039 service nova] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Received event network-vif-deleted-65194802-b80c-4a1f-855a-69a13e0abadb {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:25.333040 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:25.677538 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Took 4.59 seconds to deallocate network for instance.
May 27 02:59:25.769121 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:25.868307 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "60418cf4-cd7f-4256-ad92-cc8336802816" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:25.868563 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "60418cf4-cd7f-4256-ad92-cc8336802816" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:25.869106 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Attaching volume 115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 to /dev/vdb
May 27 02:59:25.945399 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:59:25.966225 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 02:59:25.998202 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:26.039152 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 02:59:26.041360 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 02:59:26.054241 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 02:59:26.056659 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe81:1162', 'fe80::ac86:83ff:fe2f:8c85', 'fe80::fc16:3eff:fe62:4bbd', 'fe80::fc16:3eff:fe2e:6d18', 'fe80::fc16:3eff:fe66:2b5e', 'fe80::fc16:3eff:fe0f:1d12', 'fe80::fc16:3eff:fe28:9b06', 'fe80::905a:63ff:fe3f:a285', 'fe80::fc16:3eff:fe0f:78c6', 'fe80::304d:48ff:fe5e:ff03', 'fe80::fc16:3eff:fe8f:94b9', 'fe80::b820:35ff:fe01:438d', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b', 'fe80::fc16:3eff:fe26:2ceb', 'fe80::dc63:41ff:fe48:d91a'] 
May 27 02:59:26.056905 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 02:59:26.057094 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 02:59:26.057445 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:59:26.057803 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Updating existing volume attachment record: 1fbc11b1-cd4b-46d6-85a7-ee77b57a0081 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 02:59:26.279066 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:26.641945 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 02:59:26.642594 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:59:26.642594 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:59:26.643134 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:59:26.643473 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 02:59:26.657994 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:59:26.658501 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:59:26.658703 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:59:26.659885 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:59:26.664325 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:59:26.664576 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:59:26.674888 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:59:26.674888 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:26.684375 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:59:26.684375 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:26.692249 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80] added
May 27 02:59:26.692249 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:59:26.692249 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:59:26.692249 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:59:26.692249 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:59:26.692249 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:59:26.692249 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:26.692557 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:59:26.692704 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0339(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:59:26.692821 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:59:26.697490 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80] added
May 27 02:59:26.697490 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:59:26.697490 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:59:26.697490 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:59:26.697490 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:59:26.697490 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:59:26.697490 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:26.697913 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:59:26.698173 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:59:26.698173 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:59:27.119018 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0016108639999856678 future=<Future at 0x75572473a270 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:27.119545 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:27.119713 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.001513442000032228 future=<Future at 0x75572473a180 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:27.119925 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.001727528999936112 future=<Future at 0x75572473a180 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:27.123315 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] Emitting event <LifecycleEvent: 1779850752.1172593, 63151241-1b03-4b3c-9ecd-27703137e752 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:59:27.123315 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:27.123660 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Emitting event <LifecycleEvent: 1779850752.1181374, a6c0c0f0-846a-4ffb-8f02-d43af196da22 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:59:27.123929 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] VM Stopped (Lifecycle Event)
May 27 02:59:27.125534 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=6.316925975000004 future=<Future at 0x75572c409a30 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:27.130761 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] VM Stopped (Lifecycle Event)
May 27 02:59:27.133509 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=6.310203855000054 future=<Future at 0x75572c409a30 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:27.419816 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Took 1.74 seconds to detach 3 volumes for instance.
May 27 02:59:27.634728 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1812c149-a995-4e67-873e-f1c21707e763 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] [instance: a6c0c0f0-846a-4ffb-8f02-d43af196da22] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:59:27.637722 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-459a314a-5c24-4bd4-a67c-8969a18fcd9e tempest-VolumesAssistedSnapshotsTest-1998652501 tempest-VolumesAssistedSnapshotsTest-1998652501-project-member] [instance: 63151241-1b03-4b3c-9ecd-27703137e752] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:59:27.693234 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:59:27.703763 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:59:27.710142 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:59:27.710142 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:59:27.720890 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:59:27.720890 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:27.731424 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:27.739174 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:27.748275 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:27.748645 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:27.757766 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:27.757766 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:27.757766 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:27.757766 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:27.757766 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:27.757766 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:27.757766 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:27.757766 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:27.757766 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:27.758632 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:27.758632 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:27.758632 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:27.758632 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:27.758632 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:27.758632 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:27.758632 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:27.758632 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:27.758632 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:27.764561 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:27.764561 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:27.764561 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:27.764561 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:27.764561 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:27.764561 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:27.764561 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:27.764561 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:27.764561 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:27.765015 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:27.765015 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:27.765015 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:27.765015 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:27.765015 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:27.765015 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:27.765015 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:27.765015 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:27.765015 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:27.818328 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.40.100,3260]
May 27 02:59:27.818328 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.40.100,3260] successful.
May 27 02:59:27.818328 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:27.819120 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.50.100,3260]
May 27 02:59:27.819120 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.50.100,3260] successful.
May 27 02:59:27.819120 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:27.833581 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:27.838292 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:27.859067 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:27.859067 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:27.859067 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:27.859067 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:27.859067 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:27.859067 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:27.859067 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:27.859067 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:27.859067 np0000001475 nova-compute[98471]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 02:59:27.859067 np0000001475 nova-compute[98471]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 02:59:27.859067 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:27.859547 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:27.859547 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:27.859547 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:27.859547 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:27.859547 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:27.859547 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:27.859547 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:27.859547 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:27.859547 np0000001475 nova-compute[98471]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 02:59:27.859547 np0000001475 nova-compute[98471]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 02:59:27.859547 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:27.859887 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:59:27.859887 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:59:27.861252 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] HCTL ('8', '-', '-', 0) found on session 32 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:59:27.861315 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:59:27.863244 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:27.863244 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:27.863244 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:27.863244 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:27.863244 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:27.863244 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:27.863244 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:27.863244 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:27.863244 np0000001475 nova-compute[98471]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 02:59:27.863244 np0000001475 nova-compute[98471]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 02:59:27.863244 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:27.865910 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:27.865910 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:27.865910 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:27.865910 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:27.865910 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:27.865910 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:27.865910 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:27.865910 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:27.865910 np0000001475 nova-compute[98471]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 02:59:27.865910 np0000001475 nova-compute[98471]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 02:59:27.865910 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:27.866413 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.208s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:59:27.866716 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:59:27.867761 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] HCTL ('7', '-', '-', 0) found on session 31 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:59:27.867911 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:59:27.890479 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Searching for a device in session 32 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:59:27.890479 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:59:27.890479 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Searching for a device in session 31 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:59:27.890479 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:59:27.931172 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:27.931426 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:28.077363 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:28.253900 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 02:59:28.408219 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:59:28.408219 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:59:28.661081 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 02:59:28.835332 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:28.910161 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:59:29.353438 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:29.419022 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.487s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:29.421014 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.588s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:29.426341 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 02:59:29.426485 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Claim successful on node np0000001475
May 27 02:59:29.516483 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Deleted allocations for instance 8b048373-2f8d-454a-9ad5-888403e8ee5f
May 27 02:59:29.678173 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Found WWN 33000000058a2856d for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 02:59:29.678551 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:59:29.678551 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '33000000058a2856d', 'path': '/dev/dm-0', 'multipath_id': '33000000058a2856d'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:59:29.678724 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000058a2856d', 'path': '/dev/dm-0', 'multipath_id': '33000000058a2856d'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 02:59:29.681133 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lazy-loading 'flavor' on Instance uuid 60418cf4-cd7f-4256-ad92-cc8336802816 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:59:29.923299 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "6ad1223d-d197-46e7-a32b-a25380d409a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:29.923299 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:30.079074 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:30.185502 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Attempting to attach volume 115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 02:59:30.186880 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] attach device xml: <disk type="block" device="disk">
May 27 02:59:30.186880 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 02:59:30.186880 np0000001475 nova-compute[98471]:   <alias name="ua-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80"/>
May 27 02:59:30.186880 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-0"/>
May 27 02:59:30.186880 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 02:59:30.186880 np0000001475 nova-compute[98471]:   <serial>115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80</serial>
May 27 02:59:30.186880 np0000001475 nova-compute[98471]: </disk>
May 27 02:59:30.186880 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 02:59:30.424170 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 02:59:30.524433 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5eb5a4f3-1883-496b-a52c-537d0ebf7bf0 tempest-TaggedBootDevicesTest_v242-1214928212 tempest-TaggedBootDevicesTest_v242-1214928212-project-member] Lock "8b048373-2f8d-454a-9ad5-888403e8ee5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.285s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:30.766824 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:30.772568 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:30.838287 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:59:30.838552 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:59:30.978653 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:31.341151 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:59:31.850522 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.430s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:31.852032 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 02:59:31.856352 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.876s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:31.861109 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 02:59:31.861258 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Claim successful on node np0000001475
May 27 02:59:31.868460 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:59:31.870207 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:59:31.870433 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:59:31.870770 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] No VIF found with MAC fa:16:3e:8f:94:b9, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:59:32.359053 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 02:59:32.359731 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 02:59:32.360137 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:32.360469 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:32.463837 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff4b501bdb27488490da6b1032106687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997fc21542b04af2a2d9113d30f87b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 02:59:32.862464 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 02:59:33.052521 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Successfully created port: 6cfc1d4d-e055-4ba7-a926-19911b813fe0 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:59:33.365442 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 02:59:33.380077 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:59:33.380393 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:59:33.443034 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0005726079998567002 future=<Future at 0x75572c409a30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:33.444183 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] Emitting event <LifecycleEvent: 1779850758.4423647, 8b048373-2f8d-454a-9ad5-888403e8ee5f => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:59:33.444354 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] VM Stopped (Lifecycle Event)
May 27 02:59:33.445571 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:33.445867 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f6197d11-6872-4be6-8894-3d1c15777d8f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "60418cf4-cd7f-4256-ad92-cc8336802816" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.575s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:33.722551 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Successfully updated port: 6cfc1d4d-e055-4ba7-a926-19911b813fe0 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:59:33.814594 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-11969dc7-0464-4256-814a-b47387e0a7fa req-943a1029-0407-45ac-a513-415849fd3fd9 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Received event network-changed-6cfc1d4d-e055-4ba7-a926-19911b813fe0 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:33.814594 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-11969dc7-0464-4256-814a-b47387e0a7fa req-943a1029-0407-45ac-a513-415849fd3fd9 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Refreshing instance network info cache due to event network-changed-6cfc1d4d-e055-4ba7-a926-19911b813fe0. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:59:33.814594 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-11969dc7-0464-4256-814a-b47387e0a7fa req-943a1029-0407-45ac-a513-415849fd3fd9 service nova] Acquiring lock "refresh_cache-ebd2884b-67b5-40c1-8cf0-a22bd90be727" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:59:33.814594 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-11969dc7-0464-4256-814a-b47387e0a7fa req-943a1029-0407-45ac-a513-415849fd3fd9 service nova] Acquired lock "refresh_cache-ebd2884b-67b5-40c1-8cf0-a22bd90be727" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:59:33.814594 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-11969dc7-0464-4256-814a-b47387e0a7fa req-943a1029-0407-45ac-a513-415849fd3fd9 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Refreshing network info cache for port 6cfc1d4d-e055-4ba7-a926-19911b813fe0 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:59:33.883543 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:59:33.952842 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3fb434fb-83c3-48b9-89d8-2df5a2920d1c tempest-TestMultiAttachVolumeSwap-90789856 tempest-TestMultiAttachVolumeSwap-90789856-project-member] [instance: 8b048373-2f8d-454a-9ad5-888403e8ee5f] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:59:34.225474 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "refresh_cache-ebd2884b-67b5-40c1-8cf0-a22bd90be727" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:59:34.289200 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:34.318794 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-11969dc7-0464-4256-814a-b47387e0a7fa req-943a1029-0407-45ac-a513-415849fd3fd9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:34.355204 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:34.376734 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 02:59:34.378690 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 02:59:34.378690 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Creating image(s)
May 27 02:59:34.378690 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:34.378690 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:34.378965 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:34.380771 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:59:34.386188 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:59:34.387159 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:34.403724 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.550s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:34.404594 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 02:59:34.450176 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-11969dc7-0464-4256-814a-b47387e0a7fa req-943a1029-0407-45ac-a513-415849fd3fd9 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:59:34.484387 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.097s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:34.485686 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:34.486033 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:34.486673 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:59:34.492107 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:59:34.492107 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:34.599519 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.108s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:34.600033 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:34.654261 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk 1073741824" returned: 0 in 0.054s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:34.656917 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.170s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:34.657059 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:34.761270 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.104s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:34.761817 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 02:59:34.763320 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:34.854952 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:34.855426 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Cannot resize image /opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 02:59:34.855883 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 02:59:34.856091 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Ensure instance console log exists: /opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 02:59:34.856418 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:34.856667 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:34.857100 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:34.886890 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-11969dc7-0464-4256-814a-b47387e0a7fa req-943a1029-0407-45ac-a513-415849fd3fd9 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:59:34.915838 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 02:59:34.916050 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 02:59:34.916838 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:34.917480 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:35.063084 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4a93dfe76ab455d8aa6e691b1fa34c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d191c03874150880aca259ffd3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 02:59:35.200251 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:59:35.200421 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Cleaning up deleted instances {{(pid=98471) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 27 02:59:35.390396 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-11969dc7-0464-4256-814a-b47387e0a7fa req-943a1029-0407-45ac-a513-415849fd3fd9 service nova] Releasing lock "refresh_cache-ebd2884b-67b5-40c1-8cf0-a22bd90be727" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:59:35.392829 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquired lock "refresh_cache-ebd2884b-67b5-40c1-8cf0-a22bd90be727" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:59:35.392829 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 02:59:35.416653 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 02:59:35.704678 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] There are 0 instances to clean {{(pid=98471) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 27 02:59:35.704945 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:59:35.705123 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98471) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 27 02:59:35.772703 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:35.923027 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 02:59:35.930347 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Stashing vm_state: active {{(pid=98471) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 27 02:59:36.207537 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:59:36.233941 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Successfully created port: 28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 02:59:36.341311 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:59:36.505379 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:36.505379 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:36.709769 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 02:59:36.864622 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:36.937287 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 02:59:36.938797 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 02:59:36.939059 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Creating image(s)
May 27 02:59:36.939539 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:36.939689 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "/opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:36.940216 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "/opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:36.941876 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:59:36.947773 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:59:36.950891 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:37.017695 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 02:59:37.017979 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Claim successful on node np0000001475
May 27 02:59:37.053851 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.103s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:37.054151 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:37.056257 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:37.056257 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:59:37.059245 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 02:59:37.059638 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:37.147146 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.087s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:37.149034 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:37.199861 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk 1073741824" returned: 0 in 0.050s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:37.200467 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.145s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:37.200903 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:37.215336 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:37.296163 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.095s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:37.297267 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 02:59:37.297267 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:37.380524 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:37.381004 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Cannot resize image /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 02:59:37.381527 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 02:59:37.381734 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Ensure instance console log exists: /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 02:59:37.382038 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:37.382262 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:37.382385 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:37.432678 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Successfully updated port: 28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 02:59:37.492510 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c2cec0aa-f1ae-4210-98a8-e7406ca50f0a req-c0334779-40aa-4692-8be5-bf2638c05884 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Received event network-changed-28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:37.492676 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c2cec0aa-f1ae-4210-98a8-e7406ca50f0a req-c0334779-40aa-4692-8be5-bf2638c05884 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Refreshing instance network info cache due to event network-changed-28ae6612-6474-4d47-8296-02394b0dabe5. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:59:37.492885 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c2cec0aa-f1ae-4210-98a8-e7406ca50f0a req-c0334779-40aa-4692-8be5-bf2638c05884 service nova] Acquiring lock "refresh_cache-6ad1223d-d197-46e7-a32b-a25380d409a8" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:59:37.493028 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c2cec0aa-f1ae-4210-98a8-e7406ca50f0a req-c0334779-40aa-4692-8be5-bf2638c05884 service nova] Acquired lock "refresh_cache-6ad1223d-d197-46e7-a32b-a25380d409a8" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:59:37.495861 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c2cec0aa-f1ae-4210-98a8-e7406ca50f0a req-c0334779-40aa-4692-8be5-bf2638c05884 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Refreshing network info cache for port 28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:59:37.526952 np0000001475 nova-compute[98471]: INFO nova.compute.resource_tracker [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Updating resource usage from migration 812ba8d3-5345-46d4-bf1b-0b53d5854b6b
May 27 02:59:37.936177 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "refresh_cache-6ad1223d-d197-46e7-a32b-a25380d409a8" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:59:37.962156 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:59:37.963120 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:59:37.995723 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c2cec0aa-f1ae-4210-98a8-e7406ca50f0a req-c0334779-40aa-4692-8be5-bf2638c05884 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:38.465030 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:59:38.591170 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:38.619976 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c2cec0aa-f1ae-4210-98a8-e7406ca50f0a req-c0334779-40aa-4692-8be5-bf2638c05884 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:59:38.709542 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:59:38.710562 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:59:38.710795 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:59:38.710959 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:59:38.711110 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 02:59:38.711540 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 02:59:38.974434 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.470s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:38.974947 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Migrating
May 27 02:59:38.974947 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:59:38.974947 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquired lock "compute-rpcapi-router" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:59:39.197782 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:59:39.198205 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 02:59:39.210272 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:39.357428 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:39.411946 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c2cec0aa-f1ae-4210-98a8-e7406ca50f0a req-c0334779-40aa-4692-8be5-bf2638c05884 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:59:39.434044 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:39.446311 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Updating instance_info_cache with network_info: [{"id": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "address": "fa:16:3e:b8:34:46", "network": {"id": "00a82372-a9cb-4a7e-8f75-6883f0e85849", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2146755790-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cfc1d4d-e0", "ovs_interfaceid": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:59:39.477017 np0000001475 nova-compute[98471]: INFO nova.compute.rpcapi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72
May 27 02:59:39.477836 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Releasing lock "compute-rpcapi-router" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:59:39.478628 np0000001475 nova-compute[98471]: DEBUG nova.compute.rpcapi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98471) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 02:59:39.915899 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c2cec0aa-f1ae-4210-98a8-e7406ca50f0a req-c0334779-40aa-4692-8be5-bf2638c05884 service nova] Releasing lock "refresh_cache-6ad1223d-d197-46e7-a32b-a25380d409a8" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:59:39.916566 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquired lock "refresh_cache-6ad1223d-d197-46e7-a32b-a25380d409a8" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:59:39.916813 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 02:59:39.948916 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Releasing lock "refresh_cache-ebd2884b-67b5-40c1-8cf0-a22bd90be727" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:59:39.949289 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Instance network_info: |[{"id": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "address": "fa:16:3e:b8:34:46", "network": {"id": "00a82372-a9cb-4a7e-8f75-6883f0e85849", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2146755790-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cfc1d4d-e0", "ovs_interfaceid": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 02:59:39.951209 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Start _get_guest_xml network_info=[{"id": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "address": "fa:16:3e:b8:34:46", "network": {"id": "00a82372-a9cb-4a7e-8f75-6883f0e85849", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2146755790-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cfc1d4d-e0", "ovs_interfaceid": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 02:59:39.953993 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 02:59:39.955288 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1481412241', uuid='ebd2884b-67b5-40c1-8cf0-a22bd90be727'), owner=OwnerMeta(userid='ff4b501bdb27488490da6b1032106687', username='tempest-TaggedAttachmentsTest-1282046058-project-member', projectid='997fc21542b04af2a2d9113d30f87b22', projectname='tempest-TaggedAttachmentsTest-1282046058'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "address": "fa:16:3e:b8:34:46", "network": {"id": "00a82372-a9cb-4a7e-8f75-6883f0e85849", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2146755790-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cfc1d4d-e0", "ovs_interfaceid": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850779.9549537) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 02:59:39.956359 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 02:59:39.956792 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 02:59:39.957548 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 02:59:39.957822 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 02:59:39.959193 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 02:59:39.959770 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 02:59:39.960096 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 02:59:39.960264 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 02:59:39.960450 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 02:59:39.960940 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 02:59:39.960940 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 02:59:39.960940 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 02:59:39.961156 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 02:59:39.964774 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 02:59:39.964774 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 02:59:39.964774 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 02:59:39.979372 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1481412241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-1481412241',id=12,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX3hrfXJylogloNcsVODyT6YV7aMSshELm9OJiUcOjH996gMpO5+kFiAKQhQX7ZkAoqoXhzYZQLrM0rlP3d/NY+cv+dBD4+nzGVXWnWfuAvNWMegazBzNSt2XeuVXBmtQ==',key_name='tempest-keypair-1422957137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='997fc21542b04af2a2d9113d30f87b22',ramdisk_id='',reservation_id='r-b9zanhfv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1282046058',owner_user_name='tempest-TaggedAttachmentsTest-1282046058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff4b501bdb27488490da6b1032106687',uuid=ebd2884b-67b5-40c1-8cf0-a22bd90be727,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "address": "fa:16:3e:b8:34:46", "network": {"id": "00a82372-a9cb-4a7e-8f75-6883f0e85849", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2146755790-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cfc1d4d-e0", "ovs_interfaceid": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:59:39.980059 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Converting VIF {"id": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "address": "fa:16:3e:b8:34:46", "network": {"id": "00a82372-a9cb-4a7e-8f75-6883f0e85849", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2146755790-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cfc1d4d-e0", "ovs_interfaceid": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:39.981278 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:34:46,bridge_name='br-int',has_traffic_filtering=True,id=6cfc1d4d-e055-4ba7-a926-19911b813fe0,network=Network(00a82372-a9cb-4a7e-8f75-6883f0e85849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cfc1d4d-e0') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:39.982471 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lazy-loading 'pci_devices' on Instance uuid ebd2884b-67b5-40c1-8cf0-a22bd90be727 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:59:39.997888 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:59:39.998010 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquired lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:59:39.999140 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 02:59:40.199636 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:59:40.199929 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:59:40.200265 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 02:59:40.326671 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:40.487488 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] End _get_guest_xml xml=<domain type="qemu">
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:   <uuid>ebd2884b-67b5-40c1-8cf0-a22bd90be727</uuid>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:   <name>instance-0000000c</name>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:   <metadata>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <nova:name>tempest-device-tagging-server-1481412241</nova:name>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 02:59:39</nova:creationTime>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       </nova:image>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:         <nova:user uuid="ff4b501bdb27488490da6b1032106687">tempest-TaggedAttachmentsTest-1282046058-project-member</nova:user>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:         <nova:project uuid="997fc21542b04af2a2d9113d30f87b22">tempest-TaggedAttachmentsTest-1282046058</nova:project>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:         <nova:port uuid="6cfc1d4d-e055-4ba7-a926-19911b813fe0">
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:   </metadata>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     <system>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <entry name="serial">ebd2884b-67b5-40c1-8cf0-a22bd90be727</entry>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <entry name="uuid">ebd2884b-67b5-40c1-8cf0-a22bd90be727</entry>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     </system>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:   <os>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:   </os>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:   <features>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     <acpi/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     <tcg>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     </tcg>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:   </features>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:   <devices>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     </disk>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk.config"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     </disk>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:b8:34:46"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <target dev="tap6cfc1d4d-e0"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     </interface>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/console.log" append="off"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     </serial>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     <video>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     </video>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     </rng>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:     </memballoon>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:   </devices>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]: </domain>
May 27 02:59:40.487488 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 02:59:40.489926 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Preparing to wait for external event network-vif-plugged-6cfc1d4d-e055-4ba7-a926-19911b813fe0 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:59:40.489926 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:40.489926 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:40.489926 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:40.489926 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1481412241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-1481412241',id=12,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX3hrfXJylogloNcsVODyT6YV7aMSshELm9OJiUcOjH996gMpO5+kFiAKQhQX7ZkAoqoXhzYZQLrM0rlP3d/NY+cv+dBD4+nzGVXWnWfuAvNWMegazBzNSt2XeuVXBmtQ==',key_name='tempest-keypair-1422957137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='997fc21542b04af2a2d9113d30f87b22',ramdisk_id='',reservation_id='r-b9zanhfv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1282046058',owner_user_name='tempest-TaggedAttachmentsTest-1282046058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff4b501bdb27488490da6b1032106687',uuid=ebd2884b-67b5-40c1-8cf0-a22bd90be727,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "address": "fa:16:3e:b8:34:46", "network": {"id": "00a82372-a9cb-4a7e-8f75-6883f0e85849", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2146755790-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cfc1d4d-e0", "ovs_interfaceid": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:59:40.489926 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Converting VIF {"id": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "address": "fa:16:3e:b8:34:46", "network": {"id": "00a82372-a9cb-4a7e-8f75-6883f0e85849", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2146755790-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cfc1d4d-e0", "ovs_interfaceid": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:40.489926 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:34:46,bridge_name='br-int',has_traffic_filtering=True,id=6cfc1d4d-e055-4ba7-a926-19911b813fe0,network=Network(00a82372-a9cb-4a7e-8f75-6883f0e85849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cfc1d4d-e0') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:40.489926 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:34:46,bridge_name='br-int',has_traffic_filtering=True,id=6cfc1d4d-e055-4ba7-a926-19911b813fe0,network=Network(00a82372-a9cb-4a7e-8f75-6883f0e85849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cfc1d4d-e0') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:59:40.490758 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:40.491151 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:40.491502 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:59:40.494972 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:40.495437 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8744b422-4cfd-5faf-8afe-581b7dd96c3c', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:40.500328 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:40.503187 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:40.503491 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cfc1d4d-e0, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:40.503782 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6cfc1d4d-e0, col_values=(('qos', UUID('93a82106-f2e8-4504-9aeb-a9b8ac8fa859')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:40.503955 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6cfc1d4d-e0, col_values=(('external_ids', {'iface-id': '6cfc1d4d-e055-4ba7-a926-19911b813fe0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:34:46', 'vm-uuid': 'ebd2884b-67b5-40c1-8cf0-a22bd90be727'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:40.506072 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:40.509760 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:40.513671 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:40.514137 np0000001475 nova-compute[98471]: INFO os_vif [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:34:46,bridge_name='br-int',has_traffic_filtering=True,id=6cfc1d4d-e055-4ba7-a926-19911b813fe0,network=Network(00a82372-a9cb-4a7e-8f75-6883f0e85849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cfc1d4d-e0')
May 27 02:59:40.530767 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 02:59:40.774486 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:40.915841 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8c25e708-c0d0-4ae3-b33f-046ce41911cc req-c47c0ec5-c3bb-499c-bbb8-9213096817ce service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Received event network-vif-unplugged-6cfc1d4d-e055-4ba7-a926-19911b813fe0 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:40.915841 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8c25e708-c0d0-4ae3-b33f-046ce41911cc req-c47c0ec5-c3bb-499c-bbb8-9213096817ce service nova] Acquiring lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:40.915841 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8c25e708-c0d0-4ae3-b33f-046ce41911cc req-c47c0ec5-c3bb-499c-bbb8-9213096817ce service nova] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:40.915841 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8c25e708-c0d0-4ae3-b33f-046ce41911cc req-c47c0ec5-c3bb-499c-bbb8-9213096817ce service nova] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:40.915841 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8c25e708-c0d0-4ae3-b33f-046ce41911cc req-c47c0ec5-c3bb-499c-bbb8-9213096817ce service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] No event matching network-vif-unplugged-6cfc1d4d-e055-4ba7-a926-19911b813fe0 in dict_keys([('network-vif-plugged', '6cfc1d4d-e055-4ba7-a926-19911b813fe0')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 02:59:40.915841 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-8c25e708-c0d0-4ae3-b33f-046ce41911cc req-c47c0ec5-c3bb-499c-bbb8-9213096817ce service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Received unexpected event network-vif-unplugged-6cfc1d4d-e055-4ba7-a926-19911b813fe0 for instance with vm_state building and task_state spawning.
May 27 02:59:40.998410 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:41.630000 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Updating instance_info_cache with network_info: [{"id": "28ae6612-6474-4d47-8296-02394b0dabe5", "address": "fa:16:3e:fc:b5:d4", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ae6612-64", "ovs_interfaceid": "28ae6612-6474-4d47-8296-02394b0dabe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:59:41.738856 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:41.858669 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:42.031710 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:59:42.032703 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:59:42.032703 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] No VIF found with MAC fa:16:3e:b8:34:46, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:59:42.032703 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Using config drive
May 27 02:59:42.115333 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Updating instance_info_cache with network_info: [{"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:59:42.132680 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Releasing lock "refresh_cache-6ad1223d-d197-46e7-a32b-a25380d409a8" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:59:42.132807 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Instance network_info: |[{"id": "28ae6612-6474-4d47-8296-02394b0dabe5", "address": "fa:16:3e:fc:b5:d4", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ae6612-64", "ovs_interfaceid": "28ae6612-6474-4d47-8296-02394b0dabe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 02:59:42.135387 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Start _get_guest_xml network_info=[{"id": "28ae6612-6474-4d47-8296-02394b0dabe5", "address": "fa:16:3e:fc:b5:d4", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ae6612-64", "ovs_interfaceid": "28ae6612-6474-4d47-8296-02394b0dabe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 02:59:42.139398 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:42.141054 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 02:59:42.142163 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-tempest.common.compute-instance-875613762', uuid='6ad1223d-d197-46e7-a32b-a25380d409a8'), owner=OwnerMeta(userid='d4a93dfe76ab455d8aa6e691b1fa34c5', username='tempest-ServerActionsTestOtherA-569974590-project-member', projectid='233d191c03874150880aca259ffd3e21', projectname='tempest-ServerActionsTestOtherA-569974590'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "28ae6612-6474-4d47-8296-02394b0dabe5", "address": "fa:16:3e:fc:b5:d4", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ae6612-64", "ovs_interfaceid": "28ae6612-6474-4d47-8296-02394b0dabe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850782.1418276) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 02:59:42.143607 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 02:59:42.144099 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 02:59:42.144752 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 02:59:42.144938 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 02:59:42.145935 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 02:59:42.146122 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 02:59:42.146311 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 02:59:42.146449 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 02:59:42.146795 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 02:59:42.147654 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 02:59:42.147654 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 02:59:42.147654 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 02:59:42.147654 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 02:59:42.147654 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 02:59:42.148217 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 02:59:42.148401 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 02:59:42.160653 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T02:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-875613762',display_name='tempest-tempest.common.compute-instance-875613762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-tempest-common-compute-instance-875613762',id=13,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhbCOMX0cDx/uCjoD1pQ3iMb/yxZcupQyHf7uuxnrf7EdI6EEP6StEltLO6whpKYwhmElUFdPkkHXCp77KUbxPxYkUhhTpx6/EQ206sxZO2JeMp5jzBChiUJOOt29J78w==',key_name='tempest-keypair-1019067704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='233d191c03874150880aca259ffd3e21',ramdisk_id='',reservation_id='r-gfwl4dxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-569974590',owner_user_name='tempest-ServerActionsTestOtherA-569974590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:59:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a93dfe76ab455d8aa6e691b1fa34c5',uuid=6ad1223d-d197-46e7-a32b-a25380d409a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28ae6612-6474-4d47-8296-02394b0dabe5", "address": "fa:16:3e:fc:b5:d4", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ae6612-64", "ovs_interfaceid": "28ae6612-6474-4d47-8296-02394b0dabe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 02:59:42.160905 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converting VIF {"id": "28ae6612-6474-4d47-8296-02394b0dabe5", "address": "fa:16:3e:fc:b5:d4", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ae6612-64", "ovs_interfaceid": "28ae6612-6474-4d47-8296-02394b0dabe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:42.161410 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=28ae6612-6474-4d47-8296-02394b0dabe5,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ae6612-64') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:42.161859 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ad1223d-d197-46e7-a32b-a25380d409a8 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:59:42.199726 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 02:59:42.538696 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:42.617469 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Releasing lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:59:42.665120 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] End _get_guest_xml xml=<domain type="qemu">
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:   <uuid>6ad1223d-d197-46e7-a32b-a25380d409a8</uuid>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:   <name>instance-0000000d</name>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:   <metadata>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <nova:name>tempest-tempest.common.compute-instance-875613762</nova:name>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 02:59:42</nova:creationTime>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       </nova:image>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:         <nova:user uuid="d4a93dfe76ab455d8aa6e691b1fa34c5">tempest-ServerActionsTestOtherA-569974590-project-member</nova:user>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:         <nova:project uuid="233d191c03874150880aca259ffd3e21">tempest-ServerActionsTestOtherA-569974590</nova:project>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:         <nova:port uuid="28ae6612-6474-4d47-8296-02394b0dabe5">
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:         </nova:port>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:   </metadata>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     <system>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <entry name="serial">6ad1223d-d197-46e7-a32b-a25380d409a8</entry>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <entry name="uuid">6ad1223d-d197-46e7-a32b-a25380d409a8</entry>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     </system>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:   <os>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:   </os>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:   <features>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     <acpi/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     <tcg>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     </tcg>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:   </features>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:   </cpu>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:   <devices>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     </disk>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk.config"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     </disk>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:fc:b5:d4"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <target dev="tap28ae6612-64"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     </interface>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/console.log" append="off"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     </serial>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     <video>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     </video>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     </rng>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:     </memballoon>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:   </devices>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]: </domain>
May 27 02:59:42.665120 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 02:59:42.669051 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Preparing to wait for external event network-vif-plugged-28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 02:59:42.669051 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:42.669051 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:42.669051 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:42.669051 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T02:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-875613762',display_name='tempest-tempest.common.compute-instance-875613762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-tempest-common-compute-instance-875613762',id=13,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhbCOMX0cDx/uCjoD1pQ3iMb/yxZcupQyHf7uuxnrf7EdI6EEP6StEltLO6whpKYwhmElUFdPkkHXCp77KUbxPxYkUhhTpx6/EQ206sxZO2JeMp5jzBChiUJOOt29J78w==',key_name='tempest-keypair-1019067704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='233d191c03874150880aca259ffd3e21',ramdisk_id='',reservation_id='r-gfwl4dxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-569974590',owner_user_name='tempest-ServerActionsTestOtherA-569974590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:59:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a93dfe76ab455d8aa6e691b1fa34c5',uuid=6ad1223d-d197-46e7-a32b-a25380d409a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28ae6612-6474-4d47-8296-02394b0dabe5", "address": "fa:16:3e:fc:b5:d4", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ae6612-64", "ovs_interfaceid": "28ae6612-6474-4d47-8296-02394b0dabe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 02:59:42.669051 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converting VIF {"id": "28ae6612-6474-4d47-8296-02394b0dabe5", "address": "fa:16:3e:fc:b5:d4", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ae6612-64", "ovs_interfaceid": "28ae6612-6474-4d47-8296-02394b0dabe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:42.670199 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=28ae6612-6474-4d47-8296-02394b0dabe5,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ae6612-64') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:42.670349 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=28ae6612-6474-4d47-8296-02394b0dabe5,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ae6612-64') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 02:59:42.670598 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:42.670838 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:42.671045 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 02:59:42.672027 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:42.672277 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c7cf543-c52a-5d79-ab23-de6cf5beab1a', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:42.674279 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:42.681591 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:42.684000 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:42.684277 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28ae6612-64, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:42.684701 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28ae6612-64, col_values=(('qos', UUID('515c13ea-0a08-428c-be3e-0f1c4aa142cc')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:42.684934 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28ae6612-64, col_values=(('external_ids', {'iface-id': '28ae6612-6474-4d47-8296-02394b0dabe5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:b5:d4', 'vm-uuid': '6ad1223d-d197-46e7-a32b-a25380d409a8'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:42.686079 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:42.687373 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:42.698958 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:42.700172 np0000001475 nova-compute[98471]: INFO os_vif [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=28ae6612-6474-4d47-8296-02394b0dabe5,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ae6612-64')
May 27 02:59:42.710659 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:42.711330 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:42.711645 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:42.711940 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 02:59:42.819553 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Creating config drive at /opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk.config
May 27 02:59:42.824729 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpky9f_nqf {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:42.885361 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpky9f_nqf" returned: 0 in 0.060s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:43.397463 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:43.438389 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:43.530488 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:43.749222 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 02:59:43.759247 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:43.840608 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:43.863817 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:43.868275 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:43.872344 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:43.872894 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:43.898352 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:43.906120 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:43.976524 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:43.977142 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 02:59:43.981193 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:44.075810 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:44.076406 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:44.135317 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Starting migrate_disk_and_power_off {{(pid=98471) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 27 02:59:44.173307 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:44.177970 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:44.184832 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:44.200403 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:44.208192 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:44.237071 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:59:44.237071 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 02:59:44.237071 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No VIF found with MAC fa:16:3e:fc:b5:d4, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 02:59:44.237071 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Using config drive
May 27 02:59:44.237287 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:44.239083 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:44.294613 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:44.294791 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:44.391307 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:44.398134 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 02:59:44.398543 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-11 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 02:59:44.398543 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-12 (vdc) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 02:59:44.401211 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:44.504700 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:44.506898 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:44.522656 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850784.506782, ebd2884b-67b5-40c1-8cf0-a22bd90be727 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:59:44.529117 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] VM Started (Lifecycle Event)
May 27 02:59:44.534036 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Instance destroyed successfully.
May 27 02:59:44.540582 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2003998951',display_name='tempest-ServerActionsTestOtherB-server-2003998951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serveractionstestotherb-server-2003998951',id=10,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg7MMihIxBG1QGB6QSTA9rrk5T7Na9nzECiQ6YZKa+5mhSSqtwAjACf4ZBO/nNtoXKyk5k1Psoc+8lMf/kcUG6+ibFAACUX2UpjW+QvgPhfAshXB22uMHukoxMZ4AS6zw==',key_name='tempest-keypair-1292561843',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:58:42Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='88bb33ad146843308b381f8379c70094',ramdisk_id='',reservation_id='r-cw0r0f6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1490236880',owner_user_name='tempest-ServerActionsTestOtherB-1490236880-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:59:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1358d6b48fbe42159155175cf488804b',uuid=60418cf4-cd7f-4256-ad92-cc8336802816,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-159671913-network", "vif_mac": "fa:16:3e:8f:94:b9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:59:44.540933 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Converting VIF {"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-159671913-network", "vif_mac": "fa:16:3e:8f:94:b9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:44.543923 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:44.544596 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:59:44.547420 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:44.548207 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap920f5752-8d, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:44.552543 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:44.553640 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:44.562916 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:44.564421 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:44.564760 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1133e929-3cbc-4d5f-b553-7ec4eda77a15) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:44.566756 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:44.566999 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:44.575807 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:44.578908 np0000001475 nova-compute[98471]: INFO os_vif [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d')
May 27 02:59:44.582184 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 02:59:44.582877 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:59:44.583195 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:59:44.583936 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:59:44.584403 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 02:59:44.584611 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 02:59:44.618200 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:44.618862 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Periodic task is updating the host stat, it is trying to get disk instance-0000000d, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk.config'
May 27 02:59:44.623294 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:44.623294 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:44.623294 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:44.623294 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:44.623294 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:44.623294 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:44.623294 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:44.623294 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:44.623294 np0000001475 nova-compute[98471]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 02:59:44.623294 np0000001475 nova-compute[98471]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 02:59:44.623294 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:44.624324 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 02:59:44.625333 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:44.625333 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:44.625333 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:44.625333 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:44.625333 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:44.625333 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:44.625333 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:44.625333 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:44.625333 np0000001475 nova-compute[98471]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 02:59:44.625333 np0000001475 nova-compute[98471]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 02:59:44.625333 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:44.625769 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', '32')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 02:59:44.625861 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', '31')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:59:44.626286 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:44.649284 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', '32')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:59:44.651369 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c0c1c60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'): ({'sdb'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 02:59:44.651895 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Removing multipathed devices sdc, sdb {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 02:59:44.652366 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Flush multipath device 33000000058a2856d {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 02:59:44.668888 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.042s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:44.669470 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=13100MB free_disk=74.59392547607422GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 02:59:44.669699 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:44.672353 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:44.688961 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:59:44.742788 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:44.749812 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:59:44.791896 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 02:59:44.792935 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 02:59:44.794736 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 02:59:44.809853 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 02:59:44.810200 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 02:59:44.824890 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:44.863054 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.40.100,3260]
May 27 02:59:44.863054 np0000001475 nova-compute[98471]: Logout of [sid: 31, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.40.100,3260] successful.
May 27 02:59:44.863054 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:44.890888 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:44.908020 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:44.947998 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.50.100,3260]
May 27 02:59:44.947998 np0000001475 nova-compute[98471]: Logout of [sid: 32, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.50.100,3260] successful.
May 27 02:59:44.947998 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:44.952232 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:44.971936 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:44.978879 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:59:44.978879 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] <== disconnect_volume: return (392ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:59:44.978879 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 02:59:44.982796 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:45.024235 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Creating config drive at /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk.config
May 27 02:59:45.026017 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-319a0391-9ec7-41e4-bc09-9a6ce4bf97cf req-2e4fa06d-de71-43e7-b740-4daa603e1c6a service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Received event network-vif-plugged-6cfc1d4d-e055-4ba7-a926-19911b813fe0 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:45.026556 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-319a0391-9ec7-41e4-bc09-9a6ce4bf97cf req-2e4fa06d-de71-43e7-b740-4daa603e1c6a service nova] Acquiring lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:45.026970 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-319a0391-9ec7-41e4-bc09-9a6ce4bf97cf req-2e4fa06d-de71-43e7-b740-4daa603e1c6a service nova] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:45.027173 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-319a0391-9ec7-41e4-bc09-9a6ce4bf97cf req-2e4fa06d-de71-43e7-b740-4daa603e1c6a service nova] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:45.027308 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-319a0391-9ec7-41e4-bc09-9a6ce4bf97cf req-2e4fa06d-de71-43e7-b740-4daa603e1c6a service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Processing event network-vif-plugged-6cfc1d4d-e055-4ba7-a926-19911b813fe0 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:59:45.030040 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-745c5544-3532-46bf-96aa-a95cd7d3db21 req-bf77e33a-290b-4ff3-8d67-711e490cc051 service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received event network-vif-unplugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:45.030236 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-745c5544-3532-46bf-96aa-a95cd7d3db21 req-bf77e33a-290b-4ff3-8d67-711e490cc051 service nova] Acquiring lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:45.031014 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-745c5544-3532-46bf-96aa-a95cd7d3db21 req-bf77e33a-290b-4ff3-8d67-711e490cc051 service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:45.031503 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-745c5544-3532-46bf-96aa-a95cd7d3db21 req-bf77e33a-290b-4ff3-8d67-711e490cc051 service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:45.031659 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-745c5544-3532-46bf-96aa-a95cd7d3db21 req-bf77e33a-290b-4ff3-8d67-711e490cc051 service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] No waiting events found dispatching network-vif-unplugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:45.031831 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-745c5544-3532-46bf-96aa-a95cd7d3db21 req-bf77e33a-290b-4ff3-8d67-711e490cc051 service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received unexpected event network-vif-unplugged-920f5752-8d06-40e8-90e8-53fa42f5488d for instance with vm_state active and task_state resize_migrating.
May 27 02:59:45.032086 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 02:59:45.036594 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 02:59:45.038285 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:59:45.041726 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp11ktk9w3 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:45.042344 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:59:45.056568 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Instance spawned successfully.
May 27 02:59:45.058737 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 02:59:45.101361 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:45.104562 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:45.121511 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp11ktk9w3" returned: 0 in 0.079s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:45.206536 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:45.206536 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 02:59:45.207427 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816_resize/disk /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:45.321473 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CMD "cp -r /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816_resize/disk /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk" returned: 0 in 0.114s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:45.325771 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816_resize/disk.config /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.config {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:45.362794 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CMD "cp -r /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816_resize/disk.config /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.config" returned: 0 in 0.039s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:45.365760 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816_resize/disk.info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.info {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:45.397082 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CMD "cp -r /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816_resize/disk.info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.info" returned: 0 in 0.033s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:45.569367 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 02:59:45.569367 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850785.5680406, ebd2884b-67b5-40c1-8cf0-a22bd90be727 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:59:45.569367 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] VM Paused (Lifecycle Event)
May 27 02:59:45.580095 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:59:45.580095 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:59:45.580095 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:59:45.580095 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:59:45.580095 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:59:45.580095 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:59:45.687359 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Applying migration context for instance 60418cf4-cd7f-4256-ad92-cc8336802816 as it has an incoming, in-progress migration 812ba8d3-5345-46d4-bf1b-0b53d5854b6b. Migration status is migrating {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 27 02:59:45.688787 np0000001475 nova-compute[98471]: INFO nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Updating resource usage from migration 812ba8d3-5345-46d4-bf1b-0b53d5854b6b
May 27 02:59:45.741496 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:45.763130 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 7c0291f5-62af-417b-9418-41d808856a8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:59:45.763130 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 27b7be13-fa61-4916-a350-a2370d4430bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:59:45.763130 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 8d762a67-82b6-40d3-b625-0731ea01c45b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:59:45.763130 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance ebd2884b-67b5-40c1-8cf0-a22bd90be727 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:59:45.763130 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 6ad1223d-d197-46e7-a32b-a25380d409a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:59:45.763130 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Migration 812ba8d3-5345-46d4-bf1b-0b53d5854b6b is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 27 02:59:45.763130 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 60418cf4-cd7f-4256-ad92-cc8336802816 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 02:59:45.763130 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 02:59:45.763130 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=1920MB phys_disk=95GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:59:44 up 31 min,  2 users,  load average: 9.64, 5.04, 2.29\n', 'num_instances': '6', 'num_vm_active': '4', 'num_task_None': '3', 'num_os_type_None': '6', 'num_proj_36131e6324ff45ddb65932f4ade9a1a8': '1', 'io_workload': '3', 'num_proj_faa29a06cd694e828f6bc5146d9f7339': '1', 'num_task_resize_migrating': '1', 'num_proj_88bb33ad146843308b381f8379c70094': '1', 'num_proj_233d191c03874150880aca259ffd3e21': '2', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_997fc21542b04af2a2d9113d30f87b22': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 02:59:45.773875 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:45.777945 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:45.887153 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:45.959232 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:45.961160 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:46.074780 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:59:46.086425 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999637787999973 future=<Future at 0x75572c5aa180 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:46.088799 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99805751200006 future=<Future at 0x75572c5aa180 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:46.092477 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850786.0891109, ebd2884b-67b5-40c1-8cf0-a22bd90be727 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:59:46.092646 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] VM Resumed (Lifecycle Event)
May 27 02:59:46.102815 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.983619152000074 future=<Future at 0x75572c5aa180 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:46.103269 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Took 11.71 seconds to spawn the instance on the hypervisor.
May 27 02:59:46.105646 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:59:46.297218 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:59:46.297522 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:59:46.598649 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:59:46.606400 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:59:46.608581 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:46.608581 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:46.621108 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Took 17.86 seconds to build instance.
May 27 02:59:46.721687 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:46.801284 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:59:47.023558 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Port 920f5752-8d06-40e8-90e8-53fa42f5488d binding to destination host np0000001475 is already ACTIVE {{(pid=98471) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 27 02:59:47.082413 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a7c7727e-14ee-42b5-8e2f-b4041f2bd7e7 req-43c67e52-056f-4aec-bcb2-560f16519e23 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Received event network-vif-plugged-6cfc1d4d-e055-4ba7-a926-19911b813fe0 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:47.085107 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a7c7727e-14ee-42b5-8e2f-b4041f2bd7e7 req-43c67e52-056f-4aec-bcb2-560f16519e23 service nova] Acquiring lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:47.085367 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a7c7727e-14ee-42b5-8e2f-b4041f2bd7e7 req-43c67e52-056f-4aec-bcb2-560f16519e23 service nova] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:47.086033 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a7c7727e-14ee-42b5-8e2f-b4041f2bd7e7 req-43c67e52-056f-4aec-bcb2-560f16519e23 service nova] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:47.086200 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a7c7727e-14ee-42b5-8e2f-b4041f2bd7e7 req-43c67e52-056f-4aec-bcb2-560f16519e23 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] No waiting events found dispatching network-vif-plugged-6cfc1d4d-e055-4ba7-a926-19911b813fe0 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:47.086361 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-a7c7727e-14ee-42b5-8e2f-b4041f2bd7e7 req-43c67e52-056f-4aec-bcb2-560f16519e23 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Received unexpected event network-vif-plugged-6cfc1d4d-e055-4ba7-a926-19911b813fe0 for instance with vm_state active and task_state None.
May 27 02:59:47.111295 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-056828d1-c27a-4a17-aad5-e5819b959aaf req-12870fa6-5b97-416e-a567-5055efe5e40e service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received event network-vif-unplugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:47.111511 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-056828d1-c27a-4a17-aad5-e5819b959aaf req-12870fa6-5b97-416e-a567-5055efe5e40e service nova] Acquiring lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:47.111670 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-056828d1-c27a-4a17-aad5-e5819b959aaf req-12870fa6-5b97-416e-a567-5055efe5e40e service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:47.111839 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-056828d1-c27a-4a17-aad5-e5819b959aaf req-12870fa6-5b97-416e-a567-5055efe5e40e service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:47.114280 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850787.1124403, 6ad1223d-d197-46e7-a32b-a25380d409a8 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:59:47.114544 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-056828d1-c27a-4a17-aad5-e5819b959aaf req-12870fa6-5b97-416e-a567-5055efe5e40e service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] No waiting events found dispatching network-vif-unplugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:47.114694 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-056828d1-c27a-4a17-aad5-e5819b959aaf req-12870fa6-5b97-416e-a567-5055efe5e40e service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received unexpected event network-vif-unplugged-920f5752-8d06-40e8-90e8-53fa42f5488d for instance with vm_state active and task_state resize_migrating.
May 27 02:59:47.117933 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] VM Started (Lifecycle Event)
May 27 02:59:47.124200 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31f14e80-6699-4e87-86c4-aed9b881d1b5 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.375s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:47.315603 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 02:59:47.315818 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.646s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:47.316361 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 55.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 02:59:47.623246 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:59:47.627240 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850787.6268673, 6ad1223d-d197-46e7-a32b-a25380d409a8 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:59:47.627351 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] VM Paused (Lifecycle Event)
May 27 02:59:48.036049 np0000001475 nova-compute[98471]: DEBUG nova.compute.rpcapi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98471) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 02:59:48.049289 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:48.049426 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:48.049541 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:48.130791 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:59:48.135840 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:59:48.639700 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 02:59:49.015401 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "7c0291f5-62af-417b-9418-41d808856a8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:49.016890 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "7c0291f5-62af-417b-9418-41d808856a8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:49.016890 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "7c0291f5-62af-417b-9418-41d808856a8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:49.016890 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:49.016890 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:49.018369 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Terminating instance
May 27 02:59:49.069356 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:49.123247 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:49.382914 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:59:49.382914 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquired lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:59:49.382914 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 02:59:49.525272 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 02:59:49.551723 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:49.556809 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:49.565879 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:49.575041 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:49.579253 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:49.605462 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:49.606493 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:49.768509 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:49.768972 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "27b7be13-fa61-4916-a350-a2370d4430bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:49.768972 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:49.769339 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:49.769339 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:49.771379 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Terminating instance
May 27 02:59:49.881731 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999654569999848 future=<Future at 0x7557241938c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:49.883071 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Instance destroyed successfully.
May 27 02:59:49.883475 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lazy-loading 'resources' on Instance uuid 7c0291f5-62af-417b-9418-41d808856a8d {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:59:49.885434 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:50.275285 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 02:59:50.307462 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:50.314304 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:50.338856 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:50.367830 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:50.385999 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-424293934',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serveractionsv293testjson-server-1629751309',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD01cBGq/IkOVvMiNNSEzke/Ew4L0jaQY97yIGPfSv1JXwnxRa+HmYDFmBWFxgN0p371J80Ye8vuUhMxKGiaH6IKyRaiveYFSXCzEZJC6BeRyymyWvE7WXoWHiN9My+zCA==',key_name='tempest-keypair-795165112',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:59:11Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36131e6324ff45ddb65932f4ade9a1a8',ramdisk_id='',reservation_id='r-hxvg0h83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='48155fdd-4ef0-4719-a052-7861f417b7f0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-450650320',owner_user_name='tempest-ServerActionsV293TestJSON-450650320-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:59:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34d4ecd608df47c6b6057f74772ef553',uuid=7c0291f5-62af-417b-9418-41d808856a8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "address": "fa:16:3e:26:2c:eb", "network": {"id": "c7f25d43-cc3f-4be2-b8f5-311363bbd4ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1793934555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36131e6324ff45ddb65932f4ade9a1a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f6cb37-5c", "ovs_interfaceid": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:59:50.386263 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Converting VIF {"id": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "address": "fa:16:3e:26:2c:eb", "network": {"id": "c7f25d43-cc3f-4be2-b8f5-311363bbd4ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1793934555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "36131e6324ff45ddb65932f4ade9a1a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap51f6cb37-5c", "ovs_interfaceid": "51f6cb37-5c11-47c2-bf1c-d072ecfff71a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:50.386947 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:2c:eb,bridge_name='br-int',has_traffic_filtering=True,id=51f6cb37-5c11-47c2-bf1c-d072ecfff71a,network=Network(c7f25d43-cc3f-4be2-b8f5-311363bbd4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f6cb37-5c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:50.387185 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:2c:eb,bridge_name='br-int',has_traffic_filtering=True,id=51f6cb37-5c11-47c2-bf1c-d072ecfff71a,network=Network(c7f25d43-cc3f-4be2-b8f5-311363bbd4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f6cb37-5c') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:59:50.389106 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:50.392088 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:50.392240 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51f6cb37-5c, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:50.394906 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:50.396591 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:50.468792 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:50.479786 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:50.479786 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0891a80-ed52-4ca4-be1f-3ebeeaafb687) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:50.482848 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:50.564635 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:50.570112 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:50.574882 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:50.612470 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:50.614286 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:50.615870 np0000001475 nova-compute[98471]: INFO os_vif [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:2c:eb,bridge_name='br-int',has_traffic_filtering=True,id=51f6cb37-5c11-47c2-bf1c-d072ecfff71a,network=Network(c7f25d43-cc3f-4be2-b8f5-311363bbd4ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51f6cb37-5c')
May 27 02:59:50.617513 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 02:59:50.617873 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:59:50.618111 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:59:50.618451 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:59:50.618783 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 02:59:50.618988 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 02:59:50.634626 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:50.651614 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:50.651614 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:50.651614 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:50.651614 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:50.651614 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:50.651614 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:50.651614 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:50.651614 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:50.651614 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:50.651614 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:50.651614 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:50.651614 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:50.651614 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:50.651614 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:50.651614 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:50.651614 np0000001475 nova-compute[98471]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:50.651614 np0000001475 nova-compute[98471]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 (non-flash)
May 27 02:59:50.651614 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:50.651614 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '30')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 02:59:50.651614 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '30')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:59:50.653805 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41', '29')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:59:50.655779 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755739d92fc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41'): ({'sdq'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41'): ({'sdp'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 02:59:50.655779 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Removing multipathed devices sdp, sdq {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 02:59:50.655779 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Flush multipath device 330000000dfd8a205 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 02:59:50.692392 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:50.713210 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:50.717868 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:59:50.756727 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:50.768397 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:59:50.800393 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:50.801566 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:50.812320 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Checking to see if SCSI volumes sdp, sdq have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 02:59:50.812443 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] SCSI volumes sdp, sdq have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 02:59:50.814106 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Checking to see if device paths {'sdp', 'sdq'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 02:59:50.829219 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Device paths {'sdp', 'sdq'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 02:59:50.829461 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 02:59:50.849355 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:50.950680 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, portal: 192.168.40.100,3260]
May 27 02:59:50.950680 np0000001475 nova-compute[98471]: Logout of [sid: 30, target: iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, portal: 192.168.40.100,3260] successful.
May 27 02:59:50.950680 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:50.970233 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:50.985620 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:51.003407 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99969157999999 future=<Future at 0x75572460b290 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 02:59:51.006182 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Instance destroyed successfully.
May 27 02:59:51.006313 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lazy-loading 'resources' on Instance uuid 27b7be13-fa61-4916-a350-a2370d4430bb {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 02:59:51.025390 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, portal: 192.168.50.100,3260]
May 27 02:59:51.025390 np0000001475 nova-compute[98471]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41, portal: 192.168.50.100,3260] successful.
May 27 02:59:51.025390 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:51.045660 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:51.045953 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:59:51.046124 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] <== disconnect_volume: return (428ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:59:51.046290 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 02:59:51.046635 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Deleting instance files /opt/stack/data/nova/instances/7c0291f5-62af-417b-9418-41d808856a8d_del
May 27 02:59:51.047273 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Deletion of /opt/stack/data/nova/instances/7c0291f5-62af-417b-9418-41d808856a8d_del complete
May 27 02:59:51.168533 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.209925 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.512493 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:58:38Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:58:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "address": "fa:16:3e:81:11:62", "network": {"id": "7552b8e6-0e85-4f88-9104-5524c033e9f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-38877104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c38424-43", "ovs_interfaceid": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:59:51.513608 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "address": "fa:16:3e:81:11:62", "network": {"id": "7552b8e6-0e85-4f88-9104-5524c033e9f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-38877104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c38424-43", "ovs_interfaceid": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:51.513608 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:11:62,bridge_name='br-int',has_traffic_filtering=True,id=f7c38424-435e-481a-b1a2-6b3e7f8c7d42,network=Network(7552b8e6-0e85-4f88-9104-5524c033e9f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7c38424-43') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:51.514969 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:11:62,bridge_name='br-int',has_traffic_filtering=True,id=f7c38424-435e-481a-b1a2-6b3e7f8c7d42,network=Network(7552b8e6-0e85-4f88-9104-5524c033e9f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7c38424-43') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:59:51.519506 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.520909 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7c38424-43, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:51.524088 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:51.554082 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.557824 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.560789 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4758fa1-0933-45a2-a711-0d067d9d2f80) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:51.562295 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:51.564788 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Took 2.04 seconds to destroy the instance on the hypervisor.
May 27 02:59:51.565477 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 02:59:51.566762 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 02:59:51.567186 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 02:59:51.568173 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:51.600186 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.600640 np0000001475 nova-compute[98471]: INFO os_vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:11:62,bridge_name='br-int',has_traffic_filtering=True,id=f7c38424-435e-481a-b1a2-6b3e7f8c7d42,network=Network(7552b8e6-0e85-4f88-9104-5524c033e9f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7c38424-43')
May 27 02:59:51.601620 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:58:38Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:58:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "address": "fa:16:3e:62:4b:bd", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72bf3a93-7d", "ovs_interfaceid": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:59:51.602065 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "address": "fa:16:3e:62:4b:bd", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72bf3a93-7d", "ovs_interfaceid": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:51.602496 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:4b:bd,bridge_name='br-int',has_traffic_filtering=True,id=72bf3a93-7d2a-4507-940a-d8e5fcf51f41,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72bf3a93-7d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:51.602827 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:4b:bd,bridge_name='br-int',has_traffic_filtering=True,id=72bf3a93-7d2a-4507-940a-d8e5fcf51f41,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72bf3a93-7d') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:59:51.604519 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.605149 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72bf3a93-7d, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:51.607797 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:51.643667 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.646900 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.647242 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43213d24-697b-4283-a974-6b60352a4c8e) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:51.649355 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:51.676463 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.682208 np0000001475 nova-compute[98471]: INFO os_vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:4b:bd,bridge_name='br-int',has_traffic_filtering=True,id=72bf3a93-7d2a-4507-940a-d8e5fcf51f41,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap72bf3a93-7d')
May 27 02:59:51.682693 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:58:38Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:58:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "address": "fa:16:3e:2e:6d:18", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbdd2d0b-2f", "ovs_interfaceid": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:59:51.684599 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "address": "fa:16:3e:2e:6d:18", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbdd2d0b-2f", "ovs_interfaceid": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:51.684599 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:6d:18,bridge_name='br-int',has_traffic_filtering=True,id=cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbdd2d0b-2f') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:51.684599 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:6d:18,bridge_name='br-int',has_traffic_filtering=True,id=cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbdd2d0b-2f') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:59:51.684599 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.684855 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbdd2d0b-2f, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:51.689008 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:51.712478 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.713396 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.714043 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6adfd6f-a6d3-4491-93c7-1aea79d870c8) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:51.715832 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.715832 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:51.740237 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.749761 np0000001475 nova-compute[98471]: INFO os_vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:6d:18,bridge_name='br-int',has_traffic_filtering=True,id=cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcbdd2d0b-2f')
May 27 02:59:51.749761 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:58:38Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:58:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "address": "fa:16:3e:66:2b:5e", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaa84fe-02", "ovs_interfaceid": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:59:51.749761 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "address": "fa:16:3e:66:2b:5e", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eaa84fe-02", "ovs_interfaceid": "8eaa84fe-02ca-447a-8993-74f9a4fc8e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:51.749761 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:2b:5e,bridge_name='br-int',has_traffic_filtering=True,id=8eaa84fe-02ca-447a-8993-74f9a4fc8e8f,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eaa84fe-02') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:51.749761 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:2b:5e,bridge_name='br-int',has_traffic_filtering=True,id=8eaa84fe-02ca-447a-8993-74f9a4fc8e8f,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eaa84fe-02') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:59:51.752342 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.752638 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8eaa84fe-02, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:51.758959 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:51.770332 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f9d2460e-0a66-4fa9-bb47-2c9d99613d2c req-a1b98634-29de-40f1-b4b5-9a7d43ead39a service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Received event network-changed-6cfc1d4d-e055-4ba7-a926-19911b813fe0 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:51.770332 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f9d2460e-0a66-4fa9-bb47-2c9d99613d2c req-a1b98634-29de-40f1-b4b5-9a7d43ead39a service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Refreshing instance network info cache due to event network-changed-6cfc1d4d-e055-4ba7-a926-19911b813fe0. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 02:59:51.770332 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f9d2460e-0a66-4fa9-bb47-2c9d99613d2c req-a1b98634-29de-40f1-b4b5-9a7d43ead39a service nova] Acquiring lock "refresh_cache-ebd2884b-67b5-40c1-8cf0-a22bd90be727" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 02:59:51.770332 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f9d2460e-0a66-4fa9-bb47-2c9d99613d2c req-a1b98634-29de-40f1-b4b5-9a7d43ead39a service nova] Acquired lock "refresh_cache-ebd2884b-67b5-40c1-8cf0-a22bd90be727" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 02:59:51.770332 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f9d2460e-0a66-4fa9-bb47-2c9d99613d2c req-a1b98634-29de-40f1-b4b5-9a7d43ead39a service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Refreshing network info cache for port 6cfc1d4d-e055-4ba7-a926-19911b813fe0 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 02:59:51.773589 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.775306 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.775306 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c4db594-28ba-469b-9b76-a4dad399ecc0) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:51.776473 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:51.793562 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.798978 np0000001475 nova-compute[98471]: INFO os_vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:2b:5e,bridge_name='br-int',has_traffic_filtering=True,id=8eaa84fe-02ca-447a-8993-74f9a4fc8e8f,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eaa84fe-02')
May 27 02:59:51.805023 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:58:38Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:58:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "538a6aad-d866-4a39-85f1-ec6544f540ff", "address": "fa:16:3e:0f:1d:12", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap538a6aad-d8", "ovs_interfaceid": "538a6aad-d866-4a39-85f1-ec6544f540ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:59:51.806372 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "538a6aad-d866-4a39-85f1-ec6544f540ff", "address": "fa:16:3e:0f:1d:12", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap538a6aad-d8", "ovs_interfaceid": "538a6aad-d866-4a39-85f1-ec6544f540ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:51.806605 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:1d:12,bridge_name='br-int',has_traffic_filtering=True,id=538a6aad-d866-4a39-85f1-ec6544f540ff,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538a6aad-d8') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:51.806996 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:1d:12,bridge_name='br-int',has_traffic_filtering=True,id=538a6aad-d866-4a39-85f1-ec6544f540ff,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538a6aad-d8') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:59:51.809197 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.809197 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap538a6aad-d8, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:51.810446 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.811292 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:51.823813 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.826527 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.826963 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5328f695-6536-4b6e-8256-9fdc1c1c006e) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:51.827493 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.828027 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:51.840431 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.842959 np0000001475 nova-compute[98471]: INFO os_vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:1d:12,bridge_name='br-int',has_traffic_filtering=True,id=538a6aad-d866-4a39-85f1-ec6544f540ff,network=Network(ae43852e-141a-4646-84c9-58e4144b1f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538a6aad-d8')
May 27 02:59:51.844722 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:58:38Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:58:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "address": "fa:16:3e:28:9b:06", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdaf3b03-8e", "ovs_interfaceid": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:59:51.847983 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "address": "fa:16:3e:28:9b:06", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdaf3b03-8e", "ovs_interfaceid": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:51.849046 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:06,bridge_name='br-int',has_traffic_filtering=True,id=fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1,network=Network(c8afdec5-859c-40e9-b374-2590771ff168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdaf3b03-8e') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:51.850238 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:06,bridge_name='br-int',has_traffic_filtering=True,id=fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1,network=Network(c8afdec5-859c-40e9-b374-2590771ff168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdaf3b03-8e') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:59:51.853542 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-85b30dea-c5a0-4dc6-a6d3-233f707b7cde req-9ec5e145-c0c3-4f93-940f-df64db8f4b6b service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-72bf3a93-7d2a-4507-940a-d8e5fcf51f41 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:51.858145 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-85b30dea-c5a0-4dc6-a6d3-233f707b7cde req-9ec5e145-c0c3-4f93-940f-df64db8f4b6b service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:51.858493 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.858861 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-85b30dea-c5a0-4dc6-a6d3-233f707b7cde req-9ec5e145-c0c3-4f93-940f-df64db8f4b6b service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:51.859045 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-85b30dea-c5a0-4dc6-a6d3-233f707b7cde req-9ec5e145-c0c3-4f93-940f-df64db8f4b6b service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:51.859194 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-85b30dea-c5a0-4dc6-a6d3-233f707b7cde req-9ec5e145-c0c3-4f93-940f-df64db8f4b6b service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] No waiting events found dispatching network-vif-unplugged-72bf3a93-7d2a-4507-940a-d8e5fcf51f41 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:51.860186 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdaf3b03-8e, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:51.860349 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-85b30dea-c5a0-4dc6-a6d3-233f707b7cde req-9ec5e145-c0c3-4f93-940f-df64db8f4b6b service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-72bf3a93-7d2a-4507-940a-d8e5fcf51f41 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:51.862707 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:51.869149 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.869899 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.870060 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e253703-e3b9-4f6f-acaf-c20f8244638e) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:51.871132 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.871581 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:51.879767 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.882041 np0000001475 nova-compute[98471]: INFO os_vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:06,bridge_name='br-int',has_traffic_filtering=True,id=fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1,network=Network(c8afdec5-859c-40e9-b374-2590771ff168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdaf3b03-8e')
May 27 02:59:51.883117 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-597581258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-597581258',id=9,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzspM9De8MIbmltLqoZRkbSMEBVmPifGrw9CX4AKRtJEeEeXVY1pIk7GN1vt+koxOq8KhKvIgX+bbxe/WPKDC0Ll4EPsIg2XwVqGQ4pVetRFXgojlCkWmOqTPQxKKfYcA==',key_name='tempest-keypair-1730823986',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:58:38Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faa29a06cd694e828f6bc5146d9f7339',ramdisk_id='',reservation_id='r-52o0ecd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-763075040',owner_user_name='tempest-TaggedBootDevicesTest-763075040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:58:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53592b383294428a94c52288ed87629d',uuid=27b7be13-fa61-4916-a350-a2370d4430bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "address": "fa:16:3e:0f:78:c6", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad76a2d7-6a", "ovs_interfaceid": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 02:59:51.883117 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converting VIF {"id": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "address": "fa:16:3e:0f:78:c6", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad76a2d7-6a", "ovs_interfaceid": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 02:59:51.883514 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:78:c6,bridge_name='br-int',has_traffic_filtering=True,id=ad76a2d7-6ae6-45c6-b51f-5967a5392afa,network=Network(c8afdec5-859c-40e9-b374-2590771ff168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad76a2d7-6a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 02:59:51.883710 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:78:c6,bridge_name='br-int',has_traffic_filtering=True,id=ad76a2d7-6ae6-45c6-b51f-5967a5392afa,network=Network(c8afdec5-859c-40e9-b374-2590771ff168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad76a2d7-6a') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 02:59:51.884461 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.884622 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad76a2d7-6a, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:51.886656 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.887286 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:51.887884 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.889085 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12c95a98-3dd8-4f99-9688-23eddc46065c) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 02:59:51.889085 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 02:59:51.889723 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:51.892618 np0000001475 nova-compute[98471]: INFO os_vif [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:78:c6,bridge_name='br-int',has_traffic_filtering=True,id=ad76a2d7-6ae6-45c6-b51f-5967a5392afa,network=Network(c8afdec5-859c-40e9-b374-2590771ff168),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad76a2d7-6a')
May 27 02:59:51.895460 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 02:59:51.896609 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5ffa6ef1-5054-4e50-b2d9-79430a736c19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:59:51.896609 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:59:51.898037 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:59:51.900897 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5ffa6ef1-5054-4e50-b2d9-79430a736c19', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 02:59:51.900897 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 02:59:51.935223 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:51.935223 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:51.935223 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:51.935223 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:51.935223 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:51.935223 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:51.935223 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:51.935515 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsi session list stdout=tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:51.935515 np0000001475 nova-compute[98471]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19 (non-flash)
May 27 02:59:51.935515 np0000001475 nova-compute[98471]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:51.935515 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:51.935515 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:51.935515 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:51.935515 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:51.935636 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '20')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 02:59:51.935786 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '14')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:59:51.937091 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19', '13')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:59:51.939727 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c0dc180>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19'): ({'sdd'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 02:59:51.939841 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Removing multipathed devices sdd, sde {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 02:59:51.940144 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Flush multipath device 3300000006738a34f {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 02:59:52.010169 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:59:52.064137 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:59:52.120332 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 02:59:52.120538 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 02:59:52.121547 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 02:59:52.136992 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 02:59:52.137295 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 02:59:52.149341 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:52.162584 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:52.183777 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19, portal: 192.168.40.100,3260]
May 27 02:59:52.183777 np0000001475 nova-compute[98471]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19, portal: 192.168.40.100,3260] successful.
May 27 02:59:52.183777 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:52.202392 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:52.218240 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:52.242865 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7f63d3ec-0461-4378-a6df-e13cf620290c req-c8c1d1dc-ab99-4392-9df2-baf8b5a72ba7 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received event network-vif-unplugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:52.244575 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7f63d3ec-0461-4378-a6df-e13cf620290c req-c8c1d1dc-ab99-4392-9df2-baf8b5a72ba7 service nova] Acquiring lock "7c0291f5-62af-417b-9418-41d808856a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:52.244751 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7f63d3ec-0461-4378-a6df-e13cf620290c req-c8c1d1dc-ab99-4392-9df2-baf8b5a72ba7 service nova] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:52.245047 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7f63d3ec-0461-4378-a6df-e13cf620290c req-c8c1d1dc-ab99-4392-9df2-baf8b5a72ba7 service nova] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:52.245083 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7f63d3ec-0461-4378-a6df-e13cf620290c req-c8c1d1dc-ab99-4392-9df2-baf8b5a72ba7 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] No waiting events found dispatching network-vif-unplugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:52.245240 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7f63d3ec-0461-4378-a6df-e13cf620290c req-c8c1d1dc-ab99-4392-9df2-baf8b5a72ba7 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received event network-vif-unplugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:52.255703 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19, portal: 192.168.50.100,3260]
May 27 02:59:52.255703 np0000001475 nova-compute[98471]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-5ffa6ef1-5054-4e50-b2d9-79430a736c19, portal: 192.168.50.100,3260] successful.
May 27 02:59:52.255703 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:52.273051 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:52.276201 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f9d2460e-0a66-4fa9-bb47-2c9d99613d2c req-a1b98634-29de-40f1-b4b5-9a7d43ead39a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:52.280644 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:52.280644 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:59:52.280644 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] <== disconnect_volume: return (384ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:59:52.280644 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 02:59:52.283177 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 02:59:52.283177 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '16fec4f6-6aec-4a56-9937-69c00d6e904e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:59:52.283177 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:59:52.283177 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:59:52.283177 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '16fec4f6-6aec-4a56-9937-69c00d6e904e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 02:59:52.283177 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 02:59:52.318041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:52.318041 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:52.318041 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:52.318041 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:52.318041 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:52.318041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsi session list stdout=tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:52.318041 np0000001475 nova-compute[98471]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e (non-flash)
May 27 02:59:52.318041 np0000001475 nova-compute[98471]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:52.318041 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:52.318041 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:52.318041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '20')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 02:59:52.318041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '18')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:59:52.318041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e', '17')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:59:52.318041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572464d580>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e'): ({'sdl'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 02:59:52.318041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Removing multipathed devices sdm, sdl {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 02:59:52.318041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Flush multipath device 33000000099fbf1bc {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 02:59:52.362411 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:59:52.413255 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:59:52.462284 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 02:59:52.462466 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 02:59:52.463140 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 02:59:52.480034 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 02:59:52.480174 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 02:59:52.492452 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:52.527966 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e, portal: 192.168.40.100,3260]
May 27 02:59:52.527966 np0000001475 nova-compute[98471]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e, portal: 192.168.40.100,3260] successful.
May 27 02:59:52.527966 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:52.547179 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:52.559778 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:52.588897 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e, portal: 192.168.50.100,3260]
May 27 02:59:52.588897 np0000001475 nova-compute[98471]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-16fec4f6-6aec-4a56-9937-69c00d6e904e, portal: 192.168.50.100,3260] successful.
May 27 02:59:52.588897 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:52.608431 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:52.608887 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:59:52.608887 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] <== disconnect_volume: return (326ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:59:52.609054 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 02:59:52.610158 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 02:59:52.610449 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '876cc28e-8f99-46f5-9732-e221b4c5467e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:59:52.611083 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:59:52.611083 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:59:52.611330 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '876cc28e-8f99-46f5-9732-e221b4c5467e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 02:59:52.611492 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 02:59:52.643380 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:52.643380 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:52.643380 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:52.643574 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:52.643574 np0000001475 nova-compute[98471]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e (non-flash)
May 27 02:59:52.643574 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:52.643826 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '20')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 02:59:52.643826 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '19')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:59:52.644676 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e', '20')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 02:59:52.645501 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572464d620>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e'): ({'sdo'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 02:59:52.645717 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Removing multipathed devices sdn, sdo {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 02:59:52.646005 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Flush multipath device 3300000001485b7f7 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 02:59:52.679455 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:59:52.739575 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 02:59:52.791832 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 02:59:52.792076 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 02:59:52.792883 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 02:59:52.807045 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 02:59:52.807568 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 02:59:52.822017 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:52.852256 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e, portal: 192.168.40.100,3260]
May 27 02:59:52.852256 np0000001475 nova-compute[98471]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e, portal: 192.168.40.100,3260] successful.
May 27 02:59:52.852256 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:52.866281 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:52.878148 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:52.905925 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e, portal: 192.168.50.100,3260]
May 27 02:59:52.905925 np0000001475 nova-compute[98471]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-876cc28e-8f99-46f5-9732-e221b4c5467e, portal: 192.168.50.100,3260] successful.
May 27 02:59:52.905925 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:52.919651 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:52.919898 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:59:52.920070 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] <== disconnect_volume: return (309ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:59:52.920214 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 02:59:52.920493 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Deleting instance files /opt/stack/data/nova/instances/27b7be13-fa61-4916-a350-a2370d4430bb_del
May 27 02:59:52.921067 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Deletion of /opt/stack/data/nova/instances/27b7be13-fa61-4916-a350-a2370d4430bb_del complete
May 27 02:59:53.429022 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Took 3.15 seconds to destroy the instance on the hypervisor.
May 27 02:59:53.430702 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 02:59:53.431059 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 02:59:53.431162 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 02:59:53.431379 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:54.415305 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:54.713535 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:54.744361 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:59:54.781114 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:54.930120 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f0fb93ba-9f75-43a5-b6fe-f55f393447e8 req-061a7999-82ee-47bd-9f75-1dad9edfef44 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Received event network-vif-plugged-28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:54.930120 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f0fb93ba-9f75-43a5-b6fe-f55f393447e8 req-061a7999-82ee-47bd-9f75-1dad9edfef44 service nova] Acquiring lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:54.930120 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f0fb93ba-9f75-43a5-b6fe-f55f393447e8 req-061a7999-82ee-47bd-9f75-1dad9edfef44 service nova] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:54.930551 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f0fb93ba-9f75-43a5-b6fe-f55f393447e8 req-061a7999-82ee-47bd-9f75-1dad9edfef44 service nova] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:54.930677 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f0fb93ba-9f75-43a5-b6fe-f55f393447e8 req-061a7999-82ee-47bd-9f75-1dad9edfef44 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Processing event network-vif-plugged-28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 02:59:54.931048 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f0fb93ba-9f75-43a5-b6fe-f55f393447e8 req-061a7999-82ee-47bd-9f75-1dad9edfef44 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Received event network-vif-plugged-28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:54.931373 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Instance event wait completed in 8 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 02:59:54.932136 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f0fb93ba-9f75-43a5-b6fe-f55f393447e8 req-061a7999-82ee-47bd-9f75-1dad9edfef44 service nova] Acquiring lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:54.932319 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f0fb93ba-9f75-43a5-b6fe-f55f393447e8 req-061a7999-82ee-47bd-9f75-1dad9edfef44 service nova] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:54.932452 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f0fb93ba-9f75-43a5-b6fe-f55f393447e8 req-061a7999-82ee-47bd-9f75-1dad9edfef44 service nova] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:54.932609 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f0fb93ba-9f75-43a5-b6fe-f55f393447e8 req-061a7999-82ee-47bd-9f75-1dad9edfef44 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] No waiting events found dispatching network-vif-plugged-28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:54.932782 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-f0fb93ba-9f75-43a5-b6fe-f55f393447e8 req-061a7999-82ee-47bd-9f75-1dad9edfef44 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Received unexpected event network-vif-plugged-28ae6612-6474-4d47-8296-02394b0dabe5 for instance with vm_state building and task_state spawning.
May 27 02:59:54.937009 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850794.9349563, 6ad1223d-d197-46e7-a32b-a25380d409a8 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 02:59:54.937009 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] VM Resumed (Lifecycle Event)
May 27 02:59:54.942381 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 02:59:54.948203 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Instance spawned successfully.
May 27 02:59:54.948799 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 02:59:54.985075 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-72bf3a93-7d2a-4507-940a-d8e5fcf51f41 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:54.985075 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:54.985075 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:54.985075 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:54.985075 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] No waiting events found dispatching network-vif-unplugged-72bf3a93-7d2a-4507-940a-d8e5fcf51f41 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:54.985075 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-72bf3a93-7d2a-4507-940a-d8e5fcf51f41 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:54.985354 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:54.985509 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:54.985659 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:54.985838 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:54.986013 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] No waiting events found dispatching network-vif-unplugged-cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:54.986140 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:54.986368 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:54.986569 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:54.986718 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:54.987243 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:54.987392 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] No waiting events found dispatching network-vif-unplugged-cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:54.987556 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:54.987688 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-538a6aad-d866-4a39-85f1-ec6544f540ff {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:54.987990 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:54.989283 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:54.989283 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:54.989283 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] No waiting events found dispatching network-vif-unplugged-538a6aad-d866-4a39-85f1-ec6544f540ff {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:54.989283 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-538a6aad-d866-4a39-85f1-ec6544f540ff for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:54.989283 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-538a6aad-d866-4a39-85f1-ec6544f540ff {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:54.989582 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:54.989732 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:54.989732 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:54.990003 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] No waiting events found dispatching network-vif-unplugged-538a6aad-d866-4a39-85f1-ec6544f540ff {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:54.990593 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-538a6aad-d866-4a39-85f1-ec6544f540ff for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:54.990698 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-8eaa84fe-02ca-447a-8993-74f9a4fc8e8f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:54.990877 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:54.991094 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:54.991941 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:54.991941 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] No waiting events found dispatching network-vif-unplugged-8eaa84fe-02ca-447a-8993-74f9a4fc8e8f {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:54.991941 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-881ec9dc-e58f-4ea7-8e70-c390367d7784 req-4a2c3355-f7ea-4450-962e-2bd992a81db3 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-8eaa84fe-02ca-447a-8993-74f9a4fc8e8f for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:55.019922 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received event network-vif-unplugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:55.020143 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] Acquiring lock "7c0291f5-62af-417b-9418-41d808856a8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:55.021814 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:55.024931 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] Lock "7c0291f5-62af-417b-9418-41d808856a8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:55.025165 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] No waiting events found dispatching network-vif-unplugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:55.025654 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received event network-vif-unplugged-51f6cb37-5c11-47c2-bf1c-d072ecfff71a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:55.025836 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:55.026046 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:55.026234 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:55.026371 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:55.026524 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] No waiting events found dispatching network-vif-unplugged-fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:55.026840 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:55.027238 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:55.027337 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:55.027527 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:55.028305 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:55.028305 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] No waiting events found dispatching network-vif-unplugged-fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:55.028305 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:55.030130 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-ad76a2d7-6ae6-45c6-b51f-5967a5392afa {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:55.030311 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:55.030501 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:55.030704 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:55.030831 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] No waiting events found dispatching network-vif-unplugged-ad76a2d7-6ae6-45c6-b51f-5967a5392afa {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:55.031001 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-ad76a2d7-6ae6-45c6-b51f-5967a5392afa for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:55.031134 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-ad76a2d7-6ae6-45c6-b51f-5967a5392afa {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:55.031939 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:55.031939 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:55.032104 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:55.032261 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] No waiting events found dispatching network-vif-unplugged-ad76a2d7-6ae6-45c6-b51f-5967a5392afa {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:55.032422 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-18997412-731b-4a86-b04c-c7cef827eebb req-2120d5dd-d8ca-488d-ad90-c0908e2ad6dd service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-ad76a2d7-6ae6-45c6-b51f-5967a5392afa for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:55.247447 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Took 3.68 seconds to deallocate network for instance.
May 27 02:59:55.294391 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Updating instance_info_cache with network_info: [{"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:59:55.441711 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:59:55.444498 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f9d2460e-0a66-4fa9-bb47-2c9d99613d2c req-a1b98634-29de-40f1-b4b5-9a7d43ead39a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 02:59:55.448602 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 02:59:55.458422 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:59:55.458650 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:59:55.459097 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:59:55.459397 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:59:55.459951 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:59:55.460031 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 02:59:55.799537 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Releasing lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:59:55.839946 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Took 0.59 seconds to detach 1 volumes for instance.
May 27 02:59:55.842001 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Deleting volume: dcdd4ccf-df2a-479e-ac0a-2d1051bf7f41 {{(pid=98471) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 27 02:59:55.893944 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:55.952670 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 02:59:55.969507 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Took 19.03 seconds to spawn the instance on the hypervisor.
May 27 02:59:55.969507 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 02:59:55.988797 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f9d2460e-0a66-4fa9-bb47-2c9d99613d2c req-a1b98634-29de-40f1-b4b5-9a7d43ead39a service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Updated VIF entry in instance network info cache for port 6cfc1d4d-e055-4ba7-a926-19911b813fe0. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 02:59:55.990326 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f9d2460e-0a66-4fa9-bb47-2c9d99613d2c req-a1b98634-29de-40f1-b4b5-9a7d43ead39a service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Updating instance_info_cache with network_info: [{"id": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "address": "fa:16:3e:b8:34:46", "network": {"id": "00a82372-a9cb-4a7e-8f75-6883f0e85849", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2146755790-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cfc1d4d-e0", "ovs_interfaceid": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:59:56.161372 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:56.173222 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "9847a45d-ad45-4b2b-85eb-664604911991" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:56.173497 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "9847a45d-ad45-4b2b-85eb-664604911991" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:56.308299 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:59:56.325389 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 02:59:56.351823 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:56.390411 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 02:59:56.398157 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 02:59:56.406451 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:56.406718 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:56.412498 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 02:59:56.413829 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b', 'fe80::fc16:3eff:feb8:3446', 'fe80::48f3:78ff:fe0a:4de1', 'fe80::fc16:3eff:fefc:b5d4'] 
May 27 02:59:56.414033 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 02:59:56.414175 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 02:59:56.414462 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 02:59:56.482240 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Took 25.55 seconds to build instance.
May 27 02:59:56.493680 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f9d2460e-0a66-4fa9-bb47-2c9d99613d2c req-a1b98634-29de-40f1-b4b5-9a7d43ead39a service nova] Releasing lock "refresh_cache-ebd2884b-67b5-40c1-8cf0-a22bd90be727" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 02:59:56.626737 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Refreshing inventories for resource provider 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 27 02:59:56.677379 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 02:59:56.688646 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Updating ProviderTree inventory for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 27 02:59:56.688916 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Updating inventory in ProviderTree for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 27 02:59:56.749140 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Refreshing aggregate associations for resource provider 379b682a-2af7-4cd6-bb46-9d0c412d430a, aggregates: None {{(pid=98471) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 27 02:59:56.802273 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Refreshing trait associations for resource provider 379b682a-2af7-4cd6-bb46-9d0c412d430a, traits: HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ARCH_X86_64,HW_CPU_X86_SSSE3,COMPUTE_ARCH_S390X,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NODE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ARCH_RISCV64,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ARCH_AARCH64,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_MIPSEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_ARCH_X86_64,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE {{(pid=98471) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 27 02:59:56.891704 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:56.934367 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:56.984535 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.066s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:57.021380 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-97ac31a9-1df6-405e-ba03-b82feb8770fb req-3333481d-9eea-471c-a48e-97bb646f8339 service nova] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Received event network-vif-deleted-51f6cb37-5c11-47c2-bf1c-d072ecfff71a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:57.073158 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-980a3b79-9de6-489c-840a-70886930a90a req-d163e323-69d6-497e-9960-0c45eed72a2f service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-8eaa84fe-02ca-447a-8993-74f9a4fc8e8f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:57.073158 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-980a3b79-9de6-489c-840a-70886930a90a req-d163e323-69d6-497e-9960-0c45eed72a2f service nova] Acquiring lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:57.073522 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-980a3b79-9de6-489c-840a-70886930a90a req-d163e323-69d6-497e-9960-0c45eed72a2f service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:57.073708 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-980a3b79-9de6-489c-840a-70886930a90a req-d163e323-69d6-497e-9960-0c45eed72a2f service nova] Lock "27b7be13-fa61-4916-a350-a2370d4430bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:57.073935 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-980a3b79-9de6-489c-840a-70886930a90a req-d163e323-69d6-497e-9960-0c45eed72a2f service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] No waiting events found dispatching network-vif-unplugged-8eaa84fe-02ca-447a-8993-74f9a4fc8e8f {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 02:59:57.074082 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-980a3b79-9de6-489c-840a-70886930a90a req-d163e323-69d6-497e-9960-0c45eed72a2f service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-unplugged-8eaa84fe-02ca-447a-8993-74f9a4fc8e8f for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 02:59:57.074216 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-980a3b79-9de6-489c-840a-70886930a90a req-d163e323-69d6-497e-9960-0c45eed72a2f service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-deleted-8eaa84fe-02ca-447a-8993-74f9a4fc8e8f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:57.074362 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-980a3b79-9de6-489c-840a-70886930a90a req-d163e323-69d6-497e-9960-0c45eed72a2f service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Neutron deleted interface 8eaa84fe-02ca-447a-8993-74f9a4fc8e8f; detaching it from the instance and deleting it from the info cache
May 27 02:59:57.075587 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-980a3b79-9de6-489c-840a-70886930a90a req-d163e323-69d6-497e-9960-0c45eed72a2f service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Updating instance_info_cache with network_info: [{"id": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "address": "fa:16:3e:81:11:62", "network": {"id": "7552b8e6-0e85-4f88-9104-5524c033e9f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-38877104-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7c38424-43", "ovs_interfaceid": "f7c38424-435e-481a-b1a2-6b3e7f8c7d42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "address": "fa:16:3e:62:4b:bd", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72bf3a93-7d", "ovs_interfaceid": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "address": "fa:16:3e:2e:6d:18", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbdd2d0b-2f", "ovs_interfaceid": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "538a6aad-d866-4a39-85f1-ec6544f540ff", "address": "fa:16:3e:0f:1d:12", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap538a6aad-d8", "ovs_interfaceid": "538a6aad-d866-4a39-85f1-ec6544f540ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "address": "fa:16:3e:28:9b:06", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdaf3b03-8e", "ovs_interfaceid": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "address": "fa:16:3e:0f:78:c6", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad76a2d7-6a", "ovs_interfaceid": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:59:57.268393 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:57.335794 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:59:57.336063 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:59:57.584402 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-980a3b79-9de6-489c-840a-70886930a90a req-d163e323-69d6-497e-9960-0c45eed72a2f service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Detach interface failed, port_id=8eaa84fe-02ca-447a-8993-74f9a4fc8e8f, reason: Instance 27b7be13-fa61-4916-a350-a2370d4430bb could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 02:59:57.640948 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Starting finish_migration {{(pid=98471) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 27 02:59:57.646770 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Instance directory exists: not creating {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 02:59:57.646770 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Creating image(s)
May 27 02:59:57.646770 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:57.745915 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.100s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:57.746371 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 02:59:57.746626 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:57.842143 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 02:59:57.852619 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:57.853272 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Cannot resize image /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 02:59:58.357937 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.951s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:58.361247 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 02:59:58.361758 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.091s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:58.362075 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Ensure instance console log exists: /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 02:59:58.362516 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:58.362685 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:58.362829 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:58.365453 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Start _get_guest_xml network_info=[{"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-159671913-network", "vif_mac": "fa:16:3e:8f:94:b9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '60418cf4-cd7f-4256-ad92-cc8336802816', 'attached_at': '2026-05-27T02:59:57.000000', 'detached_at': '', 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'serial': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'}, 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '9bfb1f9d-0e49-4d32-a177-66bcfccb4fd0', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 02:59:58.368882 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 02:59:58.369025 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Claim successful on node np0000001475
May 27 02:59:58.378082 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 02:59:58.379692 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-2003998951', uuid='60418cf4-cd7f-4256-ad92-cc8336802816'), owner=OwnerMeta(userid='1358d6b48fbe42159155175cf488804b', username='tempest-ServerActionsTestOtherB-1490236880-project-member', projectid='88bb33ad146843308b381f8379c70094', projectname='tempest-ServerActionsTestOtherB-1490236880'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-159671913-network", "vif_mac": "fa:16:3e:8f:94:b9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850798.3792214) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 02:59:58.380812 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 02:59:58.381260 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 02:59:58.381876 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 02:59:58.382690 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 02:59:58.382990 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 02:59:58.383258 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 02:59:58.383380 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 02:59:58.383435 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 02:59:58.383567 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 02:59:58.383619 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 02:59:58.383713 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 02:59:58.383878 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 02:59:58.383972 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 02:59:58.384073 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 02:59:58.384172 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 02:59:58.384280 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 02:59:58.396626 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.config --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 02:59:58.447981 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Deleted allocations for instance 7c0291f5-62af-417b-9418-41d808856a8d
May 27 02:59:58.518531 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.config --force-share --output=json" returned: 0 in 0.121s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 02:59:58.524373 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "/opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 02:59:58.524373 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "/opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 02:59:58.527285 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "/opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:58.530357 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 02:59:58.530357 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 02:59:58.530357 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:59:58.530357 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:59:58.530357 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 02:59:58.545466 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:59:58.546018 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 02:59:58.546403 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:59:58.546700 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:59:58.547882 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 02:59:58.547882 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:59:58.564233 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:59:58.564233 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:58.570276 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 02:59:58.570276 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:58.579738 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80] added
May 27 02:59:58.579738 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:59:58.579738 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:59:58.579738 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:59:58.579738 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:59:58.579738 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:59:58.579738 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:58.581642 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:59:58.581642 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0335(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:59:58.581642 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:59:58.589262 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80] added
May 27 02:59:58.589262 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 02:59:58.589262 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:59:58.589262 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:59:58.589262 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 02:59:58.589262 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 02:59:58.589262 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:58.589262 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 02:59:58.589262 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0413(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 02:59:58.589262 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 02:59:59.104040 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-deleted-f7c38424-435e-481a-b1a2-6b3e7f8c7d42 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:59.105250 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Neutron deleted interface f7c38424-435e-481a-b1a2-6b3e7f8c7d42; detaching it from the instance and deleting it from the info cache
May 27 02:59:59.105364 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Updating instance_info_cache with network_info: [{"id": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "address": "fa:16:3e:62:4b:bd", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72bf3a93-7d", "ovs_interfaceid": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "address": "fa:16:3e:2e:6d:18", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbdd2d0b-2f", "ovs_interfaceid": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "538a6aad-d866-4a39-85f1-ec6544f540ff", "address": "fa:16:3e:0f:1d:12", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap538a6aad-d8", "ovs_interfaceid": "538a6aad-d866-4a39-85f1-ec6544f540ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "address": "fa:16:3e:28:9b:06", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdaf3b03-8e", "ovs_interfaceid": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "address": "fa:16:3e:0f:78:c6", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad76a2d7-6a", "ovs_interfaceid": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:59:59.369200 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:59:59.402434 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:59.469361 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-043adbc2-bcd9-420b-9ac6-4646ab8ff74b tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Lock "7c0291f5-62af-417b-9418-41d808856a8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.453s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 02:59:59.580989 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 02:59:59.584961 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 02:59:59.592227 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:59:59.595931 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:59:59.595931 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.startup = manual
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.port = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 02:59:59.607860 np0000001475 nova-compute[98471]: # END RECORD
May 27 02:59:59.607860 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:59.610507 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Detach interface failed, port_id=f7c38424-435e-481a-b1a2-6b3e7f8c7d42, reason: Instance 27b7be13-fa61-4916-a350-a2370d4430bb could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 02:59:59.610507 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-deleted-538a6aad-d866-4a39-85f1-ec6544f540ff {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 02:59:59.610507 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Neutron deleted interface 538a6aad-d866-4a39-85f1-ec6544f540ff; detaching it from the instance and deleting it from the info cache
May 27 02:59:59.612179 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Updating instance_info_cache with network_info: [{"id": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "address": "fa:16:3e:62:4b:bd", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72bf3a93-7d", "ovs_interfaceid": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "address": "fa:16:3e:2e:6d:18", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbdd2d0b-2f", "ovs_interfaceid": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "address": "fa:16:3e:28:9b:06", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdaf3b03-8e", "ovs_interfaceid": "fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "address": "fa:16:3e:0f:78:c6", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad76a2d7-6a", "ovs_interfaceid": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 02:59:59.613651 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:59.623722 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:59.632893 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 02:59:59.632893 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:59.632893 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 02:59:59.632893 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:59.632893 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 02:59:59.632893 np0000001475 nova-compute[98471]: 
May 27 02:59:59.644779 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 02:59:59.644779 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:59.644779 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 02:59:59.644779 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:59.644779 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 02:59:59.644779 np0000001475 nova-compute[98471]: 
May 27 02:59:59.668077 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.40.100,3260]
May 27 02:59:59.668077 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.40.100,3260] successful.
May 27 02:59:59.668077 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:59.678503 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.50.100,3260]
May 27 02:59:59.678503 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.50.100,3260] successful.
May 27 02:59:59.678503 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:59.687784 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:59.701001 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 02:59:59.707221 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 02:59:59.707221 np0000001475 nova-compute[98471]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 02:59:59.707221 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:59.707446 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 02:59:59.707446 np0000001475 nova-compute[98471]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 02:59:59.707446 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:59.707808 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:59:59.708009 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:59:59.708644 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] HCTL ('7', '-', '-', 0) found on session 33 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:59:59.708836 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:59:59.717872 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 02:59:59.717872 np0000001475 nova-compute[98471]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 02:59:59.717872 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 02:59:59.717872 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 02:59:59.717872 np0000001475 nova-compute[98471]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 02:59:59.717872 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 02:59:59.718235 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 02:59:59.718457 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 02:59:59.719481 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] HCTL ('8', '-', '-', 0) found on session 34 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 02:59:59.719611 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 02:59:59.731892 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Searching for a device in session 33 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:59:59.731892 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:59:59.748489 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Searching for a device in session 34 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 02:59:59.748690 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 02:59:59.869568 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 02:59:59.870759 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 02:59:59.871811 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Took 6.44 seconds to deallocate network for instance.
May 27 03:00:00.117657 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Detach interface failed, port_id=538a6aad-d866-4a39-85f1-ec6544f540ff, reason: Instance 27b7be13-fa61-4916-a350-a2370d4430bb could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:00:00.117657 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Received event network-changed-28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:00.117657 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Refreshing instance network info cache due to event network-changed-28ae6612-6474-4d47-8296-02394b0dabe5. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:00:00.117657 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] Acquiring lock "refresh_cache-6ad1223d-d197-46e7-a32b-a25380d409a8" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:00:00.117657 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] Acquired lock "refresh_cache-6ad1223d-d197-46e7-a32b-a25380d409a8" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:00:00.117657 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Refreshing network info cache for port 28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:00:00.377851 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:00:00.548573 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:00:00.617850 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:00.885215 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.526s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:00.885831 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:00:00.898113 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:01.086637 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.00050015099986922 future=<Future at 0x75572c5aa180 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:01.086923 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:01.086923 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=3.794500681999807 future=<Future at 0x7557241938c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:01.087021 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=3.7943474989999686 future=<Future at 0x7557241938c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:01.087429 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Emitting event <LifecycleEvent: 1779850786.085946, 60418cf4-cd7f-4256-ad92-cc8336802816 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:01.087598 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] VM Stopped (Lifecycle Event)
May 27 03:00:01.397487 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:00:01.397487 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:00:01.397487 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:01.397487 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:01.573542 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Found WWN 33000000058a2856d for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:00:01.574076 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:01.574971 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '33000000058a2856d', 'path': '/dev/dm-0', 'multipath_id': '33000000058a2856d'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:00:01.575468 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000058a2856d', 'path': '/dev/dm-0', 'multipath_id': '33000000058a2856d'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:00:01.592226 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:01.603503 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:00:01.647962 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:01.651496 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Took 1.78 seconds to detach 3 volumes for instance.
May 27 03:00:01.772683 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '787c8d4d4527402cbbc2ad0475f710bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab70ea24752242a88583e819c6c34e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:00:01.891765 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:01.905950 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:00:02.094722 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2003998951',display_name='tempest-ServerActionsTestOtherB-server-2003998951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001475',hostname='tempest-serveractionstestotherb-server-2003998951',id=10,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg7MMihIxBG1QGB6QSTA9rrk5T7Na9nzECiQ6YZKa+5mhSSqtwAjACf4ZBO/nNtoXKyk5k1Psoc+8lMf/kcUG6+ibFAACUX2UpjW+QvgPhfAshXB22uMHukoxMZ4AS6zw==',key_name='tempest-keypair-1292561843',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:58:42Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001475',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='88bb33ad146843308b381f8379c70094',ramdisk_id='',reservation_id='r-cw0r0f6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1490236880',owner_user_name='tempest-ServerActionsTestOtherB-1490236880-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:59:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1358d6b48fbe42159155175cf488804b',uuid=60418cf4-cd7f-4256-ad92-cc8336802816,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-159671913-network", "vif_mac": "fa:16:3e:8f:94:b9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:00:02.094722 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Converting VIF {"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-159671913-network", "vif_mac": "fa:16:3e:8f:94:b9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:02.095809 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:02.105682 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] End _get_guest_xml xml=<domain type="qemu">
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:   <uuid>60418cf4-cd7f-4256-ad92-cc8336802816</uuid>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:   <name>instance-0000000a</name>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:   <memory>262144</memory>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerActionsTestOtherB-server-2003998951</nova:name>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 02:59:58</nova:creationTime>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.micro" id="84">
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:         <nova:memory>256</nova:memory>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:         <nova:user uuid="1358d6b48fbe42159155175cf488804b">tempest-ServerActionsTestOtherB-1490236880-project-member</nova:user>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:         <nova:project uuid="88bb33ad146843308b381f8379c70094">tempest-ServerActionsTestOtherB-1490236880</nova:project>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:         <nova:port uuid="920f5752-8d06-40e8-90e8-53fa42f5488d">
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     <system>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <entry name="serial">60418cf4-cd7f-4256-ad92-cc8336802816</entry>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <entry name="uuid">60418cf4-cd7f-4256-ad92-cc8336802816</entry>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     </system>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:   <os>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:   </os>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:   <features>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:   </features>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:   <devices>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.config"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <alias name="ua-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-0"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <target dev="vdb" bus="virtio"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <serial>115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80</serial>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:8f:94:b9"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <target dev="tap920f5752-8d"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     </interface>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/console.log" append="off"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     </serial>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     <video>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     </video>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     </rng>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:   </devices>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]: </domain>
May 27 03:00:02.105682 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:00:02.111489 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2003998951',display_name='tempest-ServerActionsTestOtherB-server-2003998951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001475',hostname='tempest-serveractionstestotherb-server-2003998951',id=10,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg7MMihIxBG1QGB6QSTA9rrk5T7Na9nzECiQ6YZKa+5mhSSqtwAjACf4ZBO/nNtoXKyk5k1Psoc+8lMf/kcUG6+ibFAACUX2UpjW+QvgPhfAshXB22uMHukoxMZ4AS6zw==',key_name='tempest-keypair-1292561843',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:58:42Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001475',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='88bb33ad146843308b381f8379c70094',ramdisk_id='',reservation_id='r-cw0r0f6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1490236880',owner_user_name='tempest-ServerActionsTestOtherB-1490236880-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T02:59:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1358d6b48fbe42159155175cf488804b',uuid=60418cf4-cd7f-4256-ad92-cc8336802816,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-159671913-network", "vif_mac": "fa:16:3e:8f:94:b9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:00:02.111489 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Converting VIF {"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-159671913-network", "vif_mac": "fa:16:3e:8f:94:b9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:02.111489 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:02.111489 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 27 03:00:02.111489 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:00:02.111489 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:02.111926 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:02.114181 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:00:02.116410 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:02.116550 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03b8b391-d626-5e3d-8a47-dc389f134820', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:02.118978 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:02.122288 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:02.129269 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:02.129269 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap920f5752-8d, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:02.129269 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap920f5752-8d, col_values=(('qos', UUID('c689fc56-fd48-44fa-9ec6-1786c87363c7')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:02.129269 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap920f5752-8d, col_values=(('external_ids', {'iface-id': '920f5752-8d06-40e8-90e8-53fa42f5488d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:94:b9', 'vm-uuid': '60418cf4-cd7f-4256-ad92-cc8336802816'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:02.131605 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:02.132359 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:02.142845 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:02.144885 np0000001475 nova-compute[98471]: INFO os_vif [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d')
May 27 03:00:02.167517 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:02.167759 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:02.411461 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:00:02.691658 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:00:02.691658 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:00:02.841657 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Successfully created port: 4432f2b9-dbaf-43f2-a9b4-7eee5883de22 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:00:02.905453 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Updated VIF entry in instance network info cache for port 28ae6612-6474-4d47-8296-02394b0dabe5. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:00:02.906005 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Updating instance_info_cache with network_info: [{"id": "28ae6612-6474-4d47-8296-02394b0dabe5", "address": "fa:16:3e:fc:b5:d4", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ae6612-64", "ovs_interfaceid": "28ae6612-6474-4d47-8296-02394b0dabe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:02.995033 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:03.195087 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:00:03.409732 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] Releasing lock "refresh_cache-6ad1223d-d197-46e7-a32b-a25380d409a8" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:00:03.409965 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-deleted-fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:03.410098 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Neutron deleted interface fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1; detaching it from the instance and deleting it from the info cache
May 27 03:00:03.410333 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Updating instance_info_cache with network_info: [{"id": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "address": "fa:16:3e:62:4b:bd", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72bf3a93-7d", "ovs_interfaceid": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "address": "fa:16:3e:2e:6d:18", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbdd2d0b-2f", "ovs_interfaceid": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "address": "fa:16:3e:0f:78:c6", "network": {"id": "c8afdec5-859c-40e9-b374-2590771ff168", "bridge": "br-int", "label": "tempest-device-tagging-net2-33235352", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad76a2d7-6a", "ovs_interfaceid": "ad76a2d7-6ae6-45c6-b51f-5967a5392afa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:03.424134 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:00:03.425316 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:00:03.425730 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Creating image(s)
May 27 03:00:03.426050 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "/opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:03.426222 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "/opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:03.426726 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "/opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:03.427303 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:03.432276 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Successfully updated port: 4432f2b9-dbaf-43f2-a9b4-7eee5883de22 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:00:03.434496 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:03.436641 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:03.494700 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fc338ffb-bd8c-47e1-823d-3e2ea294ff47 req-d2620a23-43da-4b89-89ed-ddc8c5a103cb service nova] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Received event network-changed-4432f2b9-dbaf-43f2-a9b4-7eee5883de22 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:03.494931 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fc338ffb-bd8c-47e1-823d-3e2ea294ff47 req-d2620a23-43da-4b89-89ed-ddc8c5a103cb service nova] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Refreshing instance network info cache due to event network-changed-4432f2b9-dbaf-43f2-a9b4-7eee5883de22. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:00:03.495228 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fc338ffb-bd8c-47e1-823d-3e2ea294ff47 req-d2620a23-43da-4b89-89ed-ddc8c5a103cb service nova] Acquiring lock "refresh_cache-9847a45d-ad45-4b2b-85eb-664604911991" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:00:03.496620 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fc338ffb-bd8c-47e1-823d-3e2ea294ff47 req-d2620a23-43da-4b89-89ed-ddc8c5a103cb service nova] Acquired lock "refresh_cache-9847a45d-ad45-4b2b-85eb-664604911991" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:00:03.496860 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-fc338ffb-bd8c-47e1-823d-3e2ea294ff47 req-d2620a23-43da-4b89-89ed-ddc8c5a103cb service nova] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Refreshing network info cache for port 4432f2b9-dbaf-43f2-a9b4-7eee5883de22 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:00:03.531019 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.094s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:03.532223 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:03.532640 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:03.533259 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:03.536365 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:03.536993 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:03.568583 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:03.625814 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.088s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:03.627450 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:03.679767 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk 1073741824" returned: 0 in 0.052s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:03.681540 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.148s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:03.682758 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:03.699206 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:03.701994 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:03.701994 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:03.701994 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] No VIF found with MAC fa:16:3e:8f:94:b9, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:00:03.702666 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Using config drive
May 27 03:00:03.711101 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.543s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:03.781861 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Deleted allocations for instance 27b7be13-fa61-4916-a350-a2370d4430bb
May 27 03:00:03.793092 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.110s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:03.793715 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:00:03.794064 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:03.875920 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:03.876629 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Cannot resize image /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:00:03.877153 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:00:03.877398 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Ensure instance console log exists: /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:00:03.877748 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:03.878075 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:03.878284 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:03.915273 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Detach interface failed, port_id=fdaf3b03-8ec8-4158-8e18-2c9183eb2ee1, reason: Instance 27b7be13-fa61-4916-a350-a2370d4430bb could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:00:03.915529 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Received event network-vif-deleted-ad76a2d7-6ae6-45c6-b51f-5967a5392afa {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:03.915674 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Neutron deleted interface ad76a2d7-6ae6-45c6-b51f-5967a5392afa; detaching it from the instance and deleting it from the info cache
May 27 03:00:03.916140 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Updating instance_info_cache with network_info: [{"id": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "address": "fa:16:3e:62:4b:bd", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72bf3a93-7d", "ovs_interfaceid": "72bf3a93-7d2a-4507-940a-d8e5fcf51f41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "address": "fa:16:3e:2e:6d:18", "network": {"id": "ae43852e-141a-4646-84c9-58e4144b1f18", "bridge": "br-int", "label": "tempest-device-tagging-net1-929347282", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "faa29a06cd694e828f6bc5146d9f7339", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbdd2d0b-2f", "ovs_interfaceid": "cbdd2d0b-2fa2-4161-b0af-a5f8f7b95fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:03.937089 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "refresh_cache-9847a45d-ad45-4b2b-85eb-664604911991" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:00:04.003826 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-fc338ffb-bd8c-47e1-823d-3e2ea294ff47 req-d2620a23-43da-4b89-89ed-ddc8c5a103cb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:04.106443 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-fc338ffb-bd8c-47e1-823d-3e2ea294ff47 req-d2620a23-43da-4b89-89ed-ddc8c5a103cb service nova] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:00:04.233903 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:04.257310 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:04.257917 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:04.324593 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-fc338ffb-bd8c-47e1-823d-3e2ea294ff47 req-d2620a23-43da-4b89-89ed-ddc8c5a103cb service nova] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:04.392524 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:04.427964 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c1312869-7e3e-42fd-89c1-baa132166210 req-7ec32c40-93f2-4d58-be81-58bab6c50b42 service nova] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Detach interface failed, port_id=ad76a2d7-6ae6-45c6-b51f-5967a5392afa, reason: Instance 27b7be13-fa61-4916-a350-a2370d4430bb could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:00:04.623370 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:04.635397 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:04.649964 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:04.751159 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:04.751604 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:04.800549 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-37cf96c7-001c-421a-aa27-e2a00027e3e0 tempest-TaggedBootDevicesTest-763075040 tempest-TaggedBootDevicesTest-763075040-project-member] Lock "27b7be13-fa61-4916-a350-a2370d4430bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.032s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:04.829987 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fc338ffb-bd8c-47e1-823d-3e2ea294ff47 req-d2620a23-43da-4b89-89ed-ddc8c5a103cb service nova] Releasing lock "refresh_cache-9847a45d-ad45-4b2b-85eb-664604911991" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:00:04.830532 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquired lock "refresh_cache-9847a45d-ad45-4b2b-85eb-664604911991" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:00:04.830765 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:00:04.882449 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0010579390000202693 future=<Future at 0x7557241938c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:04.883125 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] Emitting event <LifecycleEvent: 1779850789.881268, 7c0291f5-62af-417b-9418-41d808856a8d => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:04.883375 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] VM Stopped (Lifecycle Event)
May 27 03:00:04.885034 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:04.885833 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=1.1172581749999608 future=<Future at 0x75572460b290 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:04.885972 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=1.1171190580000712 future=<Future at 0x75572460b290 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:05.254615 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:00:05.299877 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850805.2987874, 60418cf4-cd7f-4256-ad92-cc8336802816 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:05.299877 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] VM Resumed (Lifecycle Event)
May 27 03:00:05.302174 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Instance event wait completed in 0 seconds for  {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:00:05.305720 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Instance running successfully.
May 27 03:00:05.307207 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Failed to set time: agent not configured {{(pid=98471) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 27 03:00:05.307495 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c1269b69-6fb5-4602-b990-036443a47f5b tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] finish_migration finished successfully. {{(pid=98471) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 27 03:00:05.386345 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-04ee3a5c-5c75-48bd-9cd8-45f450c9cc3a tempest-ServerActionsV293TestJSON-450650320 tempest-ServerActionsV293TestJSON-450650320-project-member] [instance: 7c0291f5-62af-417b-9418-41d808856a8d] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:05.428809 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:00:05.593425 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c551f7a6-cf1c-4772-8ea1-963a8251fef7 req-6b6ae5ed-2f9e-422d-9cad-9b50ed3bb18a service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received event network-vif-plugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:05.593647 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c551f7a6-cf1c-4772-8ea1-963a8251fef7 req-6b6ae5ed-2f9e-422d-9cad-9b50ed3bb18a service nova] Acquiring lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:05.594193 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c551f7a6-cf1c-4772-8ea1-963a8251fef7 req-6b6ae5ed-2f9e-422d-9cad-9b50ed3bb18a service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:05.594543 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c551f7a6-cf1c-4772-8ea1-963a8251fef7 req-6b6ae5ed-2f9e-422d-9cad-9b50ed3bb18a service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:05.594908 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c551f7a6-cf1c-4772-8ea1-963a8251fef7 req-6b6ae5ed-2f9e-422d-9cad-9b50ed3bb18a service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] No waiting events found dispatching network-vif-plugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:00:05.594982 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c551f7a6-cf1c-4772-8ea1-963a8251fef7 req-6b6ae5ed-2f9e-422d-9cad-9b50ed3bb18a service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received unexpected event network-vif-plugged-920f5752-8d06-40e8-90e8-53fa42f5488d for instance with vm_state active and task_state resize_finish.
May 27 03:00:05.595416 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c551f7a6-cf1c-4772-8ea1-963a8251fef7 req-6b6ae5ed-2f9e-422d-9cad-9b50ed3bb18a service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received event network-vif-plugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:05.595513 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c551f7a6-cf1c-4772-8ea1-963a8251fef7 req-6b6ae5ed-2f9e-422d-9cad-9b50ed3bb18a service nova] Acquiring lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:05.595696 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c551f7a6-cf1c-4772-8ea1-963a8251fef7 req-6b6ae5ed-2f9e-422d-9cad-9b50ed3bb18a service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:05.595966 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c551f7a6-cf1c-4772-8ea1-963a8251fef7 req-6b6ae5ed-2f9e-422d-9cad-9b50ed3bb18a service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:05.596192 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c551f7a6-cf1c-4772-8ea1-963a8251fef7 req-6b6ae5ed-2f9e-422d-9cad-9b50ed3bb18a service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] No waiting events found dispatching network-vif-plugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:00:05.596331 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c551f7a6-cf1c-4772-8ea1-963a8251fef7 req-6b6ae5ed-2f9e-422d-9cad-9b50ed3bb18a service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received unexpected event network-vif-plugged-920f5752-8d06-40e8-90e8-53fa42f5488d for instance with vm_state active and task_state resize_finish.
May 27 03:00:05.777822 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:05.804345 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:05.811328 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:00:05.851322 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:05.851811 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:05.855379 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:00:05.856624 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Claim successful on node np0000001475
May 27 03:00:05.898597 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:06.003456 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.00032467000005453883 future=<Future at 0x75572460b290 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:06.004704 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Emitting event <LifecycleEvent: 1779850791.0030043, 27b7be13-fa61-4916-a350-a2370d4430bb => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:06.004971 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:06.005888 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] VM Stopped (Lifecycle Event)
May 27 03:00:06.027812 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Updating instance_info_cache with network_info: [{"id": "4432f2b9-dbaf-43f2-a9b4-7eee5883de22", "address": "fa:16:3e:1f:05:a7", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4432f2b9-db", "ovs_interfaceid": "4432f2b9-dbaf-43f2-a9b4-7eee5883de22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:06.304696 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d07a0502-7efe-4539-99cc-fc90d07aa660 req-79d51e15-e878-4faf-89d9-afca12beb737 service nova] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Received event network-vif-unplugged-4432f2b9-dbaf-43f2-a9b4-7eee5883de22 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:06.304896 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d07a0502-7efe-4539-99cc-fc90d07aa660 req-79d51e15-e878-4faf-89d9-afca12beb737 service nova] Acquiring lock "9847a45d-ad45-4b2b-85eb-664604911991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:06.305583 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d07a0502-7efe-4539-99cc-fc90d07aa660 req-79d51e15-e878-4faf-89d9-afca12beb737 service nova] Lock "9847a45d-ad45-4b2b-85eb-664604911991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:06.308778 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d07a0502-7efe-4539-99cc-fc90d07aa660 req-79d51e15-e878-4faf-89d9-afca12beb737 service nova] Lock "9847a45d-ad45-4b2b-85eb-664604911991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:06.309006 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d07a0502-7efe-4539-99cc-fc90d07aa660 req-79d51e15-e878-4faf-89d9-afca12beb737 service nova] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] No waiting events found dispatching network-vif-unplugged-4432f2b9-dbaf-43f2-a9b4-7eee5883de22 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:00:06.309677 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-d07a0502-7efe-4539-99cc-fc90d07aa660 req-79d51e15-e878-4faf-89d9-afca12beb737 service nova] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Received unexpected event network-vif-unplugged-4432f2b9-dbaf-43f2-a9b4-7eee5883de22 for instance with vm_state building and task_state spawning.
May 27 03:00:06.316579 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 27 03:00:06.316819 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850806.316607, 60418cf4-cd7f-4256-ad92-cc8336802816 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:06.316952 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] VM Started (Lifecycle Event)
May 27 03:00:06.510771 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ca23690c-2e3d-4430-8895-d4758730033f tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 27b7be13-fa61-4916-a350-a2370d4430bb] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:06.532715 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Releasing lock "refresh_cache-9847a45d-ad45-4b2b-85eb-664604911991" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:00:06.533054 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Instance network_info: |[{"id": "4432f2b9-dbaf-43f2-a9b4-7eee5883de22", "address": "fa:16:3e:1f:05:a7", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4432f2b9-db", "ovs_interfaceid": "4432f2b9-dbaf-43f2-a9b4-7eee5883de22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:00:06.535605 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Start _get_guest_xml network_info=[{"id": "4432f2b9-dbaf-43f2-a9b4-7eee5883de22", "address": "fa:16:3e:1f:05:a7", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4432f2b9-db", "ovs_interfaceid": "4432f2b9-dbaf-43f2-a9b4-7eee5883de22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:00:06.537609 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:00:06.539148 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-443350888', uuid='9847a45d-ad45-4b2b-85eb-664604911991'), owner=OwnerMeta(userid='787c8d4d4527402cbbc2ad0475f710bb', username='tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member', projectid='ab70ea24752242a88583e819c6c34e12', projectname='tempest-ServerBootFromVolumeStableRescueTest-1976367979'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4432f2b9-dbaf-43f2-a9b4-7eee5883de22", "address": "fa:16:3e:1f:05:a7", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4432f2b9-db", "ovs_interfaceid": "4432f2b9-dbaf-43f2-a9b4-7eee5883de22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850806.5386992) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:00:06.540400 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:00:06.540833 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:00:06.541680 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:00:06.541925 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:00:06.543068 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:00:06.543548 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:00:06.543774 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:00:06.544143 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:00:06.544310 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:00:06.544407 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:00:06.544551 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:00:06.544719 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:00:06.544852 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:00:06.544987 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:00:06.545094 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:00:06.545589 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:00:06.558882 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T02:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-443350888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverbootfromvolumestablerescuetest-server-443350888',id=14,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab70ea24752242a88583e819c6c34e12',ramdisk_id='',reservation_id='r-1f156n6k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:00:02Z,user_data=None,user_id='787c8d4d4527402cbbc2ad0475f710bb',uuid=9847a45d-ad45-4b2b-85eb-664604911991,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4432f2b9-dbaf-43f2-a9b4-7eee5883de22", "address": "fa:16:3e:1f:05:a7", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4432f2b9-db", "ovs_interfaceid": "4432f2b9-dbaf-43f2-a9b4-7eee5883de22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:00:06.559135 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converting VIF {"id": "4432f2b9-dbaf-43f2-a9b4-7eee5883de22", "address": "fa:16:3e:1f:05:a7", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4432f2b9-db", "ovs_interfaceid": "4432f2b9-dbaf-43f2-a9b4-7eee5883de22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:06.559821 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:05:a7,bridge_name='br-int',has_traffic_filtering=True,id=4432f2b9-dbaf-43f2-a9b4-7eee5883de22,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4432f2b9-db') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:06.560294 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'pci_devices' on Instance uuid 9847a45d-ad45-4b2b-85eb-664604911991 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:06.819464 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:06.822044 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:00:07.062896 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] End _get_guest_xml xml=<domain type="qemu">
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:   <uuid>9847a45d-ad45-4b2b-85eb-664604911991</uuid>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:   <name>instance-0000000e</name>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-443350888</nova:name>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:00:06</nova:creationTime>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:         <nova:user uuid="787c8d4d4527402cbbc2ad0475f710bb">tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member</nova:user>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:         <nova:project uuid="ab70ea24752242a88583e819c6c34e12">tempest-ServerBootFromVolumeStableRescueTest-1976367979</nova:project>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:         <nova:port uuid="4432f2b9-dbaf-43f2-a9b4-7eee5883de22">
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     <system>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <entry name="serial">9847a45d-ad45-4b2b-85eb-664604911991</entry>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <entry name="uuid">9847a45d-ad45-4b2b-85eb-664604911991</entry>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     </system>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:   <os>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:   </os>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:   <features>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:   </features>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:   <devices>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk.config"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:1f:05:a7"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <target dev="tap4432f2b9-db"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     </interface>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/console.log" append="off"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     </serial>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     <video>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     </video>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     </rng>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:   </devices>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]: </domain>
May 27 03:00:07.062896 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:00:07.066120 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Preparing to wait for external event network-vif-plugged-4432f2b9-dbaf-43f2-a9b4-7eee5883de22 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:00:07.066120 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "9847a45d-ad45-4b2b-85eb-664604911991-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:07.066120 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "9847a45d-ad45-4b2b-85eb-664604911991-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:07.066120 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "9847a45d-ad45-4b2b-85eb-664604911991-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:07.066120 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T02:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-443350888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverbootfromvolumestablerescuetest-server-443350888',id=14,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab70ea24752242a88583e819c6c34e12',ramdisk_id='',reservation_id='r-1f156n6k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:00:02Z,user_data=None,user_id='787c8d4d4527402cbbc2ad0475f710bb',uuid=9847a45d-ad45-4b2b-85eb-664604911991,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4432f2b9-dbaf-43f2-a9b4-7eee5883de22", "address": "fa:16:3e:1f:05:a7", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4432f2b9-db", "ovs_interfaceid": "4432f2b9-dbaf-43f2-a9b4-7eee5883de22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:00:07.066120 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converting VIF {"id": "4432f2b9-dbaf-43f2-a9b4-7eee5883de22", "address": "fa:16:3e:1f:05:a7", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4432f2b9-db", "ovs_interfaceid": "4432f2b9-dbaf-43f2-a9b4-7eee5883de22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:07.066120 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:05:a7,bridge_name='br-int',has_traffic_filtering=True,id=4432f2b9-dbaf-43f2-a9b4-7eee5883de22,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4432f2b9-db') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:07.066120 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:05:a7,bridge_name='br-int',has_traffic_filtering=True,id=4432f2b9-dbaf-43f2-a9b4-7eee5883de22,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4432f2b9-db') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:00:07.066644 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:07.066734 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:07.067062 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:00:07.068015 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:07.068240 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85acd1bf-5f89-5d7a-9b2d-1775011be492', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:07.069177 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:07.069911 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:07.070720 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:07.075959 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:07.076086 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4432f2b9-db, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:07.076481 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4432f2b9-db, col_values=(('qos', UUID('cf672c1b-f7e5-44ee-8b17-f8e6c92beaad')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:07.076786 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4432f2b9-db, col_values=(('external_ids', {'iface-id': '4432f2b9-dbaf-43f2-a9b4-7eee5883de22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:05:a7', 'vm-uuid': '9847a45d-ad45-4b2b-85eb-664604911991'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:07.078180 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:07.079617 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:07.091058 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:07.091058 np0000001475 nova-compute[98471]: INFO os_vif [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:05:a7,bridge_name='br-int',has_traffic_filtering=True,id=4432f2b9-dbaf-43f2-a9b4-7eee5883de22,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4432f2b9-db')
May 27 03:00:07.338023 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:00:07.338023 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:00:07.842162 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:00:08.310311 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:08.353795 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.500s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:08.353795 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:00:08.415794 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:08.416429 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:08.416705 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:08.515237 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Port 920f5752-8d06-40e8-90e8-53fa42f5488d binding to destination host np0000001475 is already ACTIVE {{(pid=98471) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 27 03:00:08.515473 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:00:08.515588 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquired lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:00:08.515733 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:00:08.617866 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:08.618117 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:08.618155 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] No VIF found with MAC fa:16:3e:1f:05:a7, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:00:08.618699 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Using config drive
May 27 03:00:08.867762 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:00:08.867762 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:00:08.867762 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:08.867762 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:08.991685 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9da156cb05846c88c7da2a17f564ecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7ebe6073564995b0dd1bb85437f4d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:00:09.019240 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:09.124839 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:09.365995 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:00:09.508155 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:09.652765 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Successfully created port: d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:00:09.868851 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:00:09.983217 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Creating config drive at /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk.config
May 27 03:00:09.987931 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmj2br3tr {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:10.037668 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmj2br3tr" returned: 0 in 0.049s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:10.201528 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:10.408258 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Updating instance_info_cache with network_info: [{"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:10.545404 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:10.578880 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:10.580567 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:10.687372 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:10.882023 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:00:10.883556 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:00:10.883556 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Creating image(s)
May 27 03:00:10.883686 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "/opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:10.884157 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "/opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:10.884958 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "/opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:10.885760 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:10.889874 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:10.891674 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:10.902703 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:10.912849 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Releasing lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:00:10.951180 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ef49d5a3-01d1-4284-90d4-9e0977739917 req-77b55fe1-1216-4ad7-887c-bc71b2c5cc2a service nova] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Received event network-vif-plugged-4432f2b9-dbaf-43f2-a9b4-7eee5883de22 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:10.952286 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ef49d5a3-01d1-4284-90d4-9e0977739917 req-77b55fe1-1216-4ad7-887c-bc71b2c5cc2a service nova] Acquiring lock "9847a45d-ad45-4b2b-85eb-664604911991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:10.952286 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ef49d5a3-01d1-4284-90d4-9e0977739917 req-77b55fe1-1216-4ad7-887c-bc71b2c5cc2a service nova] Lock "9847a45d-ad45-4b2b-85eb-664604911991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:10.952286 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ef49d5a3-01d1-4284-90d4-9e0977739917 req-77b55fe1-1216-4ad7-887c-bc71b2c5cc2a service nova] Lock "9847a45d-ad45-4b2b-85eb-664604911991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:10.952286 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ef49d5a3-01d1-4284-90d4-9e0977739917 req-77b55fe1-1216-4ad7-887c-bc71b2c5cc2a service nova] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Processing event network-vif-plugged-4432f2b9-dbaf-43f2-a9b4-7eee5883de22 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:00:10.972486 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:10.974151 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:10.978459 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:10.987804 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.096s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:10.988233 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:10.988612 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:10.989066 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:10.995885 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:10.997299 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:10.997405 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:11.097981 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.100s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:11.099555 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:11.160675 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk 1073741824" returned: 0 in 0.061s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:11.161430 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.173s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:11.161967 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:11.263653 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.101s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:11.264594 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:00:11.264861 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:11.359141 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:11.359650 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Cannot resize image /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:00:11.360148 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:00:11.360396 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Ensure instance console log exists: /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:00:11.360925 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:11.361684 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:11.361942 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:11.421770 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Creating tmpfile /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/tmp_4d5ofez to verify with other compute node that the instance is on the same shared storage. {{(pid=98471) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}}
May 27 03:00:11.421996 np0000001475 nova-compute[98471]: DEBUG nova.compute.rpcapi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98471) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 03:00:11.516183 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850811.5158296, 9847a45d-ad45-4b2b-85eb-664604911991 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:11.516339 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] VM Started (Lifecycle Event)
May 27 03:00:11.518120 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:00:11.521594 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:00:11.527783 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Instance spawned successfully.
May 27 03:00:11.528583 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:00:11.565478 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Successfully updated port: d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:00:11.637990 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4ef7674d-7e54-4aa1-9bd2-685368806b96 req-c283a26c-e88f-47a8-91f5-1333151d03cd service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received event network-changed-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:11.638165 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4ef7674d-7e54-4aa1-9bd2-685368806b96 req-c283a26c-e88f-47a8-91f5-1333151d03cd service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Refreshing instance network info cache due to event network-changed-d113df60-11d0-4f48-a42a-9541589d6a45. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:00:11.638371 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4ef7674d-7e54-4aa1-9bd2-685368806b96 req-c283a26c-e88f-47a8-91f5-1333151d03cd service nova] Acquiring lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:00:11.638519 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4ef7674d-7e54-4aa1-9bd2-685368806b96 req-c283a26c-e88f-47a8-91f5-1333151d03cd service nova] Acquired lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:00:11.638667 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4ef7674d-7e54-4aa1-9bd2-685368806b96 req-c283a26c-e88f-47a8-91f5-1333151d03cd service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Refreshing network info cache for port d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:00:11.955438 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:11.973302 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:11.978254 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:12.006433 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:12.019661 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:12.027601 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:00:12.036198 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:12.036338 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:12.036759 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:12.037011 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:12.037278 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:12.037533 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:12.069284 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:00:12.079568 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:12.145368 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-4ef7674d-7e54-4aa1-9bd2-685368806b96 req-c283a26c-e88f-47a8-91f5-1333151d03cd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:12.253754 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:12.266325 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:12.288911 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fbb58301-94ea-47b2-bd8a-a35b8ae8190d req-b262855a-a31e-4662-bc23-ee170eb2079c service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received event network-vif-unplugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:12.289612 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fbb58301-94ea-47b2-bd8a-a35b8ae8190d req-b262855a-a31e-4662-bc23-ee170eb2079c service nova] Acquiring lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:12.289860 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fbb58301-94ea-47b2-bd8a-a35b8ae8190d req-b262855a-a31e-4662-bc23-ee170eb2079c service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:12.289992 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fbb58301-94ea-47b2-bd8a-a35b8ae8190d req-b262855a-a31e-4662-bc23-ee170eb2079c service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:12.290392 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fbb58301-94ea-47b2-bd8a-a35b8ae8190d req-b262855a-a31e-4662-bc23-ee170eb2079c service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] No waiting events found dispatching network-vif-unplugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:00:12.290392 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-fbb58301-94ea-47b2-bd8a-a35b8ae8190d req-b262855a-a31e-4662-bc23-ee170eb2079c service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received unexpected event network-vif-unplugged-920f5752-8d06-40e8-90e8-53fa42f5488d for instance with vm_state resized and task_state resize_reverting.
May 27 03:00:12.296179 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Instance destroyed successfully.
May 27 03:00:12.297142 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lazy-loading 'resources' on Instance uuid 60418cf4-cd7f-4256-ad92-cc8336802816 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:12.346713 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:12.374801 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4ef7674d-7e54-4aa1-9bd2-685368806b96 req-c283a26c-e88f-47a8-91f5-1333151d03cd service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:00:12.532206 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:00:12.532206 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850812.5319839, 9847a45d-ad45-4b2b-85eb-664604911991 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:12.532444 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] VM Paused (Lifecycle Event)
May 27 03:00:12.549593 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Took 9.12 seconds to spawn the instance on the hypervisor.
May 27 03:00:12.549734 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:12.640955 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4ef7674d-7e54-4aa1-9bd2-685368806b96 req-c283a26c-e88f-47a8-91f5-1333151d03cd service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:12.801223 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2003998951',display_name='tempest-ServerActionsTestOtherB-server-2003998951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001475',hostname='tempest-serveractionstestotherb-server-2003998951',id=10,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg7MMihIxBG1QGB6QSTA9rrk5T7Na9nzECiQ6YZKa+5mhSSqtwAjACf4ZBO/nNtoXKyk5k1Psoc+8lMf/kcUG6+ibFAACUX2UpjW+QvgPhfAshXB22uMHukoxMZ4AS6zw==',key_name='tempest-keypair-1292561843',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:00:05Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=Flavor(12),node='np0000001475',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88bb33ad146843308b381f8379c70094',ramdisk_id='',reservation_id='r-cw0r0f6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1490236880',owner_user_name='tempest-ServerActionsTestOtherB-1490236880-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:00:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1358d6b48fbe42159155175cf488804b',uuid=60418cf4-cd7f-4256-ad92-cc8336802816,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:00:12.804964 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Converting VIF {"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:12.805383 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:12.806237 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:00:12.809384 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:12.809384 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap920f5752-8d, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:12.815149 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:12.816844 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:12.816844 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c689fc56-fd48-44fa-9ec6-1786c87363c7) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:12.817760 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:12.819358 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:12.822279 np0000001475 nova-compute[98471]: INFO os_vif [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d')
May 27 03:00:12.824567 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:00:12.825143 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:00:12.825350 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:12.825856 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:12.826278 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:00:12.826530 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:00:12.860720 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:12.860720 np0000001475 nova-compute[98471]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:12.860720 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:12.861107 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:12.861107 np0000001475 nova-compute[98471]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:12.861107 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:12.862018 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', '34')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:00:12.862018 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', '33')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:00:12.862449 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', '34')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:00:12.863643 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572475a200>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'): ({'sdc'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:00:12.864018 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Removing multipathed devices sdb, sdc {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:00:12.864209 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Flush multipath device 33000000058a2856d {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:00:12.894305 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:00:12.949906 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:00:12.999192 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:00:12.999580 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:00:13.000182 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:00:13.020016 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:00:13.020336 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:00:13.038265 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:13.039210 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:13.043518 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850813.0432143, 9847a45d-ad45-4b2b-85eb-664604911991 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:13.043776 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] VM Resumed (Lifecycle Event)
May 27 03:00:13.063910 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d4ca1bcb-b845-4560-b062-2b1bcef1cea8 req-1ba523d0-5fed-4702-98ae-2719919a794b service nova] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Received event network-vif-plugged-4432f2b9-dbaf-43f2-a9b4-7eee5883de22 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:13.063910 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d4ca1bcb-b845-4560-b062-2b1bcef1cea8 req-1ba523d0-5fed-4702-98ae-2719919a794b service nova] Acquiring lock "9847a45d-ad45-4b2b-85eb-664604911991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:13.066153 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d4ca1bcb-b845-4560-b062-2b1bcef1cea8 req-1ba523d0-5fed-4702-98ae-2719919a794b service nova] Lock "9847a45d-ad45-4b2b-85eb-664604911991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:13.069165 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d4ca1bcb-b845-4560-b062-2b1bcef1cea8 req-1ba523d0-5fed-4702-98ae-2719919a794b service nova] Lock "9847a45d-ad45-4b2b-85eb-664604911991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:13.069519 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d4ca1bcb-b845-4560-b062-2b1bcef1cea8 req-1ba523d0-5fed-4702-98ae-2719919a794b service nova] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] No waiting events found dispatching network-vif-plugged-4432f2b9-dbaf-43f2-a9b4-7eee5883de22 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:00:13.074209 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-d4ca1bcb-b845-4560-b062-2b1bcef1cea8 req-1ba523d0-5fed-4702-98ae-2719919a794b service nova] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Received unexpected event network-vif-plugged-4432f2b9-dbaf-43f2-a9b4-7eee5883de22 for instance with vm_state active and task_state None.
May 27 03:00:13.074488 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.40.100,3260]
May 27 03:00:13.074488 np0000001475 nova-compute[98471]: Logout of [sid: 33, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.40.100,3260] successful.
May 27 03:00:13.074488 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:13.075582 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Took 15.87 seconds to build instance.
May 27 03:00:13.090367 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:13.107139 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:13.139149 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.50.100,3260]
May 27 03:00:13.139149 np0000001475 nova-compute[98471]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.50.100,3260] successful.
May 27 03:00:13.139149 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:13.143400 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4ef7674d-7e54-4aa1-9bd2-685368806b96 req-c283a26c-e88f-47a8-91f5-1333151d03cd service nova] Releasing lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:00:13.144159 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquired lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:00:13.144342 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:00:13.152226 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:13.152545 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:13.152762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] <== disconnect_volume: return (327ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:00:13.152917 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:00:13.338282 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:13.551302 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:13.554544 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:00:13.580104 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "9847a45d-ad45-4b2b-85eb-664604911991" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.406s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:13.738803 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:00:13.748985 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-86932537-b8b1-4d72-a23d-2713988d45c1 req-c1645c28-a7e5-4d44-a781-8c4ef9004b50 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received event network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:13.750523 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-86932537-b8b1-4d72-a23d-2713988d45c1 req-c1645c28-a7e5-4d44-a781-8c4ef9004b50 service nova] Acquiring lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:13.750794 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-86932537-b8b1-4d72-a23d-2713988d45c1 req-c1645c28-a7e5-4d44-a781-8c4ef9004b50 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:13.750981 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-86932537-b8b1-4d72-a23d-2713988d45c1 req-c1645c28-a7e5-4d44-a781-8c4ef9004b50 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:13.751189 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-86932537-b8b1-4d72-a23d-2713988d45c1 req-c1645c28-a7e5-4d44-a781-8c4ef9004b50 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] No waiting events found dispatching network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:00:13.751328 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-86932537-b8b1-4d72-a23d-2713988d45c1 req-c1645c28-a7e5-4d44-a781-8c4ef9004b50 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received unexpected event network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 for instance with vm_state building and task_state spawning.
May 27 03:00:13.957367 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:14.059409 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99966518999986 future=<Future at 0x75572475d490 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:14.059890 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999297338999895 future=<Future at 0x75572475d490 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:14.059969 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999056602999872 future=<Future at 0x75572475d490 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:14.158453 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Updating instance_info_cache with network_info: [{"id": "d113df60-11d0-4f48-a42a-9541589d6a45", "address": "fa:16:3e:af:c0:52", "network": {"id": "a5ee8bff-dbe9-420a-bc58-64e9082e7d84", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a7ebe6073564995b0dd1bb85437f4d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd113df60-11", "ovs_interfaceid": "d113df60-11d0-4f48-a42a-9541589d6a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:14.359429 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:14.360777 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:14.397332 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f6f241a7-e9b4-462b-a99d-61264d4ab446 req-411ef7d1-d3a4-4724-9953-d2178782d050 service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received event network-vif-unplugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:14.397483 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6f241a7-e9b4-462b-a99d-61264d4ab446 req-411ef7d1-d3a4-4724-9953-d2178782d050 service nova] Acquiring lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:14.397711 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6f241a7-e9b4-462b-a99d-61264d4ab446 req-411ef7d1-d3a4-4724-9953-d2178782d050 service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:14.397939 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6f241a7-e9b4-462b-a99d-61264d4ab446 req-411ef7d1-d3a4-4724-9953-d2178782d050 service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:14.398168 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f6f241a7-e9b4-462b-a99d-61264d4ab446 req-411ef7d1-d3a4-4724-9953-d2178782d050 service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] No waiting events found dispatching network-vif-unplugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:00:14.398234 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-f6f241a7-e9b4-462b-a99d-61264d4ab446 req-411ef7d1-d3a4-4724-9953-d2178782d050 service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received unexpected event network-vif-unplugged-920f5752-8d06-40e8-90e8-53fa42f5488d for instance with vm_state resized and task_state resize_reverting.
May 27 03:00:14.660623 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Releasing lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:00:14.660922 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Instance network_info: |[{"id": "d113df60-11d0-4f48-a42a-9541589d6a45", "address": "fa:16:3e:af:c0:52", "network": {"id": "a5ee8bff-dbe9-420a-bc58-64e9082e7d84", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a7ebe6073564995b0dd1bb85437f4d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd113df60-11", "ovs_interfaceid": "d113df60-11d0-4f48-a42a-9541589d6a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:00:14.662765 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Start _get_guest_xml network_info=[{"id": "d113df60-11d0-4f48-a42a-9541589d6a45", "address": "fa:16:3e:af:c0:52", "network": {"id": "a5ee8bff-dbe9-420a-bc58-64e9082e7d84", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a7ebe6073564995b0dd1bb85437f4d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd113df60-11", "ovs_interfaceid": "d113df60-11d0-4f48-a42a-9541589d6a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:00:14.670893 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:00:14.672640 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-2030533079', uuid='f33f8709-32f7-4ce3-9967-c54609dcbb0c'), owner=OwnerMeta(userid='d9da156cb05846c88c7da2a17f564ecd', username='tempest-ServerStableDeviceRescueTest-923030128-project-member', projectid='2a7ebe6073564995b0dd1bb85437f4d7', projectname='tempest-ServerStableDeviceRescueTest-923030128'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d113df60-11d0-4f48-a42a-9541589d6a45", "address": "fa:16:3e:af:c0:52", "network": {"id": "a5ee8bff-dbe9-420a-bc58-64e9082e7d84", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a7ebe6073564995b0dd1bb85437f4d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd113df60-11", "ovs_interfaceid": "d113df60-11d0-4f48-a42a-9541589d6a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850814.672235) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:00:14.673590 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:00:14.674013 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:00:14.674951 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:00:14.675171 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:00:14.676344 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:00:14.676941 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:00:14.677333 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:00:14.677483 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:00:14.677673 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:00:14.677876 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:00:14.678044 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:00:14.678269 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:00:14.678428 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:00:14.678569 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:00:14.678729 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:00:14.678929 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:00:14.694488 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:00:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2030533079',display_name='tempest-ServerStableDeviceRescueTest-server-2030533079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverstabledevicerescuetest-server-2030533079',id=15,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa8+CqVdw8nKJ5lReXEmt096EbGDMIc3VhRlcn+2FQfGHdmNBgrivb5lUlAyS2qoKWf32kYpLN8CS14ZT4JmO1zy/Ua7yFw8818K16/tqTyTOYQu+pF7MZ52tXxUY4mhQ==',key_name='tempest-keypair-2125337620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a7ebe6073564995b0dd1bb85437f4d7',ramdisk_id='',reservation_id='r-qxkxc9ng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-923030128',owner_user_name='tempest-ServerStableDeviceRescueTest-923030128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:00:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9da156cb05846c88c7da2a17f564ecd',uuid=f33f8709-32f7-4ce3-9967-c54609dcbb0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d113df60-11d0-4f48-a42a-9541589d6a45", "address": "fa:16:3e:af:c0:52", "network": {"id": "a5ee8bff-dbe9-420a-bc58-64e9082e7d84", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a7ebe6073564995b0dd1bb85437f4d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd113df60-11", "ovs_interfaceid": "d113df60-11d0-4f48-a42a-9541589d6a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:00:14.694775 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Converting VIF {"id": "d113df60-11d0-4f48-a42a-9541589d6a45", "address": "fa:16:3e:af:c0:52", "network": {"id": "a5ee8bff-dbe9-420a-bc58-64e9082e7d84", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a7ebe6073564995b0dd1bb85437f4d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd113df60-11", "ovs_interfaceid": "d113df60-11d0-4f48-a42a-9541589d6a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:14.695434 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:c0:52,bridge_name='br-int',has_traffic_filtering=True,id=d113df60-11d0-4f48-a42a-9541589d6a45,network=Network(a5ee8bff-dbe9-420a-bc58-64e9082e7d84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd113df60-11') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:14.696041 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lazy-loading 'pci_devices' on Instance uuid f33f8709-32f7-4ce3-9967-c54609dcbb0c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:14.862323 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lazy-loading 'migration_context' on Instance uuid 60418cf4-cd7f-4256-ad92-cc8336802816 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:15.077188 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:15.199395 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] End _get_guest_xml xml=<domain type="qemu">
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:   <uuid>f33f8709-32f7-4ce3-9967-c54609dcbb0c</uuid>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:   <name>instance-0000000f</name>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2030533079</nova:name>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:00:14</nova:creationTime>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:         <nova:user uuid="d9da156cb05846c88c7da2a17f564ecd">tempest-ServerStableDeviceRescueTest-923030128-project-member</nova:user>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:         <nova:project uuid="2a7ebe6073564995b0dd1bb85437f4d7">tempest-ServerStableDeviceRescueTest-923030128</nova:project>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:         <nova:port uuid="d113df60-11d0-4f48-a42a-9541589d6a45">
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     <system>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <entry name="serial">f33f8709-32f7-4ce3-9967-c54609dcbb0c</entry>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <entry name="uuid">f33f8709-32f7-4ce3-9967-c54609dcbb0c</entry>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     </system>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:   <os>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:   </os>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:   <features>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:   </features>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:   <devices>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.config"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:af:c0:52"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <target dev="tapd113df60-11"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     </interface>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/console.log" append="off"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     </serial>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     <video>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     </video>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     </rng>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:   </devices>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]: </domain>
May 27 03:00:15.199395 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:00:15.201202 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Preparing to wait for external event network-vif-plugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:00:15.201202 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:15.201202 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:15.201202 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:15.201202 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:00:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2030533079',display_name='tempest-ServerStableDeviceRescueTest-server-2030533079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverstabledevicerescuetest-server-2030533079',id=15,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa8+CqVdw8nKJ5lReXEmt096EbGDMIc3VhRlcn+2FQfGHdmNBgrivb5lUlAyS2qoKWf32kYpLN8CS14ZT4JmO1zy/Ua7yFw8818K16/tqTyTOYQu+pF7MZ52tXxUY4mhQ==',key_name='tempest-keypair-2125337620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a7ebe6073564995b0dd1bb85437f4d7',ramdisk_id='',reservation_id='r-qxkxc9ng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-923030128',owner_user_name='tempest-ServerStableDeviceRescueTest-923030128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:00:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9da156cb05846c88c7da2a17f564ecd',uuid=f33f8709-32f7-4ce3-9967-c54609dcbb0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d113df60-11d0-4f48-a42a-9541589d6a45", "address": "fa:16:3e:af:c0:52", "network": {"id": "a5ee8bff-dbe9-420a-bc58-64e9082e7d84", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a7ebe6073564995b0dd1bb85437f4d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd113df60-11", "ovs_interfaceid": "d113df60-11d0-4f48-a42a-9541589d6a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:00:15.201202 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Converting VIF {"id": "d113df60-11d0-4f48-a42a-9541589d6a45", "address": "fa:16:3e:af:c0:52", "network": {"id": "a5ee8bff-dbe9-420a-bc58-64e9082e7d84", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a7ebe6073564995b0dd1bb85437f4d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd113df60-11", "ovs_interfaceid": "d113df60-11d0-4f48-a42a-9541589d6a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:15.201202 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:c0:52,bridge_name='br-int',has_traffic_filtering=True,id=d113df60-11d0-4f48-a42a-9541589d6a45,network=Network(a5ee8bff-dbe9-420a-bc58-64e9082e7d84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd113df60-11') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:15.202423 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:c0:52,bridge_name='br-int',has_traffic_filtering=True,id=d113df60-11d0-4f48-a42a-9541589d6a45,network=Network(a5ee8bff-dbe9-420a-bc58-64e9082e7d84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd113df60-11') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:00:15.202423 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:15.202423 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:15.202423 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:00:15.202789 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:15.202934 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '130e9591-5ed8-5d09-953a-37a8d2ceec3a', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:15.204575 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:15.205140 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:15.206817 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:15.206966 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd113df60-11, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:15.207251 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd113df60-11, col_values=(('qos', UUID('eeee486a-3bad-4bf9-ae0e-3c5253b991c3')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:15.207416 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd113df60-11, col_values=(('external_ids', {'iface-id': 'd113df60-11d0-4f48-a42a-9541589d6a45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:c0:52', 'vm-uuid': 'f33f8709-32f7-4ce3-9967-c54609dcbb0c'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:15.209967 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:15.214791 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:15.215184 np0000001475 nova-compute[98471]: INFO os_vif [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:c0:52,bridge_name='br-int',has_traffic_filtering=True,id=d113df60-11d0-4f48-a42a-9541589d6a45,network=Network(a5ee8bff-dbe9-420a-bc58-64e9082e7d84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd113df60-11')
May 27 03:00:15.364459 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Object Instance<60418cf4-cd7f-4256-ad92-cc8336802816> lazy-loaded attributes: resources,migration_context {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:00:15.564146 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:15.591844 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] instance snapshotting
May 27 03:00:15.747967 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Beginning live snapshot process
May 27 03:00:15.847207 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:00:15.847449 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:00:15.903391 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:16.040873 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "f5d36573-c0e7-43a0-a7cc-66678f093375" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:16.041046 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "f5d36573-c0e7-43a0-a7cc-66678f093375" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:16.351266 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:00:16.543391 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:00:16.733903 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:16.736295 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:16.736295 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] No VIF found with MAC fa:16:3e:af:c0:52, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:00:16.736295 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Using config drive
May 27 03:00:17.112798 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:17.241841 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:17.260617 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk --force-share --output=json -f qcow2 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:17.366782 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.006s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:17.367237 np0000001475 nova-compute[98471]: DEBUG nova.compute.rpcapi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98471) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 03:00:17.368398 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.255s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:17.382768 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:00:17.384306 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Claim successful on node np0000001475
May 27 03:00:17.387578 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk --force-share --output=json -f qcow2" returned: 0 in 0.124s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:17.390884 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk --force-share --output=json -f qcow2 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:17.471305 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Creating config drive at /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.config
May 27 03:00:17.476617 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0sn0ac97 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:17.503313 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk --force-share --output=json -f qcow2" returned: 0 in 0.112s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:17.505390 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:17.509068 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:17.509328 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:17.528047 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0sn0ac97" returned: 0 in 0.051s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:17.609646 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.100s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:17.610256 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpq6np5ici/27b2cf57fb31406ca886c552c1d74703.delta 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:17.663299 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpq6np5ici/27b2cf57fb31406ca886c552c1d74703.delta 1073741824" returned: 0 in 0.053s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:17.664007 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Quiescing instance not available: QEMU guest agent is not enabled.
May 27 03:00:18.293223 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:18.296489 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98471) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 27 03:00:18.302197 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Skipping quiescing instance: QEMU guest agent is not enabled.
May 27 03:00:18.323936 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:18.438197 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:18.488807 np0000001475 nova-compute[98471]: DEBUG nova.privsep.utils [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98471) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 03:00:18.489685 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpq6np5ici/27b2cf57fb31406ca886c552c1d74703.delta /opt/stack/data/nova/instances/snapshots/tmpq6np5ici/27b2cf57fb31406ca886c552c1d74703 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:18.606713 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9a49006a-b68e-42e6-abf0-7cb99fe691bd req-180208ac-6de4-4069-8e7b-80c1082875f9 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received event network-vif-plugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:18.606929 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9a49006a-b68e-42e6-abf0-7cb99fe691bd req-180208ac-6de4-4069-8e7b-80c1082875f9 service nova] Acquiring lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:18.607319 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9a49006a-b68e-42e6-abf0-7cb99fe691bd req-180208ac-6de4-4069-8e7b-80c1082875f9 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:18.607483 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9a49006a-b68e-42e6-abf0-7cb99fe691bd req-180208ac-6de4-4069-8e7b-80c1082875f9 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:18.609711 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9a49006a-b68e-42e6-abf0-7cb99fe691bd req-180208ac-6de4-4069-8e7b-80c1082875f9 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Processing event network-vif-plugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:00:18.636437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpq6np5ici/27b2cf57fb31406ca886c552c1d74703.delta /opt/stack/data/nova/instances/snapshots/tmpq6np5ici/27b2cf57fb31406ca886c552c1d74703" returned: 0 in 0.147s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:18.637191 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Snapshot extracted, beginning image upload
May 27 03:00:18.763055 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:18.777426 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:18.778889 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:18.804268 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:19.004496 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Swapping old allocation on dict_keys(['379b682a-2af7-4cd6-bb46-9d0c412d430a']) held by migration 812ba8d3-5345-46d4-bf1b-0b53d5854b6b for instance
May 27 03:00:19.086369 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:00:19.086604 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:00:19.134434 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Overwriting current allocation {'allocations': {'379b682a-2af7-4cd6-bb46-9d0c412d430a': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 20}}, 'project_id': '88bb33ad146843308b381f8379c70094', 'user_id': '1358d6b48fbe42159155175cf488804b', 'consumer_generation': 1} on consumer 60418cf4-cd7f-4256-ad92-cc8336802816 {{(pid=98471) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
May 27 03:00:19.276356 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:19.425684 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:00:19.425833 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquired lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:00:19.426000 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:00:19.469359 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:00:19.470125 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850819.4698844, f33f8709-32f7-4ce3-9967-c54609dcbb0c => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:19.470257 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] VM Started (Lifecycle Event)
May 27 03:00:19.471626 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:00:19.473823 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Instance spawned successfully.
May 27 03:00:19.474308 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:00:19.592146 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:00:19.928415 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:19.975388 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:19.980835 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:00:19.985796 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:19.985796 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:19.985796 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:19.985796 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:19.985796 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:19.986318 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:20.103306 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.735s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:20.103306 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:00:20.209479 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:20.394055 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:20.483892 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:00:20.484268 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850820.4839504, f33f8709-32f7-4ce3-9967-c54609dcbb0c => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:20.484357 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] VM Paused (Lifecycle Event)
May 27 03:00:20.494315 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Took 9.61 seconds to spawn the instance on the hypervisor.
May 27 03:00:20.494531 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:20.614205 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:00:20.615049 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:00:20.618098 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:20.618555 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:20.639680 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Updating instance_info_cache with network_info: [{"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:20.699589 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-00e11732-da48-494e-85fe-01de34c818ab req-5db3f6b1-83fa-4dc7-b287-f5f2960bd9bc service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received event network-vif-plugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:20.700035 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-00e11732-da48-494e-85fe-01de34c818ab req-5db3f6b1-83fa-4dc7-b287-f5f2960bd9bc service nova] Acquiring lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:20.700123 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-00e11732-da48-494e-85fe-01de34c818ab req-5db3f6b1-83fa-4dc7-b287-f5f2960bd9bc service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:20.702943 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-00e11732-da48-494e-85fe-01de34c818ab req-5db3f6b1-83fa-4dc7-b287-f5f2960bd9bc service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:20.703881 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-00e11732-da48-494e-85fe-01de34c818ab req-5db3f6b1-83fa-4dc7-b287-f5f2960bd9bc service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] No waiting events found dispatching network-vif-plugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:00:20.704662 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-00e11732-da48-494e-85fe-01de34c818ab req-5db3f6b1-83fa-4dc7-b287-f5f2960bd9bc service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received unexpected event network-vif-plugged-d113df60-11d0-4f48-a42a-9541589d6a45 for instance with vm_state active and task_state None.
May 27 03:00:20.744839 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '092604511a8a467ba4ecb56261cb531f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c48d6919e8435f876f3324616521ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:00:20.906354 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:20.992378 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:20.996412 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850820.9960759, f33f8709-32f7-4ce3-9967-c54609dcbb0c => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:20.996506 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] VM Resumed (Lifecycle Event)
May 27 03:00:21.014336 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Took 15.25 seconds to build instance.
May 27 03:00:21.128495 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:00:21.143903 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Releasing lock "refresh_cache-60418cf4-cd7f-4256-ad92-cc8336802816" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:00:21.144435 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:00:21.162160 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:00:21.205556 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:21.247678 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:00:21.247891 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:00:21.256787 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:00:21.258062 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b', 'fe80::fc16:3eff:feb8:3446', 'fe80::48f3:78ff:fe0a:4de1', 'fe80::fc16:3eff:fefc:b5d4', 'fe80::fc16:3eff:fe1f:5a7', 'fe80::a095:90ff:feef:1465', 'fe80::fc16:3eff:feaf:c052', 'fe80::20bf:faff:fe0c:5acd'] 
May 27 03:00:21.258203 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:00:21.258339 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:00:21.258617 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:00:21.316994 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Successfully created port: 138260f4-bd1e-47ed-9760-9f234ebfdddc {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:00:21.501361 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:21.503347 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:00:21.517933 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74c86d51-a389-4716-8bc3-7224a5968701 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.766s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:21.630057 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:00:21.869935 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Snapshot image upload complete
May 27 03:00:21.870186 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-fce99349-7bb1-4c0a-a14b-d9cdbd42c48d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Took 6.27 seconds to snapshot the instance on the hypervisor.
May 27 03:00:22.072217 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Successfully updated port: 138260f4-bd1e-47ed-9760-9f234ebfdddc {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:00:22.137008 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f0a0730d-7f0d-43c3-adf3-ccb387402276 req-fada2f9e-d679-43b1-a4fa-15b2b9209f99 service nova] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Received event network-changed-138260f4-bd1e-47ed-9760-9f234ebfdddc {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:22.140181 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f0a0730d-7f0d-43c3-adf3-ccb387402276 req-fada2f9e-d679-43b1-a4fa-15b2b9209f99 service nova] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Refreshing instance network info cache due to event network-changed-138260f4-bd1e-47ed-9760-9f234ebfdddc. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:00:22.140457 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f0a0730d-7f0d-43c3-adf3-ccb387402276 req-fada2f9e-d679-43b1-a4fa-15b2b9209f99 service nova] Acquiring lock "refresh_cache-f5d36573-c0e7-43a0-a7cc-66678f093375" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:00:22.140870 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Booting with volume b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd at /dev/vda
May 27 03:00:22.142469 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f0a0730d-7f0d-43c3-adf3-ccb387402276 req-fada2f9e-d679-43b1-a4fa-15b2b9209f99 service nova] Acquired lock "refresh_cache-f5d36573-c0e7-43a0-a7cc-66678f093375" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:00:22.143233 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f0a0730d-7f0d-43c3-adf3-ccb387402276 req-fada2f9e-d679-43b1-a4fa-15b2b9209f99 service nova] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Refreshing network info cache for port 138260f4-bd1e-47ed-9760-9f234ebfdddc {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:00:22.211641 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:00:22.225840 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:00:22.249269 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:22.283962 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:00:22.284556 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:00:22.298810 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:00:22.300287 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b', 'fe80::fc16:3eff:feb8:3446', 'fe80::48f3:78ff:fe0a:4de1', 'fe80::fc16:3eff:fefc:b5d4', 'fe80::fc16:3eff:fe1f:5a7', 'fe80::a095:90ff:feef:1465', 'fe80::fc16:3eff:feaf:c052', 'fe80::20bf:faff:fe0c:5acd'] 
May 27 03:00:22.300445 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:00:22.300593 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:00:22.301542 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:00:22.302165 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Updating existing volume attachment record: 7e89a82e-7145-4930-9d95-d6ef5085a99b {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:00:22.386860 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Starting finish_revert_migration {{(pid=98471) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}}
May 27 03:00:22.408663 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Start _get_guest_xml network_info=[{"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '60418cf4-cd7f-4256-ad92-cc8336802816', 'attached_at': '2026-05-27T03:00:21.000000', 'detached_at': '', 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'serial': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'}, 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '2699cbc4-ec28-4b9f-a156-ca8f9fdd4e6e', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:00:22.411264 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:00:22.413160 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-2003998951', uuid='60418cf4-cd7f-4256-ad92-cc8336802816'), owner=OwnerMeta(userid='1358d6b48fbe42159155175cf488804b', username='tempest-ServerActionsTestOtherB-1490236880-project-member', projectid='88bb33ad146843308b381f8379c70094', projectname='tempest-ServerActionsTestOtherB-1490236880'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850822.412633) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:00:22.414266 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:00:22.414631 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:00:22.416490 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:00:22.416490 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:00:22.419128 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:00:22.419128 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:00:22.420484 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:00:22.420764 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:00:22.420950 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:00:22.421022 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:00:22.421159 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:00:22.421497 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:00:22.421712 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:00:22.422079 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:00:22.422142 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:00:22.422262 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:00:22.422498 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lazy-loading 'vcpu_model' on Instance uuid 60418cf4-cd7f-4256-ad92-cc8336802816 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:22.574882 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "refresh_cache-f5d36573-c0e7-43a0-a7cc-66678f093375" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:00:22.648145 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f0a0730d-7f0d-43c3-adf3-ccb387402276 req-fada2f9e-d679-43b1-a4fa-15b2b9209f99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:22.762443 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f0a0730d-7f0d-43c3-adf3-ccb387402276 req-fada2f9e-d679-43b1-a4fa-15b2b9209f99 service nova] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:00:22.939325 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.config --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:22.959133 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f0a0730d-7f0d-43c3-adf3-ccb387402276 req-fada2f9e-d679-43b1-a4fa-15b2b9209f99 service nova] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:23.020220 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.config --force-share --output=json" returned: 0 in 0.081s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:23.020779 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "/opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:23.021106 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "/opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:23.021884 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "/opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:23.022311 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:00:23.022828 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:00:23.023036 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:23.023433 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:23.023719 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:00:23.039797 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:23.041235 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:23.041707 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:23.041998 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:00:23.043183 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:23.043372 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:00:23.056455 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:00:23.056455 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:23.062219 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:00:23.062219 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:23.072734 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80] added
May 27 03:00:23.072734 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:00:23.072734 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:23.072734 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:23.072734 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:23.072734 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:23.072734 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:23.073057 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:00:23.073098 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:00:23.073271 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:00:23.074573 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80] added
May 27 03:00:23.074573 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:00:23.074573 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:23.074573 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:23.074573 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:23.074573 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:23.074573 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:23.074845 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:00:23.074937 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0315(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:00:23.075095 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:00:23.214406 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e36f7a88-839a-492e-b6b2-eaf897c1e8b4 req-778095b1-2ec5-4c89-b3ed-bcd1c893909d service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received event network-changed-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:23.215034 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e36f7a88-839a-492e-b6b2-eaf897c1e8b4 req-778095b1-2ec5-4c89-b3ed-bcd1c893909d service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Refreshing instance network info cache due to event network-changed-d113df60-11d0-4f48-a42a-9541589d6a45. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:00:23.215256 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e36f7a88-839a-492e-b6b2-eaf897c1e8b4 req-778095b1-2ec5-4c89-b3ed-bcd1c893909d service nova] Acquiring lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:00:23.215403 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e36f7a88-839a-492e-b6b2-eaf897c1e8b4 req-778095b1-2ec5-4c89-b3ed-bcd1c893909d service nova] Acquired lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:00:23.215566 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-e36f7a88-839a-492e-b6b2-eaf897c1e8b4 req-778095b1-2ec5-4c89-b3ed-bcd1c893909d service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Refreshing network info cache for port d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:00:23.463322 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f0a0730d-7f0d-43c3-adf3-ccb387402276 req-fada2f9e-d679-43b1-a4fa-15b2b9209f99 service nova] Releasing lock "refresh_cache-f5d36573-c0e7-43a0-a7cc-66678f093375" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:00:23.464121 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquired lock "refresh_cache-f5d36573-c0e7-43a0-a7cc-66678f093375" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:00:23.464315 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:00:23.720543 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-e36f7a88-839a-492e-b6b2-eaf897c1e8b4 req-778095b1-2ec5-4c89-b3ed-bcd1c893909d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:24.073963 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:00:24.075540 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:00:24.083033 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:00:24.092889 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:00:24.092889 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:00:24.096870 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:00:24.096870 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:24.110328 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:24.115382 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:24.123459 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 03:00:24.123459 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:24.123591 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 03:00:24.123591 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:24.123773 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 03:00:24.123773 np0000001475 nova-compute[98471]: 
May 27 03:00:24.130611 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 03:00:24.130611 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:24.131837 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 03:00:24.131837 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:24.131837 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 03:00:24.131837 np0000001475 nova-compute[98471]: 
May 27 03:00:24.167881 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-e36f7a88-839a-492e-b6b2-eaf897c1e8b4 req-778095b1-2ec5-4c89-b3ed-bcd1c893909d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:24.207143 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "7acda56f-e16c-4371-99b3-21eeea2904d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:24.207400 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:24.304478 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:24.395817 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-e36f7a88-839a-492e-b6b2-eaf897c1e8b4 req-778095b1-2ec5-4c89-b3ed-bcd1c893909d service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Updated VIF entry in instance network info cache for port d113df60-11d0-4f48-a42a-9541589d6a45. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:00:24.396264 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-e36f7a88-839a-492e-b6b2-eaf897c1e8b4 req-778095b1-2ec5-4c89-b3ed-bcd1c893909d service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Updating instance_info_cache with network_info: [{"id": "d113df60-11d0-4f48-a42a-9541589d6a45", "address": "fa:16:3e:af:c0:52", "network": {"id": "a5ee8bff-dbe9-420a-bc58-64e9082e7d84", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a7ebe6073564995b0dd1bb85437f4d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd113df60-11", "ovs_interfaceid": "d113df60-11d0-4f48-a42a-9541589d6a45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:24.439852 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:00:24.441338 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:00:24.441524 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Creating image(s)
May 27 03:00:24.441984 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:00:24.442180 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Ensure instance console log exists: /opt/stack/data/nova/instances/f5d36573-c0e7-43a0-a7cc-66678f093375/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:00:24.442454 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:24.442736 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:24.442843 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:24.495325 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Updating instance_info_cache with network_info: [{"id": "138260f4-bd1e-47ed-9760-9f234ebfdddc", "address": "fa:16:3e:b0:5e:79", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap138260f4-bd", "ovs_interfaceid": "138260f4-bd1e-47ed-9760-9f234ebfdddc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:24.714810 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:00:24.898319 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e36f7a88-839a-492e-b6b2-eaf897c1e8b4 req-778095b1-2ec5-4c89-b3ed-bcd1c893909d service nova] Releasing lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:00:24.997422 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Releasing lock "refresh_cache-f5d36573-c0e7-43a0-a7cc-66678f093375" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:00:24.997422 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Instance network_info: |[{"id": "138260f4-bd1e-47ed-9760-9f234ebfdddc", "address": "fa:16:3e:b0:5e:79", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap138260f4-bd", "ovs_interfaceid": "138260f4-bd1e-47ed-9760-9f234ebfdddc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:00:24.998085 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Start _get_guest_xml network_info=[{"id": "138260f4-bd1e-47ed-9760-9f234ebfdddc", "address": "fa:16:3e:b0:5e:79", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap138260f4-bd", "ovs_interfaceid": "138260f4-bd1e-47ed-9760-9f234ebfdddc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f5d36573-c0e7-43a0-a7cc-66678f093375', 'attached_at': '', 'detached_at': '', 'volume_id': 'b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'serial': 'b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'multiattach': True}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '7e89a82e-7145-4930-9d95-d6ef5085a99b', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:00:25.001925 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:00:25.003147 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-1643817025', uuid='f5d36573-c0e7-43a0-a7cc-66678f093375'), owner=OwnerMeta(userid='092604511a8a467ba4ecb56261cb531f', username='tempest-AttachVolumeMultiAttachTest-774919822-project-member', projectid='a9c48d6919e8435f876f3324616521ea', projectname='tempest-AttachVolumeMultiAttachTest-774919822'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "138260f4-bd1e-47ed-9760-9f234ebfdddc", "address": "fa:16:3e:b0:5e:79", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap138260f4-bd", "ovs_interfaceid": "138260f4-bd1e-47ed-9760-9f234ebfdddc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850825.0028176) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:00:25.008403 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:00:25.008786 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:00:25.009512 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:00:25.009854 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:00:25.011776 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:00:25.013594 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:00:25.015011 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:00:25.015150 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:00:25.015436 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:00:25.015579 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:00:25.015725 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:00:25.015936 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:00:25.016079 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:00:25.016450 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:00:25.017414 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:00:25.017607 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:00:25.034837 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:00:25.035111 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:00:25.035217 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:25.170148 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.40.100,3260]
May 27 03:00:25.170148 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.40.100,3260] successful.
May 27 03:00:25.170148 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:25.170148 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.50.100,3260]
May 27 03:00:25.170148 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.50.100,3260] successful.
May 27 03:00:25.170148 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:25.181037 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:25.188380 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:25.197302 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:25.197302 np0000001475 nova-compute[98471]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:25.197302 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:25.197899 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:25.197899 np0000001475 nova-compute[98471]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:25.197899 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:25.197899 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.156s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:25.198087 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:00:25.201147 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] HCTL ('8', '-', '-', 0) found on session 36 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:00:25.201147 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:00:25.204824 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:25.204824 np0000001475 nova-compute[98471]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:25.204824 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:25.204824 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:25.204824 np0000001475 nova-compute[98471]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:25.204824 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:25.204824 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.161s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:25.204824 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:00:25.205605 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] HCTL ('7', '-', '-', 0) found on session 35 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:00:25.205605 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:00:25.212164 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:25.214823 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Searching for a device in session 36 and hctl ['8', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:00:25.230633 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Searching for a device in session 35 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:00:25.231776 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:00:25.284643 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:25.285622 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:25.288856 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:00:25.289570 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Claim successful on node np0000001475
May 27 03:00:25.909833 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:26.215781 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Searching for a device in session 36 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:00:26.215781 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:00:26.342398 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "interface-ebd2884b-67b5-40c1-8cf0-a22bd90be727-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:26.342621 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "interface-ebd2884b-67b5-40c1-8cf0-a22bd90be727-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:26.342968 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lazy-loading 'flavor' on Instance uuid ebd2884b-67b5-40c1-8cf0-a22bd90be727 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:26.816861 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:00:26.817117 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:00:26.846240 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:27.024055 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lazy-loading 'pci_requests' on Instance uuid ebd2884b-67b5-40c1-8cf0-a22bd90be727 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:27.062134 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Found WWN 33000000058a2856d for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:00:27.062492 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.039s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:27.062771 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] <== connect_volume: return (4040ms) {'type': 'block', 'scsi_wwn': '33000000058a2856d', 'path': '/dev/dm-0', 'multipath_id': '33000000058a2856d'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:00:27.063479 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000058a2856d', 'path': '/dev/dm-0', 'multipath_id': '33000000058a2856d'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:00:27.063971 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.029s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:27.064311 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:00:27.082535 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:27.082951 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:27.083786 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:27.084517 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:00:27.084979 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:27.085238 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:00:27.094556 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:00:27.094556 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:27.099936 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:00:27.099936 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:27.107512 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd] added
May 27 03:00:27.107512 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:00:27.107512 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:27.107512 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:27.107512 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:27.107512 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:27.107512 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:27.107767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:00:27.108016 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.024(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:00:27.108210 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:00:27.115899 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd] added
May 27 03:00:27.115899 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:00:27.115899 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:27.115899 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:27.115899 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:27.115899 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:27.115899 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:27.116129 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:00:27.116417 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0312(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:00:27.116646 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:00:27.320340 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:00:27.526172 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Object Instance<ebd2884b-67b5-40c1-8cf0-a22bd90be727> lazy-loaded attributes: flavor,pci_requests {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:00:27.526340 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:00:27.526579 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:27.526876 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:27.569019 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2003998951',display_name='tempest-ServerActionsTestOtherB-server-2003998951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serveractionstestotherb-server-2003998951',id=10,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg7MMihIxBG1QGB6QSTA9rrk5T7Na9nzECiQ6YZKa+5mhSSqtwAjACf4ZBO/nNtoXKyk5k1Psoc+8lMf/kcUG6+ibFAACUX2UpjW+QvgPhfAshXB22uMHukoxMZ4AS6zw==',key_name='tempest-keypair-1292561843',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:00:05Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001475',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='88bb33ad146843308b381f8379c70094',ramdisk_id='',reservation_id='r-cw0r0f6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1490236880',owner_user_name='tempest-ServerActionsTestOtherB-1490236880-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:00:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1358d6b48fbe42159155175cf488804b',uuid=60418cf4-cd7f-4256-ad92-cc8336802816,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:00:27.569336 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Converting VIF {"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:27.570943 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:27.571243 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] End _get_guest_xml xml=<domain type="qemu">
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:   <uuid>60418cf4-cd7f-4256-ad92-cc8336802816</uuid>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:   <name>instance-0000000a</name>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerActionsTestOtherB-server-2003998951</nova:name>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:00:22</nova:creationTime>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:         <nova:user uuid="1358d6b48fbe42159155175cf488804b">tempest-ServerActionsTestOtherB-1490236880-project-member</nova:user>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:         <nova:project uuid="88bb33ad146843308b381f8379c70094">tempest-ServerActionsTestOtherB-1490236880</nova:project>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:         <nova:port uuid="920f5752-8d06-40e8-90e8-53fa42f5488d">
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     <system>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <entry name="serial">60418cf4-cd7f-4256-ad92-cc8336802816</entry>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <entry name="uuid">60418cf4-cd7f-4256-ad92-cc8336802816</entry>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     </system>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:   <os>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:   </os>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:   <features>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:   </features>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:   <devices>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/disk.config"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <alias name="ua-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-0"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <target dev="vdb" bus="virtio"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <serial>115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80</serial>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:8f:94:b9"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <target dev="tap920f5752-8d"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     </interface>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816/console.log" append="off"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     </serial>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     <video>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     </video>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     </rng>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:   </devices>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]: </domain>
May 27 03:00:27.571243 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:00:27.574588 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Preparing to wait for external event network-vif-plugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:00:27.574588 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:27.574588 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:27.574588 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:27.574588 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2003998951',display_name='tempest-ServerActionsTestOtherB-server-2003998951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serveractionstestotherb-server-2003998951',id=10,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg7MMihIxBG1QGB6QSTA9rrk5T7Na9nzECiQ6YZKa+5mhSSqtwAjACf4ZBO/nNtoXKyk5k1Psoc+8lMf/kcUG6+ibFAACUX2UpjW+QvgPhfAshXB22uMHukoxMZ4AS6zw==',key_name='tempest-keypair-1292561843',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:00:05Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001475',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='88bb33ad146843308b381f8379c70094',ramdisk_id='',reservation_id='r-cw0r0f6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1490236880',owner_user_name='tempest-ServerActionsTestOtherB-1490236880-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:00:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1358d6b48fbe42159155175cf488804b',uuid=60418cf4-cd7f-4256-ad92-cc8336802816,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:00:27.574588 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Converting VIF {"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:27.574588 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:27.574588 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:00:27.578135 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:27.578135 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:27.578135 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:00:27.578135 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:27.578135 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03b8b391-d626-5e3d-8a47-dc389f134820', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:27.581324 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:27.581324 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:27.582638 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:27.584399 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap920f5752-8d, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:27.584399 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap920f5752-8d, col_values=(('qos', UUID('2a5b378f-1dba-4158-8552-521b1494e077')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:27.584399 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap920f5752-8d, col_values=(('external_ids', {'iface-id': '920f5752-8d06-40e8-90e8-53fa42f5488d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:94:b9', 'vm-uuid': '60418cf4-cd7f-4256-ad92-cc8336802816'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:27.584617 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:27.586787 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:27.592399 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:27.593455 np0000001475 nova-compute[98471]: INFO os_vif [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d')
May 27 03:00:27.631541 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff4b501bdb27488490da6b1032106687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997fc21542b04af2a2d9113d30f87b22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:00:27.829710 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.545s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:27.830053 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:00:28.108717 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:00:28.121147 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:00:28.122212 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:00:28.122212 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:00:28.138921 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:00:28.138921 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:28.152629 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Successfully created port: b23e23e6-8bc3-4655-adc9-0038a2341ab3 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:00:28.155640 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:28.157662 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:28.160673 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:28.182860 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:28.182860 np0000001475 nova-compute[98471]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:28.182860 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:28.183883 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:28.183883 np0000001475 nova-compute[98471]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:28.183883 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:28.183883 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:28.183883 np0000001475 nova-compute[98471]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:28.183883 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:28.183883 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:28.183883 np0000001475 nova-compute[98471]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:28.183883 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:28.199030 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:28.203353 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:28.224650 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd, portal: 192.168.50.100,3260]
May 27 03:00:28.224650 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd, portal: 192.168.50.100,3260] successful.
May 27 03:00:28.224650 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:28.242417 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd, portal: 192.168.40.100,3260]
May 27 03:00:28.242417 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd, portal: 192.168.40.100,3260] successful.
May 27 03:00:28.242417 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:28.243147 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:28.257233 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:28.258878 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:28.258878 np0000001475 nova-compute[98471]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:28.258878 np0000001475 nova-compute[98471]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:28.258878 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:28.258878 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:28.259048 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:28.259048 np0000001475 nova-compute[98471]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:28.259048 np0000001475 nova-compute[98471]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:28.259048 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:28.259048 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:28.259236 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:28.259351 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:00:28.259851 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] HCTL ('9', '-', '-', 0) found on session 37 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:00:28.260070 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:00:28.272643 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:28.272643 np0000001475 nova-compute[98471]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:28.272643 np0000001475 nova-compute[98471]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:28.272643 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:28.272643 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:28.272806 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:28.272806 np0000001475 nova-compute[98471]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:28.272806 np0000001475 nova-compute[98471]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:28.272806 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:28.272806 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:28.273075 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:28.273199 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:00:28.273836 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] HCTL ('10', '-', '-', 0) found on session 38 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:00:28.273935 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:00:28.282584 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching for a device in session 37 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:00:28.282977 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:00:28.304029 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching for a device in session 38 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:00:28.304029 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:00:28.306488 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:28.339766 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:00:28.339766 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:00:28.339766 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:28.339979 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:28.500217 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '787c8d4d4527402cbbc2ad0475f710bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab70ea24752242a88583e819c6c34e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:00:28.667529 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:28.671539 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:28.675711 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:28.687506 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3cccbd63-0a19-433f-a658-8c049209e34c req-e9749bd7-e78d-413c-80a2-44f94090e731 service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received event network-vif-plugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:28.687506 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3cccbd63-0a19-433f-a658-8c049209e34c req-e9749bd7-e78d-413c-80a2-44f94090e731 service nova] Acquiring lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:28.687506 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3cccbd63-0a19-433f-a658-8c049209e34c req-e9749bd7-e78d-413c-80a2-44f94090e731 service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:28.687506 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3cccbd63-0a19-433f-a658-8c049209e34c req-e9749bd7-e78d-413c-80a2-44f94090e731 service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:28.687506 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3cccbd63-0a19-433f-a658-8c049209e34c req-e9749bd7-e78d-413c-80a2-44f94090e731 service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Processing event network-vif-plugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:00:28.697969 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:28.844232 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:00:29.061303 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.002221608000127162 future=<Future at 0x75572475d490 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:29.063806 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Emitting event <LifecycleEvent: 1779850814.0589333, 60418cf4-cd7f-4256-ad92-cc8336802816 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:29.063806 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] VM Stopped (Lifecycle Event)
May 27 03:00:29.067655 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:29.088443 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:00:29.214782 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Successfully created port: ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:00:29.314174 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Removed pending STOPPED event for 60418cf4-cd7f-4256-ad92-cc8336802816 due to new event <LifecycleEvent: 1779850829.313732, 60418cf4-cd7f-4256-ad92-cc8336802816 => Started> {{(pid=98471) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 03:00:29.314615 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850829.313732, 60418cf4-cd7f-4256-ad92-cc8336802816 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:29.315130 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:00:29.315130 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] VM Started (Lifecycle Event)
May 27 03:00:29.325733 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Instance running successfully.
May 27 03:00:29.325733 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] finish_revert_migration finished successfully. {{(pid=98471) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}}
May 27 03:00:29.351502 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:00:29.409522 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Successfully updated port: b23e23e6-8bc3-4655-adc9-0038a2341ab3 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:00:29.569437 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c0d4b139-1ba2-4a69-9206-ed4d782ca40c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:29.817442 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:29.819205 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:00:29.856475 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Booting with blank volume at /dev/vda
May 27 03:00:29.878694 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Successfully updated port: ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:00:29.912585 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "refresh_cache-ebd2884b-67b5-40c1-8cf0-a22bd90be727" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:00:29.912585 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquired lock "refresh_cache-ebd2884b-67b5-40c1-8cf0-a22bd90be727" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:00:29.912585 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:00:29.943135 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-555ca2c1-6265-4c5c-9141-4b3d155d00ba req-5948a6da-8e10-487f-a29b-2c57d51a6df7 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received event network-changed-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:29.943592 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-555ca2c1-6265-4c5c-9141-4b3d155d00ba req-5948a6da-8e10-487f-a29b-2c57d51a6df7 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Refreshing instance network info cache due to event network-changed-ed993fcc-f75a-4549-937f-26a3a42c5fe8. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:00:29.943592 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-555ca2c1-6265-4c5c-9141-4b3d155d00ba req-5948a6da-8e10-487f-a29b-2c57d51a6df7 service nova] Acquiring lock "refresh_cache-7acda56f-e16c-4371-99b3-21eeea2904d1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:00:29.943711 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-555ca2c1-6265-4c5c-9141-4b3d155d00ba req-5948a6da-8e10-487f-a29b-2c57d51a6df7 service nova] Acquired lock "refresh_cache-7acda56f-e16c-4371-99b3-21eeea2904d1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:00:29.943801 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-555ca2c1-6265-4c5c-9141-4b3d155d00ba req-5948a6da-8e10-487f-a29b-2c57d51a6df7 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Refreshing network info cache for port ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:00:30.105019 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Found WWN 33000000053058fee for multipath device dm-1 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:00:30.105019 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:30.105249 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] <== connect_volume: return (5069ms) {'type': 'block', 'scsi_wwn': '33000000053058fee', 'path': '/dev/dm-1', 'multipath_id': '33000000053058fee'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:00:30.105423 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000053058fee', 'path': '/dev/dm-1', 'multipath_id': '33000000053058fee'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:00:30.322114 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 27 03:00:30.322586 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850830.322039, 60418cf4-cd7f-4256-ad92-cc8336802816 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:30.322586 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] VM Paused (Lifecycle Event)
May 27 03:00:30.385069 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "refresh_cache-7acda56f-e16c-4371-99b3-21eeea2904d1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:00:30.413814 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-41409be9-a8b1-4591-874b-b1a51458d0b8 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Updating instance to original state: 'active'
May 27 03:00:30.448812 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-555ca2c1-6265-4c5c-9141-4b3d155d00ba req-5948a6da-8e10-487f-a29b-2c57d51a6df7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:30.614060 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1643817025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumemultiattachtest-server-1643817025',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-f61mimih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:00:22Z,user_data=None,user_id='092604511a8a467ba4ecb56261cb531f',uuid=f5d36573-c0e7-43a0-a7cc-66678f093375,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "138260f4-bd1e-47ed-9760-9f234ebfdddc", "address": "fa:16:3e:b0:5e:79", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap138260f4-bd", "ovs_interfaceid": "138260f4-bd1e-47ed-9760-9f234ebfdddc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:00:30.614060 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "138260f4-bd1e-47ed-9760-9f234ebfdddc", "address": "fa:16:3e:b0:5e:79", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap138260f4-bd", "ovs_interfaceid": "138260f4-bd1e-47ed-9760-9f234ebfdddc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:30.614060 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5e:79,bridge_name='br-int',has_traffic_filtering=True,id=138260f4-bd1e-47ed-9760-9f234ebfdddc,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138260f4-bd') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:30.614060 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'pci_devices' on Instance uuid f5d36573-c0e7-43a0-a7cc-66678f093375 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:30.639490 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-555ca2c1-6265-4c5c-9141-4b3d155d00ba req-5948a6da-8e10-487f-a29b-2c57d51a6df7 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:00:30.793386 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-de321b64-3e94-4318-a66d-02c743f3e601 req-553fcb78-476a-4fa7-8a98-e988ccd7c758 service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received event network-vif-plugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:30.793603 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-de321b64-3e94-4318-a66d-02c743f3e601 req-553fcb78-476a-4fa7-8a98-e988ccd7c758 service nova] Acquiring lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:30.794097 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-de321b64-3e94-4318-a66d-02c743f3e601 req-553fcb78-476a-4fa7-8a98-e988ccd7c758 service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:30.794466 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-de321b64-3e94-4318-a66d-02c743f3e601 req-553fcb78-476a-4fa7-8a98-e988ccd7c758 service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:30.794466 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-de321b64-3e94-4318-a66d-02c743f3e601 req-553fcb78-476a-4fa7-8a98-e988ccd7c758 service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] No waiting events found dispatching network-vif-plugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:00:30.794466 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-de321b64-3e94-4318-a66d-02c743f3e601 req-553fcb78-476a-4fa7-8a98-e988ccd7c758 service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received unexpected event network-vif-plugged-920f5752-8d06-40e8-90e8-53fa42f5488d for instance with vm_state active and task_state None.
May 27 03:00:30.794679 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-de321b64-3e94-4318-a66d-02c743f3e601 req-553fcb78-476a-4fa7-8a98-e988ccd7c758 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Received event network-changed-b23e23e6-8bc3-4655-adc9-0038a2341ab3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:30.794870 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-de321b64-3e94-4318-a66d-02c743f3e601 req-553fcb78-476a-4fa7-8a98-e988ccd7c758 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Refreshing instance network info cache due to event network-changed-b23e23e6-8bc3-4655-adc9-0038a2341ab3. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:00:30.795077 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-de321b64-3e94-4318-a66d-02c743f3e601 req-553fcb78-476a-4fa7-8a98-e988ccd7c758 service nova] Acquiring lock "refresh_cache-ebd2884b-67b5-40c1-8cf0-a22bd90be727" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:00:30.825564 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:30.834217 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850830.833862, 60418cf4-cd7f-4256-ad92-cc8336802816 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:30.834368 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] VM Resumed (Lifecycle Event)
May 27 03:00:30.880251 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-555ca2c1-6265-4c5c-9141-4b3d155d00ba req-5948a6da-8e10-487f-a29b-2c57d51a6df7 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:30.893170 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:30.910242 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:31.119306 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] End _get_guest_xml xml=<domain type="qemu">
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:   <uuid>f5d36573-c0e7-43a0-a7cc-66678f093375</uuid>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:   <name>instance-00000010</name>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-1643817025</nova:name>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:00:25</nova:creationTime>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:         <nova:user uuid="092604511a8a467ba4ecb56261cb531f">tempest-AttachVolumeMultiAttachTest-774919822-project-member</nova:user>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:         <nova:project uuid="a9c48d6919e8435f876f3324616521ea">tempest-AttachVolumeMultiAttachTest-774919822</nova:project>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:         <nova:port uuid="138260f4-bd1e-47ed-9760-9f234ebfdddc">
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     <system>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <entry name="serial">f5d36573-c0e7-43a0-a7cc-66678f093375</entry>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <entry name="uuid">f5d36573-c0e7-43a0-a7cc-66678f093375</entry>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     </system>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:   <os>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:   </os>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:   <features>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:   </features>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:   <devices>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/f5d36573-c0e7-43a0-a7cc-66678f093375/disk.config"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <alias name="ua-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-1"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <serial>b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd</serial>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <shareable/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:b0:5e:79"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <target dev="tap138260f4-bd"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     </interface>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/f5d36573-c0e7-43a0-a7cc-66678f093375/console.log" append="off"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     </serial>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     <video>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     </video>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     </rng>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:   </devices>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]: </domain>
May 27 03:00:31.119306 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:00:31.122076 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Preparing to wait for external event network-vif-plugged-138260f4-bd1e-47ed-9760-9f234ebfdddc {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:00:31.122076 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "f5d36573-c0e7-43a0-a7cc-66678f093375-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:31.122076 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "f5d36573-c0e7-43a0-a7cc-66678f093375-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:31.122076 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "f5d36573-c0e7-43a0-a7cc-66678f093375-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:31.122076 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1643817025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumemultiattachtest-server-1643817025',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-f61mimih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:00:22Z,user_data=None,user_id='092604511a8a467ba4ecb56261cb531f',uuid=f5d36573-c0e7-43a0-a7cc-66678f093375,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "138260f4-bd1e-47ed-9760-9f234ebfdddc", "address": "fa:16:3e:b0:5e:79", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap138260f4-bd", "ovs_interfaceid": "138260f4-bd1e-47ed-9760-9f234ebfdddc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:00:31.122076 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "138260f4-bd1e-47ed-9760-9f234ebfdddc", "address": "fa:16:3e:b0:5e:79", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap138260f4-bd", "ovs_interfaceid": "138260f4-bd1e-47ed-9760-9f234ebfdddc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:31.122076 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5e:79,bridge_name='br-int',has_traffic_filtering=True,id=138260f4-bd1e-47ed-9760-9f234ebfdddc,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138260f4-bd') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:31.122076 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5e:79,bridge_name='br-int',has_traffic_filtering=True,id=138260f4-bd1e-47ed-9760-9f234ebfdddc,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138260f4-bd') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:00:31.122076 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:31.122076 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:31.122076 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:00:31.122635 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:31.122845 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0019d1cd-bbf2-5852-999d-bc85b00ed7d2', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:31.123614 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:31.124376 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:31.125834 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:31.129110 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:31.129275 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap138260f4-bd, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:31.129560 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap138260f4-bd, col_values=(('qos', UUID('4143530a-9df8-495b-b2eb-b15ebc35b6e7')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:31.129696 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap138260f4-bd, col_values=(('external_ids', {'iface-id': '138260f4-bd1e-47ed-9760-9f234ebfdddc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:5e:79', 'vm-uuid': 'f5d36573-c0e7-43a0-a7cc-66678f093375'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:31.132318 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:31.136765 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:31.140257 np0000001475 nova-compute[98471]: INFO os_vif [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5e:79,bridge_name='br-int',has_traffic_filtering=True,id=138260f4-bd1e-47ed-9760-9f234ebfdddc,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138260f4-bd')
May 27 03:00:31.263766 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:31.338636 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:31.346229 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:00:31.381489 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-555ca2c1-6265-4c5c-9141-4b3d155d00ba req-5948a6da-8e10-487f-a29b-2c57d51a6df7 service nova] Releasing lock "refresh_cache-7acda56f-e16c-4371-99b3-21eeea2904d1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:00:31.382325 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquired lock "refresh_cache-7acda56f-e16c-4371-99b3-21eeea2904d1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:00:31.384120 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:00:31.400899 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Updating instance_info_cache with network_info: [{"id": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "address": "fa:16:3e:b8:34:46", "network": {"id": "00a82372-a9cb-4a7e-8f75-6883f0e85849", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2146755790-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cfc1d4d-e0", "ovs_interfaceid": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "address": "fa:16:3e:d8:d6:24", "network": {"id": "135d20cc-9a53-4eed-9b52-1e13a89fc18e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2095472683", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e23e6-8b", "ovs_interfaceid": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:31.903594 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Releasing lock "refresh_cache-ebd2884b-67b5-40c1-8cf0-a22bd90be727" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:00:31.904226 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-de321b64-3e94-4318-a66d-02c743f3e601 req-553fcb78-476a-4fa7-8a98-e988ccd7c758 service nova] Acquired lock "refresh_cache-ebd2884b-67b5-40c1-8cf0-a22bd90be727" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:00:31.904458 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-de321b64-3e94-4318-a66d-02c743f3e601 req-553fcb78-476a-4fa7-8a98-e988ccd7c758 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Refreshing network info cache for port b23e23e6-8bc3-4655-adc9-0038a2341ab3 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:00:31.908316 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1481412241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-1481412241',id=12,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX3hrfXJylogloNcsVODyT6YV7aMSshELm9OJiUcOjH996gMpO5+kFiAKQhQX7ZkAoqoXhzYZQLrM0rlP3d/NY+cv+dBD4+nzGVXWnWfuAvNWMegazBzNSt2XeuVXBmtQ==',key_name='tempest-keypair-1422957137',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:59:46Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='997fc21542b04af2a2d9113d30f87b22',ramdisk_id='',reservation_id='r-b9zanhfv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1282046058',owner_user_name='tempest-TaggedAttachmentsTest-1282046058-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:59:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff4b501bdb27488490da6b1032106687',uuid=ebd2884b-67b5-40c1-8cf0-a22bd90be727,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "address": "fa:16:3e:d8:d6:24", "network": {"id": "135d20cc-9a53-4eed-9b52-1e13a89fc18e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2095472683", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e23e6-8b", "ovs_interfaceid": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:00:31.908890 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Converting VIF {"id": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "address": "fa:16:3e:d8:d6:24", "network": {"id": "135d20cc-9a53-4eed-9b52-1e13a89fc18e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2095472683", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e23e6-8b", "ovs_interfaceid": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:31.909435 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:d6:24,bridge_name='br-int',has_traffic_filtering=True,id=b23e23e6-8bc3-4655-adc9-0038a2341ab3,network=Network(135d20cc-9a53-4eed-9b52-1e13a89fc18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23e23e6-8b') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:31.909756 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:d6:24,bridge_name='br-int',has_traffic_filtering=True,id=b23e23e6-8bc3-4655-adc9-0038a2341ab3,network=Network(135d20cc-9a53-4eed-9b52-1e13a89fc18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23e23e6-8b') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:00:31.914829 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:31.915134 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:31.915331 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:00:31.918560 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:31.918843 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6551f46d-c4e3-5e97-b283-25e247074a0b', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:31.924005 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:31.928965 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:31.934192 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:31.934415 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb23e23e6-8b, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:31.934870 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb23e23e6-8b, col_values=(('qos', UUID('f47ecb6b-990f-4a54-92ca-7d658769cccc')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:31.935065 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb23e23e6-8b, col_values=(('external_ids', {'iface-id': 'b23e23e6-8bc3-4655-adc9-0038a2341ab3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:d6:24', 'vm-uuid': 'ebd2884b-67b5-40c1-8cf0-a22bd90be727'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:31.942609 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:31.943423 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:31.953410 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:31.954737 np0000001475 nova-compute[98471]: INFO os_vif [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:d6:24,bridge_name='br-int',has_traffic_filtering=True,id=b23e23e6-8bc3-4655-adc9-0038a2341ab3,network=Network(135d20cc-9a53-4eed-9b52-1e13a89fc18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23e23e6-8b')
May 27 03:00:31.955589 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1481412241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-1481412241',id=12,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX3hrfXJylogloNcsVODyT6YV7aMSshELm9OJiUcOjH996gMpO5+kFiAKQhQX7ZkAoqoXhzYZQLrM0rlP3d/NY+cv+dBD4+nzGVXWnWfuAvNWMegazBzNSt2XeuVXBmtQ==',key_name='tempest-keypair-1422957137',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:59:46Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='997fc21542b04af2a2d9113d30f87b22',ramdisk_id='',reservation_id='r-b9zanhfv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1282046058',owner_user_name='tempest-TaggedAttachmentsTest-1282046058-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:59:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff4b501bdb27488490da6b1032106687',uuid=ebd2884b-67b5-40c1-8cf0-a22bd90be727,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "address": "fa:16:3e:d8:d6:24", "network": {"id": "135d20cc-9a53-4eed-9b52-1e13a89fc18e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2095472683", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e23e6-8b", "ovs_interfaceid": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:00:31.955787 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Converting VIF {"id": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "address": "fa:16:3e:d8:d6:24", "network": {"id": "135d20cc-9a53-4eed-9b52-1e13a89fc18e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2095472683", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e23e6-8b", "ovs_interfaceid": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:31.956334 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:d6:24,bridge_name='br-int',has_traffic_filtering=True,id=b23e23e6-8bc3-4655-adc9-0038a2341ab3,network=Network(135d20cc-9a53-4eed-9b52-1e13a89fc18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23e23e6-8b') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:31.957322 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] attach device xml: <interface type="ethernet">
May 27 03:00:31.957322 np0000001475 nova-compute[98471]:   <mac address="fa:16:3e:d8:d6:24"/>
May 27 03:00:31.957322 np0000001475 nova-compute[98471]:   <model type="virtio"/>
May 27 03:00:31.957322 np0000001475 nova-compute[98471]:   <driver name="qemu"/>
May 27 03:00:31.957322 np0000001475 nova-compute[98471]:   <mtu size="1372"/>
May 27 03:00:31.957322 np0000001475 nova-compute[98471]:   <target dev="tapb23e23e6-8b"/>
May 27 03:00:31.957322 np0000001475 nova-compute[98471]: </interface>
May 27 03:00:31.957322 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:00:31.975016 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:00:31.979949 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:32.064116 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:32.065854 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:32.080481 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:32.119289 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:32.264929 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:32.323630 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6ef7eb17-6eb4-495a-a56c-cedcb4b05508 req-7b4160ba-cc88-41d1-a138-ee5172b5d992 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Received event network-vif-plugged-b23e23e6-8bc3-4655-adc9-0038a2341ab3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:32.323630 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6ef7eb17-6eb4-495a-a56c-cedcb4b05508 req-7b4160ba-cc88-41d1-a138-ee5172b5d992 service nova] Acquiring lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:32.323630 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6ef7eb17-6eb4-495a-a56c-cedcb4b05508 req-7b4160ba-cc88-41d1-a138-ee5172b5d992 service nova] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:32.323630 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6ef7eb17-6eb4-495a-a56c-cedcb4b05508 req-7b4160ba-cc88-41d1-a138-ee5172b5d992 service nova] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:32.324056 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6ef7eb17-6eb4-495a-a56c-cedcb4b05508 req-7b4160ba-cc88-41d1-a138-ee5172b5d992 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] No waiting events found dispatching network-vif-plugged-b23e23e6-8bc3-4655-adc9-0038a2341ab3 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:00:32.324576 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-6ef7eb17-6eb4-495a-a56c-cedcb4b05508 req-7b4160ba-cc88-41d1-a138-ee5172b5d992 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Received unexpected event network-vif-plugged-b23e23e6-8bc3-4655-adc9-0038a2341ab3 for instance with vm_state active and task_state None.
May 27 03:00:32.409655 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-de321b64-3e94-4318-a66d-02c743f3e601 req-553fcb78-476a-4fa7-8a98-e988ccd7c758 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:32.465437 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:32.476774 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:32.490575 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Updating instance_info_cache with network_info: [{"id": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "address": "fa:16:3e:7e:90:4a", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped993fcc-f7", "ovs_interfaceid": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:32.511980 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:32.664150 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:32.664352 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:32.664546 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No VIF found with MAC fa:16:3e:b0:5e:79, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:00:32.665085 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Using config drive
May 27 03:00:32.798411 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-de321b64-3e94-4318-a66d-02c743f3e601 req-553fcb78-476a-4fa7-8a98-e988ccd7c758 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:32.994761 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Releasing lock "refresh_cache-7acda56f-e16c-4371-99b3-21eeea2904d1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:00:32.994761 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Instance network_info: |[{"id": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "address": "fa:16:3e:7e:90:4a", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped993fcc-f7", "ovs_interfaceid": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:00:32.999766 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-de321b64-3e94-4318-a66d-02c743f3e601 req-553fcb78-476a-4fa7-8a98-e988ccd7c758 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Updated VIF entry in instance network info cache for port b23e23e6-8bc3-4655-adc9-0038a2341ab3. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:00:33.001232 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-de321b64-3e94-4318-a66d-02c743f3e601 req-553fcb78-476a-4fa7-8a98-e988ccd7c758 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Updating instance_info_cache with network_info: [{"id": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "address": "fa:16:3e:b8:34:46", "network": {"id": "00a82372-a9cb-4a7e-8f75-6883f0e85849", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2146755790-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cfc1d4d-e0", "ovs_interfaceid": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "address": "fa:16:3e:d8:d6:24", "network": {"id": "135d20cc-9a53-4eed-9b52-1e13a89fc18e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2095472683", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e23e6-8b", "ovs_interfaceid": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:33.171003 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:33.194211 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "60418cf4-cd7f-4256-ad92-cc8336802816" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:33.194382 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "60418cf4-cd7f-4256-ad92-cc8336802816" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:33.194587 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:33.194720 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:33.194881 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:33.198110 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Terminating instance
May 27 03:00:33.347820 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Creating config drive at /opt/stack/data/nova/instances/f5d36573-c0e7-43a0-a7cc-66678f093375/disk.config
May 27 03:00:33.352122 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f5d36573-c0e7-43a0-a7cc-66678f093375/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3sz9n0d6 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:33.379119 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:00:33.395592 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:00:33.417247 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:33.427388 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f5d36573-c0e7-43a0-a7cc-66678f093375/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3sz9n0d6" returned: 0 in 0.076s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:33.448665 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:00:33.449041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:00:33.458855 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:00:33.460564 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b', 'fe80::fc16:3eff:feb8:3446', 'fe80::48f3:78ff:fe0a:4de1', 'fe80::fc16:3eff:fefc:b5d4', 'fe80::fc16:3eff:fe1f:5a7', 'fe80::a095:90ff:feef:1465', 'fe80::fc16:3eff:feaf:c052', 'fe80::20bf:faff:fe0c:5acd', 'fe80::fc16:3eff:fe8f:94b9', 'fe80::b820:35ff:fe01:438d', 'fe80::fc16:3eff:fed8:d624', 'fe80::30d2:55ff:fe35:f968'] 
May 27 03:00:33.460732 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:00:33.460884 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:00:33.461190 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:00:33.461445 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Updating existing volume attachment record: a5bb1b5a-6511-44d0-bc32-4aa332ab6c56 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:00:33.504174 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-de321b64-3e94-4318-a66d-02c743f3e601 req-553fcb78-476a-4fa7-8a98-e988ccd7c758 service nova] Releasing lock "refresh_cache-ebd2884b-67b5-40c1-8cf0-a22bd90be727" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:00:33.668895 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:33.669044 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:33.669165 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] No VIF found with MAC fa:16:3e:b8:34:46, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:00:33.701703 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:00:33.741093 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:33.771213 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:33.773233 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:33.807810 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:33.902975 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d63d88d0-559a-4df5-aa35-9438825d5269 req-506067fc-564f-4cac-883f-281424587d94 service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received event network-vif-unplugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:33.903308 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d63d88d0-559a-4df5-aa35-9438825d5269 req-506067fc-564f-4cac-883f-281424587d94 service nova] Acquiring lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:33.904276 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d63d88d0-559a-4df5-aa35-9438825d5269 req-506067fc-564f-4cac-883f-281424587d94 service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:33.904276 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d63d88d0-559a-4df5-aa35-9438825d5269 req-506067fc-564f-4cac-883f-281424587d94 service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:33.904276 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d63d88d0-559a-4df5-aa35-9438825d5269 req-506067fc-564f-4cac-883f-281424587d94 service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] No waiting events found dispatching network-vif-unplugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:00:33.904276 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d63d88d0-559a-4df5-aa35-9438825d5269 req-506067fc-564f-4cac-883f-281424587d94 service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received event network-vif-unplugged-920f5752-8d06-40e8-90e8-53fa42f5488d for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:00:33.962604 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:34.000619 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:34.003485 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:34.181263 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1481412241', uuid='ebd2884b-67b5-40c1-8cf0-a22bd90be727'), owner=OwnerMeta(userid='ff4b501bdb27488490da6b1032106687', username='tempest-TaggedAttachmentsTest-1282046058-project-member', projectid='997fc21542b04af2a2d9113d30f87b22', projectname='tempest-TaggedAttachmentsTest-1282046058'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "address": "fa:16:3e:b8:34:46", "network": {"id": "00a82372-a9cb-4a7e-8f75-6883f0e85849", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2146755790-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cfc1d4d-e0", "ovs_interfaceid": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "address": "fa:16:3e:d8:d6:24", "network": {"id": "135d20cc-9a53-4eed-9b52-1e13a89fc18e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2095472683", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e23e6-8b", "ovs_interfaceid": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850834.179955) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:00:34.182476 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:   <nova:package version="33.1.0"/>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:   <nova:name>tempest-device-tagging-server-1481412241</nova:name>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:   <nova:creationTime>2026-05-27 03:00:34</nova:creationTime>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:   <nova:flavor name="m1.nano" id="42">
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:     <nova:memory>192</nova:memory>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:     <nova:disk>1</nova:disk>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:     <nova:swap>0</nova:swap>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:     <nova:ephemeral>0</nova:ephemeral>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:     <nova:vcpus>1</nova:vcpus>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:     <nova:extraSpecs>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:     </nova:extraSpecs>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:   </nova:flavor>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:   <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:     <nova:containerFormat>bare</nova:containerFormat>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:     <nova:minDisk>1</nova:minDisk>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:     <nova:minRam>0</nova:minRam>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:     <nova:properties>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:       <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:       <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:     </nova:properties>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:   </nova:image>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:   <nova:owner>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:     <nova:user uuid="ff4b501bdb27488490da6b1032106687">tempest-TaggedAttachmentsTest-1282046058-project-member</nova:user>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:     <nova:project uuid="997fc21542b04af2a2d9113d30f87b22">tempest-TaggedAttachmentsTest-1282046058</nova:project>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:   </nova:owner>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:   <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:   <nova:ports>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:     <nova:port uuid="6cfc1d4d-e055-4ba7-a926-19911b813fe0">
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:       <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:     </nova:port>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:     <nova:port uuid="b23e23e6-8bc3-4655-adc9-0038a2341ab3">
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:       <nova:ip type="fixed" address="10.10.10.229" ipVersion="4"/>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:     </nova:port>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:   </nova:ports>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]: </nova:instance>
May 27 03:00:34.182476 np0000001475 nova-compute[98471]:  {{(pid=98471) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 27 03:00:34.220309 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999634944000036 future=<Future at 0x755704745be0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:34.220803 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999335830000064 future=<Future at 0x755704745be0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:34.220803 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999231888000168 future=<Future at 0x755704745be0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:34.224630 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:34.232574 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Instance destroyed successfully.
May 27 03:00:34.238715 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lazy-loading 'resources' on Instance uuid 60418cf4-cd7f-4256-ad92-cc8336802816 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:34.372395 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:34.378788 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:34.386276 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:34.412262 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:34.413861 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d2aa9263-1451-4c34-8332-f247f1394e73 req-7fbc79c1-5d97-436f-a662-e40832e8b318 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Received event network-vif-plugged-b23e23e6-8bc3-4655-adc9-0038a2341ab3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:34.414213 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d2aa9263-1451-4c34-8332-f247f1394e73 req-7fbc79c1-5d97-436f-a662-e40832e8b318 service nova] Acquiring lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:34.414263 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d2aa9263-1451-4c34-8332-f247f1394e73 req-7fbc79c1-5d97-436f-a662-e40832e8b318 service nova] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:34.414565 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d2aa9263-1451-4c34-8332-f247f1394e73 req-7fbc79c1-5d97-436f-a662-e40832e8b318 service nova] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:34.414894 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d2aa9263-1451-4c34-8332-f247f1394e73 req-7fbc79c1-5d97-436f-a662-e40832e8b318 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] No waiting events found dispatching network-vif-plugged-b23e23e6-8bc3-4655-adc9-0038a2341ab3 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:00:34.415038 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-d2aa9263-1451-4c34-8332-f247f1394e73 req-7fbc79c1-5d97-436f-a662-e40832e8b318 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Received unexpected event network-vif-plugged-b23e23e6-8bc3-4655-adc9-0038a2341ab3 for instance with vm_state active and task_state None.
May 27 03:00:34.415220 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d2aa9263-1451-4c34-8332-f247f1394e73 req-7fbc79c1-5d97-436f-a662-e40832e8b318 service nova] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Received event network-vif-plugged-138260f4-bd1e-47ed-9760-9f234ebfdddc {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:34.415425 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d2aa9263-1451-4c34-8332-f247f1394e73 req-7fbc79c1-5d97-436f-a662-e40832e8b318 service nova] Acquiring lock "f5d36573-c0e7-43a0-a7cc-66678f093375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:34.415626 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d2aa9263-1451-4c34-8332-f247f1394e73 req-7fbc79c1-5d97-436f-a662-e40832e8b318 service nova] Lock "f5d36573-c0e7-43a0-a7cc-66678f093375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:34.415861 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d2aa9263-1451-4c34-8332-f247f1394e73 req-7fbc79c1-5d97-436f-a662-e40832e8b318 service nova] Lock "f5d36573-c0e7-43a0-a7cc-66678f093375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:34.416295 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d2aa9263-1451-4c34-8332-f247f1394e73 req-7fbc79c1-5d97-436f-a662-e40832e8b318 service nova] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Processing event network-vif-plugged-138260f4-bd1e-47ed-9760-9f234ebfdddc {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:00:34.424881 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:34.694387 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-faa9567a-7a40-4e73-9b82-0f18f926faaf tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "interface-ebd2884b-67b5-40c1-8cf0-a22bd90be727-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 8.352s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:34.744672 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2003998951',display_name='tempest-ServerActionsTestOtherB-server-2003998951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serveractionstestotherb-server-2003998951',id=10,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg7MMihIxBG1QGB6QSTA9rrk5T7Na9nzECiQ6YZKa+5mhSSqtwAjACf4ZBO/nNtoXKyk5k1Psoc+8lMf/kcUG6+ibFAACUX2UpjW+QvgPhfAshXB22uMHukoxMZ4AS6zw==',key_name='tempest-keypair-1292561843',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:00:29Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88bb33ad146843308b381f8379c70094',ramdisk_id='',reservation_id='r-cw0r0f6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1490236880',owner_user_name='tempest-ServerActionsTestOtherB-1490236880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:00:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1358d6b48fbe42159155175cf488804b',uuid=60418cf4-cd7f-4256-ad92-cc8336802816,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:00:34.744928 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Converting VIF {"id": "920f5752-8d06-40e8-90e8-53fa42f5488d", "address": "fa:16:3e:8f:94:b9", "network": {"id": "e2488745-0830-49aa-9455-0f121427798e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-159671913-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88bb33ad146843308b381f8379c70094", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap920f5752-8d", "ovs_interfaceid": "920f5752-8d06-40e8-90e8-53fa42f5488d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:34.746198 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:34.746198 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:00:34.750635 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:34.752102 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap920f5752-8d, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:34.752456 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:34.753278 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:34.755369 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:34.756843 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:34.757033 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a5b378f-1dba-4158-8552-521b1494e077) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:34.757703 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:34.758294 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:34.758588 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:34.764346 np0000001475 nova-compute[98471]: INFO os_vif [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:94:b9,bridge_name='br-int',has_traffic_filtering=True,id=920f5752-8d06-40e8-90e8-53fa42f5488d,network=Network(e2488745-0830-49aa-9455-0f121427798e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap920f5752-8d')
May 27 03:00:34.767096 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:00:34.768443 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:00:34.768443 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:34.768443 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:34.768443 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:00:34.768443 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:00:34.795408 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:34.795408 np0000001475 nova-compute[98471]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:34.795408 np0000001475 nova-compute[98471]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:34.795408 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:34.795408 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:34.795642 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsi session list stdout=tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:34.795642 np0000001475 nova-compute[98471]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80 (non-flash)
May 27 03:00:34.795642 np0000001475 nova-compute[98471]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:34.795642 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:34.795642 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:34.795778 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:00:34.796087 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', '36')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:00:34.797009 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80', '35')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:00:34.802380 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c29c360>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'): ({'sdc'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:00:34.803146 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Removing multipathed devices sdb, sdc {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:00:34.803247 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Flush multipath device 33000000058a2856d {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:00:34.840962 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:00:34.888824 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:00:34.946189 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:00:34.946419 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:00:34.947713 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:00:34.963484 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:00:34.963768 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:00:34.977035 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:35.012022 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.40.100,3260]
May 27 03:00:35.012022 np0000001475 nova-compute[98471]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.40.100,3260] successful.
May 27 03:00:35.012022 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:35.027113 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:35.038314 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:35.068884 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.50.100,3260]
May 27 03:00:35.068884 np0000001475 nova-compute[98471]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-115c3c9a-e70c-48b9-a5eb-4a0e8ff7eb80, portal: 192.168.50.100,3260] successful.
May 27 03:00:35.068884 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:35.081099 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:35.081364 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:35.081519 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] <== disconnect_volume: return (313ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:00:35.081643 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:00:35.082051 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Deleting instance files /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816_del
May 27 03:00:35.089990 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Deletion of /opt/stack/data/nova/instances/60418cf4-cd7f-4256-ad92-cc8336802816_del complete
May 27 03:00:35.097828 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850835.0967693, f5d36573-c0e7-43a0-a7cc-66678f093375 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:35.097828 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] VM Started (Lifecycle Event)
May 27 03:00:35.099864 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:00:35.110896 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:00:35.113237 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Instance spawned successfully.
May 27 03:00:35.113574 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:00:35.326165 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "6ad1223d-d197-46e7-a32b-a25380d409a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:35.326352 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:35.606773 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:00:35.611434 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:00:35.611434 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Creating image(s)
May 27 03:00:35.611434 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:00:35.611434 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Ensure instance console log exists: /opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:00:35.611434 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:35.611434 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:35.611434 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:35.612368 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Start _get_guest_xml network_info=[{"id": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "address": "fa:16:3e:7e:90:4a", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped993fcc-f7", "ovs_interfaceid": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7acda56f-e16c-4371-99b3-21eeea2904d1', 'attached_at': '', 'detached_at': '', 'volume_id': '6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'serial': '6a1921ec-dd47-422c-af8e-b1cbf29ad186'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'a5bb1b5a-6511-44d0-bc32-4aa332ab6c56', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:00:35.612811 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Took 1.91 seconds to destroy the instance on the hypervisor.
May 27 03:00:35.613656 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:00:35.614643 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:00:35.614643 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:00:35.614643 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:35.623173 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:00:35.626128 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:35.627098 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-125761252', uuid='7acda56f-e16c-4371-99b3-21eeea2904d1'), owner=OwnerMeta(userid='787c8d4d4527402cbbc2ad0475f710bb', username='tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member', projectid='ab70ea24752242a88583e819c6c34e12', projectname='tempest-ServerBootFromVolumeStableRescueTest-1976367979'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "address": "fa:16:3e:7e:90:4a", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped993fcc-f7", "ovs_interfaceid": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850835.6251943) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:00:35.628291 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:35.629915 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:35.630633 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:35.631903 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:35.632538 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:35.634228 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:00:35.634474 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:00:35.638906 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:35.646211 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:00:35.651653 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:00:35.651859 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:00:35.652816 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:00:35.653184 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:00:35.655205 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:00:35.655205 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:00:35.655205 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:00:35.655205 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:00:35.655205 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:00:35.655205 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:00:35.655205 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:00:35.655705 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:00:35.655705 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:00:35.656128 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:00:35.688228 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:35.689088 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:00:35.689467 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:35.693801 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:00:35.694138 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:35.695275 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:35.695628 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:00:35.709158 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:35.709805 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:35.711652 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:35.711900 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:00:35.712245 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:35.712425 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:00:35.724802 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:00:35.724802 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:35.729242 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:35.736761 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:00:35.736761 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:35.743067 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186] added
May 27 03:00:35.743067 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:00:35.743067 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:35.743067 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:35.743067 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:35.743067 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:35.743067 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:35.743387 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:00:35.743681 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0316(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:00:35.743963 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:00:35.749536 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186] added
May 27 03:00:35.749536 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:00:35.749536 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:35.749536 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:35.749536 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:35.749536 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:35.749536 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:35.749788 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:00:35.749820 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0374(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:00:35.749975 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:00:35.833461 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lazy-loading 'flavor' on Instance uuid 6ad1223d-d197-46e7-a32b-a25380d409a8 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:35.925048 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:36.135992 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5998db06-b2a9-45f7-90eb-972b6b305b88 req-05b919ed-9085-4ebe-a6ee-4f2b8aa84932 service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received event network-vif-unplugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:36.136392 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5998db06-b2a9-45f7-90eb-972b6b305b88 req-05b919ed-9085-4ebe-a6ee-4f2b8aa84932 service nova] Acquiring lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:36.136660 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5998db06-b2a9-45f7-90eb-972b6b305b88 req-05b919ed-9085-4ebe-a6ee-4f2b8aa84932 service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:36.136832 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5998db06-b2a9-45f7-90eb-972b6b305b88 req-05b919ed-9085-4ebe-a6ee-4f2b8aa84932 service nova] Lock "60418cf4-cd7f-4256-ad92-cc8336802816-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:36.137036 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5998db06-b2a9-45f7-90eb-972b6b305b88 req-05b919ed-9085-4ebe-a6ee-4f2b8aa84932 service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] No waiting events found dispatching network-vif-unplugged-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:00:36.137167 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5998db06-b2a9-45f7-90eb-972b6b305b88 req-05b919ed-9085-4ebe-a6ee-4f2b8aa84932 service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received event network-vif-unplugged-920f5752-8d06-40e8-90e8-53fa42f5488d for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:00:36.152042 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Took 11.71 seconds to spawn the instance on the hypervisor.
May 27 03:00:36.152042 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:00:36.152042 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850836.1517048, f5d36573-c0e7-43a0-a7cc-66678f093375 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:36.152042 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] VM Paused (Lifecycle Event)
May 27 03:00:36.153249 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:36.196784 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lazy-loading 'flavor' on Instance uuid ebd2884b-67b5-40c1-8cf0-a22bd90be727 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:36.483709 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-40fff04c-119f-4050-82bf-71a9300ab921 req-84c7b7c3-ed03-470e-97a7-bd514ee4d7eb service nova] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Received event network-vif-plugged-138260f4-bd1e-47ed-9760-9f234ebfdddc {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:36.483709 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-40fff04c-119f-4050-82bf-71a9300ab921 req-84c7b7c3-ed03-470e-97a7-bd514ee4d7eb service nova] Acquiring lock "f5d36573-c0e7-43a0-a7cc-66678f093375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:36.483709 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-40fff04c-119f-4050-82bf-71a9300ab921 req-84c7b7c3-ed03-470e-97a7-bd514ee4d7eb service nova] Lock "f5d36573-c0e7-43a0-a7cc-66678f093375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:36.483709 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-40fff04c-119f-4050-82bf-71a9300ab921 req-84c7b7c3-ed03-470e-97a7-bd514ee4d7eb service nova] Lock "f5d36573-c0e7-43a0-a7cc-66678f093375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:36.483709 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-40fff04c-119f-4050-82bf-71a9300ab921 req-84c7b7c3-ed03-470e-97a7-bd514ee4d7eb service nova] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] No waiting events found dispatching network-vif-plugged-138260f4-bd1e-47ed-9760-9f234ebfdddc {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:00:36.483709 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-40fff04c-119f-4050-82bf-71a9300ab921 req-84c7b7c3-ed03-470e-97a7-bd514ee4d7eb service nova] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Received unexpected event network-vif-plugged-138260f4-bd1e-47ed-9760-9f234ebfdddc for instance with vm_state active and task_state None.
May 27 03:00:36.655233 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:36.656541 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850836.6563125, f5d36573-c0e7-43a0-a7cc-66678f093375 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:36.656650 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] VM Resumed (Lifecycle Event)
May 27 03:00:36.662049 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Took 19.61 seconds to build instance.
May 27 03:00:36.744437 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:00:36.750498 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:00:36.759175 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:00:36.759175 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:00:36.767253 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:00:36.767253 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:36.776050 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:36.782175 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:36.790059 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:36.790059 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:36.790059 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:36.790265 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:36.790265 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:36.790265 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:36.797692 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:36.797692 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:36.797692 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:36.797907 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:36.797907 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:36.797907 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:36.825270 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186, portal: 192.168.40.100,3260]
May 27 03:00:36.825270 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186, portal: 192.168.40.100,3260] successful.
May 27 03:00:36.825270 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:36.836871 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:36.841254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:36.845449 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186, portal: 192.168.50.100,3260]
May 27 03:00:36.845449 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186, portal: 192.168.50.100,3260] successful.
May 27 03:00:36.845449 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:36.854554 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:36.854554 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:36.854554 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:36.854554 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:36.854554 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:36.854810 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:36.854810 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:36.854810 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:36.854810 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:36.854810 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:36.854972 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:36.855127 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:00:36.855859 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] HCTL ('7', '-', '-', 0) found on session 39 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:00:36.855982 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:00:36.865427 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:36.875904 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Searching for a device in session 39 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:00:36.875904 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:00:36.882806 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:36.882806 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:36.882806 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:36.882806 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:36.882806 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:36.883005 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:36.883005 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:36.883005 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:36.883005 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:36.883005 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:36.883307 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:36.883497 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:00:36.884166 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] HCTL ('8', '-', '-', 0) found on session 40 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:00:36.884308 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:00:36.911671 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Searching for a device in session 40 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:00:36.911671 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:00:36.914667 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:37.159863 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:37.165184 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-68871d44-069b-4351-a3c1-48c5cab9c329 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "f5d36573-c0e7-43a0-a7cc-66678f093375" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.124s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:37.165928 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:00:37.203045 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:37.417389 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Took 1.80 seconds to deallocate network for instance.
May 27 03:00:37.712212 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:00:37.927536 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "6ad1223d-d197-46e7-a32b-a25380d409a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:37.927931 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:37.928013 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Attaching volume 0301a508-e6af-4ae2-b6af-9a5abf80f200 to /dev/vdb
May 27 03:00:37.977628 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:00:37.980114 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Took 0.56 seconds to detach 1 volumes for instance.
May 27 03:00:37.993921 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:00:38.018634 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:38.054993 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:00:38.055281 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:00:38.067682 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:00:38.069536 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b', 'fe80::fc16:3eff:feb8:3446', 'fe80::48f3:78ff:fe0a:4de1', 'fe80::fc16:3eff:fefc:b5d4', 'fe80::fc16:3eff:fe1f:5a7', 'fe80::a095:90ff:feef:1465', 'fe80::fc16:3eff:feaf:c052', 'fe80::20bf:faff:fe0c:5acd', 'fe80::fc16:3eff:fed8:d624', 'fe80::30d2:55ff:fe35:f968', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324'] 
May 27 03:00:38.069728 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:00:38.070003 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:00:38.070660 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:00:38.070986 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Updating existing volume attachment record: 2d35836c-e6ec-4c3e-9cbd-0d706597894e {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:00:38.220408 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-06f33b51-7431-46fb-94fe-e572efc5e4ca req-632b9d07-1fa3-46db-8550-9acbf681a042 service nova] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Received event network-vif-deleted-920f5752-8d06-40e8-90e8-53fa42f5488d {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:38.290989 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:38.291284 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:38.291570 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Attaching volume 32a71ff1-f2ac-4945-98d6-be406befc106 to /dev/vdb
May 27 03:00:38.336651 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:00:38.353970 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:00:38.376266 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:38.420115 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:00:38.420288 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:00:38.429848 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:00:38.431444 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b', 'fe80::fc16:3eff:feb8:3446', 'fe80::48f3:78ff:fe0a:4de1', 'fe80::fc16:3eff:fefc:b5d4', 'fe80::fc16:3eff:fe1f:5a7', 'fe80::a095:90ff:feef:1465', 'fe80::fc16:3eff:feaf:c052', 'fe80::20bf:faff:fe0c:5acd', 'fe80::fc16:3eff:fed8:d624', 'fe80::30d2:55ff:fe35:f968', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324'] 
May 27 03:00:38.431612 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:00:38.431793 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:00:38.432664 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:00:38.433107 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Updating existing volume attachment record: 2f3ab784-f157-4cf5-bbb6-a1a54f53db1f {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:00:38.492148 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:38.492419 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:38.494720 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:38.580424 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Deleted allocations for instance 60418cf4-cd7f-4256-ad92-cc8336802816
May 27 03:00:38.642949 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:00:38.643595 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0301a508-e6af-4ae2-b6af-9a5abf80f200', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:00:38.643595 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:38.727843 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Found WWN 330000000ea028c01 for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:00:38.728284 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:38.728478 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000ea028c01', 'path': '/dev/dm-0', 'multipath_id': '330000000ea028c01'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:00:38.728624 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ea028c01', 'path': '/dev/dm-0', 'multipath_id': '330000000ea028c01'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:00:38.732763 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.087s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:38.732763 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0301a508-e6af-4ae2-b6af-9a5abf80f200', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:00:38.746975 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:38.747509 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:38.748181 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:38.748373 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:00:38.749065 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:38.749504 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:00:38.761679 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:00:38.761679 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:38.768661 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:00:38.768661 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:38.776672 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200] added
May 27 03:00:38.776672 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:00:38.776672 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:38.776672 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:38.776672 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:38.776672 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:38.776672 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:38.776909 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:00:38.777127 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:00:38.777314 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:00:38.782796 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200] added
May 27 03:00:38.782796 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:00:38.782796 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:38.782796 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:38.782796 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:38.782796 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:38.782796 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:38.782989 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:00:38.783205 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0337(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:00:38.783415 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:00:39.000346 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:00:39.001431 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106', 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '32a71ff1-f2ac-4945-98d6-be406befc106', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:00:39.001431 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:39.236673 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-125761252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverbootfromvolumestablerescuetest-server-125761252',id=17,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab70ea24752242a88583e819c6c34e12',ramdisk_id='',reservation_id='r-nn9dht37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:00:29Z,user_data=None,user_id='787c8d4d4527402cbbc2ad0475f710bb',uuid=7acda56f-e16c-4371-99b3-21eeea2904d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "address": "fa:16:3e:7e:90:4a", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped993fcc-f7", "ovs_interfaceid": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:00:39.236957 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converting VIF {"id": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "address": "fa:16:3e:7e:90:4a", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped993fcc-f7", "ovs_interfaceid": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:39.237642 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:90:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed993fcc-f75a-4549-937f-26a3a42c5fe8,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped993fcc-f7') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:39.238480 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'pci_devices' on Instance uuid 7acda56f-e16c-4371-99b3-21eeea2904d1 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:39.596420 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4ef41b8f-84af-477a-bc9b-3b49268deea7 tempest-ServerActionsTestOtherB-1490236880 tempest-ServerActionsTestOtherB-1490236880-project-member] Lock "60418cf4-cd7f-4256-ad92-cc8336802816" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.402s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:39.744708 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] End _get_guest_xml xml=<domain type="qemu">
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:   <uuid>7acda56f-e16c-4371-99b3-21eeea2904d1</uuid>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:   <name>instance-00000011</name>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-125761252</nova:name>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:00:35</nova:creationTime>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:         <nova:user uuid="787c8d4d4527402cbbc2ad0475f710bb">tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member</nova:user>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:         <nova:project uuid="ab70ea24752242a88583e819c6c34e12">tempest-ServerBootFromVolumeStableRescueTest-1976367979</nova:project>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:         <nova:port uuid="ed993fcc-f75a-4549-937f-26a3a42c5fe8">
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     <system>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <entry name="serial">7acda56f-e16c-4371-99b3-21eeea2904d1</entry>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <entry name="uuid">7acda56f-e16c-4371-99b3-21eeea2904d1</entry>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     </system>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:   <os>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:   </os>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:   <features>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:   </features>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:   <devices>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/disk.config"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <alias name="ua-6a1921ec-dd47-422c-af8e-b1cbf29ad186"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-0"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <serial>6a1921ec-dd47-422c-af8e-b1cbf29ad186</serial>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:7e:90:4a"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <target dev="taped993fcc-f7"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     </interface>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/console.log" append="off"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     </serial>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     <video>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     </video>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     </rng>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:   </devices>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]: </domain>
May 27 03:00:39.744708 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:00:39.751603 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Preparing to wait for external event network-vif-plugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:00:39.751603 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:39.751603 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:39.751603 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:39.751603 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-125761252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverbootfromvolumestablerescuetest-server-125761252',id=17,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab70ea24752242a88583e819c6c34e12',ramdisk_id='',reservation_id='r-nn9dht37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:00:29Z,user_data=None,user_id='787c8d4d4527402cbbc2ad0475f710bb',uuid=7acda56f-e16c-4371-99b3-21eeea2904d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "address": "fa:16:3e:7e:90:4a", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped993fcc-f7", "ovs_interfaceid": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:00:39.751603 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converting VIF {"id": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "address": "fa:16:3e:7e:90:4a", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped993fcc-f7", "ovs_interfaceid": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:39.751603 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:90:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed993fcc-f75a-4549-937f-26a3a42c5fe8,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped993fcc-f7') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:39.751603 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:90:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed993fcc-f75a-4549-937f-26a3a42c5fe8,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped993fcc-f7') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:00:39.754089 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:39.754399 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:39.754714 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:00:39.755528 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:39.755678 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9782868-00e2-513b-8394-388e1bb0619e', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:39.756504 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:39.757166 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:39.759004 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:39.761072 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:39.761219 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped993fcc-f7, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:39.761546 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped993fcc-f7, col_values=(('qos', UUID('1cd40d9d-07e2-492b-8f8a-c81235b3e283')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:39.761729 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped993fcc-f7, col_values=(('external_ids', {'iface-id': 'ed993fcc-f75a-4549-937f-26a3a42c5fe8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:90:4a', 'vm-uuid': '7acda56f-e16c-4371-99b3-21eeea2904d1'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:39.763210 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:39.764576 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:39.770447 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:39.771932 np0000001475 nova-compute[98471]: INFO os_vif [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:90:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed993fcc-f75a-4549-937f-26a3a42c5fe8,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped993fcc-f7')
May 27 03:00:39.778107 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:00:39.785056 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:00:39.795287 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:00:39.795287 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:00:39.805781 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:00:39.805781 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:39.816769 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:39.819571 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:39.830140 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:39.830140 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:39.830140 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:39.830140 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:39.830140 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:39.830399 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:39.830399 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:39.830399 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:39.830399 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:39.830399 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:39.836720 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:39.836720 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:39.836720 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:39.836720 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:39.836720 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:39.836979 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:39.836979 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:39.836979 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:39.836979 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:39.836979 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:39.871661 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, portal: 192.168.40.100,3260]
May 27 03:00:39.871661 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, portal: 192.168.40.100,3260] successful.
May 27 03:00:39.871661 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:39.877955 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, portal: 192.168.50.100,3260]
May 27 03:00:39.877955 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, portal: 192.168.50.100,3260] successful.
May 27 03:00:39.877955 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:39.890172 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:39.896421 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:39.907583 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:39.907583 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:39.907583 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:39.907583 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:39.907583 np0000001475 nova-compute[98471]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:39.907583 np0000001475 nova-compute[98471]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:39.907583 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:39.908465 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:39.908465 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:39.908465 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:39.908465 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:39.908465 np0000001475 nova-compute[98471]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:39.908465 np0000001475 nova-compute[98471]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:39.908465 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:39.908465 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:39.908465 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:00:39.909263 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] HCTL ('11', '-', '-', 0) found on session 41 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:00:39.909384 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:00:39.916707 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:39.916707 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:39.916707 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:39.916707 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:39.916707 np0000001475 nova-compute[98471]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:39.916707 np0000001475 nova-compute[98471]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:39.916707 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:39.917027 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:39.917027 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:39.917027 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:39.917027 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:39.917027 np0000001475 nova-compute[98471]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:39.917027 np0000001475 nova-compute[98471]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:39.917027 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:39.918734 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:39.918734 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:00:39.918734 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] HCTL ('12', '-', '-', 0) found on session 42 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:00:39.918734 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:00:39.944123 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Searching for a device in session 41 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:00:39.944123 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0301a508-e6af-4ae2-b6af-9a5abf80f200', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:00:39.944123 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Searching for a device in session 42 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:00:39.944123 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0301a508-e6af-4ae2-b6af-9a5abf80f200', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:00:40.132033 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "71af628e-b06d-446d-8c2e-dcfbb232df33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:40.132317 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:40.635760 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:00:40.752144 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:00:40.925139 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:41.196991 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:41.197177 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:41.200033 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:00:41.200307 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Claim successful on node np0000001475
May 27 03:00:41.294819 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:41.294947 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:41.295050 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] No VIF found with MAC fa:16:3e:7e:90:4a, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:00:41.295462 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Using config drive
May 27 03:00:41.771046 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Found WWN 330000000d581dd7b for multipath device dm-4 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:00:41.771589 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:41.771589 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] <== connect_volume: return (3127ms) {'type': 'block', 'scsi_wwn': '330000000d581dd7b', 'path': '/dev/dm-4', 'multipath_id': '330000000d581dd7b'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:00:41.771801 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d581dd7b', 'path': '/dev/dm-4', 'multipath_id': '330000000d581dd7b'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:00:41.772438 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.772s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:41.772701 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106', 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '32a71ff1-f2ac-4945-98d6-be406befc106', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:00:41.781121 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lazy-loading 'flavor' on Instance uuid 6ad1223d-d197-46e7-a32b-a25380d409a8 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:41.784854 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:41.785655 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:41.785885 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:00:41.786914 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:41.787684 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:41.787969 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:00:41.803238 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:41.805653 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:00:41.805653 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:41.807519 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:00:41.807519 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:41.819172 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106] added
May 27 03:00:41.819172 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:00:41.819172 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:41.819172 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:41.819172 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:41.819172 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:41.819172 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:41.819602 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:00:41.820077 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106] added
May 27 03:00:41.820077 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:00:41.820077 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:41.820077 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:41.820077 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:41.820077 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:41.820077 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:41.820285 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.032(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:00:41.820543 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:00:41.820816 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:00:41.823955 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:00:41.824169 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:00:41.937530 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Creating config drive at /opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/disk.config
May 27 03:00:41.941841 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsh9m6d1g {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:41.986136 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsh9m6d1g" returned: 0 in 0.044s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:42.285899 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Attempting to attach volume 0301a508-e6af-4ae2-b6af-9a5abf80f200 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:00:42.287126 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:00:42.287126 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:00:42.287126 np0000001475 nova-compute[98471]:   <alias name="ua-0301a508-e6af-4ae2-b6af-9a5abf80f200"/>
May 27 03:00:42.287126 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-4"/>
May 27 03:00:42.287126 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:00:42.287126 np0000001475 nova-compute[98471]:   <serial>0301a508-e6af-4ae2-b6af-9a5abf80f200</serial>
May 27 03:00:42.287126 np0000001475 nova-compute[98471]: </disk>
May 27 03:00:42.287126 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:00:42.317595 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:00:42.318212 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:00:42.318591 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:00:42.318927 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:00:42.319134 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:00:42.319399 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:00:42.319707 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:00:42.319974 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:00:42.320116 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:00:42.320394 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.88 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:00:42.627867 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:42.667838 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:42.748543 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:00:42.748543 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:00:42.786772 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:42.822485 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:00:42.824913 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:00:42.844037 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:00:42.844037 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:42.846036 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:00:42.854306 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:00:42.854306 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:42.860832 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:42.871406 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:42.888768 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:42.888768 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:42.888768 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:42.888768 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:42.888768 np0000001475 nova-compute[98471]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:42.888768 np0000001475 nova-compute[98471]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:42.888768 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:42.888768 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:42.888768 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:42.888768 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:42.888768 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:42.888768 np0000001475 nova-compute[98471]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:42.888768 np0000001475 nova-compute[98471]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:42.888768 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:42.892375 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:42.892375 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:42.892375 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:42.892375 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:42.892375 np0000001475 nova-compute[98471]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:42.892375 np0000001475 nova-compute[98471]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:42.892375 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:42.892633 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:42.892633 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:42.892633 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:42.892633 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:42.892633 np0000001475 nova-compute[98471]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:42.892633 np0000001475 nova-compute[98471]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:42.892633 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:42.899651 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a61ead12-dcd3-4451-a3ad-2f3a6eb5decc req-ea2684a2-9b98-49e3-843c-711aaa528d18 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received event network-vif-plugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:42.899651 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a61ead12-dcd3-4451-a3ad-2f3a6eb5decc req-ea2684a2-9b98-49e3-843c-711aaa528d18 service nova] Acquiring lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:42.899651 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a61ead12-dcd3-4451-a3ad-2f3a6eb5decc req-ea2684a2-9b98-49e3-843c-711aaa528d18 service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:42.899651 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a61ead12-dcd3-4451-a3ad-2f3a6eb5decc req-ea2684a2-9b98-49e3-843c-711aaa528d18 service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:42.899651 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a61ead12-dcd3-4451-a3ad-2f3a6eb5decc req-ea2684a2-9b98-49e3-843c-711aaa528d18 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Processing event network-vif-plugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:00:42.925486 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106, portal: 192.168.50.100,3260]
May 27 03:00:42.925486 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106, portal: 192.168.50.100,3260] successful.
May 27 03:00:42.925486 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:42.943864 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:42.951349 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106, portal: 192.168.40.100,3260]
May 27 03:00:42.951349 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106, portal: 192.168.40.100,3260] successful.
May 27 03:00:42.951349 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:42.965233 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:42.968285 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:42.968285 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:42.968285 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:42.968285 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:42.968285 np0000001475 nova-compute[98471]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:42.968285 np0000001475 nova-compute[98471]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:42.968285 np0000001475 nova-compute[98471]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106 (non-flash)
May 27 03:00:42.968285 np0000001475 nova-compute[98471]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106 (non-flash)
May 27 03:00:42.968285 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:42.968285 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:42.968285 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:42.968285 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:42.968285 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:42.968285 np0000001475 nova-compute[98471]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:42.968285 np0000001475 nova-compute[98471]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:42.968285 np0000001475 nova-compute[98471]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106 (non-flash)
May 27 03:00:42.968285 np0000001475 nova-compute[98471]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106 (non-flash)
May 27 03:00:42.968285 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:42.968285 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:42.968285 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:00:42.968285 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] HCTL ('13', '-', '-', 0) found on session 43 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:00:42.969175 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:00:42.986634 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:42.986634 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:42.986634 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:42.986634 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:42.986634 np0000001475 nova-compute[98471]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:42.986634 np0000001475 nova-compute[98471]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:42.986634 np0000001475 nova-compute[98471]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106 (non-flash)
May 27 03:00:42.986634 np0000001475 nova-compute[98471]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106 (non-flash)
May 27 03:00:42.986634 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:42.986634 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:42.986634 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:42.986634 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:42.986634 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:42.986634 np0000001475 nova-compute[98471]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:42.986634 np0000001475 nova-compute[98471]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:42.986634 np0000001475 nova-compute[98471]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106 (non-flash)
May 27 03:00:42.986634 np0000001475 nova-compute[98471]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106 (non-flash)
May 27 03:00:42.986634 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:42.987231 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:42.987231 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:00:42.988827 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] HCTL ('14', '-', '-', 0) found on session 44 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:00:42.988827 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:00:43.004194 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Searching for a device in session 43 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:00:43.004652 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '32a71ff1-f2ac-4945-98d6-be406befc106', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:00:43.011214 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Searching for a device in session 44 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:00:43.011432 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '32a71ff1-f2ac-4945-98d6-be406befc106', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:00:43.251318 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:00:43.622483 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850843.6220303, 7acda56f-e16c-4371-99b3-21eeea2904d1 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:43.622712 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] VM Started (Lifecycle Event)
May 27 03:00:43.625046 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:00:43.632494 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:00:43.635246 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Instance spawned successfully.
May 27 03:00:43.636939 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:00:43.760214 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.563s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:43.760921 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:00:43.789025 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:00:43.807690 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:44.127264 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:44.128677 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:00:44.142719 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:44.143384 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:44.144373 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:44.144501 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:44.145131 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:44.145709 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:44.193562 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:44.195181 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:44.195350 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:44.195510 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No VIF found with MAC fa:16:3e:fc:b5:d4, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:00:44.202836 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:00:44.266004 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:00:44.266481 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:00:44.266937 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:44.267237 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:44.350198 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '092604511a8a467ba4ecb56261cb531f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c48d6919e8435f876f3324616521ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:00:44.631613 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:00:44.631873 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850844.6316795, 7acda56f-e16c-4371-99b3-21eeea2904d1 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:44.632058 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] VM Paused (Lifecycle Event)
May 27 03:00:44.653600 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Took 9.05 seconds to spawn the instance on the hypervisor.
May 27 03:00:44.653916 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:44.715777 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:44.715980 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:44.716137 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:44.716280 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:00:44.764966 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:44.766996 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:00:44.808838 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Found WWN 33000000005312720 for multipath device dm-5 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:00:44.809276 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:44.809582 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] <== connect_volume: return (5808ms) {'type': 'block', 'scsi_wwn': '33000000005312720', 'path': '/dev/dm-5', 'multipath_id': '33000000005312720'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:00:44.809752 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000005312720', 'path': '/dev/dm-5', 'multipath_id': '33000000005312720'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:00:44.813174 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lazy-loading 'flavor' on Instance uuid ebd2884b-67b5-40c1-8cf0-a22bd90be727 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:44.976303 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6248c052-6674-4ef8-8fa6-3eac6b642db9 req-acd1ebda-56dc-4977-b2d5-0275d5552a23 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received event network-vif-plugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:44.977081 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6248c052-6674-4ef8-8fa6-3eac6b642db9 req-acd1ebda-56dc-4977-b2d5-0275d5552a23 service nova] Acquiring lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:44.977261 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6248c052-6674-4ef8-8fa6-3eac6b642db9 req-acd1ebda-56dc-4977-b2d5-0275d5552a23 service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:44.977395 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6248c052-6674-4ef8-8fa6-3eac6b642db9 req-acd1ebda-56dc-4977-b2d5-0275d5552a23 service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:44.977531 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6248c052-6674-4ef8-8fa6-3eac6b642db9 req-acd1ebda-56dc-4977-b2d5-0275d5552a23 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] No waiting events found dispatching network-vif-plugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:00:44.977735 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-6248c052-6674-4ef8-8fa6-3eac6b642db9 req-acd1ebda-56dc-4977-b2d5-0275d5552a23 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received unexpected event network-vif-plugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 for instance with vm_state active and task_state None.
May 27 03:00:45.041879 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Successfully created port: 63e286dc-7977-40c8-b72b-fc4860de9e20 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:00:45.134630 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:45.139962 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850845.139633, 7acda56f-e16c-4371-99b3-21eeea2904d1 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:45.140134 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] VM Resumed (Lifecycle Event)
May 27 03:00:45.165547 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Took 19.95 seconds to build instance.
May 27 03:00:45.275201 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:00:45.316735 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Attempting to attach volume 32a71ff1-f2ac-4945-98d6-be406befc106 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:00:45.324856 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:00:45.324856 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:00:45.324856 np0000001475 nova-compute[98471]:   <alias name="ua-32a71ff1-f2ac-4945-98d6-be406befc106"/>
May 27 03:00:45.324856 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:00:45.324856 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:00:45.324856 np0000001475 nova-compute[98471]:   <serial>32a71ff1-f2ac-4945-98d6-be406befc106</serial>
May 27 03:00:45.324856 np0000001475 nova-compute[98471]: </disk>
May 27 03:00:45.324856 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:00:45.645958 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:45.654625 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:00:45.675294 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.467s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:45.705653 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Successfully updated port: 63e286dc-7977-40c8-b72b-fc4860de9e20 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:00:45.756588 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:00:45.760949 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:45.814766 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5e4afb7-e547-48db-8d7a-31bd0bd33e8a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.887s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:45.874620 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:45.875186 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:45.927248 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:45.989674 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:45.993852 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:46.083734 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:46.084696 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:46.192533 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:46.192626 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:00:46.197835 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:46.213713 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "refresh_cache-71af628e-b06d-446d-8c2e-dcfbb232df33" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:00:46.213927 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquired lock "refresh_cache-71af628e-b06d-446d-8c2e-dcfbb232df33" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:00:46.214297 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:00:46.285852 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:46.285852 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:46.300544 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:00:46.303118 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:00:46.303632 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Creating image(s)
May 27 03:00:46.305106 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "/opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:46.305433 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "/opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:46.306539 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "/opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:46.312088 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:46.318592 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:46.320098 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:46.392712 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:46.399935 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:00:46.402518 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:46.436908 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.116s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:46.437706 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:46.438901 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:46.439653 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:46.442768 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:46.444137 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:46.515944 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:46.515944 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:46.544056 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.100s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:46.545487 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:46.598428 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk 1073741824" returned: 0 in 0.052s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:46.599086 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.160s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:46.599537 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:46.634201 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:46.635314 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:00:46.641425 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:46.684688 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Rescuing
May 27 03:00:46.685100 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "refresh_cache-7acda56f-e16c-4371-99b3-21eeea2904d1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:00:46.685242 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquired lock "refresh_cache-7acda56f-e16c-4371-99b3-21eeea2904d1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:00:46.685526 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:00:46.719366 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.120s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:46.720253 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:00:46.720883 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:46.761062 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:46.762432 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:46.841539 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:46.842054 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Cannot resize image /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:00:46.842538 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:00:46.842767 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Ensure instance console log exists: /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:00:46.843068 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:46.843433 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:46.843873 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:46.872626 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:46.878662 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:00:46.885285 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:00:46.886850 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:46.930222 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:46.934930 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=12256MB free_disk=74.44011688232422GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:00:46.935129 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:46.935448 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:47.047052 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e67befdc-d57c-4bd6-8537-1e55388e8e9c req-1985044a-9e88-4982-93d8-83ab8110325f service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Received event network-changed-63e286dc-7977-40c8-b72b-fc4860de9e20 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:47.047860 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e67befdc-d57c-4bd6-8537-1e55388e8e9c req-1985044a-9e88-4982-93d8-83ab8110325f service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Refreshing instance network info cache due to event network-changed-63e286dc-7977-40c8-b72b-fc4860de9e20. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:00:47.048613 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e67befdc-d57c-4bd6-8537-1e55388e8e9c req-1985044a-9e88-4982-93d8-83ab8110325f service nova] Acquiring lock "refresh_cache-71af628e-b06d-446d-8c2e-dcfbb232df33" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:00:47.050452 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:47.050764 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:47.050903 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] No VIF found with MAC fa:16:3e:b8:34:46, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:00:47.155374 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:47.190510 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:47.362919 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Updating instance_info_cache with network_info: [{"id": "63e286dc-7977-40c8-b72b-fc4860de9e20", "address": "fa:16:3e:23:4b:54", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e286dc-79", "ovs_interfaceid": "63e286dc-7977-40c8-b72b-fc4860de9e20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:47.739286 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:47.867962 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Releasing lock "refresh_cache-71af628e-b06d-446d-8c2e-dcfbb232df33" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:00:47.867962 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Instance network_info: |[{"id": "63e286dc-7977-40c8-b72b-fc4860de9e20", "address": "fa:16:3e:23:4b:54", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e286dc-79", "ovs_interfaceid": "63e286dc-7977-40c8-b72b-fc4860de9e20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:00:47.869301 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e67befdc-d57c-4bd6-8537-1e55388e8e9c req-1985044a-9e88-4982-93d8-83ab8110325f service nova] Acquired lock "refresh_cache-71af628e-b06d-446d-8c2e-dcfbb232df33" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:00:47.869441 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-e67befdc-d57c-4bd6-8537-1e55388e8e9c req-1985044a-9e88-4982-93d8-83ab8110325f service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Refreshing network info cache for port 63e286dc-7977-40c8-b72b-fc4860de9e20 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:00:47.875868 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Start _get_guest_xml network_info=[{"id": "63e286dc-7977-40c8-b72b-fc4860de9e20", "address": "fa:16:3e:23:4b:54", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e286dc-79", "ovs_interfaceid": "63e286dc-7977-40c8-b72b-fc4860de9e20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:00:47.885900 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:00:47.887588 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='71af628e-b06d-446d-8c2e-dcfbb232df33'), owner=OwnerMeta(userid='092604511a8a467ba4ecb56261cb531f', username='tempest-AttachVolumeMultiAttachTest-774919822-project-member', projectid='a9c48d6919e8435f876f3324616521ea', projectname='tempest-AttachVolumeMultiAttachTest-774919822'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "63e286dc-7977-40c8-b72b-fc4860de9e20", "address": "fa:16:3e:23:4b:54", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e286dc-79", "ovs_interfaceid": "63e286dc-7977-40c8-b72b-fc4860de9e20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850847.88704) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:00:47.891226 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:00:47.893050 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:00:47.896021 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:00:47.896336 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:00:47.897568 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:00:47.898015 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:00:47.898580 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:00:47.898762 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:00:47.898856 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:00:47.898954 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:00:47.899170 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:00:47.899225 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:00:47.899320 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:00:47.899403 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:00:47.899532 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:00:47.899665 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:00:47.912462 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='multiattach-server-0',id=18,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7X60AtOl0SsfuAMV1LtNGpvh0yvi8THxioUm4x62ykVhuM7q4sXRNe3S5fa56OsOiAX0ZbtOowRZ4+AKeGhch21Oc/NUN3hQGbbFxrwclVqtJHRu4HOLbwt9JgM8J0mA==',key_name='tempest-keypair-1333870124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-bv0hcghc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:00:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092604511a8a467ba4ecb56261cb531f',uuid=71af628e-b06d-446d-8c2e-dcfbb232df33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63e286dc-7977-40c8-b72b-fc4860de9e20", "address": "fa:16:3e:23:4b:54", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e286dc-79", "ovs_interfaceid": "63e286dc-7977-40c8-b72b-fc4860de9e20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:00:47.912733 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "63e286dc-7977-40c8-b72b-fc4860de9e20", "address": "fa:16:3e:23:4b:54", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e286dc-79", "ovs_interfaceid": "63e286dc-7977-40c8-b72b-fc4860de9e20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:47.913493 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=63e286dc-7977-40c8-b72b-fc4860de9e20,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e286dc-79') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:47.914252 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'pci_devices' on Instance uuid 71af628e-b06d-446d-8c2e-dcfbb232df33 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:47.945165 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Updating instance_info_cache with network_info: [{"id": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "address": "fa:16:3e:7e:90:4a", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped993fcc-f7", "ovs_interfaceid": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:48.014025 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 8d762a67-82b6-40d3-b625-0731ea01c45b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:00:48.014025 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance ebd2884b-67b5-40c1-8cf0-a22bd90be727 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:00:48.014025 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 6ad1223d-d197-46e7-a32b-a25380d409a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:00:48.014025 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 9847a45d-ad45-4b2b-85eb-664604911991 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:00:48.014025 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance f33f8709-32f7-4ce3-9967-c54609dcbb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:00:48.014270 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance f5d36573-c0e7-43a0-a7cc-66678f093375 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:00:48.014270 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 7acda56f-e16c-4371-99b3-21eeea2904d1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:00:48.014338 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 71af628e-b06d-446d-8c2e-dcfbb232df33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:00:48.015071 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:00:48.015071 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:00:46 up 32 min,  2 users,  load average: 8.72, 5.63, 2.67\n', 'num_instances': '8', 'num_vm_active': '7', 'num_task_None': '6', 'num_os_type_None': '8', 'num_proj_233d191c03874150880aca259ffd3e21': '2', 'io_workload': '2', 'num_proj_997fc21542b04af2a2d9113d30f87b22': '1', 'num_proj_ab70ea24752242a88583e819c6c34e12': '2', 'num_proj_2a7ebe6073564995b0dd1bb85437f4d7': '1', 'num_proj_a9c48d6919e8435f876f3324616521ea': '2', 'num_task_rescuing': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:00:48.378446 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-e67befdc-d57c-4bd6-8537-1e55388e8e9c req-1985044a-9e88-4982-93d8-83ab8110325f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:48.417186 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] End _get_guest_xml xml=<domain type="qemu">
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:   <uuid>71af628e-b06d-446d-8c2e-dcfbb232df33</uuid>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:   <name>instance-00000012</name>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <nova:name>multiattach-server-0</nova:name>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:00:47</nova:creationTime>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:         <nova:user uuid="092604511a8a467ba4ecb56261cb531f">tempest-AttachVolumeMultiAttachTest-774919822-project-member</nova:user>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:         <nova:project uuid="a9c48d6919e8435f876f3324616521ea">tempest-AttachVolumeMultiAttachTest-774919822</nova:project>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:         <nova:port uuid="63e286dc-7977-40c8-b72b-fc4860de9e20">
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     <system>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <entry name="serial">71af628e-b06d-446d-8c2e-dcfbb232df33</entry>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <entry name="uuid">71af628e-b06d-446d-8c2e-dcfbb232df33</entry>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     </system>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:   <os>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:   </os>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:   <features>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:   </features>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:   <devices>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk.config"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:23:4b:54"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <target dev="tap63e286dc-79"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     </interface>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/console.log" append="off"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     </serial>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     <video>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     </video>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     </rng>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:   </devices>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]: </domain>
May 27 03:00:48.417186 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:00:48.419861 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Preparing to wait for external event network-vif-plugged-63e286dc-7977-40c8-b72b-fc4860de9e20 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:00:48.419861 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "71af628e-b06d-446d-8c2e-dcfbb232df33-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:48.419861 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:48.419861 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:48.419861 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='multiattach-server-0',id=18,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7X60AtOl0SsfuAMV1LtNGpvh0yvi8THxioUm4x62ykVhuM7q4sXRNe3S5fa56OsOiAX0ZbtOowRZ4+AKeGhch21Oc/NUN3hQGbbFxrwclVqtJHRu4HOLbwt9JgM8J0mA==',key_name='tempest-keypair-1333870124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-bv0hcghc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:00:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092604511a8a467ba4ecb56261cb531f',uuid=71af628e-b06d-446d-8c2e-dcfbb232df33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63e286dc-7977-40c8-b72b-fc4860de9e20", "address": "fa:16:3e:23:4b:54", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e286dc-79", "ovs_interfaceid": "63e286dc-7977-40c8-b72b-fc4860de9e20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:00:48.419861 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "63e286dc-7977-40c8-b72b-fc4860de9e20", "address": "fa:16:3e:23:4b:54", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e286dc-79", "ovs_interfaceid": "63e286dc-7977-40c8-b72b-fc4860de9e20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:48.419861 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=63e286dc-7977-40c8-b72b-fc4860de9e20,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e286dc-79') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:48.419861 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=63e286dc-7977-40c8-b72b-fc4860de9e20,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e286dc-79') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:00:48.425003 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:48.425582 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:48.425994 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:00:48.427633 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:48.427633 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76a17fd6-b921-52c7-a1fb-bdb25d459e81', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:48.429429 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:48.430588 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:48.434444 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:48.434682 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63e286dc-79, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:48.435071 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63e286dc-79, col_values=(('qos', UUID('655e1814-2e59-48b0-a122-1c481a386d56')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:48.435266 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63e286dc-79, col_values=(('external_ids', {'iface-id': '63e286dc-7977-40c8-b72b-fc4860de9e20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:4b:54', 'vm-uuid': '71af628e-b06d-446d-8c2e-dcfbb232df33'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:48.437609 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:48.439228 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:48.445584 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:48.446477 np0000001475 nova-compute[98471]: INFO os_vif [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=63e286dc-7977-40c8-b72b-fc4860de9e20,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e286dc-79')
May 27 03:00:48.449408 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Releasing lock "refresh_cache-7acda56f-e16c-4371-99b3-21eeea2904d1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:00:48.528139 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Rebuilding instance
May 27 03:00:48.624630 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:00:48.624922 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:00:48.639574 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-16c88def-fc25-44ae-9f71-10efcb7367b0 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.348s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:48.779657 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:48.796590 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-e67befdc-d57c-4bd6-8537-1e55388e8e9c req-1985044a-9e88-4982-93d8-83ab8110325f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:48.991498 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-e67befdc-d57c-4bd6-8537-1e55388e8e9c req-1985044a-9e88-4982-93d8-83ab8110325f service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Updated VIF entry in instance network info cache for port 63e286dc-7977-40c8-b72b-fc4860de9e20. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:00:48.993168 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-e67befdc-d57c-4bd6-8537-1e55388e8e9c req-1985044a-9e88-4982-93d8-83ab8110325f service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Updating instance_info_cache with network_info: [{"id": "63e286dc-7977-40c8-b72b-fc4860de9e20", "address": "fa:16:3e:23:4b:54", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e286dc-79", "ovs_interfaceid": "63e286dc-7977-40c8-b72b-fc4860de9e20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:49.127762 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:00:49.220327 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0003853700000036042 future=<Future at 0x755704745be0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:49.220501 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:49.221843 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Emitting event <LifecycleEvent: 1779850834.2198224, 60418cf4-cd7f-4256-ad92-cc8336802816 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:49.221962 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] VM Stopped (Lifecycle Event)
May 27 03:00:49.252963 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:49.495188 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e67befdc-d57c-4bd6-8537-1e55388e8e9c req-1985044a-9e88-4982-93d8-83ab8110325f service nova] Releasing lock "refresh_cache-71af628e-b06d-446d-8c2e-dcfbb232df33" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:00:49.636039 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:00:49.636208 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.701s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:49.636516 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 54.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:00:49.729301 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-feaa8e23-8cab-4e2d-b852-ece4f3357d4d tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 60418cf4-cd7f-4256-ad92-cc8336802816] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:49.824537 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:49.829904 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:49.859630 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:49.967436 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:49.967576 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:49.967696 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No VIF found with MAC fa:16:3e:23:4b:54, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:00:49.968173 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Using config drive
May 27 03:00:50.033637 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:50.045405 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:50.160667 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999647557999879 future=<Future at 0x755704604ad0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:50.161303 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99912273599989 future=<Future at 0x755704604ad0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:50.161630 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.998662384 future=<Future at 0x755704604ad0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:50.165582 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Instance destroyed successfully.
May 27 03:00:50.195872 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:50.201665 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:50.221963 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:50.277919 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Detaching volume 0301a508-e6af-4ae2-b6af-9a5abf80f200
May 27 03:00:50.337818 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Attempting to driver detach volume 0301a508-e6af-4ae2-b6af-9a5abf80f200 from mountpoint /dev/vdb
May 27 03:00:50.346026 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Found disk vdb by alias ua-0301a508-e6af-4ae2-b6af-9a5abf80f200 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:00:50.346191 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Attempting to detach device vdb from instance 6ad1223d-d197-46e7-a32b-a25380d409a8 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:00:50.346512 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:00:50.346512 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:00:50.346512 np0000001475 nova-compute[98471]:   <alias name="ua-0301a508-e6af-4ae2-b6af-9a5abf80f200"/>
May 27 03:00:50.346512 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-4"/>
May 27 03:00:50.346512 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:00:50.346512 np0000001475 nova-compute[98471]:   <serial>0301a508-e6af-4ae2-b6af-9a5abf80f200</serial>
May 27 03:00:50.346512 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:00:50.346512 np0000001475 nova-compute[98471]: </disk>
May 27 03:00:50.346512 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:00:50.360146 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Successfully detached device vdb from instance 6ad1223d-d197-46e7-a32b-a25380d409a8 from the persistent domain config.
May 27 03:00:50.364194 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:00:50.364604 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0301a508-e6af-4ae2-b6af-9a5abf80f200', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:00:50.364779 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:50.365237 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:50.365613 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0301a508-e6af-4ae2-b6af-9a5abf80f200', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:00:50.365817 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:00:50.377727 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:50.393303 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:50.400574 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:50.400574 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:50.400574 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:50.400574 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:50.400574 np0000001475 nova-compute[98471]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:50.400574 np0000001475 nova-compute[98471]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:50.400574 np0000001475 nova-compute[98471]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106 (non-flash)
May 27 03:00:50.400574 np0000001475 nova-compute[98471]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106 (non-flash)
May 27 03:00:50.400574 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:50.400839 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:50.400839 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:50.400839 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:50.400839 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:50.400839 np0000001475 nova-compute[98471]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:50.400839 np0000001475 nova-compute[98471]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:50.400839 np0000001475 nova-compute[98471]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106 (non-flash)
May 27 03:00:50.400839 np0000001475 nova-compute[98471]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106 (non-flash)
May 27 03:00:50.400839 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:50.400985 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106', '44')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:00:50.401098 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', '41')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:00:50.402387 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', '42')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:00:50.403464 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75570462ee80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200'): ({'sdg'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:00:50.403694 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Removing multipathed devices sdf, sdg {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:00:50.403991 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Flush multipath device 330000000d581dd7b {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:00:50.433962 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:00:50.476917 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:50.491450 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:00:50.507887 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999492089000114 future=<Future at 0x75572c282030 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:00:50.517709 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Instance destroyed successfully.
May 27 03:00:50.518509 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'numa_topology' on Instance uuid 7acda56f-e16c-4371-99b3-21eeea2904d1 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:50.536678 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:00:50.537795 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:00:50.540445 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:00:50.557730 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:00:50.558081 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:00:50.574512 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:50.619072 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, portal: 192.168.40.100,3260]
May 27 03:00:50.619072 np0000001475 nova-compute[98471]: Logout of [sid: 41, target: iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, portal: 192.168.40.100,3260] successful.
May 27 03:00:50.619072 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:50.638314 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:50.652129 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:50.691065 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, portal: 192.168.50.100,3260]
May 27 03:00:50.691065 np0000001475 nova-compute[98471]: Logout of [sid: 42, target: iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, portal: 192.168.50.100,3260] successful.
May 27 03:00:50.691065 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:50.714770 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:50.714770 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:50.714770 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] <== disconnect_volume: return (347ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:00:50.714770 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:00:50.789991 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-22061190-841d-4977-8908-3df43cff7f33 req-301475c3-f1bc-454f-a032-712d9f630566 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Received event network-vif-unplugged-28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:50.793207 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-22061190-841d-4977-8908-3df43cff7f33 req-301475c3-f1bc-454f-a032-712d9f630566 service nova] Acquiring lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:50.793462 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-22061190-841d-4977-8908-3df43cff7f33 req-301475c3-f1bc-454f-a032-712d9f630566 service nova] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:50.793539 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-22061190-841d-4977-8908-3df43cff7f33 req-301475c3-f1bc-454f-a032-712d9f630566 service nova] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:50.794163 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-22061190-841d-4977-8908-3df43cff7f33 req-301475c3-f1bc-454f-a032-712d9f630566 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] No waiting events found dispatching network-vif-unplugged-28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:00:50.794269 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-22061190-841d-4977-8908-3df43cff7f33 req-301475c3-f1bc-454f-a032-712d9f630566 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Received unexpected event network-vif-unplugged-28ae6612-6474-4d47-8296-02394b0dabe5 for instance with vm_state active and task_state rebuilding.
May 27 03:00:50.912084 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Creating config drive at /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk.config
May 27 03:00:50.920933 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwkzgm2yf {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:50.936258 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:50.979723 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwkzgm2yf" returned: 0 in 0.057s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:51.031194 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Attempting a stable device rescue
May 27 03:00:51.114703 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:51.114703 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:51.163949 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98471) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 27 03:00:51.173652 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Instance directory exists: not creating {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 03:00:51.173652 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Creating image(s)
May 27 03:00:51.173652 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "/opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:51.173652 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "/opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:51.173652 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "/opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:51.174246 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7acda56f-e16c-4371-99b3-21eeea2904d1 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:51.525178 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:51.567987 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:51.615880 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Detaching volume 32a71ff1-f2ac-4945-98d6-be406befc106
May 27 03:00:51.655948 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:51.676688 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Object Instance<7acda56f-e16c-4371-99b3-21eeea2904d1> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:00:51.680579 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "4d904bfe5d280525b3b38a20bbac8d23171a808c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:51.680903 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "4d904bfe5d280525b3b38a20bbac8d23171a808c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:51.699558 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Attempting to driver detach volume 32a71ff1-f2ac-4945-98d6-be406befc106 from mountpoint /dev/vdb
May 27 03:00:51.719623 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Found disk vdb by alias ua-32a71ff1-f2ac-4945-98d6-be406befc106 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:00:51.721124 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Found disk vdb by alias ua-32a71ff1-f2ac-4945-98d6-be406befc106 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:00:51.721275 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Attempting to detach device vdb from instance ebd2884b-67b5-40c1-8cf0-a22bd90be727 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:00:51.721643 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:00:51.721643 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:00:51.721643 np0000001475 nova-compute[98471]:   <alias name="ua-32a71ff1-f2ac-4945-98d6-be406befc106"/>
May 27 03:00:51.721643 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:00:51.721643 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:00:51.721643 np0000001475 nova-compute[98471]:   <serial>32a71ff1-f2ac-4945-98d6-be406befc106</serial>
May 27 03:00:51.721643 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 27 03:00:51.721643 np0000001475 nova-compute[98471]: </disk>
May 27 03:00:51.721643 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:00:51.728041 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:51.731390 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Successfully detached device vdb from instance ebd2884b-67b5-40c1-8cf0-a22bd90be727 from the persistent domain config.
May 27 03:00:51.731552 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] (1/8): Attempting to detach device vdb with device alias ua-32a71ff1-f2ac-4945-98d6-be406befc106 from instance ebd2884b-67b5-40c1-8cf0-a22bd90be727 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:00:51.732466 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:00:51.732466 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:00:51.732466 np0000001475 nova-compute[98471]:   <alias name="ua-32a71ff1-f2ac-4945-98d6-be406befc106"/>
May 27 03:00:51.732466 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:00:51.732466 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:00:51.732466 np0000001475 nova-compute[98471]:   <serial>32a71ff1-f2ac-4945-98d6-be406befc106</serial>
May 27 03:00:51.732466 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 27 03:00:51.732466 np0000001475 nova-compute[98471]: </disk>
May 27 03:00:51.732466 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:00:51.743225 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:51.806363 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Instance destroyed successfully.
May 27 03:00:51.808533 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-875613762',display_name='tempest-ServerActionsTestOtherA-server-1000576881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-tempest-common-compute-instance-875613762',id=13,image_ref='48155fdd-4ef0-4719-a052-7861f417b7f0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhbCOMX0cDx/uCjoD1pQ3iMb/yxZcupQyHf7uuxnrf7EdI6EEP6StEltLO6whpKYwhmElUFdPkkHXCp77KUbxPxYkUhhTpx6/EQ206sxZO2JeMp5jzBChiUJOOt29J78w==',key_name='tempest-keypair-1019067704',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:59:55Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='233d191c03874150880aca259ffd3e21',ramdisk_id='',reservation_id='r-gfwl4dxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='48155fdd-4ef0-4719-a052-7861f417b7f0',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-569974590',owner_user_name='tempest-ServerActionsTestOtherA-569974590-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a93dfe76ab455d8aa6e691b1fa34c5',uuid=6ad1223d-d197-46e7-a32b-a25380d409a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28ae6612-6474-4d47-8296-02394b0dabe5", "address": "fa:16:3e:fc:b5:d4", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ae6612-64", "ovs_interfaceid": "28ae6612-6474-4d47-8296-02394b0dabe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:00:51.810813 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converting VIF {"id": "28ae6612-6474-4d47-8296-02394b0dabe5", "address": "fa:16:3e:fc:b5:d4", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ae6612-64", "ovs_interfaceid": "28ae6612-6474-4d47-8296-02394b0dabe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:51.810813 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=28ae6612-6474-4d47-8296-02394b0dabe5,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ae6612-64') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:51.810813 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=28ae6612-6474-4d47-8296-02394b0dabe5,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ae6612-64') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:00:51.812659 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:51.813627 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28ae6612-64, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:51.818566 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:51.818566 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:51.822803 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:51.824558 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:51.824558 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=515c13ea-0a08-428c-be3e-0f1c4aa142cc) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:51.825951 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:51.825951 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:51.833007 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:51.835032 np0000001475 nova-compute[98471]: INFO os_vif [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=28ae6612-6474-4d47-8296-02394b0dabe5,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ae6612-64')
May 27 03:00:51.838278 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:00:51.838278 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0301a508-e6af-4ae2-b6af-9a5abf80f200', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:00:51.838278 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:51.838278 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:51.838278 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0301a508-e6af-4ae2-b6af-9a5abf80f200', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:00:51.838278 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:00:51.883821 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:51.883821 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:51.883821 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:51.883821 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:51.883821 np0000001475 nova-compute[98471]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106 (non-flash)
May 27 03:00:51.883821 np0000001475 nova-compute[98471]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106 (non-flash)
May 27 03:00:51.883821 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:51.883821 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:51.883821 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:51.883821 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:51.883821 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:51.883821 np0000001475 nova-compute[98471]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106 (non-flash)
May 27 03:00:51.883821 np0000001475 nova-compute[98471]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106 (non-flash)
May 27 03:00:51.883821 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:51.883821 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106', '44')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:00:51.884485 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, 0): [] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:00:51.884485 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200') {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 03:00:51.884485 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, 0): [] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:00:51.884485 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200') {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 03:00:51.884485 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572472fd80>, {}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:00:51.884654 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Disconnecting from: [] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:00:51.886312 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.047s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:51.886312 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] <== disconnect_volume: return (47ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:00:51.886312 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:00:51.886312 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Deleting instance files /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8_del
May 27 03:00:51.886920 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Deletion of /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8_del complete
May 27 03:00:52.465910 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d74ef75f-585c-46d0-a8ec-2e9c42139573 req-6377c87d-26cc-4f9c-8aa2-8ef484d32879 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received event network-vif-unplugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:52.465910 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d74ef75f-585c-46d0-a8ec-2e9c42139573 req-6377c87d-26cc-4f9c-8aa2-8ef484d32879 service nova] Acquiring lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:52.465910 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d74ef75f-585c-46d0-a8ec-2e9c42139573 req-6377c87d-26cc-4f9c-8aa2-8ef484d32879 service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:52.466513 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d74ef75f-585c-46d0-a8ec-2e9c42139573 req-6377c87d-26cc-4f9c-8aa2-8ef484d32879 service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:52.466912 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d74ef75f-585c-46d0-a8ec-2e9c42139573 req-6377c87d-26cc-4f9c-8aa2-8ef484d32879 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] No waiting events found dispatching network-vif-unplugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:00:52.468299 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-d74ef75f-585c-46d0-a8ec-2e9c42139573 req-6377c87d-26cc-4f9c-8aa2-8ef484d32879 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received unexpected event network-vif-unplugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 for instance with vm_state active and task_state rescuing.
May 27 03:00:52.482419 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779850852.4816566, ebd2884b-67b5-40c1-8cf0-a22bd90be727 => ua-32a71ff1-f2ac-4945-98d6-be406befc106> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:00:52.488075 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-32a71ff1-f2ac-4945-98d6-be406befc106 for instance ebd2884b-67b5-40c1-8cf0-a22bd90be727 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:00:52.497484 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Successfully detached device vdb from instance ebd2884b-67b5-40c1-8cf0-a22bd90be727 from the live domain config.
May 27 03:00:52.505406 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:00:52.506687 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106', 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '32a71ff1-f2ac-4945-98d6-be406befc106', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:00:52.507451 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:52.507836 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:52.508222 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106', 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '32a71ff1-f2ac-4945-98d6-be406befc106', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:00:52.508322 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:00:52.558755 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:52.558755 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:52.558755 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:52.558755 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:52.558755 np0000001475 nova-compute[98471]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106 (non-flash)
May 27 03:00:52.558755 np0000001475 nova-compute[98471]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106 (non-flash)
May 27 03:00:52.558755 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:52.559109 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:52.559109 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:52.559109 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:52.559109 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:52.559109 np0000001475 nova-compute[98471]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106 (non-flash)
May 27 03:00:52.559109 np0000001475 nova-compute[98471]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106 (non-flash)
May 27 03:00:52.559109 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:52.559317 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106', '44')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:00:52.559442 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106', '44')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:00:52.560577 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106', '43')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:00:52.561733 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75570462d440>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106'): ({'sdh'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:00:52.561733 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Removing multipathed devices sdi, sdh {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:00:52.573930 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Flush multipath device 33000000005312720 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:00:52.610792 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:00:52.664839 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:52.670607 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:52.675907 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d904bfe5d280525b3b38a20bbac8d23171a808c.part --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:52.675907 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:00:52.721064 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:52.748405 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:00:52.748708 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:00:52.750248 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:00:52.766706 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:00:52.766706 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:00:52.783427 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:52.817402 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d904bfe5d280525b3b38a20bbac8d23171a808c.part --force-share --output=json" returned: 0 in 0.144s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:52.819023 np0000001475 nova-compute[98471]: DEBUG nova.virt.images [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] ebcec9d0-cea4-4440-ac41-24c3abd85590 was qcow2, converting to raw {{(pid=98471) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 03:00:52.819956 np0000001475 nova-compute[98471]: DEBUG nova.privsep.utils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98471) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 03:00:52.820597 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d904bfe5d280525b3b38a20bbac8d23171a808c.part /opt/stack/data/nova/instances/_base/4d904bfe5d280525b3b38a20bbac8d23171a808c.converted {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:52.840232 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106, portal: 192.168.40.100,3260]
May 27 03:00:52.840232 np0000001475 nova-compute[98471]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106, portal: 192.168.40.100,3260] successful.
May 27 03:00:52.840232 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:52.852562 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850852.8505414, 71af628e-b06d-446d-8c2e-dcfbb232df33 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:52.852562 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] VM Started (Lifecycle Event)
May 27 03:00:52.860532 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:52.876116 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:52.912721 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106, portal: 192.168.50.100,3260]
May 27 03:00:52.912721 np0000001475 nova-compute[98471]: Logout of [sid: 43, target: iqn.2023-03.storpool.com:os--volume-32a71ff1-f2ac-4945-98d6-be406befc106, portal: 192.168.50.100,3260] successful.
May 27 03:00:52.912721 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:52.930248 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e6114c24-d6c5-40f2-a1a1-4c1f111d3b95 req-46924ecc-c947-4557-adc5-bd5fa9bb7e1a service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Received event network-vif-unplugged-28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:52.935836 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Booting with volume 0301a508-e6af-4ae2-b6af-9a5abf80f200 at /dev/vdb
May 27 03:00:52.939030 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e6114c24-d6c5-40f2-a1a1-4c1f111d3b95 req-46924ecc-c947-4557-adc5-bd5fa9bb7e1a service nova] Acquiring lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:52.939971 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:52.940785 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d904bfe5d280525b3b38a20bbac8d23171a808c.part /opt/stack/data/nova/instances/_base/4d904bfe5d280525b3b38a20bbac8d23171a808c.converted" returned: 0 in 0.119s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:52.941240 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e6114c24-d6c5-40f2-a1a1-4c1f111d3b95 req-46924ecc-c947-4557-adc5-bd5fa9bb7e1a service nova] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:52.941689 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e6114c24-d6c5-40f2-a1a1-4c1f111d3b95 req-46924ecc-c947-4557-adc5-bd5fa9bb7e1a service nova] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:52.941689 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e6114c24-d6c5-40f2-a1a1-4c1f111d3b95 req-46924ecc-c947-4557-adc5-bd5fa9bb7e1a service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] No waiting events found dispatching network-vif-unplugged-28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:00:52.941884 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-e6114c24-d6c5-40f2-a1a1-4c1f111d3b95 req-46924ecc-c947-4557-adc5-bd5fa9bb7e1a service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Received unexpected event network-vif-unplugged-28ae6612-6474-4d47-8296-02394b0dabe5 for instance with vm_state active and task_state rebuild_block_device_mapping.
May 27 03:00:52.942995 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.433s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:52.943778 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e6114c24-d6c5-40f2-a1a1-4c1f111d3b95 req-46924ecc-c947-4557-adc5-bd5fa9bb7e1a service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Received event network-vif-plugged-63e286dc-7977-40c8-b72b-fc4860de9e20 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:52.943947 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e6114c24-d6c5-40f2-a1a1-4c1f111d3b95 req-46924ecc-c947-4557-adc5-bd5fa9bb7e1a service nova] Acquiring lock "71af628e-b06d-446d-8c2e-dcfbb232df33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:52.944584 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e6114c24-d6c5-40f2-a1a1-4c1f111d3b95 req-46924ecc-c947-4557-adc5-bd5fa9bb7e1a service nova] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:52.944584 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e6114c24-d6c5-40f2-a1a1-4c1f111d3b95 req-46924ecc-c947-4557-adc5-bd5fa9bb7e1a service nova] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:52.944584 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e6114c24-d6c5-40f2-a1a1-4c1f111d3b95 req-46924ecc-c947-4557-adc5-bd5fa9bb7e1a service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Processing event network-vif-plugged-63e286dc-7977-40c8-b72b-fc4860de9e20 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:00:52.944761 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e6114c24-d6c5-40f2-a1a1-4c1f111d3b95 req-46924ecc-c947-4557-adc5-bd5fa9bb7e1a service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Received event network-vif-plugged-63e286dc-7977-40c8-b72b-fc4860de9e20 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:52.944915 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e6114c24-d6c5-40f2-a1a1-4c1f111d3b95 req-46924ecc-c947-4557-adc5-bd5fa9bb7e1a service nova] Acquiring lock "71af628e-b06d-446d-8c2e-dcfbb232df33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:52.945043 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e6114c24-d6c5-40f2-a1a1-4c1f111d3b95 req-46924ecc-c947-4557-adc5-bd5fa9bb7e1a service nova] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:52.945159 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e6114c24-d6c5-40f2-a1a1-4c1f111d3b95 req-46924ecc-c947-4557-adc5-bd5fa9bb7e1a service nova] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:52.945266 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e6114c24-d6c5-40f2-a1a1-4c1f111d3b95 req-46924ecc-c947-4557-adc5-bd5fa9bb7e1a service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] No waiting events found dispatching network-vif-plugged-63e286dc-7977-40c8-b72b-fc4860de9e20 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:00:52.945389 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-e6114c24-d6c5-40f2-a1a1-4c1f111d3b95 req-46924ecc-c947-4557-adc5-bd5fa9bb7e1a service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Received unexpected event network-vif-plugged-63e286dc-7977-40c8-b72b-fc4860de9e20 for instance with vm_state building and task_state spawning.
May 27 03:00:52.946509 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:00:52.946753 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] <== disconnect_volume: return (435ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:00:52.947187 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:00:52.951182 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:00:52.953161 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d904bfe5d280525b3b38a20bbac8d23171a808c.converted --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:52.984999 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Instance spawned successfully.
May 27 03:00:52.987057 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:00:53.039812 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:00:53.042933 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d904bfe5d280525b3b38a20bbac8d23171a808c.converted --force-share --output=json" returned: 0 in 0.090s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:53.043756 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "4d904bfe5d280525b3b38a20bbac8d23171a808c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.363s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:53.046248 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:53.049910 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:53.052397 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "4d904bfe5d280525b3b38a20bbac8d23171a808c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:53.053417 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "4d904bfe5d280525b3b38a20bbac8d23171a808c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:53.053798 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:53.058486 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:53.058905 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d904bfe5d280525b3b38a20bbac8d23171a808c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:53.059725 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:00:53.098594 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:53.143779 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:00:53.144175 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:00:53.161789 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:00:53.163104 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b', 'fe80::fc16:3eff:feb8:3446', 'fe80::48f3:78ff:fe0a:4de1', 'fe80::fc16:3eff:fe1f:5a7', 'fe80::a095:90ff:feef:1465', 'fe80::fc16:3eff:feaf:c052', 'fe80::20bf:faff:fe0c:5acd', 'fe80::fc16:3eff:fed8:d624', 'fe80::30d2:55ff:fe35:f968', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54'] 
May 27 03:00:53.163279 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:00:53.163466 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:00:53.163724 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:00:53.163922 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Updating existing volume attachment record: 34dd7018-6e19-4f23-9db0-4297f8f216e2 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:00:53.172302 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d904bfe5d280525b3b38a20bbac8d23171a808c --force-share --output=json" returned: 0 in 0.113s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:53.173109 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d904bfe5d280525b3b38a20bbac8d23171a808c,backing_fmt=raw /opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/disk.rescue {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:53.194790 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:53.252756 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d904bfe5d280525b3b38a20bbac8d23171a808c,backing_fmt=raw /opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/disk.rescue" returned: 0 in 0.080s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:53.254827 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "4d904bfe5d280525b3b38a20bbac8d23171a808c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:53.255982 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'migration_context' on Instance uuid 7acda56f-e16c-4371-99b3-21eeea2904d1 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:53.361120 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:53.366821 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:00:53.506533 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:53.506533 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:53.506533 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:53.506533 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:53.506533 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:53.506533 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:00:53.562979 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lazy-loading 'flavor' on Instance uuid ebd2884b-67b5-40c1-8cf0-a22bd90be727 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:53.759490 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Object Instance<7acda56f-e16c-4371-99b3-21eeea2904d1> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:00:53.766276 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:00:53.766987 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Start _get_guest_xml network_info=[{"id": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "address": "fa:16:3e:7e:90:4a", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "vif_mac": "fa:16:3e:7e:90:4a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped993fcc-f7", "ovs_interfaceid": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ebcec9d0-cea4-4440-ac41-24c3abd85590', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': '7acda56f-e16c-4371-99b3-21eeea2904d1', 'attached_at': '', 'detached_at': '', 'volume_id': '6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'serial': '6a1921ec-dd47-422c-af8e-b1cbf29ad186'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'a5bb1b5a-6511-44d0-bc32-4aa332ab6c56', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:00:53.769707 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'resources' on Instance uuid 7acda56f-e16c-4371-99b3-21eeea2904d1 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:53.874306 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:00:53.874306 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850853.8726687, 71af628e-b06d-446d-8c2e-dcfbb232df33 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:53.874306 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] VM Paused (Lifecycle Event)
May 27 03:00:54.009844 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Took 7.71 seconds to spawn the instance on the hypervisor.
May 27 03:00:54.010915 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:54.276770 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Object Instance<7acda56f-e16c-4371-99b3-21eeea2904d1> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:00:54.282503 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:00:54.284268 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-125761252', uuid='7acda56f-e16c-4371-99b3-21eeea2904d1'), owner=OwnerMeta(userid='787c8d4d4527402cbbc2ad0475f710bb', username='tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member', projectid='ab70ea24752242a88583e819c6c34e12', projectname='tempest-ServerBootFromVolumeStableRescueTest-1976367979'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "address": "fa:16:3e:7e:90:4a", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "vif_mac": "fa:16:3e:7e:90:4a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped993fcc-f7", "ovs_interfaceid": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850854.2837932) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:00:54.289649 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:00:54.289649 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:00:54.294219 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:00:54.294480 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:00:54.295487 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:00:54.295843 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:00:54.296034 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:00:54.296128 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:00:54.296256 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:00:54.296365 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:00:54.296453 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:00:54.296643 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:00:54.299841 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:00:54.300155 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:00:54.300414 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:00:54.300510 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:00:54.300701 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7acda56f-e16c-4371-99b3-21eeea2904d1 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:54.376602 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:54.380371 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850854.3790145, 71af628e-b06d-446d-8c2e-dcfbb232df33 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:00:54.380371 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] VM Resumed (Lifecycle Event)
May 27 03:00:54.394562 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "interface-ebd2884b-67b5-40c1-8cf0-a22bd90be727-b23e23e6-8bc3-4655-adc9-0038a2341ab3" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:54.394562 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "interface-ebd2884b-67b5-40c1-8cf0-a22bd90be727-b23e23e6-8bc3-4655-adc9-0038a2341ab3" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:54.526038 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Took 13.38 seconds to build instance.
May 27 03:00:54.543127 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-489346af-feda-4fb6-ab72-1092920b5604 req-26670f25-8bfa-4428-bdcf-f07f3399269a service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received event network-vif-unplugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:54.543401 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-489346af-feda-4fb6-ab72-1092920b5604 req-26670f25-8bfa-4428-bdcf-f07f3399269a service nova] Acquiring lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:54.544275 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-489346af-feda-4fb6-ab72-1092920b5604 req-26670f25-8bfa-4428-bdcf-f07f3399269a service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:54.544467 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-489346af-feda-4fb6-ab72-1092920b5604 req-26670f25-8bfa-4428-bdcf-f07f3399269a service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:54.544784 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-489346af-feda-4fb6-ab72-1092920b5604 req-26670f25-8bfa-4428-bdcf-f07f3399269a service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] No waiting events found dispatching network-vif-unplugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:00:54.544835 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-489346af-feda-4fb6-ab72-1092920b5604 req-26670f25-8bfa-4428-bdcf-f07f3399269a service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received unexpected event network-vif-unplugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 for instance with vm_state active and task_state rescuing.
May 27 03:00:54.803758 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Object Instance<7acda56f-e16c-4371-99b3-21eeea2904d1> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:00:54.815889 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/disk.config --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:54.884927 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:00:54.889857 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:00:54.906766 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lazy-loading 'flavor' on Instance uuid ebd2884b-67b5-40c1-8cf0-a22bd90be727 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:54.924776 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/disk.config --force-share --output=json" returned: 0 in 0.109s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:54.925437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "/opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:54.925717 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "/opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:54.926388 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "/opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:54.926779 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:00:54.928191 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:00:54.928433 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:54.928863 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:54.929106 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:00:54.946827 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:54.947479 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:54.948786 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:54.949036 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:00:54.949816 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:54.950291 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.startup = automatic
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.scan = manual
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:00:54.966493 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:00:54.966493 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.startup = automatic
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.scan = manual
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:00:54.969036 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:00:54.969036 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:54.981478 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:54.989872 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:54.998558 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:54.998558 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:54.998558 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:54.998558 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:54.998558 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:54.999373 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:54.999373 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:54.999373 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:54.999373 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:54.999373 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:54.999956 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.051s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:54.999956 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:00:55.000574 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] HCTL ('7', '0', '0', 0) found on session 39 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:00:55.000795 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:00:55.009351 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:55.009351 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:55.009351 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:55.009351 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:55.009351 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:55.009351 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:55.009351 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:55.009351 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:55.009351 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:55.009351 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:55.009351 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.058s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:55.009351 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:00:55.009351 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] HCTL ('8', '0', '0', 0) found on session 40 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:00:55.009351 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:00:55.016676 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Searching for a device in session 39 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:00:55.016676 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:00:55.019587 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Searching for a device in session 40 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:00:55.019647 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:00:55.027951 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed9cbc95-4969-4211-a6be-d745753ec147 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.895s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:55.093290 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-97b1e109-9586-426e-a1bf-1203d14286ea tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.981s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:55.225590 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Acquiring lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:55.225590 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:55.337137 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:00:55.337468 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Creating image(s)
May 27 03:00:55.338760 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:55.338961 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "/opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:55.339497 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "/opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:55.339861 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "9690e7daa5f59004f4b2fa234427455be67ab69b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:55.340171 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "9690e7daa5f59004f4b2fa234427455be67ab69b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:55.412007 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1481412241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-1481412241',id=12,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX3hrfXJylogloNcsVODyT6YV7aMSshELm9OJiUcOjH996gMpO5+kFiAKQhQX7ZkAoqoXhzYZQLrM0rlP3d/NY+cv+dBD4+nzGVXWnWfuAvNWMegazBzNSt2XeuVXBmtQ==',key_name='tempest-keypair-1422957137',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:59:46Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='997fc21542b04af2a2d9113d30f87b22',ramdisk_id='',reservation_id='r-b9zanhfv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1282046058',owner_user_name='tempest-TaggedAttachmentsTest-1282046058-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:59:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff4b501bdb27488490da6b1032106687',uuid=ebd2884b-67b5-40c1-8cf0-a22bd90be727,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "address": "fa:16:3e:d8:d6:24", "network": {"id": "135d20cc-9a53-4eed-9b52-1e13a89fc18e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2095472683", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e23e6-8b", "ovs_interfaceid": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:00:55.412285 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Converting VIF {"id": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "address": "fa:16:3e:d8:d6:24", "network": {"id": "135d20cc-9a53-4eed-9b52-1e13a89fc18e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2095472683", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e23e6-8b", "ovs_interfaceid": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:55.414999 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:d6:24,bridge_name='br-int',has_traffic_filtering=True,id=b23e23e6-8bc3-4655-adc9-0038a2341ab3,network=Network(135d20cc-9a53-4eed-9b52-1e13a89fc18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23e23e6-8b') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:55.417915 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "4e583b08-e323-4681-9e95-01767f510590" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:55.419228 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "4e583b08-e323-4681-9e95-01767f510590" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:55.420392 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:d6:24"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapb23e23e6-8b"/></interface> {{(pid=98471) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 27 03:00:55.423617 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:d6:24"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapb23e23e6-8b"/></interface> {{(pid=98471) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 27 03:00:55.425050 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Attempting to detach device tapb23e23e6-8b from instance ebd2884b-67b5-40c1-8cf0-a22bd90be727 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:00:55.425343 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] detach device xml: <interface type="ethernet">
May 27 03:00:55.425343 np0000001475 nova-compute[98471]:   <mac address="fa:16:3e:d8:d6:24"/>
May 27 03:00:55.425343 np0000001475 nova-compute[98471]:   <model type="virtio"/>
May 27 03:00:55.425343 np0000001475 nova-compute[98471]:   <driver name="qemu"/>
May 27 03:00:55.425343 np0000001475 nova-compute[98471]:   <mtu size="1372"/>
May 27 03:00:55.425343 np0000001475 nova-compute[98471]:   <target dev="tapb23e23e6-8b"/>
May 27 03:00:55.425343 np0000001475 nova-compute[98471]: </interface>
May 27 03:00:55.425343 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:00:55.433041 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:d6:24"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapb23e23e6-8b"/></interface> {{(pid=98471) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 27 03:00:55.435066 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d8:d6:24"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapb23e23e6-8b"/></interface>not found in domain: <domain type='qemu' id='13'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <name>instance-0000000c</name>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <uuid>ebd2884b-67b5-40c1-8cf0-a22bd90be727</uuid>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <nova:package version="33.1.0"/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <nova:name>tempest-device-tagging-server-1481412241</nova:name>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <nova:creationTime>2026-05-27 03:00:34</nova:creationTime>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <nova:flavor name="m1.nano" id="42">
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <nova:memory>192</nova:memory>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <nova:disk>1</nova:disk>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <nova:swap>0</nova:swap>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <nova:ephemeral>0</nova:ephemeral>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <nova:vcpus>1</nova:vcpus>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <nova:extraSpecs>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </nova:extraSpecs>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   </nova:flavor>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <nova:containerFormat>bare</nova:containerFormat>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <nova:minDisk>1</nova:minDisk>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <nova:minRam>0</nova:minRam>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <nova:properties>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </nova:properties>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   </nova:image>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <nova:owner>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <nova:user uuid="ff4b501bdb27488490da6b1032106687">tempest-TaggedAttachmentsTest-1282046058-project-member</nova:user>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <nova:project uuid="997fc21542b04af2a2d9113d30f87b22">tempest-TaggedAttachmentsTest-1282046058</nova:project>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   </nova:owner>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <nova:ports>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <nova:port uuid="6cfc1d4d-e055-4ba7-a926-19911b813fe0">
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </nova:port>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <nova:port uuid="b23e23e6-8bc3-4655-adc9-0038a2341ab3">
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <nova:ip type="fixed" address="10.10.10.229" ipVersion="4"/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </nova:port>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   </nova:ports>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]: </nova:instance>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <memory unit='KiB'>196608</memory>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <currentMemory unit='KiB'>196608</currentMemory>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <vcpu placement='static'>1</vcpu>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <resource>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <partition>/machine</partition>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   </resource>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <sysinfo type='smbios'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <system>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <entry name='product'>OpenStack Nova</entry>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <entry name='version'>33.1.0</entry>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <entry name='serial'>ebd2884b-67b5-40c1-8cf0-a22bd90be727</entry>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <entry name='uuid'>ebd2884b-67b5-40c1-8cf0-a22bd90be727</entry>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <entry name='family'>Virtual Machine</entry>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </system>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <os>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <boot dev='hd'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <smbios mode='sysinfo'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   </os>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <features>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <vmcoreinfo state='on'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <tb-cache unit='KiB'>131072</tb-cache>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   </features>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <cpu mode='custom' match='exact' check='full'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <model fallback='forbid'>Nehalem</model>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <feature policy='require' name='hypervisor'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <clock offset='utc'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <on_poweroff>destroy</on_poweroff>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <on_reboot>restart</on_reboot>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <on_crash>destroy</on_crash>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <devices>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <disk type='file' device='disk'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <driver name='qemu' type='qcow2' cache='none'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <source file='/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk' index='2'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <backingStore type='file' index='3'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:         <format type='raw'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:         <source file='/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:         <backingStore/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       </backingStore>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <target dev='vda' bus='virtio'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <alias name='virtio-disk0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <disk type='file' device='cdrom'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <driver name='qemu' type='raw' cache='none'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <source file='/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk.config' index='1'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <backingStore/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <target dev='hda' bus='ide'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <readonly/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <alias name='ide0-0-0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <controller type='usb' index='0' model='none'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <alias name='usb'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </controller>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <controller type='pci' index='0' model='pci-root'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <alias name='pci.0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </controller>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <controller type='ide' index='0'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <alias name='ide'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </controller>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <interface type='ethernet'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <mac address='fa:16:3e:b8:34:46'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <target dev='tap6cfc1d4d-e0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <model type='virtio'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <driver name='qemu'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <mtu size='1372'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <alias name='net0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </interface>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <interface type='ethernet'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <mac address='fa:16:3e:d8:d6:24'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <target dev='tapb23e23e6-8b'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <model type='virtio'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <driver name='qemu'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <mtu size='1372'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <alias name='net1'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </interface>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <serial type='pty'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <source path='/dev/pts/0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <log file='/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/console.log' append='off'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <target type='isa-serial' port='0'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:         <model name='isa-serial'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       </target>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <alias name='serial0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </serial>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <console type='pty' tty='/dev/pts/0'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <source path='/dev/pts/0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <log file='/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/console.log' append='off'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <target type='serial' port='0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <alias name='serial0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </console>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <input type='mouse' bus='ps2'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <alias name='input0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </input>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <input type='keyboard' bus='ps2'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <alias name='input1'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </input>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <listen type='address' address='0.0.0.0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </graphics>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <audio id='1' type='none'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <video>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <model type='virtio' heads='1' primary='yes'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <alias name='video0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </video>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <stats period='10'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <alias name='balloon0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <rng model='virtio'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <backend model='random'>/dev/urandom</backend>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <alias name='rng0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     </rng>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   </devices>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <label>libvirt-ebd2884b-67b5-40c1-8cf0-a22bd90be727</label>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <imagelabel>libvirt-ebd2884b-67b5-40c1-8cf0-a22bd90be727</imagelabel>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   </seclabel>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <label>+64055:+993</label>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:     <imagelabel>+64055:+993</imagelabel>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:   </seclabel>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]: </domain>
May 27 03:00:55.435066 np0000001475 nova-compute[98471]:  {{(pid=98471) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 27 03:00:55.442942 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Successfully detached device tapb23e23e6-8b from instance ebd2884b-67b5-40c1-8cf0-a22bd90be727 from the persistent domain config.
May 27 03:00:55.442942 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] (1/8): Attempting to detach device tapb23e23e6-8b with device alias net1 from instance ebd2884b-67b5-40c1-8cf0-a22bd90be727 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:00:55.442942 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] detach device xml: <interface type="ethernet">
May 27 03:00:55.442942 np0000001475 nova-compute[98471]:   <mac address="fa:16:3e:d8:d6:24"/>
May 27 03:00:55.442942 np0000001475 nova-compute[98471]:   <model type="virtio"/>
May 27 03:00:55.442942 np0000001475 nova-compute[98471]:   <driver name="qemu"/>
May 27 03:00:55.442942 np0000001475 nova-compute[98471]:   <mtu size="1372"/>
May 27 03:00:55.442942 np0000001475 nova-compute[98471]:   <target dev="tapb23e23e6-8b"/>
May 27 03:00:55.442942 np0000001475 nova-compute[98471]: </interface>
May 27 03:00:55.442942 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:00:55.716255 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:55.719896 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:55.720334 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9690e7daa5f59004f4b2fa234427455be67ab69b.part --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:55.736828 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:00:55.835884 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9690e7daa5f59004f4b2fa234427455be67ab69b.part --force-share --output=json" returned: 0 in 0.115s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:55.836356 np0000001475 nova-compute[98471]: DEBUG nova.virt.images [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] 48155fdd-4ef0-4719-a052-7861f417b7f0 was qcow2, converting to raw {{(pid=98471) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 03:00:55.836902 np0000001475 nova-compute[98471]: DEBUG nova.privsep.utils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98471) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 03:00:55.837230 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9690e7daa5f59004f4b2fa234427455be67ab69b.part /opt/stack/data/nova/instances/_base/9690e7daa5f59004f4b2fa234427455be67ab69b.converted {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:55.924229 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:00:55.933929 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:55.949135 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:00:56.061700 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9690e7daa5f59004f4b2fa234427455be67ab69b.part /opt/stack/data/nova/instances/_base/9690e7daa5f59004f4b2fa234427455be67ab69b.converted" returned: 0 in 0.224s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:56.068874 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9690e7daa5f59004f4b2fa234427455be67ab69b.converted --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:56.191798 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9690e7daa5f59004f4b2fa234427455be67ab69b.converted --force-share --output=json" returned: 0 in 0.122s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:56.192092 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "9690e7daa5f59004f4b2fa234427455be67ab69b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.852s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:56.192389 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:56.204023 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:56.204023 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:56.206979 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9690e7daa5f59004f4b2fa234427455be67ab69b --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:56.301218 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9690e7daa5f59004f4b2fa234427455be67ab69b --force-share --output=json" returned: 0 in 0.093s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:56.301218 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "9690e7daa5f59004f4b2fa234427455be67ab69b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:56.301218 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "9690e7daa5f59004f4b2fa234427455be67ab69b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:56.301367 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:56.304937 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:00:56.305384 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9690e7daa5f59004f4b2fa234427455be67ab69b --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:56.349119 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:56.349542 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:56.357333 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:00:56.357584 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Claim successful on node np0000001475
May 27 03:00:56.415528 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9690e7daa5f59004f4b2fa234427455be67ab69b --force-share --output=json" returned: 0 in 0.110s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:56.418045 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9690e7daa5f59004f4b2fa234427455be67ab69b,backing_fmt=raw /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:56.454733 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "66b799ed-716a-4b29-8125-bac73213f2cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:56.455438 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "66b799ed-716a-4b29-8125-bac73213f2cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:56.471733 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9690e7daa5f59004f4b2fa234427455be67ab69b,backing_fmt=raw /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk 1073741824" returned: 0 in 0.056s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:56.472092 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "9690e7daa5f59004f4b2fa234427455be67ab69b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.171s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:56.472432 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9690e7daa5f59004f4b2fa234427455be67ab69b --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:56.530305 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:56.530884 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779850856.5304642, ebd2884b-67b5-40c1-8cf0-a22bd90be727 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:00:56.544065 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Start waiting for the detach event from libvirt for device tapb23e23e6-8b with device alias net1 for instance ebd2884b-67b5-40c1-8cf0-a22bd90be727 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:00:56.544520 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:d6:24"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapb23e23e6-8b"/></interface> {{(pid=98471) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 27 03:00:56.547645 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:56.550043 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d8:d6:24"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapb23e23e6-8b"/></interface>not found in domain: <domain type='qemu' id='13'>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <name>instance-0000000c</name>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <uuid>ebd2884b-67b5-40c1-8cf0-a22bd90be727</uuid>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <nova:package version="33.1.0"/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <nova:name>tempest-device-tagging-server-1481412241</nova:name>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <nova:creationTime>2026-05-27 03:00:34</nova:creationTime>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <nova:flavor name="m1.nano" id="42">
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <nova:memory>192</nova:memory>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <nova:disk>1</nova:disk>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <nova:swap>0</nova:swap>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <nova:ephemeral>0</nova:ephemeral>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <nova:vcpus>1</nova:vcpus>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <nova:extraSpecs>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     </nova:extraSpecs>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   </nova:flavor>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <nova:containerFormat>bare</nova:containerFormat>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <nova:minDisk>1</nova:minDisk>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <nova:minRam>0</nova:minRam>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <nova:properties>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     </nova:properties>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   </nova:image>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <nova:owner>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <nova:user uuid="ff4b501bdb27488490da6b1032106687">tempest-TaggedAttachmentsTest-1282046058-project-member</nova:user>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <nova:project uuid="997fc21542b04af2a2d9113d30f87b22">tempest-TaggedAttachmentsTest-1282046058</nova:project>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   </nova:owner>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <nova:ports>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <nova:port uuid="6cfc1d4d-e055-4ba7-a926-19911b813fe0">
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     </nova:port>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <nova:port uuid="b23e23e6-8bc3-4655-adc9-0038a2341ab3">
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <nova:ip type="fixed" address="10.10.10.229" ipVersion="4"/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     </nova:port>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   </nova:ports>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]: </nova:instance>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <memory unit='KiB'>196608</memory>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <currentMemory unit='KiB'>196608</currentMemory>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <vcpu placement='static'>1</vcpu>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <resource>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <partition>/machine</partition>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   </resource>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <sysinfo type='smbios'>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <system>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <entry name='product'>OpenStack Nova</entry>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <entry name='version'>33.1.0</entry>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <entry name='serial'>ebd2884b-67b5-40c1-8cf0-a22bd90be727</entry>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <entry name='uuid'>ebd2884b-67b5-40c1-8cf0-a22bd90be727</entry>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <entry name='family'>Virtual Machine</entry>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     </system>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <os>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <boot dev='hd'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <smbios mode='sysinfo'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   </os>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <features>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <vmcoreinfo state='on'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <tb-cache unit='KiB'>131072</tb-cache>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   </features>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <cpu mode='custom' match='exact' check='full'>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <model fallback='forbid'>Nehalem</model>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <feature policy='require' name='hypervisor'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <clock offset='utc'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <on_poweroff>destroy</on_poweroff>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <on_reboot>restart</on_reboot>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <on_crash>destroy</on_crash>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <devices>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <disk type='file' device='disk'>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <driver name='qemu' type='qcow2' cache='none'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <source file='/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk' index='2'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <backingStore type='file' index='3'>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:         <format type='raw'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:         <source file='/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:         <backingStore/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       </backingStore>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <target dev='vda' bus='virtio'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <alias name='virtio-disk0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <disk type='file' device='cdrom'>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <driver name='qemu' type='raw' cache='none'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <source file='/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk.config' index='1'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <backingStore/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <target dev='hda' bus='ide'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <readonly/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <alias name='ide0-0-0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <controller type='usb' index='0' model='none'>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <alias name='usb'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     </controller>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <controller type='pci' index='0' model='pci-root'>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <alias name='pci.0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     </controller>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <controller type='ide' index='0'>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <alias name='ide'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     </controller>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <interface type='ethernet'>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <mac address='fa:16:3e:b8:34:46'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <target dev='tap6cfc1d4d-e0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <model type='virtio'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <driver name='qemu'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <mtu size='1372'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <alias name='net0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     </interface>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <serial type='pty'>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <source path='/dev/pts/0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <log file='/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/console.log' append='off'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <target type='isa-serial' port='0'>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:         <model name='isa-serial'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       </target>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <alias name='serial0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     </serial>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <console type='pty' tty='/dev/pts/0'>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <source path='/dev/pts/0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <log file='/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/console.log' append='off'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <target type='serial' port='0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <alias name='serial0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     </console>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <input type='mouse' bus='ps2'>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <alias name='input0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     </input>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <input type='keyboard' bus='ps2'>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <alias name='input1'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     </input>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <listen type='address' address='0.0.0.0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     </graphics>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <audio id='1' type='none'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <video>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <model type='virtio' heads='1' primary='yes'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <alias name='video0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     </video>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <stats period='10'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <alias name='balloon0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <rng model='virtio'>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <backend model='random'>/dev/urandom</backend>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <alias name='rng0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     </rng>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   </devices>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <label>libvirt-ebd2884b-67b5-40c1-8cf0-a22bd90be727</label>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <imagelabel>libvirt-ebd2884b-67b5-40c1-8cf0-a22bd90be727</imagelabel>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   </seclabel>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <label>+64055:+993</label>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:     <imagelabel>+64055:+993</imagelabel>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:   </seclabel>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]: </domain>
May 27 03:00:56.550043 np0000001475 nova-compute[98471]:  {{(pid=98471) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 27 03:00:56.553371 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Successfully detached device tapb23e23e6-8b from instance ebd2884b-67b5-40c1-8cf0-a22bd90be727 from the live domain config.
May 27 03:00:56.553371 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1481412241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-1481412241',id=12,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX3hrfXJylogloNcsVODyT6YV7aMSshELm9OJiUcOjH996gMpO5+kFiAKQhQX7ZkAoqoXhzYZQLrM0rlP3d/NY+cv+dBD4+nzGVXWnWfuAvNWMegazBzNSt2XeuVXBmtQ==',key_name='tempest-keypair-1422957137',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:59:46Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='997fc21542b04af2a2d9113d30f87b22',ramdisk_id='',reservation_id='r-b9zanhfv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1282046058',owner_user_name='tempest-TaggedAttachmentsTest-1282046058-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:59:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff4b501bdb27488490da6b1032106687',uuid=ebd2884b-67b5-40c1-8cf0-a22bd90be727,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "address": "fa:16:3e:d8:d6:24", "network": {"id": "135d20cc-9a53-4eed-9b52-1e13a89fc18e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2095472683", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e23e6-8b", "ovs_interfaceid": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:00:56.553371 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Converting VIF {"id": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "address": "fa:16:3e:d8:d6:24", "network": {"id": "135d20cc-9a53-4eed-9b52-1e13a89fc18e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2095472683", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e23e6-8b", "ovs_interfaceid": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:56.556817 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:d6:24,bridge_name='br-int',has_traffic_filtering=True,id=b23e23e6-8bc3-4655-adc9-0038a2341ab3,network=Network(135d20cc-9a53-4eed-9b52-1e13a89fc18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23e23e6-8b') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:56.556817 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:d6:24,bridge_name='br-int',has_traffic_filtering=True,id=b23e23e6-8bc3-4655-adc9-0038a2341ab3,network=Network(135d20cc-9a53-4eed-9b52-1e13a89fc18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23e23e6-8b') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:00:56.557335 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:56.557658 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb23e23e6-8b, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:56.559137 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:56.560076 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:56.568978 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:56.571437 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:56.579763 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9690e7daa5f59004f4b2fa234427455be67ab69b --force-share --output=json" returned: 0 in 0.107s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:56.580181 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:00:56.580484 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:00:56.596735 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:56.604085 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:56.604507 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f47ecb6b-990f-4a54-92ca-7d658769cccc) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:56.606923 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:56.609571 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:00:56.615809 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:56.620396 np0000001475 nova-compute[98471]: INFO os_vif [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:d6:24,bridge_name='br-int',has_traffic_filtering=True,id=b23e23e6-8bc3-4655-adc9-0038a2341ab3,network=Network(135d20cc-9a53-4eed-9b52-1e13a89fc18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23e23e6-8b')
May 27 03:00:56.623888 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1481412241', uuid='ebd2884b-67b5-40c1-8cf0-a22bd90be727'), owner=OwnerMeta(userid='ff4b501bdb27488490da6b1032106687', username='tempest-TaggedAttachmentsTest-1282046058-project-member', projectid='997fc21542b04af2a2d9113d30f87b22', projectname='tempest-TaggedAttachmentsTest-1282046058'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "address": "fa:16:3e:b8:34:46", "network": {"id": "00a82372-a9cb-4a7e-8f75-6883f0e85849", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2146755790-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cfc1d4d-e0", "ovs_interfaceid": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850856.6231987) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:00:56.625414 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:   <nova:package version="33.1.0"/>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:   <nova:name>tempest-device-tagging-server-1481412241</nova:name>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:   <nova:creationTime>2026-05-27 03:00:56</nova:creationTime>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:   <nova:flavor name="m1.nano" id="42">
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:     <nova:memory>192</nova:memory>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:     <nova:disk>1</nova:disk>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:     <nova:swap>0</nova:swap>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:     <nova:ephemeral>0</nova:ephemeral>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:     <nova:vcpus>1</nova:vcpus>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:     <nova:extraSpecs>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:     </nova:extraSpecs>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:   </nova:flavor>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:   <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:     <nova:containerFormat>bare</nova:containerFormat>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:     <nova:minDisk>1</nova:minDisk>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:     <nova:minRam>0</nova:minRam>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:     <nova:properties>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:       <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:       <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:     </nova:properties>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:   </nova:image>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:   <nova:owner>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:     <nova:user uuid="ff4b501bdb27488490da6b1032106687">tempest-TaggedAttachmentsTest-1282046058-project-member</nova:user>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:     <nova:project uuid="997fc21542b04af2a2d9113d30f87b22">tempest-TaggedAttachmentsTest-1282046058</nova:project>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:   </nova:owner>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:   <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:   <nova:ports>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:     <nova:port uuid="6cfc1d4d-e055-4ba7-a926-19911b813fe0">
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:       <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:     </nova:port>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:   </nova:ports>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]: </nova:instance>
May 27 03:00:56.625414 np0000001475 nova-compute[98471]:  {{(pid=98471) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 27 03:00:56.629396 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:56.629771 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:56.644185 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a1935058-23be-4fc9-a6ef-1cbe737b9605 req-abd84fb1-1004-4fc1-896d-b69d43213332 service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Received event network-changed-63e286dc-7977-40c8-b72b-fc4860de9e20 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:56.644185 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a1935058-23be-4fc9-a6ef-1cbe737b9605 req-abd84fb1-1004-4fc1-896d-b69d43213332 service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Refreshing instance network info cache due to event network-changed-63e286dc-7977-40c8-b72b-fc4860de9e20. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:00:56.644185 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a1935058-23be-4fc9-a6ef-1cbe737b9605 req-abd84fb1-1004-4fc1-896d-b69d43213332 service nova] Acquiring lock "refresh_cache-71af628e-b06d-446d-8c2e-dcfbb232df33" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:00:56.644185 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a1935058-23be-4fc9-a6ef-1cbe737b9605 req-abd84fb1-1004-4fc1-896d-b69d43213332 service nova] Acquired lock "refresh_cache-71af628e-b06d-446d-8c2e-dcfbb232df33" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:00:56.644185 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a1935058-23be-4fc9-a6ef-1cbe737b9605 req-abd84fb1-1004-4fc1-896d-b69d43213332 service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Refreshing network info cache for port 63e286dc-7977-40c8-b72b-fc4860de9e20 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:00:56.683894 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:00:56.687714 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Cannot resize image /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:00:56.687714 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:00:56.687714 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Ensure instance console log exists: /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:00:56.687714 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:56.687714 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:56.687714 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:56.687714 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Start _get_guest_xml network_info=[{"id": "28ae6612-6474-4d47-8296-02394b0dabe5", "address": "fa:16:3e:fc:b5:d4", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ae6612-64", "ovs_interfaceid": "28ae6612-6474-4d47-8296-02394b0dabe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-27T02:54:58Z,direct_url=<?>,disk_format='qcow2',id=48155fdd-4ef0-4719-a052-7861f417b7f0,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-27T02:55:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0301a508-e6af-4ae2-b6af-9a5abf80f200', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6ad1223d-d197-46e7-a32b-a25380d409a8', 'attached_at': '', 'detached_at': '', 'volume_id': '0301a508-e6af-4ae2-b6af-9a5abf80f200', 'serial': '0301a508-e6af-4ae2-b6af-9a5abf80f200'}, 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '34dd7018-6e19-4f23-9db0-4297f8f216e2', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:00:56.691553 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 27 03:00:56.692796 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='48155fdd-4ef0-4719-a052-7861f417b7f0', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1000576881', uuid='6ad1223d-d197-46e7-a32b-a25380d409a8'), owner=OwnerMeta(userid='d4a93dfe76ab455d8aa6e691b1fa34c5', username='tempest-ServerActionsTestOtherA-569974590-project-member', projectid='233d191c03874150880aca259ffd3e21', projectname='tempest-ServerActionsTestOtherA-569974590'), image=ImageMeta(id='48155fdd-4ef0-4719-a052-7861f417b7f0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "28ae6612-6474-4d47-8296-02394b0dabe5", "address": "fa:16:3e:fc:b5:d4", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ae6612-64", "ovs_interfaceid": "28ae6612-6474-4d47-8296-02394b0dabe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850856.6924915) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:00:56.694577 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:00:56.694577 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:00:56.695859 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:00:56.695859 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:00:56.697469 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:00:56.698208 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-27T02:54:58Z,direct_url=<?>,disk_format='qcow2',id=48155fdd-4ef0-4719-a052-7861f417b7f0,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-27T02:55:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:00:56.698635 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:00:56.701287 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:00:56.701287 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:00:56.701287 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:00:56.701287 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:00:56.701287 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:00:56.701287 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:00:56.701287 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:00:56.701287 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:00:56.701287 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:00:56.701287 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6ad1223d-d197-46e7-a32b-a25380d409a8 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:56.958450 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:00:56.968429 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Found WWN 330000000ea028c01 for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:00:56.968429 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.039s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:56.968429 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] <== connect_volume: return (2039ms) {'type': 'block', 'scsi_wwn': '330000000ea028c01', 'path': '/dev/dm-0', 'multipath_id': '330000000ea028c01'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:00:56.968674 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ea028c01', 'path': '/dev/dm-0', 'multipath_id': '330000000ea028c01'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:00:57.097166 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Received event network-vif-deleted-b23e23e6-8bc3-4655-adc9-0038a2341ab3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:00:57.097398 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Neutron deleted interface b23e23e6-8bc3-4655-adc9-0038a2341ab3; detaching it from the instance and deleting it from the info cache
May 27 03:00:57.097790 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Updating instance_info_cache with network_info: [{"id": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "address": "fa:16:3e:b8:34:46", "network": {"id": "00a82372-a9cb-4a7e-8f75-6883f0e85849", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2146755790-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cfc1d4d-e0", "ovs_interfaceid": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:57.154423 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-a1935058-23be-4fc9-a6ef-1cbe737b9605 req-abd84fb1-1004-4fc1-896d-b69d43213332 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:57.216276 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:00:57.216589 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0301a508-e6af-4ae2-b6af-9a5abf80f200', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:00:57.216695 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:57.217014 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:57.217266 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0301a508-e6af-4ae2-b6af-9a5abf80f200', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:00:57.232179 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:57.238070 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:57.238843 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:00:57.239550 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:00:57.240037 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:00:57.240257 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:00:57.256043 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:00:57.256043 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:57.259171 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:00:57.259171 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:57.272068 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200] added
May 27 03:00:57.272068 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:00:57.272068 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:57.272068 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:57.272068 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:57.272068 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:57.272068 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:57.272388 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:00:57.272576 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0339(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:00:57.272870 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:00:57.276555 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200] added
May 27 03:00:57.276555 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:00:57.276555 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:57.276555 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:57.276555 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:00:57.276555 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:00:57.276555 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:57.276819 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:00:57.277017 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0367(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:00:57.277212 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:00:57.478935 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-125761252',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverbootfromvolumestablerescuetest-server-125761252',id=17,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:00:44Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab70ea24752242a88583e819c6c34e12',ramdisk_id='',reservation_id='r-nn9dht37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:00:45Z,user_data=None,user_id='787c8d4d4527402cbbc2ad0475f710bb',uuid=7acda56f-e16c-4371-99b3-21eeea2904d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "address": "fa:16:3e:7e:90:4a", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "vif_mac": "fa:16:3e:7e:90:4a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped993fcc-f7", "ovs_interfaceid": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:00:57.478935 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converting VIF {"id": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "address": "fa:16:3e:7e:90:4a", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "vif_mac": "fa:16:3e:7e:90:4a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped993fcc-f7", "ovs_interfaceid": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:57.478935 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:90:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed993fcc-f75a-4549-937f-26a3a42c5fe8,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped993fcc-f7') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:57.480895 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'pci_devices' on Instance uuid 7acda56f-e16c-4371-99b3-21eeea2904d1 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:57.552336 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:57.593481 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-a1935058-23be-4fc9-a6ef-1cbe737b9605 req-abd84fb1-1004-4fc1-896d-b69d43213332 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:57.603790 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] Lazy-loading 'system_metadata' on Instance uuid ebd2884b-67b5-40c1-8cf0-a22bd90be727 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:57.753682 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:57.753945 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:57.794070 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a1935058-23be-4fc9-a6ef-1cbe737b9605 req-abd84fb1-1004-4fc1-896d-b69d43213332 service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Updated VIF entry in instance network info cache for port 63e286dc-7977-40c8-b72b-fc4860de9e20. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:00:57.794394 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a1935058-23be-4fc9-a6ef-1cbe737b9605 req-abd84fb1-1004-4fc1-896d-b69d43213332 service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Updating instance_info_cache with network_info: [{"id": "63e286dc-7977-40c8-b72b-fc4860de9e20", "address": "fa:16:3e:23:4b:54", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e286dc-79", "ovs_interfaceid": "63e286dc-7977-40c8-b72b-fc4860de9e20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:57.987210 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Object Instance<7acda56f-e16c-4371-99b3-21eeea2904d1> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:00:57.988347 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] End _get_guest_xml xml=<domain type="qemu">
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:   <uuid>7acda56f-e16c-4371-99b3-21eeea2904d1</uuid>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:   <name>instance-00000011</name>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-125761252</nova:name>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:00:54</nova:creationTime>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:         <nova:user uuid="787c8d4d4527402cbbc2ad0475f710bb">tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member</nova:user>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:         <nova:project uuid="ab70ea24752242a88583e819c6c34e12">tempest-ServerBootFromVolumeStableRescueTest-1976367979</nova:project>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:         <nova:port uuid="ed993fcc-f75a-4549-937f-26a3a42c5fe8">
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     <system>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <entry name="serial">7acda56f-e16c-4371-99b3-21eeea2904d1</entry>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <entry name="uuid">7acda56f-e16c-4371-99b3-21eeea2904d1</entry>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     </system>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:   <os>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:   </os>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:   <features>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:   </features>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:   <devices>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/disk.config"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <alias name="ua-6a1921ec-dd47-422c-af8e-b1cbf29ad186"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-0"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <serial>6a1921ec-dd47-422c-af8e-b1cbf29ad186</serial>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/disk.rescue"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <target dev="vdb" bus="virtio"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <boot order="1"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:7e:90:4a"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <target dev="taped993fcc-f7"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     </interface>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/console.log" append="off"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     </serial>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     <video>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     </video>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     </rng>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:   </devices>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]: </domain>
May 27 03:00:57.988347 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:00:57.996821 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Instance destroyed successfully.
May 27 03:00:58.075795 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:00:58.076143 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:00:58.108759 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] Lazy-loading 'flavor' on Instance uuid ebd2884b-67b5-40c1-8cf0-a22bd90be727 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:00:58.257538 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:00:58.273219 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:00:58.277633 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:00:58.291083 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:00:58.291083 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:58.297249 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a1935058-23be-4fc9-a6ef-1cbe737b9605 req-abd84fb1-1004-4fc1-896d-b69d43213332 service nova] Releasing lock "refresh_cache-71af628e-b06d-446d-8c2e-dcfbb232df33" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:00:58.299047 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:00:58.299047 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:58.312137 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:58.322670 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:58.335073 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:58.335073 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:58.335073 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:58.335073 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:58.335073 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:58.335073 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:58.335073 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:58.335073 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:58.335073 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:58.335073 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:58.344355 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:58.344355 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:58.344355 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:58.344355 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:58.344355 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:58.344580 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:58.344580 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:58.344580 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:58.344580 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:58.344580 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:58.375377 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, portal: 192.168.40.100,3260]
May 27 03:00:58.375377 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, portal: 192.168.40.100,3260] successful.
May 27 03:00:58.375377 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:58.381589 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, portal: 192.168.50.100,3260]
May 27 03:00:58.381589 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, portal: 192.168.50.100,3260] successful.
May 27 03:00:58.381589 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:58.389628 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:58.396115 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:00:58.407871 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:58.407871 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:58.407871 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:58.407871 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:58.407871 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:58.407871 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:58.407871 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:58.408159 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:58.408159 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:58.408159 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:58.408159 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:58.408159 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:58.408159 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:58.408159 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:58.408339 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:58.408417 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:00:58.409525 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] HCTL ('11', '-', '-', 0) found on session 45 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:00:58.409667 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:00:58.411193 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:58.411193 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:58.411193 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:58.411193 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:58.411193 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:58.411193 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:58.411193 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:00:58.411474 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:58.411474 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:00:58.411474 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:58.411474 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:00:58.411474 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:58.411474 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:00:58.411474 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:00:58.411838 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:00:58.411963 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:00:58.412910 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] HCTL ('12', '-', '-', 0) found on session 46 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:00:58.413053 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:00:58.429407 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Searching for a device in session 45 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:00:58.429407 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0301a508-e6af-4ae2-b6af-9a5abf80f200', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:00:58.442056 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Searching for a device in session 46 and hctl ['12', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:00:58.544521 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "refresh_cache-ebd2884b-67b5-40c1-8cf0-a22bd90be727" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:00:58.544911 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquired lock "refresh_cache-ebd2884b-67b5-40c1-8cf0-a22bd90be727" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:00:58.544911 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:00:58.579169 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:00:58.615434 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] Object Instance<ebd2884b-67b5-40c1-8cf0-a22bd90be727> lazy-loaded attributes: system_metadata,flavor {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:00:58.616056 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1481412241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-1481412241',id=12,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX3hrfXJylogloNcsVODyT6YV7aMSshELm9OJiUcOjH996gMpO5+kFiAKQhQX7ZkAoqoXhzYZQLrM0rlP3d/NY+cv+dBD4+nzGVXWnWfuAvNWMegazBzNSt2XeuVXBmtQ==',key_name='tempest-keypair-1422957137',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:59:46Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000001475',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='997fc21542b04af2a2d9113d30f87b22',ramdisk_id='',reservation_id='r-b9zanhfv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1282046058',owner_user_name='tempest-TaggedAttachmentsTest-1282046058-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:59:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff4b501bdb27488490da6b1032106687',uuid=ebd2884b-67b5-40c1-8cf0-a22bd90be727,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "address": "fa:16:3e:d8:d6:24", "network": {"id": "135d20cc-9a53-4eed-9b52-1e13a89fc18e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2095472683", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e23e6-8b", "ovs_interfaceid": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:00:58.616246 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] Converting VIF {"id": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "address": "fa:16:3e:d8:d6:24", "network": {"id": "135d20cc-9a53-4eed-9b52-1e13a89fc18e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2095472683", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e23e6-8b", "ovs_interfaceid": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:58.616720 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:d6:24,bridge_name='br-int',has_traffic_filtering=True,id=b23e23e6-8bc3-4655-adc9-0038a2341ab3,network=Network(135d20cc-9a53-4eed-9b52-1e13a89fc18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23e23e6-8b') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:58.620990 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:d6:24"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapb23e23e6-8b"/></interface> {{(pid=98471) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 27 03:00:58.624111 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d8:d6:24"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapb23e23e6-8b"/></interface>not found in domain: <domain type='qemu' id='13'>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <name>instance-0000000c</name>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <uuid>ebd2884b-67b5-40c1-8cf0-a22bd90be727</uuid>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <nova:package version="33.1.0"/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <nova:name>tempest-device-tagging-server-1481412241</nova:name>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <nova:creationTime>2026-05-27 03:00:56</nova:creationTime>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <nova:flavor name="m1.nano" id="42">
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <nova:memory>192</nova:memory>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <nova:disk>1</nova:disk>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <nova:swap>0</nova:swap>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <nova:ephemeral>0</nova:ephemeral>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <nova:vcpus>1</nova:vcpus>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <nova:extraSpecs>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     </nova:extraSpecs>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   </nova:flavor>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <nova:containerFormat>bare</nova:containerFormat>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <nova:minDisk>1</nova:minDisk>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <nova:minRam>0</nova:minRam>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <nova:properties>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     </nova:properties>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   </nova:image>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <nova:owner>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <nova:user uuid="ff4b501bdb27488490da6b1032106687">tempest-TaggedAttachmentsTest-1282046058-project-member</nova:user>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <nova:project uuid="997fc21542b04af2a2d9113d30f87b22">tempest-TaggedAttachmentsTest-1282046058</nova:project>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   </nova:owner>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <nova:ports>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <nova:port uuid="6cfc1d4d-e055-4ba7-a926-19911b813fe0">
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     </nova:port>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   </nova:ports>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]: </nova:instance>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <memory unit='KiB'>196608</memory>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <currentMemory unit='KiB'>196608</currentMemory>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <vcpu placement='static'>1</vcpu>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <resource>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <partition>/machine</partition>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   </resource>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <sysinfo type='smbios'>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <system>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <entry name='product'>OpenStack Nova</entry>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <entry name='version'>33.1.0</entry>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <entry name='serial'>ebd2884b-67b5-40c1-8cf0-a22bd90be727</entry>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <entry name='uuid'>ebd2884b-67b5-40c1-8cf0-a22bd90be727</entry>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <entry name='family'>Virtual Machine</entry>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     </system>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <os>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <boot dev='hd'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <smbios mode='sysinfo'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   </os>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <features>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <vmcoreinfo state='on'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <tb-cache unit='KiB'>131072</tb-cache>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   </features>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <cpu mode='custom' match='exact' check='full'>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <model fallback='forbid'>Nehalem</model>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <feature policy='require' name='hypervisor'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <clock offset='utc'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <on_poweroff>destroy</on_poweroff>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <on_reboot>restart</on_reboot>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <on_crash>destroy</on_crash>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <devices>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <disk type='file' device='disk'>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <driver name='qemu' type='qcow2' cache='none'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <source file='/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk' index='2'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <backingStore type='file' index='3'>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:         <format type='raw'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:         <source file='/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:         <backingStore/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       </backingStore>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <target dev='vda' bus='virtio'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <alias name='virtio-disk0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <disk type='file' device='cdrom'>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <driver name='qemu' type='raw' cache='none'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <source file='/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk.config' index='1'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <backingStore/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <target dev='hda' bus='ide'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <readonly/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <alias name='ide0-0-0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <controller type='usb' index='0' model='none'>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <alias name='usb'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     </controller>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <controller type='pci' index='0' model='pci-root'>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <alias name='pci.0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     </controller>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <controller type='ide' index='0'>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <alias name='ide'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     </controller>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <interface type='ethernet'>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <mac address='fa:16:3e:b8:34:46'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <target dev='tap6cfc1d4d-e0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <model type='virtio'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <driver name='qemu'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <mtu size='1372'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <alias name='net0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     </interface>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <serial type='pty'>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <source path='/dev/pts/0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <log file='/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/console.log' append='off'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <target type='isa-serial' port='0'>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:         <model name='isa-serial'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       </target>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <alias name='serial0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     </serial>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <console type='pty' tty='/dev/pts/0'>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <source path='/dev/pts/0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <log file='/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/console.log' append='off'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <target type='serial' port='0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <alias name='serial0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     </console>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <input type='mouse' bus='ps2'>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <alias name='input0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     </input>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <input type='keyboard' bus='ps2'>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <alias name='input1'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     </input>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <listen type='address' address='0.0.0.0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     </graphics>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <audio id='1' type='none'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <video>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <model type='virtio' heads='1' primary='yes'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <alias name='video0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     </video>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <stats period='10'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <alias name='balloon0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <rng model='virtio'>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <backend model='random'>/dev/urandom</backend>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <alias name='rng0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     </rng>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   </devices>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <label>libvirt-ebd2884b-67b5-40c1-8cf0-a22bd90be727</label>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <imagelabel>libvirt-ebd2884b-67b5-40c1-8cf0-a22bd90be727</imagelabel>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   </seclabel>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <label>+64055:+993</label>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:     <imagelabel>+64055:+993</imagelabel>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:   </seclabel>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]: </domain>
May 27 03:00:58.624111 np0000001475 nova-compute[98471]:  {{(pid=98471) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 27 03:00:58.628014 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:d6:24"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapb23e23e6-8b"/></interface> {{(pid=98471) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 27 03:00:58.628694 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d8:d6:24"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tapb23e23e6-8b"/></interface>not found in domain: <domain type='qemu' id='13'>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <name>instance-0000000c</name>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <uuid>ebd2884b-67b5-40c1-8cf0-a22bd90be727</uuid>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <nova:package version="33.1.0"/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <nova:name>tempest-device-tagging-server-1481412241</nova:name>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <nova:creationTime>2026-05-27 03:00:56</nova:creationTime>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <nova:flavor name="m1.nano" id="42">
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <nova:memory>192</nova:memory>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <nova:disk>1</nova:disk>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <nova:swap>0</nova:swap>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <nova:ephemeral>0</nova:ephemeral>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <nova:vcpus>1</nova:vcpus>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <nova:extraSpecs>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     </nova:extraSpecs>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   </nova:flavor>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <nova:containerFormat>bare</nova:containerFormat>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <nova:minDisk>1</nova:minDisk>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <nova:minRam>0</nova:minRam>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <nova:properties>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     </nova:properties>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   </nova:image>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <nova:owner>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <nova:user uuid="ff4b501bdb27488490da6b1032106687">tempest-TaggedAttachmentsTest-1282046058-project-member</nova:user>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <nova:project uuid="997fc21542b04af2a2d9113d30f87b22">tempest-TaggedAttachmentsTest-1282046058</nova:project>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   </nova:owner>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <nova:ports>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <nova:port uuid="6cfc1d4d-e055-4ba7-a926-19911b813fe0">
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     </nova:port>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   </nova:ports>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]: </nova:instance>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <memory unit='KiB'>196608</memory>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <currentMemory unit='KiB'>196608</currentMemory>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <vcpu placement='static'>1</vcpu>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <resource>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <partition>/machine</partition>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   </resource>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <sysinfo type='smbios'>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <system>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <entry name='product'>OpenStack Nova</entry>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <entry name='version'>33.1.0</entry>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <entry name='serial'>ebd2884b-67b5-40c1-8cf0-a22bd90be727</entry>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <entry name='uuid'>ebd2884b-67b5-40c1-8cf0-a22bd90be727</entry>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <entry name='family'>Virtual Machine</entry>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     </system>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <os>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <boot dev='hd'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <smbios mode='sysinfo'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   </os>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <features>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <vmcoreinfo state='on'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <tb-cache unit='KiB'>131072</tb-cache>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   </features>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <cpu mode='custom' match='exact' check='full'>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <model fallback='forbid'>Nehalem</model>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <feature policy='require' name='hypervisor'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <clock offset='utc'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <on_poweroff>destroy</on_poweroff>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <on_reboot>restart</on_reboot>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <on_crash>destroy</on_crash>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <devices>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <disk type='file' device='disk'>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <driver name='qemu' type='qcow2' cache='none'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <source file='/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk' index='2'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <backingStore type='file' index='3'>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:         <format type='raw'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:         <source file='/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:         <backingStore/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       </backingStore>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <target dev='vda' bus='virtio'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <alias name='virtio-disk0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <disk type='file' device='cdrom'>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <driver name='qemu' type='raw' cache='none'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <source file='/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/disk.config' index='1'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <backingStore/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <target dev='hda' bus='ide'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <readonly/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <alias name='ide0-0-0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     </disk>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <controller type='usb' index='0' model='none'>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <alias name='usb'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     </controller>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <controller type='pci' index='0' model='pci-root'>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <alias name='pci.0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     </controller>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <controller type='ide' index='0'>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <alias name='ide'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     </controller>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <interface type='ethernet'>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <mac address='fa:16:3e:b8:34:46'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <target dev='tap6cfc1d4d-e0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <model type='virtio'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <driver name='qemu'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <mtu size='1372'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <alias name='net0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     </interface>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <serial type='pty'>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <source path='/dev/pts/0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <log file='/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/console.log' append='off'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <target type='isa-serial' port='0'>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:         <model name='isa-serial'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       </target>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <alias name='serial0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     </serial>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <console type='pty' tty='/dev/pts/0'>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <source path='/dev/pts/0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <log file='/opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727/console.log' append='off'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <target type='serial' port='0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <alias name='serial0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     </console>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <input type='mouse' bus='ps2'>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <alias name='input0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     </input>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <input type='keyboard' bus='ps2'>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <alias name='input1'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     </input>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <listen type='address' address='0.0.0.0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     </graphics>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <audio id='1' type='none'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <video>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <model type='virtio' heads='1' primary='yes'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <alias name='video0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     </video>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <stats period='10'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <alias name='balloon0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <rng model='virtio'>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <backend model='random'>/dev/urandom</backend>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <alias name='rng0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     </rng>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   </devices>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <label>libvirt-ebd2884b-67b5-40c1-8cf0-a22bd90be727</label>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <imagelabel>libvirt-ebd2884b-67b5-40c1-8cf0-a22bd90be727</imagelabel>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   </seclabel>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <label>+64055:+993</label>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:     <imagelabel>+64055:+993</imagelabel>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:   </seclabel>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]: </domain>
May 27 03:00:58.628694 np0000001475 nova-compute[98471]:  {{(pid=98471) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 27 03:00:58.633725 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Detaching interface fa:16:3e:d8:d6:24 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapb23e23e6-8b' not found.
May 27 03:00:58.633725 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1481412241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-1481412241',id=12,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX3hrfXJylogloNcsVODyT6YV7aMSshELm9OJiUcOjH996gMpO5+kFiAKQhQX7ZkAoqoXhzYZQLrM0rlP3d/NY+cv+dBD4+nzGVXWnWfuAvNWMegazBzNSt2XeuVXBmtQ==',key_name='tempest-keypair-1422957137',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:59:46Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000001475',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='997fc21542b04af2a2d9113d30f87b22',ramdisk_id='',reservation_id='r-b9zanhfv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1282046058',owner_user_name='tempest-TaggedAttachmentsTest-1282046058-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:59:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff4b501bdb27488490da6b1032106687',uuid=ebd2884b-67b5-40c1-8cf0-a22bd90be727,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "address": "fa:16:3e:d8:d6:24", "network": {"id": "135d20cc-9a53-4eed-9b52-1e13a89fc18e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2095472683", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e23e6-8b", "ovs_interfaceid": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:00:58.633725 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] Converting VIF {"id": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "address": "fa:16:3e:d8:d6:24", "network": {"id": "135d20cc-9a53-4eed-9b52-1e13a89fc18e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2095472683", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e23e6-8b", "ovs_interfaceid": "b23e23e6-8bc3-4655-adc9-0038a2341ab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:00:58.633725 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:d6:24,bridge_name='br-int',has_traffic_filtering=True,id=b23e23e6-8bc3-4655-adc9-0038a2341ab3,network=Network(135d20cc-9a53-4eed-9b52-1e13a89fc18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23e23e6-8b') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:00:58.633725 np0000001475 nova-compute[98471]: DEBUG os_vif [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:d6:24,bridge_name='br-int',has_traffic_filtering=True,id=b23e23e6-8bc3-4655-adc9-0038a2341ab3,network=Network(135d20cc-9a53-4eed-9b52-1e13a89fc18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23e23e6-8b') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:00:58.633725 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:58.633725 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb23e23e6-8b, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:00:58.633725 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:00:58.635180 np0000001475 nova-compute[98471]: INFO os_vif [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:d6:24,bridge_name='br-int',has_traffic_filtering=True,id=b23e23e6-8bc3-4655-adc9-0038a2341ab3,network=Network(135d20cc-9a53-4eed-9b52-1e13a89fc18e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23e23e6-8b')
May 27 03:00:58.636135 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1481412241', uuid='ebd2884b-67b5-40c1-8cf0-a22bd90be727'), owner=OwnerMeta(userid='ff4b501bdb27488490da6b1032106687', username='tempest-TaggedAttachmentsTest-1282046058-project-member', projectid='997fc21542b04af2a2d9113d30f87b22', projectname='tempest-TaggedAttachmentsTest-1282046058'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "address": "fa:16:3e:b8:34:46", "network": {"id": "00a82372-a9cb-4a7e-8f75-6883f0e85849", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2146755790-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cfc1d4d-e0", "ovs_interfaceid": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850858.6357946) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:00:58.636832 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [req-b31ea448-a124-42c8-be34-92998c8b555a req-0b473fbc-0b78-471e-90b1-6da3366e1425 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:   <nova:package version="33.1.0"/>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:   <nova:name>tempest-device-tagging-server-1481412241</nova:name>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:   <nova:creationTime>2026-05-27 03:00:58</nova:creationTime>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:   <nova:flavor name="m1.nano" id="42">
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:     <nova:memory>192</nova:memory>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:     <nova:disk>1</nova:disk>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:     <nova:swap>0</nova:swap>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:     <nova:ephemeral>0</nova:ephemeral>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:     <nova:vcpus>1</nova:vcpus>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:     <nova:extraSpecs>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:     </nova:extraSpecs>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:   </nova:flavor>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:   <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:     <nova:containerFormat>bare</nova:containerFormat>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:     <nova:minDisk>1</nova:minDisk>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:     <nova:minRam>0</nova:minRam>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:     <nova:properties>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:       <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:       <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:     </nova:properties>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:   </nova:image>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:   <nova:owner>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:     <nova:user uuid="ff4b501bdb27488490da6b1032106687">tempest-TaggedAttachmentsTest-1282046058-project-member</nova:user>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:     <nova:project uuid="997fc21542b04af2a2d9113d30f87b22">tempest-TaggedAttachmentsTest-1282046058</nova:project>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:   </nova:owner>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:   <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:   <nova:ports>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:     <nova:port uuid="6cfc1d4d-e055-4ba7-a926-19911b813fe0">
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:       <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:     </nova:port>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:   </nova:ports>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]: </nova:instance>
May 27 03:00:58.636832 np0000001475 nova-compute[98471]:  {{(pid=98471) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 27 03:00:58.810677 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:00:59.048134 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:59.089446 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.740s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:00:59.089909 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:00:59.092442 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.563s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:00:59.096559 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:00:59.096718 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Claim successful on node np0000001475
May 27 03:00:59.441566 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Searching for a device in session 46 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:00:59.441735 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0301a508-e6af-4ae2-b6af-9a5abf80f200', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:00:59.476792 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:59.515464 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:59.515657 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:59.515785 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:00:59.515916 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] No VIF found with MAC fa:16:3e:7e:90:4a, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:00:59.516388 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Using config drive
May 27 03:00:59.596930 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:00:59.597128 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:00:59.597403 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:59.597651 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:00:59.660529 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Updating instance_info_cache with network_info: [{"id": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "address": "fa:16:3e:b8:34:46", "network": {"id": "00a82372-a9cb-4a7e-8f75-6883f0e85849", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2146755790-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cfc1d4d-e0", "ovs_interfaceid": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:00:59.781688 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:00:59.845163 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38d53ffb20cd45a4b6bbe42d0404b0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89238d7609db41788c5908672dda670a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:01:00.019576 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'ec2_ids' on Instance uuid 7acda56f-e16c-4371-99b3-21eeea2904d1 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:00.099686 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:01:00.162498 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Releasing lock "refresh_cache-ebd2884b-67b5-40c1-8cf0-a22bd90be727" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:00.261130 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Found WWN 330000000d581dd7b for multipath device dm-4 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:01:00.261363 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:01:00.261550 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '330000000d581dd7b', 'path': '/dev/dm-4', 'multipath_id': '330000000d581dd7b'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:01:00.261614 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d581dd7b', 'path': '/dev/dm-4', 'multipath_id': '330000000d581dd7b'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:01:00.495717 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Successfully created port: 1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:01:00.523796 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Object Instance<7acda56f-e16c-4371-99b3-21eeea2904d1> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:00.523971 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'keypairs' on Instance uuid 7acda56f-e16c-4371-99b3-21eeea2904d1 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:00.603102 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:01:00.667050 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5652a957-7161-4a5d-bebb-47de87a41428 tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "interface-ebd2884b-67b5-40c1-8cf0-a22bd90be727-b23e23e6-8bc3-4655-adc9-0038a2341ab3" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 6.274s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:00.766545 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T02:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-875613762',display_name='tempest-ServerActionsTestOtherA-server-1000576881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-tempest-common-compute-instance-875613762',id=13,image_ref='48155fdd-4ef0-4719-a052-7861f417b7f0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhbCOMX0cDx/uCjoD1pQ3iMb/yxZcupQyHf7uuxnrf7EdI6EEP6StEltLO6whpKYwhmElUFdPkkHXCp77KUbxPxYkUhhTpx6/EQ206sxZO2JeMp5jzBChiUJOOt29J78w==',key_name='tempest-keypair-1019067704',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:59:55Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='233d191c03874150880aca259ffd3e21',ramdisk_id='',reservation_id='r-gfwl4dxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='48155fdd-4ef0-4719-a052-7861f417b7f0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-569974590',owner_user_name='tempest-ServerActionsTestOtherA-569974590-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:00:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a93dfe76ab455d8aa6e691b1fa34c5',uuid=6ad1223d-d197-46e7-a32b-a25380d409a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28ae6612-6474-4d47-8296-02394b0dabe5", "address": "fa:16:3e:fc:b5:d4", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ae6612-64", "ovs_interfaceid": "28ae6612-6474-4d47-8296-02394b0dabe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:01:00.766797 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converting VIF {"id": "28ae6612-6474-4d47-8296-02394b0dabe5", "address": "fa:16:3e:fc:b5:d4", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ae6612-64", "ovs_interfaceid": "28ae6612-6474-4d47-8296-02394b0dabe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:00.767332 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=28ae6612-6474-4d47-8296-02394b0dabe5,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ae6612-64') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:00.768846 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] End _get_guest_xml xml=<domain type="qemu">
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:   <uuid>6ad1223d-d197-46e7-a32b-a25380d409a8</uuid>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:   <name>instance-0000000d</name>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerActionsTestOtherA-server-1000576881</nova:name>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:00:56</nova:creationTime>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <nova:image uuid="48155fdd-4ef0-4719-a052-7861f417b7f0">
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:         <nova:user uuid="d4a93dfe76ab455d8aa6e691b1fa34c5">tempest-ServerActionsTestOtherA-569974590-project-member</nova:user>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:         <nova:project uuid="233d191c03874150880aca259ffd3e21">tempest-ServerActionsTestOtherA-569974590</nova:project>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="48155fdd-4ef0-4719-a052-7861f417b7f0"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:         <nova:port uuid="28ae6612-6474-4d47-8296-02394b0dabe5">
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     <system>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <entry name="serial">6ad1223d-d197-46e7-a32b-a25380d409a8</entry>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <entry name="uuid">6ad1223d-d197-46e7-a32b-a25380d409a8</entry>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     </system>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:   <os>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:   </os>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:   <features>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:   </features>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:   <devices>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk.config"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <alias name="ua-0301a508-e6af-4ae2-b6af-9a5abf80f200"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-4"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <target dev="vdb" bus="virtio"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <serial>0301a508-e6af-4ae2-b6af-9a5abf80f200</serial>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:fc:b5:d4"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <target dev="tap28ae6612-64"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     </interface>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/console.log" append="off"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     </serial>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     <video>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     </video>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     </rng>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:   </devices>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]: </domain>
May 27 03:01:00.768846 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:01:00.771623 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T02:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-875613762',display_name='tempest-ServerActionsTestOtherA-server-1000576881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-tempest-common-compute-instance-875613762',id=13,image_ref='48155fdd-4ef0-4719-a052-7861f417b7f0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhbCOMX0cDx/uCjoD1pQ3iMb/yxZcupQyHf7uuxnrf7EdI6EEP6StEltLO6whpKYwhmElUFdPkkHXCp77KUbxPxYkUhhTpx6/EQ206sxZO2JeMp5jzBChiUJOOt29J78w==',key_name='tempest-keypair-1019067704',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:59:55Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='233d191c03874150880aca259ffd3e21',ramdisk_id='',reservation_id='r-gfwl4dxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='48155fdd-4ef0-4719-a052-7861f417b7f0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-569974590',owner_user_name='tempest-ServerActionsTestOtherA-569974590-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:00:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a93dfe76ab455d8aa6e691b1fa34c5',uuid=6ad1223d-d197-46e7-a32b-a25380d409a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28ae6612-6474-4d47-8296-02394b0dabe5", "address": "fa:16:3e:fc:b5:d4", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ae6612-64", "ovs_interfaceid": "28ae6612-6474-4d47-8296-02394b0dabe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:01:00.771623 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converting VIF {"id": "28ae6612-6474-4d47-8296-02394b0dabe5", "address": "fa:16:3e:fc:b5:d4", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ae6612-64", "ovs_interfaceid": "28ae6612-6474-4d47-8296-02394b0dabe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:00.771623 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=28ae6612-6474-4d47-8296-02394b0dabe5,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ae6612-64') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:00.771623 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=28ae6612-6474-4d47-8296-02394b0dabe5,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ae6612-64') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:01:00.771623 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:00.771623 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:00.771623 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:01:00.772159 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:00.772323 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c7cf543-c52a-5d79-ab23-de6cf5beab1a', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:00.773117 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:00.773958 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:00.779808 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:00.782003 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:00.782190 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28ae6612-64, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:00.782670 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28ae6612-64, col_values=(('qos', UUID('a39876e0-7dc2-4c32-a59c-fad87cc2f6dd')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:00.782788 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28ae6612-64, col_values=(('external_ids', {'iface-id': '28ae6612-6474-4d47-8296-02394b0dabe5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:b5:d4', 'vm-uuid': '6ad1223d-d197-46e7-a32b-a25380d409a8'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:00.783831 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:00.785323 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:00.794648 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:00.796019 np0000001475 nova-compute[98471]: INFO os_vif [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=28ae6612-6474-4d47-8296-02394b0dabe5,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ae6612-64')
May 27 03:01:00.813023 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:01:00.813186 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:01:00.935581 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:00.967488 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:01.026912 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Object Instance<7acda56f-e16c-4371-99b3-21eeea2904d1> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:01.031856 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:01.078543 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Successfully updated port: 1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:01:01.142243 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-24aa5af0-711d-448c-a818-89cc3a5e7979 req-d2f2ed24-59be-4629-ba78-0e3fff6d853a service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Received event network-changed-1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:01.142734 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-24aa5af0-711d-448c-a818-89cc3a5e7979 req-d2f2ed24-59be-4629-ba78-0e3fff6d853a service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Refreshing instance network info cache due to event network-changed-1310931d-f17c-4382-be90-17f02d98b259. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:01:01.142974 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-24aa5af0-711d-448c-a818-89cc3a5e7979 req-d2f2ed24-59be-4629-ba78-0e3fff6d853a service nova] Acquiring lock "refresh_cache-7ebb66f2-020a-4b56-9fc1-f7162e96a609" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:01.143127 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-24aa5af0-711d-448c-a818-89cc3a5e7979 req-d2f2ed24-59be-4629-ba78-0e3fff6d853a service nova] Acquired lock "refresh_cache-7ebb66f2-020a-4b56-9fc1-f7162e96a609" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:01.143337 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-24aa5af0-711d-448c-a818-89cc3a5e7979 req-d2f2ed24-59be-4629-ba78-0e3fff6d853a service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Refreshing network info cache for port 1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:01:01.174424 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Creating config drive at /opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/disk.config.rescue
May 27 03:01:01.179234 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpinkfgcxe {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:01.196273 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:01:01.231634 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpinkfgcxe" returned: 0 in 0.052s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:01.317241 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:01:01.476798 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] instance snapshotting
May 27 03:01:01.581607 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Acquiring lock "refresh_cache-7ebb66f2-020a-4b56-9fc1-f7162e96a609" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:01.612634 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Beginning live snapshot process
May 27 03:01:01.619046 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:01:01.620625 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:01:01.621304 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Creating image(s)
May 27 03:01:01.621893 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ebb66f2-020a-4b56-9fc1-f7162e96a609/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:01.622272 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Lock "/opt/stack/data/nova/instances/7ebb66f2-020a-4b56-9fc1-f7162e96a609/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:01.622822 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Lock "/opt/stack/data/nova/instances/7ebb66f2-020a-4b56-9fc1-f7162e96a609/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:01.623545 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:01.628514 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:01.631377 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:01.650146 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-24aa5af0-711d-448c-a818-89cc3a5e7979 req-d2f2ed24-59be-4629-ba78-0e3fff6d853a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:01.729356 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:01.754058 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.123s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:01.754660 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:01.755281 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:01.756070 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:01.761962 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:01.762665 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:01.778407 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:01.790646 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-24aa5af0-711d-448c-a818-89cc3a5e7979 req-d2f2ed24-59be-4629-ba78-0e3fff6d853a service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:01:01.828096 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.735s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:01.830786 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.280s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:01.831921 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:01:01.841432 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:01:01.841635 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Claim successful on node np0000001475
May 27 03:01:01.869714 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.107s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:01.870435 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/7ebb66f2-020a-4b56-9fc1-f7162e96a609/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:01.891514 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:01.940722 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/7ebb66f2-020a-4b56-9fc1-f7162e96a609/disk 1073741824" returned: 0 in 0.070s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:01.941384 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:01.942449 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:01.978589 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:01.990774 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:02.048642 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-24aa5af0-711d-448c-a818-89cc3a5e7979 req-d2f2ed24-59be-4629-ba78-0e3fff6d853a service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:02.059945 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-de6a5500-672c-4433-8484-81d159e8437d req-37f06e87-208d-42e9-b8d4-5c27a3574b69 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received event network-vif-plugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:02.060561 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-de6a5500-672c-4433-8484-81d159e8437d req-37f06e87-208d-42e9-b8d4-5c27a3574b69 service nova] Acquiring lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:02.060890 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-de6a5500-672c-4433-8484-81d159e8437d req-37f06e87-208d-42e9-b8d4-5c27a3574b69 service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:02.061073 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-de6a5500-672c-4433-8484-81d159e8437d req-37f06e87-208d-42e9-b8d4-5c27a3574b69 service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:02.061274 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-de6a5500-672c-4433-8484-81d159e8437d req-37f06e87-208d-42e9-b8d4-5c27a3574b69 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] No waiting events found dispatching network-vif-plugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:02.061431 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-de6a5500-672c-4433-8484-81d159e8437d req-37f06e87-208d-42e9-b8d4-5c27a3574b69 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received unexpected event network-vif-plugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 for instance with vm_state active and task_state rescuing.
May 27 03:01:02.076711 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.135s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:02.078356 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ebb66f2-020a-4b56-9fc1-f7162e96a609/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:01:02.078356 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ebb66f2-020a-4b56-9fc1-f7162e96a609/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:02.193434 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ebb66f2-020a-4b56-9fc1-f7162e96a609/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:02.193434 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Cannot resize image /opt/stack/data/nova/instances/7ebb66f2-020a-4b56-9fc1-f7162e96a609/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:01:02.193937 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:01:02.193937 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Ensure instance console log exists: /opt/stack/data/nova/instances/7ebb66f2-020a-4b56-9fc1-f7162e96a609/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:01:02.195054 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:02.196228 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:02.196228 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:02.317394 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:02.317679 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:02.317679 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:02.317839 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No VIF found with MAC fa:16:3e:fc:b5:d4, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:01:02.318366 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Using config drive
May 27 03:01:02.339592 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:01:02.340507 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:01:02.343606 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:02.343606 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:02.460108 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b438796ed5e44f629535db767fe2b756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cbbdb9012c4992865d4f89678ef9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:01:02.538230 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:02.538451 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:02.538724 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:02.538980 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:02.539138 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:02.544214 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Terminating instance
May 27 03:01:02.551641 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-24aa5af0-711d-448c-a818-89cc3a5e7979 req-d2f2ed24-59be-4629-ba78-0e3fff6d853a service nova] Releasing lock "refresh_cache-7ebb66f2-020a-4b56-9fc1-f7162e96a609" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:02.552275 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Acquired lock "refresh_cache-7ebb66f2-020a-4b56-9fc1-f7162e96a609" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:02.552404 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:01:02.800001 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquiring lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:02.802048 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:02.821451 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lazy-loading 'ec2_ids' on Instance uuid 6ad1223d-d197-46e7-a32b-a25380d409a8 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:02.825780 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Removed pending STOPPED event for 7acda56f-e16c-4371-99b3-21eeea2904d1 due to new event <LifecycleEvent: 1779850862.825404, 7acda56f-e16c-4371-99b3-21eeea2904d1 => Resumed> {{(pid=98471) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 03:01:02.826046 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850862.825404, 7acda56f-e16c-4371-99b3-21eeea2904d1 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:02.826284 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] VM Resumed (Lifecycle Event)
May 27 03:01:02.832385 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c5a170cb-0c25-4a51-8b61-bc8dfcd6b394 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:02.846853 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:01:03.012012 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Successfully created port: 40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:01:03.051472 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:01:03.094024 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:03.099572 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:03.120478 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:03.127125 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:03.137585 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk --force-share --output=json -f qcow2 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:03.165402 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:01:03.172793 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:03.248927 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk --force-share --output=json -f qcow2" returned: 0 in 0.111s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:03.251576 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk --force-share --output=json -f qcow2 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:03.308989 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:01:03.325858 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Object Instance<6ad1223d-d197-46e7-a32b-a25380d409a8> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:03.326782 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lazy-loading 'keypairs' on Instance uuid 6ad1223d-d197-46e7-a32b-a25380d409a8 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:03.332105 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:03.340870 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:03.353701 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:01:03.374206 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk --force-share --output=json -f qcow2" returned: 0 in 0.123s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:03.375361 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:03.398927 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:03.400112 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:03.403241 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:03.447128 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:03.464091 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Instance destroyed successfully.
May 27 03:01:03.465780 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lazy-loading 'resources' on Instance uuid ebd2884b-67b5-40c1-8cf0-a22bd90be727 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:03.520652 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.117s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:03.521132 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7y_m7zul/c719236f004a450395273c6028f1e17d.delta 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:03.559974 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:03.591411 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7y_m7zul/c719236f004a450395273c6028f1e17d.delta 1073741824" returned: 0 in 0.069s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:03.591908 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Quiescing instance not available: QEMU guest agent is not enabled.
May 27 03:01:03.790398 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Updating instance_info_cache with network_info: [{"id": "1310931d-f17c-4382-be90-17f02d98b259", "address": "fa:16:3e:c5:22:0a", "network": {"id": "c3e308a2-5e87-43a2-ab60-37f9737a84ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba717c80697f454cbbe062e8cd8e5989", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1310931d-f1", "ovs_interfaceid": "1310931d-f17c-4382-be90-17f02d98b259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:03.834588 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Object Instance<6ad1223d-d197-46e7-a32b-a25380d409a8> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:03.841666 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 27 03:01:03.855786 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850863.853778, 7acda56f-e16c-4371-99b3-21eeea2904d1 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:03.855786 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] VM Started (Lifecycle Event)
May 27 03:01:03.901411 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:03.965572 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] COPY block job progress, current cursor: 0 final cursor: 76742656 {{(pid=98471) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 27 03:01:03.972324 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1481412241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-device-tagging-server-1481412241',id=12,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX3hrfXJylogloNcsVODyT6YV7aMSshELm9OJiUcOjH996gMpO5+kFiAKQhQX7ZkAoqoXhzYZQLrM0rlP3d/NY+cv+dBD4+nzGVXWnWfuAvNWMegazBzNSt2XeuVXBmtQ==',key_name='tempest-keypair-1422957137',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:59:46Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='997fc21542b04af2a2d9113d30f87b22',ramdisk_id='',reservation_id='r-b9zanhfv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1282046058',owner_user_name='tempest-TaggedAttachmentsTest-1282046058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:59:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff4b501bdb27488490da6b1032106687',uuid=ebd2884b-67b5-40c1-8cf0-a22bd90be727,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "address": "fa:16:3e:b8:34:46", "network": {"id": "00a82372-a9cb-4a7e-8f75-6883f0e85849", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2146755790-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cfc1d4d-e0", "ovs_interfaceid": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:01:03.972833 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Converting VIF {"id": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "address": "fa:16:3e:b8:34:46", "network": {"id": "00a82372-a9cb-4a7e-8f75-6883f0e85849", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2146755790-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "997fc21542b04af2a2d9113d30f87b22", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cfc1d4d-e0", "ovs_interfaceid": "6cfc1d4d-e055-4ba7-a926-19911b813fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:03.973681 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:34:46,bridge_name='br-int',has_traffic_filtering=True,id=6cfc1d4d-e055-4ba7-a926-19911b813fe0,network=Network(00a82372-a9cb-4a7e-8f75-6883f0e85849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cfc1d4d-e0') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:03.974008 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:34:46,bridge_name='br-int',has_traffic_filtering=True,id=6cfc1d4d-e055-4ba7-a926-19911b813fe0,network=Network(00a82372-a9cb-4a7e-8f75-6883f0e85849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cfc1d4d-e0') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:01:03.978210 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:03.978574 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cfc1d4d-e0, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:03.980858 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:03.982088 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:03.988197 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:03.992601 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:03.992898 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=93a82106-f2e8-4504-9aeb-a9b8ac8fa859) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:03.994363 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:03.995075 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:04.001643 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:04.004402 np0000001475 nova-compute[98471]: INFO os_vif [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:34:46,bridge_name='br-int',has_traffic_filtering=True,id=6cfc1d4d-e055-4ba7-a926-19911b813fe0,network=Network(00a82372-a9cb-4a7e-8f75-6883f0e85849),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cfc1d4d-e0')
May 27 03:01:04.004948 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Deleting instance files /opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727_del
May 27 03:01:04.006086 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:01:04.006449 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:01:04.008849 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Deletion of /opt/stack/data/nova/instances/ebd2884b-67b5-40c1-8cf0-a22bd90be727_del complete
May 27 03:01:04.051503 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Creating config drive at /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk.config
May 27 03:01:04.057844 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4yh_ylcr {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:04.096889 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Successfully updated port: 40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:01:04.120987 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4yh_ylcr" returned: 0 in 0.063s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:04.152621 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-51399d6b-8f3e-426f-bfa6-cc414f3b67a3 req-ac14d012-77e7-4231-a730-6d3fd349ebbf service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received event network-vif-plugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:04.152621 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-51399d6b-8f3e-426f-bfa6-cc414f3b67a3 req-ac14d012-77e7-4231-a730-6d3fd349ebbf service nova] Acquiring lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:04.152621 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-51399d6b-8f3e-426f-bfa6-cc414f3b67a3 req-ac14d012-77e7-4231-a730-6d3fd349ebbf service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:04.152725 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-51399d6b-8f3e-426f-bfa6-cc414f3b67a3 req-ac14d012-77e7-4231-a730-6d3fd349ebbf service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:04.152942 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-51399d6b-8f3e-426f-bfa6-cc414f3b67a3 req-ac14d012-77e7-4231-a730-6d3fd349ebbf service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] No waiting events found dispatching network-vif-plugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:04.152942 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-51399d6b-8f3e-426f-bfa6-cc414f3b67a3 req-ac14d012-77e7-4231-a730-6d3fd349ebbf service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received unexpected event network-vif-plugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 for instance with vm_state rescued and task_state unrescuing.
May 27 03:01:04.153324 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-51399d6b-8f3e-426f-bfa6-cc414f3b67a3 req-ac14d012-77e7-4231-a730-6d3fd349ebbf service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Received event network-vif-unplugged-6cfc1d4d-e055-4ba7-a926-19911b813fe0 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:04.153324 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-51399d6b-8f3e-426f-bfa6-cc414f3b67a3 req-ac14d012-77e7-4231-a730-6d3fd349ebbf service nova] Acquiring lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:04.153324 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-51399d6b-8f3e-426f-bfa6-cc414f3b67a3 req-ac14d012-77e7-4231-a730-6d3fd349ebbf service nova] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:04.153429 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-51399d6b-8f3e-426f-bfa6-cc414f3b67a3 req-ac14d012-77e7-4231-a730-6d3fd349ebbf service nova] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:04.153461 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-51399d6b-8f3e-426f-bfa6-cc414f3b67a3 req-ac14d012-77e7-4231-a730-6d3fd349ebbf service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] No waiting events found dispatching network-vif-unplugged-6cfc1d4d-e055-4ba7-a926-19911b813fe0 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:04.153760 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-51399d6b-8f3e-426f-bfa6-cc414f3b67a3 req-ac14d012-77e7-4231-a730-6d3fd349ebbf service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Received event network-vif-unplugged-6cfc1d4d-e055-4ba7-a926-19911b813fe0 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:01:04.153760 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-51399d6b-8f3e-426f-bfa6-cc414f3b67a3 req-ac14d012-77e7-4231-a730-6d3fd349ebbf service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Received event network-vif-unplugged-6cfc1d4d-e055-4ba7-a926-19911b813fe0 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:04.154886 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-51399d6b-8f3e-426f-bfa6-cc414f3b67a3 req-ac14d012-77e7-4231-a730-6d3fd349ebbf service nova] Acquiring lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:04.154886 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-51399d6b-8f3e-426f-bfa6-cc414f3b67a3 req-ac14d012-77e7-4231-a730-6d3fd349ebbf service nova] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:04.154886 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-51399d6b-8f3e-426f-bfa6-cc414f3b67a3 req-ac14d012-77e7-4231-a730-6d3fd349ebbf service nova] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:04.154886 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-51399d6b-8f3e-426f-bfa6-cc414f3b67a3 req-ac14d012-77e7-4231-a730-6d3fd349ebbf service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] No waiting events found dispatching network-vif-unplugged-6cfc1d4d-e055-4ba7-a926-19911b813fe0 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:04.154886 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-51399d6b-8f3e-426f-bfa6-cc414f3b67a3 req-ac14d012-77e7-4231-a730-6d3fd349ebbf service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Received event network-vif-unplugged-6cfc1d4d-e055-4ba7-a926-19911b813fe0 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:01:04.292435 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Releasing lock "refresh_cache-7ebb66f2-020a-4b56-9fc1-f7162e96a609" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:04.292907 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Instance network_info: |[{"id": "1310931d-f17c-4382-be90-17f02d98b259", "address": "fa:16:3e:c5:22:0a", "network": {"id": "c3e308a2-5e87-43a2-ab60-37f9737a84ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba717c80697f454cbbe062e8cd8e5989", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1310931d-f1", "ovs_interfaceid": "1310931d-f17c-4382-be90-17f02d98b259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:01:04.294486 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Start _get_guest_xml network_info=[{"id": "1310931d-f17c-4382-be90-17f02d98b259", "address": "fa:16:3e:c5:22:0a", "network": {"id": "c3e308a2-5e87-43a2-ab60-37f9737a84ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba717c80697f454cbbe062e8cd8e5989", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1310931d-f1", "ovs_interfaceid": "1310931d-f17c-4382-be90-17f02d98b259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:01:04.297475 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:01:04.298679 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-VolumesNegativeTest-instance-1892004214', uuid='7ebb66f2-020a-4b56-9fc1-f7162e96a609'), owner=OwnerMeta(userid='38d53ffb20cd45a4b6bbe42d0404b0fd', username='tempest-VolumesNegativeTest-1026582036-project-member', projectid='89238d7609db41788c5908672dda670a', projectname='tempest-VolumesNegativeTest-1026582036'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1310931d-f17c-4382-be90-17f02d98b259", "address": "fa:16:3e:c5:22:0a", "network": {"id": "c3e308a2-5e87-43a2-ab60-37f9737a84ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba717c80697f454cbbe062e8cd8e5989", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1310931d-f1", "ovs_interfaceid": "1310931d-f17c-4382-be90-17f02d98b259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850864.2983336) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:01:04.302049 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-aa1c8518-57c7-47b6-bd32-9b3910a2a102 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Unrescuing
May 27 03:01:04.302724 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:01:04.302922 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-aa1c8518-57c7-47b6-bd32-9b3910a2a102 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "refresh_cache-7acda56f-e16c-4371-99b3-21eeea2904d1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:04.303080 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-aa1c8518-57c7-47b6-bd32-9b3910a2a102 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquired lock "refresh_cache-7acda56f-e16c-4371-99b3-21eeea2904d1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:04.303301 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-aa1c8518-57c7-47b6-bd32-9b3910a2a102 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:01:04.304549 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:01:04.305846 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:01:04.306313 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:01:04.307586 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:01:04.308094 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:01:04.308578 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:01:04.308728 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:01:04.308929 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:01:04.309063 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:01:04.309197 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:01:04.309415 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:01:04.309545 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:01:04.309694 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:01:04.309956 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:01:04.310126 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:01:04.323172 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1892004214',display_name='tempest-VolumesNegativeTest-instance-1892004214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesnegativetest-instance-1892004214',id=19,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89238d7609db41788c5908672dda670a',ramdisk_id='',reservation_id='r-9j0c94ib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1026582036',owner_user_name='tempest-VolumesNegativeTest-1026582036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:01Z,user_data=None,user_id='38d53ffb20cd45a4b6bbe42d0404b0fd',uuid=7ebb66f2-020a-4b56-9fc1-f7162e96a609,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1310931d-f17c-4382-be90-17f02d98b259", "address": "fa:16:3e:c5:22:0a", "network": {"id": "c3e308a2-5e87-43a2-ab60-37f9737a84ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba717c80697f454cbbe062e8cd8e5989", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1310931d-f1", "ovs_interfaceid": "1310931d-f17c-4382-be90-17f02d98b259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:01:04.323502 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Converting VIF {"id": "1310931d-f17c-4382-be90-17f02d98b259", "address": "fa:16:3e:c5:22:0a", "network": {"id": "c3e308a2-5e87-43a2-ab60-37f9737a84ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba717c80697f454cbbe062e8cd8e5989", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1310931d-f1", "ovs_interfaceid": "1310931d-f17c-4382-be90-17f02d98b259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:04.324028 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=1310931d-f17c-4382-be90-17f02d98b259,network=Network(c3e308a2-5e87-43a2-ab60-37f9737a84ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1310931d-f1') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:04.324685 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ebb66f2-020a-4b56-9fc1-f7162e96a609 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:04.357299 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:04.359514 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:04.376327 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:01:04.377366 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:01:04.377642 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Creating image(s)
May 27 03:01:04.378100 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:04.378290 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "/opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:04.379188 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "/opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:04.380372 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:04.384506 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:04.388564 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:04.473213 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] COPY block job progress, current cursor: 76742656 final cursor: 76742656 {{(pid=98471) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 27 03:01:04.475683 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Skipping quiescing instance: QEMU guest agent is not enabled.
May 27 03:01:04.482613 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.094s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:04.483176 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:04.483763 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:04.484337 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:04.487125 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:04.487856 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:04.525214 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:01:04.540184 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Took 1.48 seconds to destroy the instance on the hypervisor.
May 27 03:01:04.545845 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:01:04.545845 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:01:04.545845 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:01:04.545845 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:04.589770 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.102s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:04.590299 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:04.610042 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "refresh_cache-4e583b08-e323-4681-9e95-01767f510590" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:04.610431 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquired lock "refresh_cache-4e583b08-e323-4681-9e95-01767f510590" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:04.610642 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:01:04.642845 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:04.662615 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk 1073741824" returned: 0 in 0.072s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:04.663138 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.179s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:04.664091 np0000001475 nova-compute[98471]: DEBUG nova.privsep.utils [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98471) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 03:01:04.664535 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:04.687457 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7y_m7zul/c719236f004a450395273c6028f1e17d.delta /opt/stack/data/nova/instances/snapshots/tmp7y_m7zul/c719236f004a450395273c6028f1e17d {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:04.687457 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:04.778988 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:04.783841 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.119s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:04.785246 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:01:04.785625 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:04.803384 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:04.809970 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-aa1c8518-57c7-47b6-bd32-9b3910a2a102 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:04.835905 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] End _get_guest_xml xml=<domain type="qemu">
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:   <uuid>7ebb66f2-020a-4b56-9fc1-f7162e96a609</uuid>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:   <name>instance-00000013</name>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <nova:name>tempest-VolumesNegativeTest-instance-1892004214</nova:name>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:01:04</nova:creationTime>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:         <nova:user uuid="38d53ffb20cd45a4b6bbe42d0404b0fd">tempest-VolumesNegativeTest-1026582036-project-member</nova:user>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:         <nova:project uuid="89238d7609db41788c5908672dda670a">tempest-VolumesNegativeTest-1026582036</nova:project>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:         <nova:port uuid="1310931d-f17c-4382-be90-17f02d98b259">
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="192.168.233.96" ipVersion="4"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     <system>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <entry name="serial">7ebb66f2-020a-4b56-9fc1-f7162e96a609</entry>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <entry name="uuid">7ebb66f2-020a-4b56-9fc1-f7162e96a609</entry>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     </system>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:   <os>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:   </os>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:   <features>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:   </features>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:   <devices>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/7ebb66f2-020a-4b56-9fc1-f7162e96a609/disk"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/7ebb66f2-020a-4b56-9fc1-f7162e96a609/disk.config"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:c5:22:0a"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <target dev="tap1310931d-f1"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     </interface>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/7ebb66f2-020a-4b56-9fc1-f7162e96a609/console.log" append="off"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     </serial>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     <video>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     </video>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     </rng>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:   </devices>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]: </domain>
May 27 03:01:04.835905 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:01:04.835905 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Preparing to wait for external event network-vif-plugged-1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:01:04.835905 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Acquiring lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:04.835905 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:04.835905 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:04.842907 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1892004214',display_name='tempest-VolumesNegativeTest-instance-1892004214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesnegativetest-instance-1892004214',id=19,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89238d7609db41788c5908672dda670a',ramdisk_id='',reservation_id='r-9j0c94ib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1026582036',owner_user_name='tempest-VolumesNegativeTest-1026582036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:01Z,user_data=None,user_id='38d53ffb20cd45a4b6bbe42d0404b0fd',uuid=7ebb66f2-020a-4b56-9fc1-f7162e96a609,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1310931d-f17c-4382-be90-17f02d98b259", "address": "fa:16:3e:c5:22:0a", "network": {"id": "c3e308a2-5e87-43a2-ab60-37f9737a84ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba717c80697f454cbbe062e8cd8e5989", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1310931d-f1", "ovs_interfaceid": "1310931d-f17c-4382-be90-17f02d98b259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:01:04.842907 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Converting VIF {"id": "1310931d-f17c-4382-be90-17f02d98b259", "address": "fa:16:3e:c5:22:0a", "network": {"id": "c3e308a2-5e87-43a2-ab60-37f9737a84ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba717c80697f454cbbe062e8cd8e5989", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1310931d-f1", "ovs_interfaceid": "1310931d-f17c-4382-be90-17f02d98b259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:04.842907 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=1310931d-f17c-4382-be90-17f02d98b259,network=Network(c3e308a2-5e87-43a2-ab60-37f9737a84ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1310931d-f1') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:04.842907 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=1310931d-f17c-4382-be90-17f02d98b259,network=Network(c3e308a2-5e87-43a2-ab60-37f9737a84ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1310931d-f1') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:01:04.842907 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:04.842907 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:04.842907 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:01:04.846798 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:04.848995 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c76a9ca-fe72-51b0-8f3f-6bdc6dc13544', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:04.853652 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:04.853652 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:04.858010 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:04.859014 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1310931d-f1, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:04.859433 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1310931d-f1, col_values=(('qos', UUID('88c313e8-aefd-4cd1-b937-167de1cb2275')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:04.859686 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1310931d-f1, col_values=(('external_ids', {'iface-id': '1310931d-f17c-4382-be90-17f02d98b259', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:22:0a', 'vm-uuid': '7ebb66f2-020a-4b56-9fc1-f7162e96a609'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:04.862913 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:04.863274 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 27 03:01:04.867944 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:04.869713 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999677082000062 future=<Future at 0x75572c4c3860 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:04.872193 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:04.875717 np0000001475 nova-compute[98471]: INFO os_vif [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=1310931d-f17c-4382-be90-17f02d98b259,network=Network(c3e308a2-5e87-43a2-ab60-37f9737a84ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1310931d-f1')
May 27 03:01:04.891062 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:04.892083 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Cannot resize image /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:01:04.892083 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:01:04.892083 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Ensure instance console log exists: /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:01:04.897405 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:04.898275 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:04.898275 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:04.904638 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7251a6d5-dd35-4c6d-9056-02c8c4208409 req-678ee875-c6ed-4efc-bf9c-c81a7cead257 service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Received event network-vif-unplugged-1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:04.905117 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7251a6d5-dd35-4c6d-9056-02c8c4208409 req-678ee875-c6ed-4efc-bf9c-c81a7cead257 service nova] Acquiring lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:04.905117 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7251a6d5-dd35-4c6d-9056-02c8c4208409 req-678ee875-c6ed-4efc-bf9c-c81a7cead257 service nova] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:04.907886 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7251a6d5-dd35-4c6d-9056-02c8c4208409 req-678ee875-c6ed-4efc-bf9c-c81a7cead257 service nova] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:04.908548 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:04.909489 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7251a6d5-dd35-4c6d-9056-02c8c4208409 req-678ee875-c6ed-4efc-bf9c-c81a7cead257 service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] No event matching network-vif-unplugged-1310931d-f17c-4382-be90-17f02d98b259 in dict_keys([('network-vif-plugged', '1310931d-f17c-4382-be90-17f02d98b259')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 03:01:04.909653 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-7251a6d5-dd35-4c6d-9056-02c8c4208409 req-678ee875-c6ed-4efc-bf9c-c81a7cead257 service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Received unexpected event network-vif-unplugged-1310931d-f17c-4382-be90-17f02d98b259 for instance with vm_state building and task_state spawning.
May 27 03:01:04.917992 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:05.041067 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.212s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:05.043146 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 6.232s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:05.044818 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:01:05.058710 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:01:05.058923 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Claim successful on node np0000001475
May 27 03:01:05.073818 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7y_m7zul/c719236f004a450395273c6028f1e17d.delta /opt/stack/data/nova/instances/snapshots/tmp7y_m7zul/c719236f004a450395273c6028f1e17d" returned: 0 in 0.389s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:05.081132 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Snapshot extracted, beginning image upload
May 27 03:01:05.164200 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0038076440000622824 future=<Future at 0x755704604ad0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:05.164330 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:05.164520 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=0.34277184899997337 future=<Future at 0x75572c282030 state=cancelled>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:05.164768 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=0.3426495319999958 future=<Future at 0x75572c282030 state=cancelled>) was cancelled while queued, skipping {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:05.164768 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:05.164856 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.704514750000044 future=<Future at 0x75572c4c3860 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:05.165863 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.704401381000025 future=<Future at 0x75572c4c3860 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:05.165863 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Emitting event <LifecycleEvent: 1779850850.1601965, 6ad1223d-d197-46e7-a32b-a25380d409a8 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:05.165863 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] VM Stopped (Lifecycle Event)
May 27 03:01:05.275925 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:01:05.322377 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-aa1c8518-57c7-47b6-bd32-9b3910a2a102 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:05.498334 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:05.513422 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-aa1c8518-57c7-47b6-bd32-9b3910a2a102 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Updating instance_info_cache with network_info: [{"id": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "address": "fa:16:3e:7e:90:4a", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped993fcc-f7", "ovs_interfaceid": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:05.555415 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:01:05.555614 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:01:05.555951 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:05.556205 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:05.658259 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b438796ed5e44f629535db767fe2b756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cbbdb9012c4992865d4f89678ef9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:01:05.670335 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Updating instance_info_cache with network_info: [{"id": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "address": "fa:16:3e:01:3d:37", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e0fddb-8c", "ovs_interfaceid": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:05.675077 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:05.748037 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Instance event wait completed in 0 seconds for  {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:01:05.748037 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850865.7470427, 6ad1223d-d197-46e7-a32b-a25380d409a8 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:05.748037 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:01:05.748892 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] VM Resumed (Lifecycle Event)
May 27 03:01:05.755027 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Instance spawned successfully.
May 27 03:01:05.756991 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:01:05.880737 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:05.939011 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:06.016583 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-aa1c8518-57c7-47b6-bd32-9b3910a2a102 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Releasing lock "refresh_cache-7acda56f-e16c-4371-99b3-21eeea2904d1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:06.017325 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-aa1c8518-57c7-47b6-bd32-9b3910a2a102 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'flavor' on Instance uuid 7acda56f-e16c-4371-99b3-21eeea2904d1 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:06.057389 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:01:06.176515 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Releasing lock "refresh_cache-4e583b08-e323-4681-9e95-01767f510590" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:06.177185 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Instance network_info: |[{"id": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "address": "fa:16:3e:01:3d:37", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e0fddb-8c", "ovs_interfaceid": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:01:06.184706 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Start _get_guest_xml network_info=[{"id": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "address": "fa:16:3e:01:3d:37", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e0fddb-8c", "ovs_interfaceid": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:01:06.190174 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:01:06.191778 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1569279092', uuid='4e583b08-e323-4681-9e95-01767f510590'), owner=OwnerMeta(userid='b438796ed5e44f629535db767fe2b756', username='tempest-ServerRescueNegativeTestJSON-62027498-project-member', projectid='39cbbdb9012c4992865d4f89678ef9ac', projectname='tempest-ServerRescueNegativeTestJSON-62027498'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "address": "fa:16:3e:01:3d:37", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e0fddb-8c", "ovs_interfaceid": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850866.1906989) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:01:06.194964 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:01:06.194964 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:01:06.195460 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:01:06.195821 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:01:06.196909 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:01:06.199811 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:01:06.199811 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:01:06.199811 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:01:06.199811 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:01:06.199811 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:01:06.199811 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:01:06.199811 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:01:06.199811 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:01:06.199811 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:01:06.200328 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:01:06.200328 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:01:06.222883 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1569279092',display_name='tempest-ServerRescueNegativeTestJSON-server-1569279092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverrescuenegativetestjson-server-1569279092',id=20,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39cbbdb9012c4992865d4f89678ef9ac',ramdisk_id='',reservation_id='r-noabdp10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-62027498',owner_user_name='tempest-ServerRescueNegativeTestJSON-62027498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:03Z,user_data=None,user_id='b438796ed5e44f629535db767fe2b756',uuid=4e583b08-e323-4681-9e95-01767f510590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "address": "fa:16:3e:01:3d:37", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e0fddb-8c", "ovs_interfaceid": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:01:06.223053 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converting VIF {"id": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "address": "fa:16:3e:01:3d:37", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e0fddb-8c", "ovs_interfaceid": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:06.224223 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=40e0fddb-8cd7-4dee-81b1-860e4ca7040c,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e0fddb-8c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:06.224374 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e583b08-e323-4681-9e95-01767f510590 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:06.247473 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5518f090-ccc5-4826-b1e6-9b8775f10677 req-2adaa802-4b60-45eb-994a-4a0b62e6f1d5 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received event network-changed-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:06.247473 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5518f090-ccc5-4826-b1e6-9b8775f10677 req-2adaa802-4b60-45eb-994a-4a0b62e6f1d5 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Refreshing instance network info cache due to event network-changed-40e0fddb-8cd7-4dee-81b1-860e4ca7040c. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:01:06.247473 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5518f090-ccc5-4826-b1e6-9b8775f10677 req-2adaa802-4b60-45eb-994a-4a0b62e6f1d5 service nova] Acquiring lock "refresh_cache-4e583b08-e323-4681-9e95-01767f510590" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:06.247473 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5518f090-ccc5-4826-b1e6-9b8775f10677 req-2adaa802-4b60-45eb-994a-4a0b62e6f1d5 service nova] Acquired lock "refresh_cache-4e583b08-e323-4681-9e95-01767f510590" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:06.247473 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-5518f090-ccc5-4826-b1e6-9b8775f10677 req-2adaa802-4b60-45eb-994a-4a0b62e6f1d5 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Refreshing network info cache for port 40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:01:06.256042 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:06.258255 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:06.264602 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:06.264785 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:06.265102 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:06.265372 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:06.265660 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:06.266000 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:06.279763 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Successfully created port: fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:01:06.387226 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Took 1.84 seconds to deallocate network for instance.
May 27 03:01:06.411895 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:06.412193 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:06.412294 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] No VIF found with MAC fa:16:3e:c5:22:0a, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:01:06.412873 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Using config drive
May 27 03:01:06.556670 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:06.561472 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:06.562087 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:01:06.593731 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:06.731716 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] End _get_guest_xml xml=<domain type="qemu">
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:   <uuid>4e583b08-e323-4681-9e95-01767f510590</uuid>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:   <name>instance-00000014</name>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1569279092</nova:name>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:01:06</nova:creationTime>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:         <nova:user uuid="b438796ed5e44f629535db767fe2b756">tempest-ServerRescueNegativeTestJSON-62027498-project-member</nova:user>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:         <nova:project uuid="39cbbdb9012c4992865d4f89678ef9ac">tempest-ServerRescueNegativeTestJSON-62027498</nova:project>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:         <nova:port uuid="40e0fddb-8cd7-4dee-81b1-860e4ca7040c">
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     <system>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <entry name="serial">4e583b08-e323-4681-9e95-01767f510590</entry>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <entry name="uuid">4e583b08-e323-4681-9e95-01767f510590</entry>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     </system>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:   <os>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:   </os>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:   <features>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:   </features>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:   <devices>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.config"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:01:3d:37"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <target dev="tap40e0fddb-8c"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     </interface>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/console.log" append="off"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     </serial>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     <video>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     </video>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     </rng>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:   </devices>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]: </domain>
May 27 03:01:06.731716 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:01:06.731716 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Preparing to wait for external event network-vif-plugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:01:06.733984 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "4e583b08-e323-4681-9e95-01767f510590-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:06.733984 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "4e583b08-e323-4681-9e95-01767f510590-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:06.733984 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "4e583b08-e323-4681-9e95-01767f510590-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:06.733984 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1569279092',display_name='tempest-ServerRescueNegativeTestJSON-server-1569279092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverrescuenegativetestjson-server-1569279092',id=20,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39cbbdb9012c4992865d4f89678ef9ac',ramdisk_id='',reservation_id='r-noabdp10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-62027498',owner_user_name='tempest-ServerRescueNegativeTestJSON-62027498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:03Z,user_data=None,user_id='b438796ed5e44f629535db767fe2b756',uuid=4e583b08-e323-4681-9e95-01767f510590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "address": "fa:16:3e:01:3d:37", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e0fddb-8c", "ovs_interfaceid": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:01:06.733984 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converting VIF {"id": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "address": "fa:16:3e:01:3d:37", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e0fddb-8c", "ovs_interfaceid": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:06.736511 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=40e0fddb-8cd7-4dee-81b1-860e4ca7040c,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e0fddb-8c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:06.736511 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=40e0fddb-8cd7-4dee-81b1-860e4ca7040c,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e0fddb-8c') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:01:06.737567 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:06.737567 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:06.737567 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:01:06.739612 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:06.739612 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f48fd9dc-2749-5249-93de-916f4553f2a2', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:06.741159 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:06.742999 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:06.753595 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:06.755289 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-5518f090-ccc5-4826-b1e6-9b8775f10677 req-2adaa802-4b60-45eb-994a-4a0b62e6f1d5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:06.763517 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 27 03:01:06.765552 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:06.768425 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40e0fddb-8c, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:06.768425 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40e0fddb-8c, col_values=(('qos', UUID('67dfa4fe-b63a-40eb-82bb-ae911696e8cb')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:06.769262 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40e0fddb-8c, col_values=(('external_ids', {'iface-id': '40e0fddb-8cd7-4dee-81b1-860e4ca7040c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:3d:37', 'vm-uuid': '4e583b08-e323-4681-9e95-01767f510590'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:06.770390 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850866.7694614, 6ad1223d-d197-46e7-a32b-a25380d409a8 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:06.770390 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] VM Started (Lifecycle Event)
May 27 03:01:06.771578 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:06.777583 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:06.784081 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:06.788090 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:06.791586 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:06.792878 np0000001475 nova-compute[98471]: INFO os_vif [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=40e0fddb-8cd7-4dee-81b1-860e4ca7040c,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e0fddb-8c')
May 27 03:01:06.810788 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:06.899930 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:06.903538 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Instance destroyed successfully.
May 27 03:01:06.904146 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-aa1c8518-57c7-47b6-bd32-9b3910a2a102 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'numa_topology' on Instance uuid 7acda56f-e16c-4371-99b3-21eeea2904d1 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:07.130911 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:07.137897 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d3e2c949-e0c6-4f3f-bc32-2970efce7f21 req-488970cf-e933-4458-a9d0-6589bbfc0247 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Received event network-vif-plugged-28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:07.142147 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d3e2c949-e0c6-4f3f-bc32-2970efce7f21 req-488970cf-e933-4458-a9d0-6589bbfc0247 service nova] Acquiring lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:07.142839 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d3e2c949-e0c6-4f3f-bc32-2970efce7f21 req-488970cf-e933-4458-a9d0-6589bbfc0247 service nova] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:07.143006 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d3e2c949-e0c6-4f3f-bc32-2970efce7f21 req-488970cf-e933-4458-a9d0-6589bbfc0247 service nova] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:07.144531 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d3e2c949-e0c6-4f3f-bc32-2970efce7f21 req-488970cf-e933-4458-a9d0-6589bbfc0247 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] No waiting events found dispatching network-vif-plugged-28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:07.144531 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-d3e2c949-e0c6-4f3f-bc32-2970efce7f21 req-488970cf-e933-4458-a9d0-6589bbfc0247 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Received unexpected event network-vif-plugged-28ae6612-6474-4d47-8296-02394b0dabe5 for instance with vm_state active and task_state None.
May 27 03:01:07.144531 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d3e2c949-e0c6-4f3f-bc32-2970efce7f21 req-488970cf-e933-4458-a9d0-6589bbfc0247 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Received event network-vif-plugged-28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:07.144531 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d3e2c949-e0c6-4f3f-bc32-2970efce7f21 req-488970cf-e933-4458-a9d0-6589bbfc0247 service nova] Acquiring lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:07.144531 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d3e2c949-e0c6-4f3f-bc32-2970efce7f21 req-488970cf-e933-4458-a9d0-6589bbfc0247 service nova] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:07.144531 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d3e2c949-e0c6-4f3f-bc32-2970efce7f21 req-488970cf-e933-4458-a9d0-6589bbfc0247 service nova] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:07.144531 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d3e2c949-e0c6-4f3f-bc32-2970efce7f21 req-488970cf-e933-4458-a9d0-6589bbfc0247 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] No waiting events found dispatching network-vif-plugged-28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:07.144531 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-d3e2c949-e0c6-4f3f-bc32-2970efce7f21 req-488970cf-e933-4458-a9d0-6589bbfc0247 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Received unexpected event network-vif-plugged-28ae6612-6474-4d47-8296-02394b0dabe5 for instance with vm_state active and task_state None.
May 27 03:01:07.188599 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Successfully updated port: fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:01:07.276051 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-62efb3ee-641b-4225-970e-4778d114cb90 req-2f55934e-8d88-4124-b2c0-9f1ad0cb4c49 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received event network-changed-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:07.276212 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-62efb3ee-641b-4225-970e-4778d114cb90 req-2f55934e-8d88-4124-b2c0-9f1ad0cb4c49 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Refreshing instance network info cache due to event network-changed-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:01:07.276394 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-62efb3ee-641b-4225-970e-4778d114cb90 req-2f55934e-8d88-4124-b2c0-9f1ad0cb4c49 service nova] Acquiring lock "refresh_cache-66b799ed-716a-4b29-8125-bac73213f2cf" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:07.276496 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-62efb3ee-641b-4225-970e-4778d114cb90 req-2f55934e-8d88-4124-b2c0-9f1ad0cb4c49 service nova] Acquired lock "refresh_cache-66b799ed-716a-4b29-8125-bac73213f2cf" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:07.276600 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-62efb3ee-641b-4225-970e-4778d114cb90 req-2f55934e-8d88-4124-b2c0-9f1ad0cb4c49 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Refreshing network info cache for port fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:01:07.281503 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:07.283934 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:07.306262 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:07.335354 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:01:07.336116 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:01:07.363041 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Creating config drive at /opt/stack/data/nova/instances/7ebb66f2-020a-4b56-9fc1-f7162e96a609/disk.config
May 27 03:01:07.367390 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7ebb66f2-020a-4b56-9fc1-f7162e96a609/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpygsr3jg3 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:07.412373 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-aa1c8518-57c7-47b6-bd32-9b3910a2a102 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Object Instance<7acda56f-e16c-4371-99b3-21eeea2904d1> lazy-loaded attributes: flavor,numa_topology {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:07.437145 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7ebb66f2-020a-4b56-9fc1-f7162e96a609/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpygsr3jg3" returned: 0 in 0.070s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:07.503554 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-5518f090-ccc5-4826-b1e6-9b8775f10677 req-2adaa802-4b60-45eb-994a-4a0b62e6f1d5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:07.628656 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:01:07.630471 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:01:07.630684 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Creating image(s)
May 27 03:01:07.631339 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "/opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:07.631523 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "/opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:07.632709 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "/opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:07.632906 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:07.637207 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:07.638913 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:07.693769 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "refresh_cache-66b799ed-716a-4b29-8125-bac73213f2cf" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:07.727466 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-5518f090-ccc5-4826-b1e6-9b8775f10677 req-2adaa802-4b60-45eb-994a-4a0b62e6f1d5 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Updated VIF entry in instance network info cache for port 40e0fddb-8cd7-4dee-81b1-860e4ca7040c. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:01:07.728434 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-5518f090-ccc5-4826-b1e6-9b8775f10677 req-2adaa802-4b60-45eb-994a-4a0b62e6f1d5 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Updating instance_info_cache with network_info: [{"id": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "address": "fa:16:3e:01:3d:37", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e0fddb-8c", "ovs_interfaceid": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:07.763166 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.125s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:07.767245 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:07.768940 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:07.769394 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:07.777947 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:07.779726 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:07.803774 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-62efb3ee-641b-4225-970e-4778d114cb90 req-2f55934e-8d88-4124-b2c0-9f1ad0cb4c49 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:07.832222 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999458526999888 future=<Future at 0x7557047aa600 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:07.840010 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:01:07.915603 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.136s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:07.916245 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:07.967603 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-62efb3ee-641b-4225-970e-4778d114cb90 req-2f55934e-8d88-4124-b2c0-9f1ad0cb4c49 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:01:07.988571 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk 1073741824" returned: 0 in 0.072s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:07.989338 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:07.990291 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:08.106442 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.116s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:08.109053 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:01:08.109053 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:08.208866 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:08.209603 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Cannot resize image /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:01:08.210293 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:01:08.210757 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Ensure instance console log exists: /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:01:08.211210 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:08.211588 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:08.213161 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:08.227498 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-62efb3ee-641b-4225-970e-4778d114cb90 req-2f55934e-8d88-4124-b2c0-9f1ad0cb4c49 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:08.232992 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5518f090-ccc5-4826-b1e6-9b8775f10677 req-2adaa802-4b60-45eb-994a-4a0b62e6f1d5 service nova] Releasing lock "refresh_cache-4e583b08-e323-4681-9e95-01767f510590" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:08.232992 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5518f090-ccc5-4826-b1e6-9b8775f10677 req-2adaa802-4b60-45eb-994a-4a0b62e6f1d5 service nova] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Received event network-vif-deleted-6cfc1d4d-e055-4ba7-a926-19911b813fe0 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:08.352129 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:08.352129 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:08.352129 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No VIF found with MAC fa:16:3e:01:3d:37, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:01:08.352129 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Using config drive
May 27 03:01:08.363587 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ba693894-a9f0-4100-8d7f-575d1f72b58d req-d167a100-c57a-47b5-97ba-8cbbb118a1c6 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received event network-vif-unplugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:08.363587 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ba693894-a9f0-4100-8d7f-575d1f72b58d req-d167a100-c57a-47b5-97ba-8cbbb118a1c6 service nova] Acquiring lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:08.363846 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ba693894-a9f0-4100-8d7f-575d1f72b58d req-d167a100-c57a-47b5-97ba-8cbbb118a1c6 service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:08.363998 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ba693894-a9f0-4100-8d7f-575d1f72b58d req-d167a100-c57a-47b5-97ba-8cbbb118a1c6 service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:08.364204 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ba693894-a9f0-4100-8d7f-575d1f72b58d req-d167a100-c57a-47b5-97ba-8cbbb118a1c6 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] No waiting events found dispatching network-vif-unplugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:08.364763 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-ba693894-a9f0-4100-8d7f-575d1f72b58d req-d167a100-c57a-47b5-97ba-8cbbb118a1c6 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received unexpected event network-vif-unplugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 for instance with vm_state rescued and task_state unrescuing.
May 27 03:01:08.365417 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ba693894-a9f0-4100-8d7f-575d1f72b58d req-d167a100-c57a-47b5-97ba-8cbbb118a1c6 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received event network-vif-unplugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:08.365417 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ba693894-a9f0-4100-8d7f-575d1f72b58d req-d167a100-c57a-47b5-97ba-8cbbb118a1c6 service nova] Acquiring lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:08.365417 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ba693894-a9f0-4100-8d7f-575d1f72b58d req-d167a100-c57a-47b5-97ba-8cbbb118a1c6 service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:08.365593 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ba693894-a9f0-4100-8d7f-575d1f72b58d req-d167a100-c57a-47b5-97ba-8cbbb118a1c6 service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:08.365647 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ba693894-a9f0-4100-8d7f-575d1f72b58d req-d167a100-c57a-47b5-97ba-8cbbb118a1c6 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] No waiting events found dispatching network-vif-unplugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:08.365817 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-ba693894-a9f0-4100-8d7f-575d1f72b58d req-d167a100-c57a-47b5-97ba-8cbbb118a1c6 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received unexpected event network-vif-unplugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 for instance with vm_state rescued and task_state unrescuing.
May 27 03:01:08.371146 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.329s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:08.381129 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:01:08.387548 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:08.393382 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.487s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:08.406983 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:01:08.407553 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Claim successful on node np0000001475
May 27 03:01:08.416430 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:08.532765 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:08.610732 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:08.621002 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:08.626362 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:08.633882 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:08.678539 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:08.739558 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-62efb3ee-641b-4225-970e-4778d114cb90 req-2f55934e-8d88-4124-b2c0-9f1ad0cb4c49 service nova] Releasing lock "refresh_cache-66b799ed-716a-4b29-8125-bac73213f2cf" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:08.740970 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquired lock "refresh_cache-66b799ed-716a-4b29-8125-bac73213f2cf" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:08.741217 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:01:08.757154 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Snapshot image upload complete
May 27 03:01:08.757415 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-3ecfbaf9-e597-40a3-ae86-e7436d4279d7 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Took 7.28 seconds to snapshot the instance on the hypervisor.
May 27 03:01:08.838772 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:08.863414 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:08.897074 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:01:08.897074 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:01:08.897074 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:08.897074 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:09.085079 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Creating config drive at /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.config
May 27 03:01:09.088517 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp23zx14ht {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:09.105424 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:09.150311 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:09.159593 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '092604511a8a467ba4ecb56261cb531f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c48d6919e8435f876f3324616521ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:01:09.166590 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp23zx14ht" returned: 0 in 0.071s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:09.168185 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2f81f660-18c3-4bd1-b924-a9a136fb88da req-d2930f30-72a5-41ad-a584-0dbbdd8df196 service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Received event network-vif-plugged-1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:09.169518 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2f81f660-18c3-4bd1-b924-a9a136fb88da req-d2930f30-72a5-41ad-a584-0dbbdd8df196 service nova] Acquiring lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:09.171107 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2f81f660-18c3-4bd1-b924-a9a136fb88da req-d2930f30-72a5-41ad-a584-0dbbdd8df196 service nova] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:09.173117 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2f81f660-18c3-4bd1-b924-a9a136fb88da req-d2930f30-72a5-41ad-a584-0dbbdd8df196 service nova] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:09.173951 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2f81f660-18c3-4bd1-b924-a9a136fb88da req-d2930f30-72a5-41ad-a584-0dbbdd8df196 service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Processing event network-vif-plugged-1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:01:09.384855 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:01:09.398846 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:01:09.611408 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:09.803223 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:09.838214 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:09.841962 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:09.855416 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Removed pending STOPPED event for 7acda56f-e16c-4371-99b3-21eeea2904d1 due to new event <LifecycleEvent: 1779850869.8549914, 7acda56f-e16c-4371-99b3-21eeea2904d1 => Resumed> {{(pid=98471) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 03:01:09.855623 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850869.8549914, 7acda56f-e16c-4371-99b3-21eeea2904d1 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:09.855683 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] VM Resumed (Lifecycle Event)
May 27 03:01:09.860796 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-aa1c8518-57c7-47b6-bd32-9b3910a2a102 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:09.892464 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:01:09.905770 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:01:09.914300 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:01:09.922663 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Updating instance_info_cache with network_info: [{"id": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "address": "fa:16:3e:b2:aa:32", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6bdedc-0c", "ovs_interfaceid": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:09.923572 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Instance spawned successfully.
May 27 03:01:09.930555 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:01:09.960985 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:10.058919 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Successfully created port: 9d220c08-bd01-473f-a389-4dcbeb9ecf4c {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:01:10.299830 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-82502848-f596-4340-8cbd-c8c6f71e8051 req-8c04c98c-13b8-44b8-8aa0-72cd6fff89dd service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received event network-vif-plugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:10.300109 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-82502848-f596-4340-8cbd-c8c6f71e8051 req-8c04c98c-13b8-44b8-8aa0-72cd6fff89dd service nova] Acquiring lock "4e583b08-e323-4681-9e95-01767f510590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:10.301161 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-82502848-f596-4340-8cbd-c8c6f71e8051 req-8c04c98c-13b8-44b8-8aa0-72cd6fff89dd service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:10.301161 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-82502848-f596-4340-8cbd-c8c6f71e8051 req-8c04c98c-13b8-44b8-8aa0-72cd6fff89dd service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:10.301161 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-82502848-f596-4340-8cbd-c8c6f71e8051 req-8c04c98c-13b8-44b8-8aa0-72cd6fff89dd service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Processing event network-vif-plugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:01:10.362139 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:10.374336 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:10.409916 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:10.444832 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:10.454600 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Releasing lock "refresh_cache-66b799ed-716a-4b29-8125-bac73213f2cf" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:10.454726 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Instance network_info: |[{"id": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "address": "fa:16:3e:b2:aa:32", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6bdedc-0c", "ovs_interfaceid": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:01:10.455770 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:10.457751 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:10.458548 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Start _get_guest_xml network_info=[{"id": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "address": "fa:16:3e:b2:aa:32", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6bdedc-0c", "ovs_interfaceid": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:01:10.460406 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:10.462782 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:10.462782 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:10.462782 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:10.471051 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:01:10.476425 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-804870695', uuid='66b799ed-716a-4b29-8125-bac73213f2cf'), owner=OwnerMeta(userid='b438796ed5e44f629535db767fe2b756', username='tempest-ServerRescueNegativeTestJSON-62027498-project-member', projectid='39cbbdb9012c4992865d4f89678ef9ac', projectname='tempest-ServerRescueNegativeTestJSON-62027498'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "address": "fa:16:3e:b2:aa:32", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6bdedc-0c", "ovs_interfaceid": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850870.4733562) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:01:10.481022 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:01:10.481438 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:01:10.485926 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:01:10.487464 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:01:10.488591 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:01:10.489054 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:01:10.489241 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:01:10.489375 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:01:10.489556 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:01:10.489691 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:01:10.489855 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:01:10.490132 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:01:10.490207 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:01:10.490330 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:01:10.490595 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:01:10.490595 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:01:10.524680 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:00:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-804870695',display_name='tempest-ServerRescueNegativeTestJSON-server-804870695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverrescuenegativetestjson-server-804870695',id=21,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39cbbdb9012c4992865d4f89678ef9ac',ramdisk_id='',reservation_id='r-9du7vlyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-62027498',owner_user_name='tempest-ServerRescueNegativeTestJSON-62027498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:07Z,user_data=None,user_id='b438796ed5e44f629535db767fe2b756',uuid=66b799ed-716a-4b29-8125-bac73213f2cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "address": "fa:16:3e:b2:aa:32", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6bdedc-0c", "ovs_interfaceid": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:01:10.525005 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converting VIF {"id": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "address": "fa:16:3e:b2:aa:32", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6bdedc-0c", "ovs_interfaceid": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:10.526839 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:aa:32,bridge_name='br-int',has_traffic_filtering=True,id=fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6bdedc-0c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:10.532660 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'pci_devices' on Instance uuid 66b799ed-716a-4b29-8125-bac73213f2cf {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:10.619028 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-be6f1d40-1332-4dbf-8961-03f82d27caf6 req-ec38125f-3a65-45b1-ba95-1b38f67646a4 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received event network-vif-plugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:10.619028 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-be6f1d40-1332-4dbf-8961-03f82d27caf6 req-ec38125f-3a65-45b1-ba95-1b38f67646a4 service nova] Acquiring lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:10.619604 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-be6f1d40-1332-4dbf-8961-03f82d27caf6 req-ec38125f-3a65-45b1-ba95-1b38f67646a4 service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:10.619604 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-be6f1d40-1332-4dbf-8961-03f82d27caf6 req-ec38125f-3a65-45b1-ba95-1b38f67646a4 service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:10.620403 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-be6f1d40-1332-4dbf-8961-03f82d27caf6 req-ec38125f-3a65-45b1-ba95-1b38f67646a4 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] No waiting events found dispatching network-vif-plugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:10.620403 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-be6f1d40-1332-4dbf-8961-03f82d27caf6 req-ec38125f-3a65-45b1-ba95-1b38f67646a4 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received unexpected event network-vif-plugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 for instance with vm_state active and task_state None.
May 27 03:01:10.620498 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-be6f1d40-1332-4dbf-8961-03f82d27caf6 req-ec38125f-3a65-45b1-ba95-1b38f67646a4 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received event network-vif-plugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:10.620803 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-be6f1d40-1332-4dbf-8961-03f82d27caf6 req-ec38125f-3a65-45b1-ba95-1b38f67646a4 service nova] Acquiring lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:10.620918 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-be6f1d40-1332-4dbf-8961-03f82d27caf6 req-ec38125f-3a65-45b1-ba95-1b38f67646a4 service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:10.621461 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-be6f1d40-1332-4dbf-8961-03f82d27caf6 req-ec38125f-3a65-45b1-ba95-1b38f67646a4 service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:10.621461 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-be6f1d40-1332-4dbf-8961-03f82d27caf6 req-ec38125f-3a65-45b1-ba95-1b38f67646a4 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] No waiting events found dispatching network-vif-plugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:10.621654 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-be6f1d40-1332-4dbf-8961-03f82d27caf6 req-ec38125f-3a65-45b1-ba95-1b38f67646a4 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received unexpected event network-vif-plugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 for instance with vm_state active and task_state None.
May 27 03:01:10.677982 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:01:10.678237 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:01:10.847772 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Successfully updated port: 9d220c08-bd01-473f-a389-4dcbeb9ecf4c {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:01:10.880145 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850870.879764, 7acda56f-e16c-4371-99b3-21eeea2904d1 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:10.880321 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] VM Started (Lifecycle Event)
May 27 03:01:10.924573 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:01:10.927116 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:01:10.930468 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 4e583b08-e323-4681-9e95-01767f510590] Instance spawned successfully.
May 27 03:01:10.930831 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:01:10.940129 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:10.944605 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:01:10.945462 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:01:10.945687 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Creating image(s)
May 27 03:01:10.946076 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:10.946252 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "/opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:10.947757 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "/opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:10.950465 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:10.954752 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:10.956503 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:10.973414 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Took 9.35 seconds to spawn the instance on the hypervisor.
May 27 03:01:10.973809 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:11.040434 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] End _get_guest_xml xml=<domain type="qemu">
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:   <uuid>66b799ed-716a-4b29-8125-bac73213f2cf</uuid>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:   <name>instance-00000015</name>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-804870695</nova:name>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:01:10</nova:creationTime>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:         <nova:user uuid="b438796ed5e44f629535db767fe2b756">tempest-ServerRescueNegativeTestJSON-62027498-project-member</nova:user>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:         <nova:project uuid="39cbbdb9012c4992865d4f89678ef9ac">tempest-ServerRescueNegativeTestJSON-62027498</nova:project>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:         <nova:port uuid="fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2">
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     <system>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <entry name="serial">66b799ed-716a-4b29-8125-bac73213f2cf</entry>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <entry name="uuid">66b799ed-716a-4b29-8125-bac73213f2cf</entry>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     </system>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:   <os>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:   </os>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:   <features>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:   </features>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:   <devices>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.config"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:b2:aa:32"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <target dev="tapfe6bdedc-0c"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     </interface>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/console.log" append="off"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     </serial>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     <video>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     </video>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     </rng>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:   </devices>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]: </domain>
May 27 03:01:11.040434 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:01:11.042402 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Preparing to wait for external event network-vif-plugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:01:11.042402 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:11.042402 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:11.042402 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:11.042402 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:00:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-804870695',display_name='tempest-ServerRescueNegativeTestJSON-server-804870695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverrescuenegativetestjson-server-804870695',id=21,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39cbbdb9012c4992865d4f89678ef9ac',ramdisk_id='',reservation_id='r-9du7vlyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-62027498',owner_user_name='tempest-ServerRescueNegativeTestJSON-62027498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:07Z,user_data=None,user_id='b438796ed5e44f629535db767fe2b756',uuid=66b799ed-716a-4b29-8125-bac73213f2cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "address": "fa:16:3e:b2:aa:32", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6bdedc-0c", "ovs_interfaceid": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:01:11.042648 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converting VIF {"id": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "address": "fa:16:3e:b2:aa:32", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6bdedc-0c", "ovs_interfaceid": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:11.045010 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:aa:32,bridge_name='br-int',has_traffic_filtering=True,id=fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6bdedc-0c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:11.045010 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:aa:32,bridge_name='br-int',has_traffic_filtering=True,id=fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6bdedc-0c') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:01:11.045010 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:11.045289 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:11.045606 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:01:11.047225 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:11.047369 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '805cd0c2-b03c-5132-a199-5d60bc2f406d', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:11.049821 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:11.050674 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:11.053046 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:11.053239 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe6bdedc-0c, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:11.054516 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe6bdedc-0c, col_values=(('qos', UUID('19a2af4a-b8b2-4a87-bd13-fceb44077825')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:11.055923 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe6bdedc-0c, col_values=(('external_ids', {'iface-id': 'fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:aa:32', 'vm-uuid': '66b799ed-716a-4b29-8125-bac73213f2cf'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:11.059941 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:11.063827 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:11.067877 np0000001475 nova-compute[98471]: INFO os_vif [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:aa:32,bridge_name='br-int',has_traffic_filtering=True,id=fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6bdedc-0c')
May 27 03:01:11.068447 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.112s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:11.069125 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:11.069645 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:11.070319 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:11.077172 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:11.077404 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:11.116916 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:11.117285 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:11.176985 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.100s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:11.177373 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:11.193443 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:01:11.232758 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7ee914d8-5f42-45cc-94f2-68c501f16a8e req-3b9ff696-28e0-4592-892c-3a59f5287856 service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Received event network-vif-plugged-1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:11.233057 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7ee914d8-5f42-45cc-94f2-68c501f16a8e req-3b9ff696-28e0-4592-892c-3a59f5287856 service nova] Acquiring lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:11.233283 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7ee914d8-5f42-45cc-94f2-68c501f16a8e req-3b9ff696-28e0-4592-892c-3a59f5287856 service nova] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:11.233432 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7ee914d8-5f42-45cc-94f2-68c501f16a8e req-3b9ff696-28e0-4592-892c-3a59f5287856 service nova] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:11.235248 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7ee914d8-5f42-45cc-94f2-68c501f16a8e req-3b9ff696-28e0-4592-892c-3a59f5287856 service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] No waiting events found dispatching network-vif-plugged-1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:11.235248 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-7ee914d8-5f42-45cc-94f2-68c501f16a8e req-3b9ff696-28e0-4592-892c-3a59f5287856 service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Received unexpected event network-vif-plugged-1310931d-f17c-4382-be90-17f02d98b259 for instance with vm_state active and task_state None.
May 27 03:01:11.235404 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7ee914d8-5f42-45cc-94f2-68c501f16a8e req-3b9ff696-28e0-4592-892c-3a59f5287856 service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Received event network-changed-9d220c08-bd01-473f-a389-4dcbeb9ecf4c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:11.235604 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7ee914d8-5f42-45cc-94f2-68c501f16a8e req-3b9ff696-28e0-4592-892c-3a59f5287856 service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Refreshing instance network info cache due to event network-changed-9d220c08-bd01-473f-a389-4dcbeb9ecf4c. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:01:11.240926 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7ee914d8-5f42-45cc-94f2-68c501f16a8e req-3b9ff696-28e0-4592-892c-3a59f5287856 service nova] Acquiring lock "refresh_cache-3e5f7741-2c52-4242-9b37-566ff5f5a6a0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:11.242187 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7ee914d8-5f42-45cc-94f2-68c501f16a8e req-3b9ff696-28e0-4592-892c-3a59f5287856 service nova] Acquired lock "refresh_cache-3e5f7741-2c52-4242-9b37-566ff5f5a6a0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:11.242368 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7ee914d8-5f42-45cc-94f2-68c501f16a8e req-3b9ff696-28e0-4592-892c-3a59f5287856 service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Refreshing network info cache for port 9d220c08-bd01-473f-a389-4dcbeb9ecf4c {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:01:11.243259 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk 1073741824" returned: 0 in 0.065s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:11.243961 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.174s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:11.244432 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:11.336054 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.091s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:11.336626 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:01:11.336994 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:11.354819 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "refresh_cache-3e5f7741-2c52-4242-9b37-566ff5f5a6a0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:11.385504 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:11.390547 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:11.438914 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:11.439076 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:11.439354 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:11.439572 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:11.439838 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:11.440113 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:11.459724 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:11.461032 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Cannot resize image /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:01:11.461323 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:01:11.461494 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Ensure instance console log exists: /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:01:11.461700 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:11.461882 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:11.462061 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:11.502812 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Took 15.25 seconds to build instance.
May 27 03:01:11.622204 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lazy-loading 'flavor' on Instance uuid f33f8709-32f7-4ce3-9967-c54609dcbb0c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:11.711969 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.324s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:11.713271 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 4.813s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:11.713732 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:01:11.749264 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-7ee914d8-5f42-45cc-94f2-68c501f16a8e req-3b9ff696-28e0-4592-892c-3a59f5287856 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:11.836578 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7ee914d8-5f42-45cc-94f2-68c501f16a8e req-3b9ff696-28e0-4592-892c-3a59f5287856 service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:01:11.898107 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850871.8974195, 7ebb66f2-020a-4b56-9fc1-f7162e96a609 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:11.898107 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] VM Started (Lifecycle Event)
May 27 03:01:11.950501 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Took 7.57 seconds to spawn the instance on the hypervisor.
May 27 03:01:11.951366 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:12.008069 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d69f71c7-7d6b-4d15-adcc-deac12ee0528 tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.783s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:12.020273 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7ee914d8-5f42-45cc-94f2-68c501f16a8e req-3b9ff696-28e0-4592-892c-3a59f5287856 service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:12.226382 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:01:12.226382 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:01:12.226382 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:12.226382 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:12.346368 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e72474ce31364e6e93613cde1d50fcf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb860bf509bc4a51ae78e4d7bea9d930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:01:12.401514 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7c5fa3e6-1138-461a-80c7-879ab7a424b0 req-04990973-5602-44b6-9249-1fc074dda90f service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received event network-vif-plugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:12.401750 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7c5fa3e6-1138-461a-80c7-879ab7a424b0 req-04990973-5602-44b6-9249-1fc074dda90f service nova] Acquiring lock "4e583b08-e323-4681-9e95-01767f510590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:12.401938 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7c5fa3e6-1138-461a-80c7-879ab7a424b0 req-04990973-5602-44b6-9249-1fc074dda90f service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:12.403932 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7c5fa3e6-1138-461a-80c7-879ab7a424b0 req-04990973-5602-44b6-9249-1fc074dda90f service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:12.404385 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7c5fa3e6-1138-461a-80c7-879ab7a424b0 req-04990973-5602-44b6-9249-1fc074dda90f service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] No waiting events found dispatching network-vif-plugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:12.404808 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-7c5fa3e6-1138-461a-80c7-879ab7a424b0 req-04990973-5602-44b6-9249-1fc074dda90f service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received unexpected event network-vif-plugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c for instance with vm_state active and task_state None.
May 27 03:01:12.406265 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:12.410954 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:12.464904 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Took 16.02 seconds to build instance.
May 27 03:01:12.522559 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7ee914d8-5f42-45cc-94f2-68c501f16a8e req-3b9ff696-28e0-4592-892c-3a59f5287856 service nova] Releasing lock "refresh_cache-3e5f7741-2c52-4242-9b37-566ff5f5a6a0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:12.523319 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquired lock "refresh_cache-3e5f7741-2c52-4242-9b37-566ff5f5a6a0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:12.523602 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:01:12.575132 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:01:12.575418 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:01:12.607579 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:12.607731 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:12.607906 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No VIF found with MAC fa:16:3e:b2:aa:32, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:01:12.608444 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Using config drive
May 27 03:01:12.631010 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:12.732022 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:01:12.824672 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "02fd272a-5759-4995-9e5c-cc1f3e28072b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:12.824672 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "02fd272a-5759-4995-9e5c-cc1f3e28072b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:12.869479 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Successfully created port: 3c806e74-b5d9-4602-8a6f-2547db207d6c {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:01:12.893349 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Acquiring lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:12.893543 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:12.893950 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Acquiring lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:12.893950 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:12.894063 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:12.902769 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Terminating instance
May 27 03:01:12.913783 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] During sync_power_state the instance has a pending task (deleting). Skip.
May 27 03:01:12.914287 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850872.9139645, 7ebb66f2-020a-4b56-9fc1-f7162e96a609 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:12.916761 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] VM Paused (Lifecycle Event)
May 27 03:01:12.968062 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be1a17b2-9b37-4338-b42e-983dad9f6761 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "4e583b08-e323-4681-9e95-01767f510590" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.550s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:13.079478 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:01:13.108972 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:01:13.116421 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:13.233268 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:01:13.310342 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Creating config drive at /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.config
May 27 03:01:13.316570 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe37risl7 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:13.345299 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:01:13.382328 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe37risl7" returned: 0 in 0.063s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:13.409554 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:01:13.421767 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:13.423376 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:13.446560 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:13.458640 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:13.478335 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:13.491928 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:13.531501 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:13.589923 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.876s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:13.592029 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 6.283s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:13.592315 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98471) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 27 03:01:13.617455 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Successfully updated port: 3c806e74-b5d9-4602-8a6f-2547db207d6c {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:01:13.703617 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Deleted allocations for instance ebd2884b-67b5-40c1-8cf0-a22bd90be727
May 27 03:01:13.753047 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:13.753047 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:13.753047 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Attaching volume 7dd67023-0129-4acb-99a4-6d602f2837dc to /dev/vdb
May 27 03:01:13.762138 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-01652b45-ff3f-42ab-b1d9-b1aba75c329f req-7e1dd3c9-91e5-4ada-a075-458b9e412608 service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Received event network-vif-unplugged-1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:13.766036 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-01652b45-ff3f-42ab-b1d9-b1aba75c329f req-7e1dd3c9-91e5-4ada-a075-458b9e412608 service nova] Acquiring lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:13.766405 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-01652b45-ff3f-42ab-b1d9-b1aba75c329f req-7e1dd3c9-91e5-4ada-a075-458b9e412608 service nova] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:13.766653 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-01652b45-ff3f-42ab-b1d9-b1aba75c329f req-7e1dd3c9-91e5-4ada-a075-458b9e412608 service nova] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:13.766805 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-01652b45-ff3f-42ab-b1d9-b1aba75c329f req-7e1dd3c9-91e5-4ada-a075-458b9e412608 service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] No waiting events found dispatching network-vif-unplugged-1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:13.766980 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-01652b45-ff3f-42ab-b1d9-b1aba75c329f req-7e1dd3c9-91e5-4ada-a075-458b9e412608 service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Received event network-vif-unplugged-1310931d-f17c-4382-be90-17f02d98b259 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:01:13.770873 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Updating instance_info_cache with network_info: [{"id": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "address": "fa:16:3e:d1:ea:b1", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d220c08-bd", "ovs_interfaceid": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:13.832570 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:01:13.850582 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:13.860501 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:01:13.889390 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:13.892987 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:13.930070 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:13.958677 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:01:13.959029 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:01:13.974161 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:01:13.985032 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b', 'fe80::fc16:3eff:fe1f:5a7', 'fe80::a095:90ff:feef:1465', 'fe80::fc16:3eff:feaf:c052', 'fe80::20bf:faff:fe0c:5acd', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::fc16:3eff:fefc:b5d4', 'fe80::fc16:3eff:fe7e:904a', 'fe80::fc16:3eff:fe01:3d37', 'fe80::c805:4ff:fe3b:2374'] 
May 27 03:01:13.985032 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:01:13.985032 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:01:13.985032 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:01:13.985032 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Updating existing volume attachment record: 8662217d-d489-40e6-a7fc-ad399be06759 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:01:14.004757 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:14.061307 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850874.0564353, 7ebb66f2-020a-4b56-9fc1-f7162e96a609 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:14.061307 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] VM Resumed (Lifecycle Event)
May 27 03:01:14.062759 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Instance destroyed successfully.
May 27 03:01:14.063196 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Lazy-loading 'resources' on Instance uuid 7ebb66f2-020a-4b56-9fc1-f7162e96a609 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:14.127217 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquiring lock "refresh_cache-3df7da3b-46a1-47e3-99b6-3027e323b3fc" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:14.127387 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquired lock "refresh_cache-3df7da3b-46a1-47e3-99b6-3027e323b3fc" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:14.127551 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:01:14.214373 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.249690 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:01:14.251241 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:01:14.253042 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Creating image(s)
May 27 03:01:14.253342 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquiring lock "/opt/stack/data/nova/instances/3df7da3b-46a1-47e3-99b6-3027e323b3fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:14.253561 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "/opt/stack/data/nova/instances/3df7da3b-46a1-47e3-99b6-3027e323b3fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:14.254540 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "/opt/stack/data/nova/instances/3df7da3b-46a1-47e3-99b6-3027e323b3fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:14.255183 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:14.266068 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.268043 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:14.269702 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:14.283270 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Releasing lock "refresh_cache-3e5f7741-2c52-4242-9b37-566ff5f5a6a0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:14.284655 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Instance network_info: |[{"id": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "address": "fa:16:3e:d1:ea:b1", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d220c08-bd", "ovs_interfaceid": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:01:14.289384 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Start _get_guest_xml network_info=[{"id": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "address": "fa:16:3e:d1:ea:b1", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d220c08-bd", "ovs_interfaceid": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:01:14.303632 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:01:14.305236 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='3e5f7741-2c52-4242-9b37-566ff5f5a6a0'), owner=OwnerMeta(userid='092604511a8a467ba4ecb56261cb531f', username='tempest-AttachVolumeMultiAttachTest-774919822-project-member', projectid='a9c48d6919e8435f876f3324616521ea', projectname='tempest-AttachVolumeMultiAttachTest-774919822'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "address": "fa:16:3e:d1:ea:b1", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d220c08-bd", "ovs_interfaceid": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850874.3047774) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:01:14.306388 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:01:14.306709 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:01:14.308190 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:01:14.308395 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:01:14.310777 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:01:14.311198 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:01:14.312091 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:01:14.312091 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:01:14.312091 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:01:14.312091 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:01:14.312091 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:01:14.312333 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:01:14.312333 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:01:14.312574 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:01:14.312574 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:01:14.312665 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:01:14.327091 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.332979 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.339786 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:00:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='multiattach-server-1',id=22,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7X60AtOl0SsfuAMV1LtNGpvh0yvi8THxioUm4x62ykVhuM7q4sXRNe3S5fa56OsOiAX0ZbtOowRZ4+AKeGhch21Oc/NUN3hQGbbFxrwclVqtJHRu4HOLbwt9JgM8J0mA==',key_name='tempest-keypair-1333870124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-t931x00t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092604511a8a467ba4ecb56261cb531f',uuid=3e5f7741-2c52-4242-9b37-566ff5f5a6a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "address": "fa:16:3e:d1:ea:b1", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d220c08-bd", "ovs_interfaceid": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:01:14.339786 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "address": "fa:16:3e:d1:ea:b1", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d220c08-bd", "ovs_interfaceid": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:14.339786 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=9d220c08-bd01-473f-a389-4dcbeb9ecf4c,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d220c08-bd') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:14.339786 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.340399 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:14.360958 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.091s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:14.361373 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:14.361841 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:14.362302 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.364268 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:14.367364 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.368211 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:14.368531 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:14.383787 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.481025 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.485071 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.116s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:14.486803 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/3df7da3b-46a1-47e3-99b6-3027e323b3fc/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:14.518289 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-838b3b01-1121-4133-b995-537d39799f9c req-1c03e087-7ecb-4704-9f89-828fd9995118 service nova] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Received event network-changed-3c806e74-b5d9-4602-8a6f-2547db207d6c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:14.518289 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-838b3b01-1121-4133-b995-537d39799f9c req-1c03e087-7ecb-4704-9f89-828fd9995118 service nova] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Refreshing instance network info cache due to event network-changed-3c806e74-b5d9-4602-8a6f-2547db207d6c. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:01:14.518426 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-838b3b01-1121-4133-b995-537d39799f9c req-1c03e087-7ecb-4704-9f89-828fd9995118 service nova] Acquiring lock "refresh_cache-3df7da3b-46a1-47e3-99b6-3027e323b3fc" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:14.519837 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.521592 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.565602 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:14.567017 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/3df7da3b-46a1-47e3-99b6-3027e323b3fc/disk 1073741824" returned: 0 in 0.081s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:14.568397 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:14.568397 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:14.601146 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1892004214',display_name='tempest-VolumesNegativeTest-instance-1892004214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesnegativetest-instance-1892004214',id=19,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:01:10Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89238d7609db41788c5908672dda670a',ramdisk_id='',reservation_id='r-9j0c94ib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1026582036',owner_user_name='tempest-VolumesNegativeTest-1026582036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:01:11Z,user_data=None,user_id='38d53ffb20cd45a4b6bbe42d0404b0fd',uuid=7ebb66f2-020a-4b56-9fc1-f7162e96a609,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1310931d-f17c-4382-be90-17f02d98b259", "address": "fa:16:3e:c5:22:0a", "network": {"id": "c3e308a2-5e87-43a2-ab60-37f9737a84ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba717c80697f454cbbe062e8cd8e5989", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1310931d-f1", "ovs_interfaceid": "1310931d-f17c-4382-be90-17f02d98b259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:01:14.601542 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Converting VIF {"id": "1310931d-f17c-4382-be90-17f02d98b259", "address": "fa:16:3e:c5:22:0a", "network": {"id": "c3e308a2-5e87-43a2-ab60-37f9737a84ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba717c80697f454cbbe062e8cd8e5989", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1310931d-f1", "ovs_interfaceid": "1310931d-f17c-4382-be90-17f02d98b259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:14.605776 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=1310931d-f17c-4382-be90-17f02d98b259,network=Network(c3e308a2-5e87-43a2-ab60-37f9737a84ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1310931d-f1') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:14.605776 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=1310931d-f17c-4382-be90-17f02d98b259,network=Network(c3e308a2-5e87-43a2-ab60-37f9737a84ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1310931d-f1') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:01:14.605776 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850874.6049247, 4e583b08-e323-4681-9e95-01767f510590 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:14.605776 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] VM Started (Lifecycle Event)
May 27 03:01:14.611082 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2ad938af-03dd-4bd8-9631-7d38153a33ae tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.022s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:14.618278 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.623s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:14.625818 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.627088 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:01:14.628225 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1310931d-f1, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:14.629050 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7dd67023-0129-4acb-99a4-6d602f2837dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:01:14.649693 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.649693 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:14.653099 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:01:14.653481 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Claim successful on node np0000001475
May 27 03:01:14.657765 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:01:14.662814 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.662814 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.022s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:01:14.662814 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7dd67023-0129-4acb-99a4-6d602f2837dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:01:14.668471 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88c313e8-aefd-4cd1-b937-167de1cb2275) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:14.670454 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.671443 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:14.675805 np0000001475 nova-compute[98471]: INFO os_vif [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:22:0a,bridge_name='br-int',has_traffic_filtering=True,id=1310931d-f17c-4382-be90-17f02d98b259,network=Network(c3e308a2-5e87-43a2-ab60-37f9737a84ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1310931d-f1')
May 27 03:01:14.676183 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Deleting instance files /opt/stack/data/nova/instances/7ebb66f2-020a-4b56-9fc1-f7162e96a609_del
May 27 03:01:14.677217 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Deletion of /opt/stack/data/nova/instances/7ebb66f2-020a-4b56-9fc1-f7162e96a609_del complete
May 27 03:01:14.688664 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:01:14.688664 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:01:14.688664 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:01:14.689637 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:01:14.690773 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:01:14.690945 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:01:14.707822 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:01:14.707822 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:14.726913 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc] added
May 27 03:01:14.726913 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:01:14.726913 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:01:14.726913 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:01:14.726913 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:01:14.726913 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:01:14.726913 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:14.727472 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:01:14.727472 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0389(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:01:14.727472 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:01:14.728464 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:01:14.728464 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:14.730202 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.162s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:14.733636 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-59910112-1529-4f0a-b987-4d0eec784f9e tempest-TaggedAttachmentsTest-1282046058 tempest-TaggedAttachmentsTest-1282046058-project-member] Lock "ebd2884b-67b5-40c1-8cf0-a22bd90be727" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.192s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:14.733636 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3df7da3b-46a1-47e3-99b6-3027e323b3fc/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:01:14.733636 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df7da3b-46a1-47e3-99b6-3027e323b3fc/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:14.756014 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc] added
May 27 03:01:14.756014 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:01:14.756014 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:01:14.756014 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:01:14.756014 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:01:14.756014 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:01:14.756014 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:14.764660 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:01:14.764660 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0704(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:01:14.764660 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:01:14.797321 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:01:14.843996 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.848106 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] End _get_guest_xml xml=<domain type="qemu">
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:   <uuid>3e5f7741-2c52-4242-9b37-566ff5f5a6a0</uuid>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:   <name>instance-00000016</name>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <nova:name>multiattach-server-1</nova:name>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:01:14</nova:creationTime>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:         <nova:user uuid="092604511a8a467ba4ecb56261cb531f">tempest-AttachVolumeMultiAttachTest-774919822-project-member</nova:user>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:         <nova:project uuid="a9c48d6919e8435f876f3324616521ea">tempest-AttachVolumeMultiAttachTest-774919822</nova:project>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:         <nova:port uuid="9d220c08-bd01-473f-a389-4dcbeb9ecf4c">
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     <system>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <entry name="serial">3e5f7741-2c52-4242-9b37-566ff5f5a6a0</entry>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <entry name="uuid">3e5f7741-2c52-4242-9b37-566ff5f5a6a0</entry>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     </system>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:   <os>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:   </os>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:   <features>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:   </features>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:   <devices>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk.config"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:d1:ea:b1"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <target dev="tap9d220c08-bd"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     </interface>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/console.log" append="off"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     </serial>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     <video>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     </video>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     </rng>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:   </devices>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]: </domain>
May 27 03:01:14.848106 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:01:14.850538 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df7da3b-46a1-47e3-99b6-3027e323b3fc/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:14.850538 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Preparing to wait for external event network-vif-plugged-9d220c08-bd01-473f-a389-4dcbeb9ecf4c {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:01:14.851008 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Cannot resize image /opt/stack/data/nova/instances/3df7da3b-46a1-47e3-99b6-3027e323b3fc/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:01:14.851432 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:14.853211 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:01:14.853508 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:14.853806 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Ensure instance console log exists: /opt/stack/data/nova/instances/3df7da3b-46a1-47e3-99b6-3027e323b3fc/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:01:14.853999 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:14.855001 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:00:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='multiattach-server-1',id=22,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7X60AtOl0SsfuAMV1LtNGpvh0yvi8THxioUm4x62ykVhuM7q4sXRNe3S5fa56OsOiAX0ZbtOowRZ4+AKeGhch21Oc/NUN3hQGbbFxrwclVqtJHRu4HOLbwt9JgM8J0mA==',key_name='tempest-keypair-1333870124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-t931x00t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092604511a8a467ba4ecb56261cb531f',uuid=3e5f7741-2c52-4242-9b37-566ff5f5a6a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "address": "fa:16:3e:d1:ea:b1", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d220c08-bd", "ovs_interfaceid": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:01:14.855486 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:14.856618 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "address": "fa:16:3e:d1:ea:b1", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d220c08-bd", "ovs_interfaceid": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:14.857448 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:14.857855 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=9d220c08-bd01-473f-a389-4dcbeb9ecf4c,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d220c08-bd') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:14.858226 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:14.858500 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=9d220c08-bd01-473f-a389-4dcbeb9ecf4c,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d220c08-bd') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:01:14.858815 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.859044 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:14.859371 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:01:14.860628 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.860876 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31461b6f-ea50-5ec0-925b-ce55cb292bbc', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:14.864949 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.865718 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:14.870990 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.871203 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d220c08-bd, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:14.871523 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d220c08-bd, col_values=(('qos', UUID('21e96539-95e8-46cf-910c-4d0bf626567f')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:14.871672 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d220c08-bd, col_values=(('external_ids', {'iface-id': '9d220c08-bd01-473f-a389-4dcbeb9ecf4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:ea:b1', 'vm-uuid': '3e5f7741-2c52-4242-9b37-566ff5f5a6a0'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:14.872633 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.875663 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:14.883854 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:14.885019 np0000001475 nova-compute[98471]: INFO os_vif [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=9d220c08-bd01-473f-a389-4dcbeb9ecf4c,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d220c08-bd')
May 27 03:01:15.003719 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:15.125165 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:15.133617 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:15.169112 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Updating instance_info_cache with network_info: [{"id": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "address": "fa:16:3e:fe:a8:17", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c806e74-b5", "ovs_interfaceid": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:15.187970 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Took 1.78 seconds to destroy the instance on the hypervisor.
May 27 03:01:15.188093 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:01:15.188235 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:01:15.188310 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:01:15.188560 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:15.264179 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:15.637773 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850875.6363974, 4e583b08-e323-4681-9e95-01767f510590 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:15.637773 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] VM Paused (Lifecycle Event)
May 27 03:01:15.671505 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Releasing lock "refresh_cache-3df7da3b-46a1-47e3-99b6-3027e323b3fc" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:15.671869 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Instance network_info: |[{"id": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "address": "fa:16:3e:fe:a8:17", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c806e74-b5", "ovs_interfaceid": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:01:15.673978 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Start _get_guest_xml network_info=[{"id": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "address": "fa:16:3e:fe:a8:17", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c806e74-b5", "ovs_interfaceid": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:01:15.674775 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-838b3b01-1121-4133-b995-537d39799f9c req-1c03e087-7ecb-4704-9f89-828fd9995118 service nova] Acquired lock "refresh_cache-3df7da3b-46a1-47e3-99b6-3027e323b3fc" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:15.675061 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-838b3b01-1121-4133-b995-537d39799f9c req-1c03e087-7ecb-4704-9f89-828fd9995118 service nova] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Refreshing network info cache for port 3c806e74-b5d9-4602-8a6f-2547db207d6c {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:01:15.683824 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3d75ccc9-9d91-42dd-bb28-bc4d0603a0a6 req-40535951-819a-4f6a-a44d-9a462d24b48e service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Received event network-vif-deleted-1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:15.684061 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-3d75ccc9-9d91-42dd-bb28-bc4d0603a0a6 req-40535951-819a-4f6a-a44d-9a462d24b48e service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Neutron deleted interface 1310931d-f17c-4382-be90-17f02d98b259; detaching it from the instance and deleting it from the info cache
May 27 03:01:15.684270 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-3d75ccc9-9d91-42dd-bb28-bc4d0603a0a6 req-40535951-819a-4f6a-a44d-9a462d24b48e service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:15.688095 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:01:15.689896 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1000140302', uuid='3df7da3b-46a1-47e3-99b6-3027e323b3fc'), owner=OwnerMeta(userid='e72474ce31364e6e93613cde1d50fcf2', username='tempest-VolumesActionsTest-2104767204-project-member', projectid='cb860bf509bc4a51ae78e4d7bea9d930', projectname='tempest-VolumesActionsTest-2104767204'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "address": "fa:16:3e:fe:a8:17", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c806e74-b5", "ovs_interfaceid": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850875.6893823) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:01:15.691681 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:01:15.692046 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:01:15.693013 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:01:15.693409 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:01:15.694388 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:01:15.696825 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:01:15.696825 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:01:15.696825 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:01:15.697110 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:01:15.697110 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:01:15.697168 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:01:15.701828 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:01:15.701828 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:01:15.701828 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:01:15.701828 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:01:15.701828 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:01:15.729993 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:01:15.737148 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1000140302',display_name='tempest-VolumesActionsTest-instance-1000140302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesactionstest-instance-1000140302',id=23,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb860bf509bc4a51ae78e4d7bea9d930',ramdisk_id='',reservation_id='r-1680ldn8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2104767204',owner_user_name='tempest-VolumesActionsTest-2104767204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:13Z,user_data=None,user_id='e72474ce31364e6e93613cde1d50fcf2',uuid=3df7da3b-46a1-47e3-99b6-3027e323b3fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "address": "fa:16:3e:fe:a8:17", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c806e74-b5", "ovs_interfaceid": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:01:15.737450 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Converting VIF {"id": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "address": "fa:16:3e:fe:a8:17", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c806e74-b5", "ovs_interfaceid": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:15.738088 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a8:17,bridge_name='br-int',has_traffic_filtering=True,id=3c806e74-b5d9-4602-8a6f-2547db207d6c,network=Network(f44736fe-999d-4250-bc37-3b218a164370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c806e74-b5') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:15.738801 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lazy-loading 'pci_devices' on Instance uuid 3df7da3b-46a1-47e3-99b6-3027e323b3fc {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:01:15.761441 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:01:15.761441 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:15.764236 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:01:15.779832 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:01:15.781647 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:01:15.781647 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:15.796428 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:15.796428 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:15.796428 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:15.796428 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:15.796428 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:15.796428 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:15.796428 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:01:15.796713 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:15.796713 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:15.796713 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:15.796713 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:15.796713 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:15.796713 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:15.796713 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:01:15.804580 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:15.829079 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:15.829079 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:15.829079 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:15.829079 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:15.829079 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:15.829079 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:15.829079 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:01:15.829425 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:15.829425 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:15.829425 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:15.829425 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:15.829425 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:15.829425 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:15.829425 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:01:15.839924 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc, portal: 192.168.40.100,3260]
May 27 03:01:15.839924 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc, portal: 192.168.40.100,3260] successful.
May 27 03:01:15.839924 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:15.851289 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:15.859004 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Received event network-vif-unplugged-1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:15.859258 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] Acquiring lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:15.859436 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:15.859548 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:15.859670 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] No waiting events found dispatching network-vif-unplugged-1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:15.860102 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Received event network-vif-unplugged-1310931d-f17c-4382-be90-17f02d98b259 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:01:15.860102 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Received event network-vif-plugged-1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:15.860102 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] Acquiring lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:15.860528 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:15.860699 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:15.860866 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] No waiting events found dispatching network-vif-plugged-1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:15.861920 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Received unexpected event network-vif-plugged-1310931d-f17c-4382-be90-17f02d98b259 for instance with vm_state active and task_state deleting.
May 27 03:01:15.862097 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Received event network-vif-plugged-1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:15.863037 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] Acquiring lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:15.863037 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:15.863037 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:15.863037 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] No waiting events found dispatching network-vif-plugged-1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:15.863037 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Received unexpected event network-vif-plugged-1310931d-f17c-4382-be90-17f02d98b259 for instance with vm_state active and task_state deleting.
May 27 03:01:15.863616 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Received event network-vif-unplugged-1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:15.864783 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] Acquiring lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:15.865004 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:15.867814 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:15.868099 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] No waiting events found dispatching network-vif-unplugged-1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:15.868295 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Received event network-vif-unplugged-1310931d-f17c-4382-be90-17f02d98b259 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:01:15.868584 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Received event network-vif-unplugged-1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:15.870031 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:15.870524 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] Acquiring lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:15.870782 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:15.870908 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:15.871046 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] No waiting events found dispatching network-vif-unplugged-1310931d-f17c-4382-be90-17f02d98b259 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:15.871516 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e02d59f7-6dca-4bc8-a682-0a15efa72559 req-db16a1aa-1bb3-4fb9-9fd6-b220b845ae8d service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Received event network-vif-unplugged-1310931d-f17c-4382-be90-17f02d98b259 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:01:15.879617 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc, portal: 192.168.50.100,3260]
May 27 03:01:15.879617 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc, portal: 192.168.50.100,3260] successful.
May 27 03:01:15.879617 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:15.887456 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:15.887456 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:15.887456 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:15.887456 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:15.887456 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:15.887456 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:15.887456 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:15.887456 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:15.887456 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:01:15.887677 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:15.887677 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:15.887677 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:15.887677 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:15.887677 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:15.887677 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:15.887677 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:15.887677 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:15.887677 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:01:15.887975 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:01:15.888104 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:01:15.888970 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] HCTL ('13', '-', '-', 0) found on session 47 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:01:15.889078 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:01:15.896516 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:15.913188 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Searching for a device in session 47 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:01:15.913188 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7dd67023-0129-4acb-99a4-6d602f2837dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:01:15.922303 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:15.922303 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:15.922303 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:15.922303 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:15.922303 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:15.922303 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:15.922303 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:15.922303 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:15.922303 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:01:15.922992 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:15.922992 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:15.922992 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:15.922992 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:15.922992 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:15.922992 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:15.922992 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:15.922992 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:15.922992 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:01:15.924910 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.234s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:01:15.924910 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:01:15.924910 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] HCTL ('14', '-', '-', 0) found on session 48 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:01:15.924910 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:01:15.944645 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:15.952343 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Searching for a device in session 48 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:01:15.952711 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7dd67023-0129-4acb-99a4-6d602f2837dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:01:16.098952 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:16.140629 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:16.142005 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850876.1417964, 4e583b08-e323-4681-9e95-01767f510590 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:16.142169 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] VM Resumed (Lifecycle Event)
May 27 03:01:16.180569 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-838b3b01-1121-4133-b995-537d39799f9c req-1c03e087-7ecb-4704-9f89-828fd9995118 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:16.191240 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3d75ccc9-9d91-42dd-bb28-bc4d0603a0a6 req-40535951-819a-4f6a-a44d-9a462d24b48e service nova] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Detach interface failed, port_id=1310931d-f17c-4382-be90-17f02d98b259, reason: Instance 7ebb66f2-020a-4b56-9fc1-f7162e96a609 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:01:16.241897 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] End _get_guest_xml xml=<domain type="qemu">
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:   <uuid>3df7da3b-46a1-47e3-99b6-3027e323b3fc</uuid>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:   <name>instance-00000017</name>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <nova:name>tempest-VolumesActionsTest-instance-1000140302</nova:name>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:01:15</nova:creationTime>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:         <nova:user uuid="e72474ce31364e6e93613cde1d50fcf2">tempest-VolumesActionsTest-2104767204-project-member</nova:user>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:         <nova:project uuid="cb860bf509bc4a51ae78e4d7bea9d930">tempest-VolumesActionsTest-2104767204</nova:project>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:         <nova:port uuid="3c806e74-b5d9-4602-8a6f-2547db207d6c">
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     <system>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <entry name="serial">3df7da3b-46a1-47e3-99b6-3027e323b3fc</entry>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <entry name="uuid">3df7da3b-46a1-47e3-99b6-3027e323b3fc</entry>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     </system>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:   <os>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:   </os>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:   <features>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:   </features>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:   <devices>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/3df7da3b-46a1-47e3-99b6-3027e323b3fc/disk"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/3df7da3b-46a1-47e3-99b6-3027e323b3fc/disk.config"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:fe:a8:17"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <target dev="tap3c806e74-b5"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     </interface>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/3df7da3b-46a1-47e3-99b6-3027e323b3fc/console.log" append="off"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     </serial>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     <video>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     </video>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     </rng>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:   </devices>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]: </domain>
May 27 03:01:16.241897 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:01:16.247280 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Preparing to wait for external event network-vif-plugged-3c806e74-b5d9-4602-8a6f-2547db207d6c {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:01:16.247280 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquiring lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:16.247280 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:16.247280 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:16.247280 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1000140302',display_name='tempest-VolumesActionsTest-instance-1000140302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesactionstest-instance-1000140302',id=23,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb860bf509bc4a51ae78e4d7bea9d930',ramdisk_id='',reservation_id='r-1680ldn8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2104767204',owner_user_name='tempest-VolumesActionsTest-2104767204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:13Z,user_data=None,user_id='e72474ce31364e6e93613cde1d50fcf2',uuid=3df7da3b-46a1-47e3-99b6-3027e323b3fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "address": "fa:16:3e:fe:a8:17", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c806e74-b5", "ovs_interfaceid": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:01:16.247280 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Converting VIF {"id": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "address": "fa:16:3e:fe:a8:17", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c806e74-b5", "ovs_interfaceid": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:16.247280 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a8:17,bridge_name='br-int',has_traffic_filtering=True,id=3c806e74-b5d9-4602-8a6f-2547db207d6c,network=Network(f44736fe-999d-4250-bc37-3b218a164370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c806e74-b5') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:16.247280 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a8:17,bridge_name='br-int',has_traffic_filtering=True,id=3c806e74-b5d9-4602-8a6f-2547db207d6c,network=Network(f44736fe-999d-4250-bc37-3b218a164370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c806e74-b5') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:01:16.247280 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:16.247280 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:16.247280 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:01:16.247280 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:16.247280 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e349084-9022-5ae6-8974-581bee7a4fbf', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:16.249222 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:16.249222 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:16.253660 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:16.255970 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:16.256165 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c806e74-b5, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:16.256494 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c806e74-b5, col_values=(('qos', UUID('03ca6f78-9cec-4c59-8f65-7b9387b61056')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:16.256639 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c806e74-b5, col_values=(('external_ids', {'iface-id': '3c806e74-b5d9-4602-8a6f-2547db207d6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:a8:17', 'vm-uuid': '3df7da3b-46a1-47e3-99b6-3027e323b3fc'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:16.257361 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:16.258564 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:16.268133 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:16.269569 np0000001475 nova-compute[98471]: INFO os_vif [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a8:17,bridge_name='br-int',has_traffic_filtering=True,id=3c806e74-b5d9-4602-8a6f-2547db207d6c,network=Network(f44736fe-999d-4250-bc37-3b218a164370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c806e74-b5')
May 27 03:01:16.406418 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:16.406418 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:16.406418 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No VIF found with MAC fa:16:3e:d1:ea:b1, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:01:16.406418 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Using config drive
May 27 03:01:16.569164 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:01:16.569337 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:01:16.581462 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-838b3b01-1121-4133-b995-537d39799f9c req-1c03e087-7ecb-4704-9f89-828fd9995118 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:16.596858 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a7eb1784-ddbb-4fe7-b226-48a4a15d55b4 req-e2ab62de-bac8-4e2a-a5a9-dfbdf6a899f8 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received event network-vif-plugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:16.597566 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a7eb1784-ddbb-4fe7-b226-48a4a15d55b4 req-e2ab62de-bac8-4e2a-a5a9-dfbdf6a899f8 service nova] Acquiring lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:16.598120 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a7eb1784-ddbb-4fe7-b226-48a4a15d55b4 req-e2ab62de-bac8-4e2a-a5a9-dfbdf6a899f8 service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:16.598289 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a7eb1784-ddbb-4fe7-b226-48a4a15d55b4 req-e2ab62de-bac8-4e2a-a5a9-dfbdf6a899f8 service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:16.598462 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a7eb1784-ddbb-4fe7-b226-48a4a15d55b4 req-e2ab62de-bac8-4e2a-a5a9-dfbdf6a899f8 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Processing event network-vif-plugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:01:16.598628 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a7eb1784-ddbb-4fe7-b226-48a4a15d55b4 req-e2ab62de-bac8-4e2a-a5a9-dfbdf6a899f8 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received event network-vif-plugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:16.598817 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a7eb1784-ddbb-4fe7-b226-48a4a15d55b4 req-e2ab62de-bac8-4e2a-a5a9-dfbdf6a899f8 service nova] Acquiring lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:16.598981 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a7eb1784-ddbb-4fe7-b226-48a4a15d55b4 req-e2ab62de-bac8-4e2a-a5a9-dfbdf6a899f8 service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:16.599126 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a7eb1784-ddbb-4fe7-b226-48a4a15d55b4 req-e2ab62de-bac8-4e2a-a5a9-dfbdf6a899f8 service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:16.599262 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a7eb1784-ddbb-4fe7-b226-48a4a15d55b4 req-e2ab62de-bac8-4e2a-a5a9-dfbdf6a899f8 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] No waiting events found dispatching network-vif-plugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:16.599404 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-a7eb1784-ddbb-4fe7-b226-48a4a15d55b4 req-e2ab62de-bac8-4e2a-a5a9-dfbdf6a899f8 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received unexpected event network-vif-plugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 for instance with vm_state building and task_state spawning.
May 27 03:01:16.600022 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:01:16.601193 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Took 1.41 seconds to deallocate network for instance.
May 27 03:01:16.611458 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:01:16.617689 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Instance spawned successfully.
May 27 03:01:16.618631 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:01:16.645069 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:16.647771 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:16.694627 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:01:16.744413 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-838b3b01-1121-4133-b995-537d39799f9c req-1c03e087-7ecb-4704-9f89-828fd9995118 service nova] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Updated VIF entry in instance network info cache for port 3c806e74-b5d9-4602-8a6f-2547db207d6c. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:01:16.744773 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-838b3b01-1121-4133-b995-537d39799f9c req-1c03e087-7ecb-4704-9f89-828fd9995118 service nova] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Updating instance_info_cache with network_info: [{"id": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "address": "fa:16:3e:fe:a8:17", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c806e74-b5", "ovs_interfaceid": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:16.912151 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:17.050225 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Creating config drive at /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk.config
May 27 03:01:17.054925 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6phqwlpr {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:17.075722 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:01:17.117275 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:17.126546 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6phqwlpr" returned: 0 in 0.072s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:17.130286 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:17.130400 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:17.131028 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:17.131337 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:17.131869 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:17.132357 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:17.152501 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999572267000076 future=<Future at 0x7557046284a0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:17.152977 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850877.1525745, 66b799ed-716a-4b29-8125-bac73213f2cf => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:17.153245 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] VM Started (Lifecycle Event)
May 27 03:01:17.247424 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-838b3b01-1121-4133-b995-537d39799f9c req-1c03e087-7ecb-4704-9f89-828fd9995118 service nova] Releasing lock "refresh_cache-3df7da3b-46a1-47e3-99b6-3027e323b3fc" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:17.586444 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.968s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:17.588281 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.470s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:17.588281 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:01:17.639275 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Took 10.01 seconds to spawn the instance on the hypervisor.
May 27 03:01:17.639495 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:17.657764 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:17.662297 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:17.712512 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Found WWN 330000000a7ffbc1c for multipath device dm-5 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:01:17.712932 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.054s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:01:17.713173 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] <== connect_volume: return (3076ms) {'type': 'block', 'scsi_wwn': '330000000a7ffbc1c', 'path': '/dev/dm-5', 'multipath_id': '330000000a7ffbc1c'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:01:17.713298 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a7ffbc1c', 'path': '/dev/dm-5', 'multipath_id': '330000000a7ffbc1c'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:01:17.719483 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lazy-loading 'flavor' on Instance uuid f33f8709-32f7-4ce3-9967-c54609dcbb0c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:17.727454 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:17.762518 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:17.767534 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:17.787842 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:17.788025 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:17.788245 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] No VIF found with MAC fa:16:3e:fe:a8:17, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:01:17.788760 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Using config drive
May 27 03:01:17.880308 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:17.965299 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:17.973182 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:17.983994 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-38695163-76bc-4dcd-bdd8-487c80101424 req-005ed161-d427-463a-88a8-a969b090c98c service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Received event network-vif-plugged-9d220c08-bd01-473f-a389-4dcbeb9ecf4c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:17.984241 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-38695163-76bc-4dcd-bdd8-487c80101424 req-005ed161-d427-463a-88a8-a969b090c98c service nova] Acquiring lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:17.984376 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-38695163-76bc-4dcd-bdd8-487c80101424 req-005ed161-d427-463a-88a8-a969b090c98c service nova] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:17.984599 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-38695163-76bc-4dcd-bdd8-487c80101424 req-005ed161-d427-463a-88a8-a969b090c98c service nova] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:17.984809 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-38695163-76bc-4dcd-bdd8-487c80101424 req-005ed161-d427-463a-88a8-a969b090c98c service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Processing event network-vif-plugged-9d220c08-bd01-473f-a389-4dcbeb9ecf4c {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:01:18.094499 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:01:18.094760 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:01:18.095138 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:18.095483 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:18.159895 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Took 20.69 seconds to build instance.
May 27 03:01:18.165502 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:01:18.165781 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850878.1655757, 66b799ed-716a-4b29-8125-bac73213f2cf => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:18.166250 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] VM Paused (Lifecycle Event)
May 27 03:01:18.228459 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Attempting to attach volume 7dd67023-0129-4acb-99a4-6d602f2837dc with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:01:18.234489 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:01:18.234489 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:01:18.234489 np0000001475 nova-compute[98471]:   <alias name="ua-7dd67023-0129-4acb-99a4-6d602f2837dc"/>
May 27 03:01:18.234489 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:01:18.234489 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:01:18.234489 np0000001475 nova-compute[98471]:   <serial>7dd67023-0129-4acb-99a4-6d602f2837dc</serial>
May 27 03:01:18.234489 np0000001475 nova-compute[98471]: </disk>
May 27 03:01:18.234489 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:01:18.238979 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '787c8d4d4527402cbbc2ad0475f710bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab70ea24752242a88583e819c6c34e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:01:18.296622 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:18.510949 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Creating config drive at /opt/stack/data/nova/instances/3df7da3b-46a1-47e3-99b6-3027e323b3fc/disk.config
May 27 03:01:18.521961 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3df7da3b-46a1-47e3-99b6-3027e323b3fc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjmsfnyb5 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:18.571542 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:01:18.571735 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:01:18.599434 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:01:18.604322 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3df7da3b-46a1-47e3-99b6-3027e323b3fc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjmsfnyb5" returned: 0 in 0.082s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:18.663050 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-46ff57ab-35f4-4803-9f36-9478398e7ea7 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "66b799ed-716a-4b29-8125-bac73213f2cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.207s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:18.676198 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:18.684516 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850878.6838615, 66b799ed-716a-4b29-8125-bac73213f2cf => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:18.684516 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] VM Resumed (Lifecycle Event)
May 27 03:01:18.948660 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:01:18.957771 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:01:18.963766 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Instance spawned successfully.
May 27 03:01:18.964316 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:01:18.991933 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Successfully created port: 9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:01:19.080861 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:01:19.106552 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:01:19.182157 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:19.194338 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:19.207195 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:19.218643 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Rescuing
May 27 03:01:19.218643 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "refresh_cache-66b799ed-716a-4b29-8125-bac73213f2cf" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:19.218643 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquired lock "refresh_cache-66b799ed-716a-4b29-8125-bac73213f2cf" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:19.218643 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:01:19.222698 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:19.260556 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:19.373096 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:19.382013 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:19.478396 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:19.478737 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:19.479341 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:19.479730 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:19.481040 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:19.482467 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:19.594245 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.007s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:19.713997 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] During sync_power_state the instance has a pending task (rescuing). Skip.
May 27 03:01:19.714298 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850879.7141056, 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:19.714402 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] VM Started (Lifecycle Event)
May 27 03:01:19.724567 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:19.728594 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Deleted allocations for instance 7ebb66f2-020a-4b56-9fc1-f7162e96a609
May 27 03:01:19.765329 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:19.793153 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:19.793286 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:19.858484 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-665437a2-81e7-4481-8360-e2380605ae14 req-1267d844-862b-482d-9a25-8524ef8bc2f3 service nova] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Received event network-vif-plugged-3c806e74-b5d9-4602-8a6f-2547db207d6c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:19.860764 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-665437a2-81e7-4481-8360-e2380605ae14 req-1267d844-862b-482d-9a25-8524ef8bc2f3 service nova] Acquiring lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:19.860764 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-665437a2-81e7-4481-8360-e2380605ae14 req-1267d844-862b-482d-9a25-8524ef8bc2f3 service nova] Lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:19.860764 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-665437a2-81e7-4481-8360-e2380605ae14 req-1267d844-862b-482d-9a25-8524ef8bc2f3 service nova] Lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:19.860764 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-665437a2-81e7-4481-8360-e2380605ae14 req-1267d844-862b-482d-9a25-8524ef8bc2f3 service nova] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Processing event network-vif-plugged-3c806e74-b5d9-4602-8a6f-2547db207d6c {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:01:19.869939 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0005048949999491015 future=<Future at 0x75572c4c3860 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:19.870402 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:19.870402 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=2.9611792339999283 future=<Future at 0x7557047aa600 state=cancelled>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:19.870606 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=2.961048672000061 future=<Future at 0x7557047aa600 state=cancelled>) was cancelled while queued, skipping {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:19.870606 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:19.870712 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=12.281309542999907 future=<Future at 0x7557046284a0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:19.870885 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=12.281181908000008 future=<Future at 0x7557046284a0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:19.871539 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779850864.8692787, ebd2884b-67b5-40c1-8cf0-a22bd90be727 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:19.871711 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] VM Stopped (Lifecycle Event)
May 27 03:01:19.971780 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:19.971780 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:19.971780 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:19.974904 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] No VIF found with MAC fa:16:3e:af:c0:52, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:01:19.989027 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Took 9.04 seconds to spawn the instance on the hypervisor.
May 27 03:01:19.989027 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:20.084221 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Successfully updated port: 9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:01:20.132366 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:01:20.134452 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:01:20.134703 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Creating image(s)
May 27 03:01:20.135317 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "/opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:20.135503 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "/opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:20.136556 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "/opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:20.136732 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:20.144020 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:20.149978 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:20.186801 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5b0b57b8-fae0-402c-9942-9bcfa1487d4c req-c1ed1266-f903-4e49-ac53-dafc4cb7c72f service nova] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Received event network-changed-9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:20.191713 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1d49d3a0-5387-4a9a-aae2-4e391530ec27 req-5c89b80a-f552-4247-a40b-4d7f7923720e service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Received event network-vif-plugged-9d220c08-bd01-473f-a389-4dcbeb9ecf4c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:20.193020 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5b0b57b8-fae0-402c-9942-9bcfa1487d4c req-c1ed1266-f903-4e49-ac53-dafc4cb7c72f service nova] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Refreshing instance network info cache due to event network-changed-9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:01:20.194180 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1d49d3a0-5387-4a9a-aae2-4e391530ec27 req-5c89b80a-f552-4247-a40b-4d7f7923720e service nova] Acquiring lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:20.194626 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1d49d3a0-5387-4a9a-aae2-4e391530ec27 req-5c89b80a-f552-4247-a40b-4d7f7923720e service nova] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:20.194874 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1d49d3a0-5387-4a9a-aae2-4e391530ec27 req-5c89b80a-f552-4247-a40b-4d7f7923720e service nova] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:20.195300 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1d49d3a0-5387-4a9a-aae2-4e391530ec27 req-5c89b80a-f552-4247-a40b-4d7f7923720e service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] No waiting events found dispatching network-vif-plugged-9d220c08-bd01-473f-a389-4dcbeb9ecf4c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:20.198653 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5b0b57b8-fae0-402c-9942-9bcfa1487d4c req-c1ed1266-f903-4e49-ac53-dafc4cb7c72f service nova] Acquiring lock "refresh_cache-02fd272a-5759-4995-9e5c-cc1f3e28072b" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:20.198653 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5b0b57b8-fae0-402c-9942-9bcfa1487d4c req-c1ed1266-f903-4e49-ac53-dafc4cb7c72f service nova] Acquired lock "refresh_cache-02fd272a-5759-4995-9e5c-cc1f3e28072b" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:20.198653 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-5b0b57b8-fae0-402c-9942-9bcfa1487d4c req-c1ed1266-f903-4e49-ac53-dafc4cb7c72f service nova] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Refreshing network info cache for port 9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:01:20.199632 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-1d49d3a0-5387-4a9a-aae2-4e391530ec27 req-5c89b80a-f552-4247-a40b-4d7f7923720e service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Received unexpected event network-vif-plugged-9d220c08-bd01-473f-a389-4dcbeb9ecf4c for instance with vm_state active and task_state None.
May 27 03:01:20.219125 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:20.226596 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:20.244145 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:20.271774 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.121s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:20.271774 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:20.271774 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:20.271774 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:20.274753 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:20.275251 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:20.375221 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] [instance: ebd2884b-67b5-40c1-8cf0-a22bd90be727] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:20.410639 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.135s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:20.411217 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:20.480786 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk 1073741824" returned: 0 in 0.069s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:20.481289 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:20.483769 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:20.524321 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Took 21.76 seconds to build instance.
May 27 03:01:20.538304 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Updating instance_info_cache with network_info: [{"id": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "address": "fa:16:3e:b2:aa:32", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6bdedc-0c", "ovs_interfaceid": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:20.581368 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.097s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:20.581955 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:01:20.582294 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:20.602806 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "refresh_cache-02fd272a-5759-4995-9e5c-cc1f3e28072b" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:20.680547 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:01:20.685002 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:01:20.692315 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:20.692825 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Cannot resize image /opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:01:20.693459 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:01:20.693605 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Ensure instance console log exists: /opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:01:20.693918 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:20.694143 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:20.695057 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Instance spawned successfully.
May 27 03:01:20.695361 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:20.698081 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:01:20.701811 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-5b0b57b8-fae0-402c-9942-9bcfa1487d4c req-c1ed1266-f903-4e49-ac53-dafc4cb7c72f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:20.738696 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850880.737687, 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:20.738696 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] VM Paused (Lifecycle Event)
May 27 03:01:20.759930 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-280c546c-58a0-4679-b8b1-52663659ecea tempest-VolumesNegativeTest-1026582036 tempest-VolumesNegativeTest-1026582036-project-member] Lock "7ebb66f2-020a-4b56-9fc1-f7162e96a609" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.866s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:20.804542 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-5b0b57b8-fae0-402c-9942-9bcfa1487d4c req-c1ed1266-f903-4e49-ac53-dafc4cb7c72f service nova] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:01:20.951201 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:21.031872 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22ef1f52-d0f6-4b3e-a122-2ae04792f79a tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.274s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:21.046153 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Releasing lock "refresh_cache-66b799ed-716a-4b29-8125-bac73213f2cf" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:21.101836 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-5b0b57b8-fae0-402c-9942-9bcfa1487d4c req-c1ed1266-f903-4e49-ac53-dafc4cb7c72f service nova] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:21.211093 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:21.211093 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:21.211093 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:21.211093 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:21.213035 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:21.213035 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:21.241762 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:21.247648 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850881.2466142, 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:21.247648 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] VM Resumed (Lifecycle Event)
May 27 03:01:21.258803 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:21.612822 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5b0b57b8-fae0-402c-9942-9bcfa1487d4c req-c1ed1266-f903-4e49-ac53-dafc4cb7c72f service nova] Releasing lock "refresh_cache-02fd272a-5759-4995-9e5c-cc1f3e28072b" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:21.614335 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquired lock "refresh_cache-02fd272a-5759-4995-9e5c-cc1f3e28072b" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:21.614335 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:01:21.623586 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-31e5e3db-2790-438c-bc85-0133eedf3c03 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.872s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:21.729154 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Took 7.48 seconds to spawn the instance on the hypervisor.
May 27 03:01:21.729347 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:21.755698 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:21.759871 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:21.997803 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-dec3051b-dbfe-4588-a0cc-decd2f937e6f req-f9d90f46-90a9-4934-9594-d7163f5ac348 service nova] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Received event network-vif-plugged-3c806e74-b5d9-4602-8a6f-2547db207d6c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:21.997803 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-dec3051b-dbfe-4588-a0cc-decd2f937e6f req-f9d90f46-90a9-4934-9594-d7163f5ac348 service nova] Acquiring lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:21.997803 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-dec3051b-dbfe-4588-a0cc-decd2f937e6f req-f9d90f46-90a9-4934-9594-d7163f5ac348 service nova] Lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:21.997803 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-dec3051b-dbfe-4588-a0cc-decd2f937e6f req-f9d90f46-90a9-4934-9594-d7163f5ac348 service nova] Lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:21.997803 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-dec3051b-dbfe-4588-a0cc-decd2f937e6f req-f9d90f46-90a9-4934-9594-d7163f5ac348 service nova] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] No waiting events found dispatching network-vif-plugged-3c806e74-b5d9-4602-8a6f-2547db207d6c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:21.997803 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-dec3051b-dbfe-4588-a0cc-decd2f937e6f req-f9d90f46-90a9-4934-9594-d7163f5ac348 service nova] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Received unexpected event network-vif-plugged-3c806e74-b5d9-4602-8a6f-2547db207d6c for instance with vm_state active and task_state None.
May 27 03:01:22.159649 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Rescuing
May 27 03:01:22.160359 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:22.160359 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquired lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:22.160359 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:01:22.227477 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:01:22.256816 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Took 18.44 seconds to build instance.
May 27 03:01:22.264532 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850882.2641776, 3df7da3b-46a1-47e3-99b6-3027e323b3fc => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:22.264733 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] VM Started (Lifecycle Event)
May 27 03:01:22.502417 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:22.605395 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0fd56dc5-a4e3-4ada-9bba-6f7996da1631 req-e2ece5ee-c65f-44d5-a9bc-6f9e90ff54f5 service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Received event network-changed-63e286dc-7977-40c8-b72b-fc4860de9e20 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:22.605566 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0fd56dc5-a4e3-4ada-9bba-6f7996da1631 req-e2ece5ee-c65f-44d5-a9bc-6f9e90ff54f5 service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Refreshing instance network info cache due to event network-changed-63e286dc-7977-40c8-b72b-fc4860de9e20. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:01:22.605714 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0fd56dc5-a4e3-4ada-9bba-6f7996da1631 req-e2ece5ee-c65f-44d5-a9bc-6f9e90ff54f5 service nova] Acquiring lock "refresh_cache-71af628e-b06d-446d-8c2e-dcfbb232df33" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:22.605851 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0fd56dc5-a4e3-4ada-9bba-6f7996da1631 req-e2ece5ee-c65f-44d5-a9bc-6f9e90ff54f5 service nova] Acquired lock "refresh_cache-71af628e-b06d-446d-8c2e-dcfbb232df33" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:22.606092 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-0fd56dc5-a4e3-4ada-9bba-6f7996da1631 req-e2ece5ee-c65f-44d5-a9bc-6f9e90ff54f5 service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Refreshing network info cache for port 63e286dc-7977-40c8-b72b-fc4860de9e20 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:01:22.663599 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:22.764890 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Updating instance_info_cache with network_info: [{"id": "9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97", "address": "fa:16:3e:76:05:c4", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3f3f0b-8b", "ovs_interfaceid": "9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:22.766358 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d213fb3-115a-4d88-bc46-c2325958d3e7 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.964s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:22.772793 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:22.780553 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:22.845068 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:22.879804 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:23.097949 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:23.106518 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:23.113163 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-0fd56dc5-a4e3-4ada-9bba-6f7996da1631 req-e2ece5ee-c65f-44d5-a9bc-6f9e90ff54f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:23.152828 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:23.186697 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Instance destroyed successfully.
May 27 03:01:23.190315 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'numa_topology' on Instance uuid 66b799ed-716a-4b29-8125-bac73213f2cf {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:23.213086 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:23.240905 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:23.267749 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Releasing lock "refresh_cache-02fd272a-5759-4995-9e5c-cc1f3e28072b" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:23.268051 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Instance network_info: |[{"id": "9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97", "address": "fa:16:3e:76:05:c4", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3f3f0b-8b", "ovs_interfaceid": "9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:01:23.273099 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Start _get_guest_xml network_info=[{"id": "9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97", "address": "fa:16:3e:76:05:c4", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3f3f0b-8b", "ovs_interfaceid": "9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:01:23.283621 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:01:23.285425 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-878350560', uuid='02fd272a-5759-4995-9e5c-cc1f3e28072b'), owner=OwnerMeta(userid='787c8d4d4527402cbbc2ad0475f710bb', username='tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member', projectid='ab70ea24752242a88583e819c6c34e12', projectname='tempest-ServerBootFromVolumeStableRescueTest-1976367979'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97", "address": "fa:16:3e:76:05:c4", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3f3f0b-8b", "ovs_interfaceid": "9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850883.2848935) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:01:23.287396 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850883.2871807, 3df7da3b-46a1-47e3-99b6-3027e323b3fc => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:23.287585 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] VM Paused (Lifecycle Event)
May 27 03:01:23.300365 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:01:23.303620 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:23.308901 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:01:23.314111 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:01:23.314438 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:01:23.315720 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:01:23.319904 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:01:23.326018 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:01:23.326018 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:01:23.326769 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:01:23.326915 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:01:23.328290 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:01:23.329340 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:01:23.330498 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:01:23.332177 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:01:23.334613 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:01:23.334780 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:01:23.356984 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-878350560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverbootfromvolumestablerescuetest-server-878350560',id=24,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab70ea24752242a88583e819c6c34e12',ramdisk_id='',reservation_id='r-v9i46y3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:19Z,user_data=None,user_id='787c8d4d4527402cbbc2ad0475f710bb',uuid=02fd272a-5759-4995-9e5c-cc1f3e28072b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97", "address": "fa:16:3e:76:05:c4", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3f3f0b-8b", "ovs_interfaceid": "9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:01:23.358377 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converting VIF {"id": "9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97", "address": "fa:16:3e:76:05:c4", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3f3f0b-8b", "ovs_interfaceid": "9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:23.358377 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:05:c4,bridge_name='br-int',has_traffic_filtering=True,id=9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3f3f0b-8b') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:23.359867 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'pci_devices' on Instance uuid 02fd272a-5759-4995-9e5c-cc1f3e28072b {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:23.393081 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-60c029be-4128-426e-bd4a-1116f238a2c2 req-d3fc1b45-0565-4953-af6b-34f4fedb77be service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received event network-vif-unplugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:23.393691 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-60c029be-4128-426e-bd4a-1116f238a2c2 req-d3fc1b45-0565-4953-af6b-34f4fedb77be service nova] Acquiring lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:23.394145 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-60c029be-4128-426e-bd4a-1116f238a2c2 req-d3fc1b45-0565-4953-af6b-34f4fedb77be service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:23.394425 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-60c029be-4128-426e-bd4a-1116f238a2c2 req-d3fc1b45-0565-4953-af6b-34f4fedb77be service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:23.394674 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-60c029be-4128-426e-bd4a-1116f238a2c2 req-d3fc1b45-0565-4953-af6b-34f4fedb77be service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] No waiting events found dispatching network-vif-unplugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:23.394950 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-60c029be-4128-426e-bd4a-1116f238a2c2 req-d3fc1b45-0565-4953-af6b-34f4fedb77be service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received unexpected event network-vif-unplugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 for instance with vm_state active and task_state rescuing.
May 27 03:01:23.439326 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:23.449135 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:23.632709 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Updating instance_info_cache with network_info: [{"id": "d113df60-11d0-4f48-a42a-9541589d6a45", "address": "fa:16:3e:af:c0:52", "network": {"id": "a5ee8bff-dbe9-420a-bc58-64e9082e7d84", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a7ebe6073564995b0dd1bb85437f4d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd113df60-11", "ovs_interfaceid": "d113df60-11d0-4f48-a42a-9541589d6a45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:23.697852 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Attempting rescue
May 27 03:01:23.699027 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98471) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 27 03:01:23.707862 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:23.716143 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Instance directory exists: not creating {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 03:01:23.716896 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Creating image(s)
May 27 03:01:23.720772 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "/opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:23.720772 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "/opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:23.720772 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "/opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:23.720772 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'trusted_certs' on Instance uuid 66b799ed-716a-4b29-8125-bac73213f2cf {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:23.776788 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:23.784871 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:23.796080 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:23.808698 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850883.8079255, 3df7da3b-46a1-47e3-99b6-3027e323b3fc => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:23.808698 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] VM Resumed (Lifecycle Event)
May 27 03:01:23.867827 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] End _get_guest_xml xml=<domain type="qemu">
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:   <uuid>02fd272a-5759-4995-9e5c-cc1f3e28072b</uuid>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:   <name>instance-00000018</name>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-878350560</nova:name>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:01:23</nova:creationTime>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:         <nova:user uuid="787c8d4d4527402cbbc2ad0475f710bb">tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member</nova:user>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:         <nova:project uuid="ab70ea24752242a88583e819c6c34e12">tempest-ServerBootFromVolumeStableRescueTest-1976367979</nova:project>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:         <nova:port uuid="9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97">
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     <system>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <entry name="serial">02fd272a-5759-4995-9e5c-cc1f3e28072b</entry>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <entry name="uuid">02fd272a-5759-4995-9e5c-cc1f3e28072b</entry>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     </system>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:   <os>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:   </os>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:   <features>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:   </features>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:   <devices>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk.config"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:76:05:c4"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <target dev="tap9c3f3f0b-8b"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     </interface>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/console.log" append="off"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     </serial>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     <video>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     </video>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     </rng>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:   </devices>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]: </domain>
May 27 03:01:23.867827 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:01:23.870640 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Preparing to wait for external event network-vif-plugged-9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:01:23.872122 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "02fd272a-5759-4995-9e5c-cc1f3e28072b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:23.872122 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "02fd272a-5759-4995-9e5c-cc1f3e28072b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:23.872122 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "02fd272a-5759-4995-9e5c-cc1f3e28072b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:23.872390 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-878350560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverbootfromvolumestablerescuetest-server-878350560',id=24,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab70ea24752242a88583e819c6c34e12',ramdisk_id='',reservation_id='r-v9i46y3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:19Z,user_data=None,user_id='787c8d4d4527402cbbc2ad0475f710bb',uuid=02fd272a-5759-4995-9e5c-cc1f3e28072b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97", "address": "fa:16:3e:76:05:c4", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3f3f0b-8b", "ovs_interfaceid": "9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:01:23.872390 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converting VIF {"id": "9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97", "address": "fa:16:3e:76:05:c4", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3f3f0b-8b", "ovs_interfaceid": "9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:23.873100 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:05:c4,bridge_name='br-int',has_traffic_filtering=True,id=9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3f3f0b-8b') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:23.873439 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:05:c4,bridge_name='br-int',has_traffic_filtering=True,id=9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3f3f0b-8b') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:01:23.874551 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:23.874842 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:23.875303 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:01:23.878352 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:23.878528 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99f555ab-32f4-5595-a181-8ff9104ae200', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:23.880183 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:23.881816 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:23.889733 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:23.900751 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-0fd56dc5-a4e3-4ada-9bba-6f7996da1631 req-e2ece5ee-c65f-44d5-a9bc-6f9e90ff54f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:23.903086 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:23.903369 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c3f3f0b-8b, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:23.903840 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c3f3f0b-8b, col_values=(('qos', UUID('723786a0-0db7-45dc-bfcf-4d529a602433')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:23.904072 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c3f3f0b-8b, col_values=(('external_ids', {'iface-id': '9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:05:c4', 'vm-uuid': '02fd272a-5759-4995-9e5c-cc1f3e28072b'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:23.908981 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:23.910782 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:23.921546 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:23.923365 np0000001475 nova-compute[98471]: INFO os_vif [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:05:c4,bridge_name='br-int',has_traffic_filtering=True,id=9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3f3f0b-8b')
May 27 03:01:24.141475 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Releasing lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:24.159756 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-0fd56dc5-a4e3-4ada-9bba-6f7996da1631 req-e2ece5ee-c65f-44d5-a9bc-6f9e90ff54f5 service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Updated VIF entry in instance network info cache for port 63e286dc-7977-40c8-b72b-fc4860de9e20. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:01:24.161726 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-0fd56dc5-a4e3-4ada-9bba-6f7996da1631 req-e2ece5ee-c65f-44d5-a9bc-6f9e90ff54f5 service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Updating instance_info_cache with network_info: [{"id": "63e286dc-7977-40c8-b72b-fc4860de9e20", "address": "fa:16:3e:23:4b:54", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e286dc-79", "ovs_interfaceid": "63e286dc-7977-40c8-b72b-fc4860de9e20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:24.229020 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<66b799ed-716a-4b29-8125-bac73213f2cf> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:24.229020 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:24.233013 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:24.234346 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:24.234711 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:24.235067 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:24.242472 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:24.243094 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:24.317409 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:24.327050 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:24.367204 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.124s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:24.367789 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.rescue {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:24.436906 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquiring lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:24.436906 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:24.436906 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquiring lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:24.437526 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:24.437526 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:24.446016 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Terminating instance
May 27 03:01:24.458654 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.rescue" returned: 0 in 0.090s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:24.460108 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:24.460435 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'migration_context' on Instance uuid 66b799ed-716a-4b29-8125-bac73213f2cf {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:24.668720 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0fd56dc5-a4e3-4ada-9bba-6f7996da1631 req-e2ece5ee-c65f-44d5-a9bc-6f9e90ff54f5 service nova] Releasing lock "refresh_cache-71af628e-b06d-446d-8c2e-dcfbb232df33" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:24.715327 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fbc4d8e6-d476-4665-8710-b6b419824f26 req-77461cca-5ca2-47df-8353-ef5e1e3e35f3 service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Received event network-changed-9d220c08-bd01-473f-a389-4dcbeb9ecf4c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:24.715327 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fbc4d8e6-d476-4665-8710-b6b419824f26 req-77461cca-5ca2-47df-8353-ef5e1e3e35f3 service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Refreshing instance network info cache due to event network-changed-9d220c08-bd01-473f-a389-4dcbeb9ecf4c. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:01:24.715630 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fbc4d8e6-d476-4665-8710-b6b419824f26 req-77461cca-5ca2-47df-8353-ef5e1e3e35f3 service nova] Acquiring lock "refresh_cache-3e5f7741-2c52-4242-9b37-566ff5f5a6a0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:24.715630 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fbc4d8e6-d476-4665-8710-b6b419824f26 req-77461cca-5ca2-47df-8353-ef5e1e3e35f3 service nova] Acquired lock "refresh_cache-3e5f7741-2c52-4242-9b37-566ff5f5a6a0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:24.715794 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-fbc4d8e6-d476-4665-8710-b6b419824f26 req-77461cca-5ca2-47df-8353-ef5e1e3e35f3 service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Refreshing network info cache for port 9d220c08-bd01-473f-a389-4dcbeb9ecf4c {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:01:24.832331 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] During sync_power_state the instance has a pending task (deleting). Skip.
May 27 03:01:24.833080 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99960677199988 future=<Future at 0x7557047a9b80 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:24.961859 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:01:24.965717 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<66b799ed-716a-4b29-8125-bac73213f2cf> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:24.968891 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:01:24.970976 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Start _get_guest_xml network_info=[{"id": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "address": "fa:16:3e:b2:aa:32", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "vif_mac": "fa:16:3e:b2:aa:32"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6bdedc-0c", "ovs_interfaceid": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:01:24.970976 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'resources' on Instance uuid 66b799ed-716a-4b29-8125-bac73213f2cf {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:24.999052 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "71af628e-b06d-446d-8c2e-dcfbb232df33" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:25.000224 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:25.012106 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:25.014455 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:25.040702 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:25.048479 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:25.090721 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:25.211623 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5637f1c0-1b23-48e0-a0cc-0eea8d9711dc req-1568d4e7-0398-4666-b7a2-3a19177574f9 service nova] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Received event network-vif-unplugged-3c806e74-b5d9-4602-8a6f-2547db207d6c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:25.211623 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5637f1c0-1b23-48e0-a0cc-0eea8d9711dc req-1568d4e7-0398-4666-b7a2-3a19177574f9 service nova] Acquiring lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:25.211623 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5637f1c0-1b23-48e0-a0cc-0eea8d9711dc req-1568d4e7-0398-4666-b7a2-3a19177574f9 service nova] Lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:25.211623 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5637f1c0-1b23-48e0-a0cc-0eea8d9711dc req-1568d4e7-0398-4666-b7a2-3a19177574f9 service nova] Lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:25.211623 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5637f1c0-1b23-48e0-a0cc-0eea8d9711dc req-1568d4e7-0398-4666-b7a2-3a19177574f9 service nova] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] No waiting events found dispatching network-vif-unplugged-3c806e74-b5d9-4602-8a6f-2547db207d6c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:25.211623 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5637f1c0-1b23-48e0-a0cc-0eea8d9711dc req-1568d4e7-0398-4666-b7a2-3a19177574f9 service nova] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Received event network-vif-unplugged-3c806e74-b5d9-4602-8a6f-2547db207d6c for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:01:25.227061 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-fbc4d8e6-d476-4665-8710-b6b419824f26 req-77461cca-5ca2-47df-8353-ef5e1e3e35f3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:25.339263 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999658508000039 future=<Future at 0x75570473aae0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:25.341658 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Instance destroyed successfully.
May 27 03:01:25.342138 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lazy-loading 'resources' on Instance uuid 3df7da3b-46a1-47e3-99b6-3027e323b3fc {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:25.469445 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:25.469445 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:25.469732 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] No VIF found with MAC fa:16:3e:76:05:c4, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:01:25.474670 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Using config drive
May 27 03:01:25.479969 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<66b799ed-716a-4b29-8125-bac73213f2cf> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:25.487980 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:01:25.489349 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-804870695', uuid='66b799ed-716a-4b29-8125-bac73213f2cf'), owner=OwnerMeta(userid='b438796ed5e44f629535db767fe2b756', username='tempest-ServerRescueNegativeTestJSON-62027498-project-member', projectid='39cbbdb9012c4992865d4f89678ef9ac', projectname='tempest-ServerRescueNegativeTestJSON-62027498'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "address": "fa:16:3e:b2:aa:32", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "vif_mac": "fa:16:3e:b2:aa:32"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6bdedc-0c", "ovs_interfaceid": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850885.4889252) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:01:25.490868 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:01:25.491477 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:01:25.493814 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:01:25.493814 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:01:25.495407 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:01:25.495988 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:01:25.496601 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:01:25.496802 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:01:25.497041 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:01:25.497172 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:01:25.497404 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:01:25.497588 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:01:25.497696 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:01:25.497855 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:01:25.498059 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:01:25.498221 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:01:25.498449 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'vcpu_model' on Instance uuid 66b799ed-716a-4b29-8125-bac73213f2cf {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:25.506158 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'flavor' on Instance uuid 71af628e-b06d-446d-8c2e-dcfbb232df33 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:25.678175 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received event network-vif-unplugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:25.680212 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] Acquiring lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:25.680444 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:25.680528 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:25.681100 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] No waiting events found dispatching network-vif-unplugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:25.681100 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received unexpected event network-vif-unplugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 for instance with vm_state active and task_state rescuing.
May 27 03:01:25.681100 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received event network-vif-plugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:25.681100 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] Acquiring lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:25.681319 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:25.681447 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:25.681492 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] No waiting events found dispatching network-vif-plugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:25.681656 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received unexpected event network-vif-plugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 for instance with vm_state active and task_state rescuing.
May 27 03:01:25.681777 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received event network-vif-plugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:25.681907 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] Acquiring lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:25.682043 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:25.682159 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:25.682282 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] No waiting events found dispatching network-vif-plugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:25.682535 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received unexpected event network-vif-plugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 for instance with vm_state active and task_state rescuing.
May 27 03:01:25.682535 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received event network-vif-unplugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:25.682714 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] Acquiring lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:25.684732 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:25.684987 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:25.685122 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] No waiting events found dispatching network-vif-unplugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:25.685311 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received unexpected event network-vif-unplugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 for instance with vm_state active and task_state rescuing.
May 27 03:01:25.689132 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received event network-vif-unplugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:25.689370 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] Acquiring lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:25.689589 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:25.689715 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:25.689897 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] No waiting events found dispatching network-vif-unplugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:25.690082 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-f6158a35-2828-4b3f-a102-60bd312a5a19 req-de6c5d7e-fde7-4547-9e22-49564195e6c0 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received unexpected event network-vif-unplugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 for instance with vm_state active and task_state rescuing.
May 27 03:01:25.848159 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1000140302',display_name='tempest-VolumesActionsTest-instance-1000140302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesactionstest-instance-1000140302',id=23,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:01:21Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb860bf509bc4a51ae78e4d7bea9d930',ramdisk_id='',reservation_id='r-1680ldn8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2104767204',owner_user_name='tempest-VolumesActionsTest-2104767204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:01:22Z,user_data=None,user_id='e72474ce31364e6e93613cde1d50fcf2',uuid=3df7da3b-46a1-47e3-99b6-3027e323b3fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "address": "fa:16:3e:fe:a8:17", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c806e74-b5", "ovs_interfaceid": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:01:25.848453 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Converting VIF {"id": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "address": "fa:16:3e:fe:a8:17", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c806e74-b5", "ovs_interfaceid": "3c806e74-b5d9-4602-8a6f-2547db207d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:25.849756 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a8:17,bridge_name='br-int',has_traffic_filtering=True,id=3c806e74-b5d9-4602-8a6f-2547db207d6c,network=Network(f44736fe-999d-4250-bc37-3b218a164370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c806e74-b5') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:25.849756 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a8:17,bridge_name='br-int',has_traffic_filtering=True,id=3c806e74-b5d9-4602-8a6f-2547db207d6c,network=Network(f44736fe-999d-4250-bc37-3b218a164370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c806e74-b5') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:01:25.852230 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:25.852569 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c806e74-b5, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:25.862049 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:25.864169 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:25.881057 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:25.886467 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:25.921295 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:25.934168 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:25.958542 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:25.965279 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:25.965702 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03ca6f78-9cec-4c59-8f65-7b9387b61056) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:25.968892 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:25.983965 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:25.988994 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:26.002649 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<66b799ed-716a-4b29-8125-bac73213f2cf> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:26.007590 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:26.019962 np0000001475 nova-compute[98471]: INFO os_vif [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a8:17,bridge_name='br-int',has_traffic_filtering=True,id=3c806e74-b5d9-4602-8a6f-2547db207d6c,network=Network(f44736fe-999d-4250-bc37-3b218a164370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c806e74-b5')
May 27 03:01:26.023544 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Deleting instance files /opt/stack/data/nova/instances/3df7da3b-46a1-47e3-99b6-3027e323b3fc_del
May 27 03:01:26.024661 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Deletion of /opt/stack/data/nova/instances/3df7da3b-46a1-47e3-99b6-3027e323b3fc_del complete
May 27 03:01:26.027128 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:00:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-804870695',display_name='tempest-ServerRescueNegativeTestJSON-server-804870695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverrescuenegativetestjson-server-804870695',id=21,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:01:17Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39cbbdb9012c4992865d4f89678ef9ac',ramdisk_id='',reservation_id='r-9du7vlyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-62027498',owner_user_name='tempest-ServerRescueNegativeTestJSON-62027498-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:18Z,user_data=None,user_id='b438796ed5e44f629535db767fe2b756',uuid=66b799ed-716a-4b29-8125-bac73213f2cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "address": "fa:16:3e:b2:aa:32", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "vif_mac": "fa:16:3e:b2:aa:32"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6bdedc-0c", "ovs_interfaceid": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:01:26.030096 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converting VIF {"id": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "address": "fa:16:3e:b2:aa:32", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "vif_mac": "fa:16:3e:b2:aa:32"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6bdedc-0c", "ovs_interfaceid": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:26.030096 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:aa:32,bridge_name='br-int',has_traffic_filtering=True,id=fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6bdedc-0c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:26.030096 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'pci_devices' on Instance uuid 66b799ed-716a-4b29-8125-bac73213f2cf {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:26.186582 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99941762200001 future=<Future at 0x75570474e270 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:26.193774 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Instance destroyed successfully.
May 27 03:01:26.195686 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lazy-loading 'numa_topology' on Instance uuid f33f8709-32f7-4ce3-9967-c54609dcbb0c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:26.250470 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Creating config drive at /opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk.config
May 27 03:01:26.259204 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6zv45738 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:26.341371 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6zv45738" returned: 0 in 0.082s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:26.381988 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-fbc4d8e6-d476-4665-8710-b6b419824f26 req-77461cca-5ca2-47df-8353-ef5e1e3e35f3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:26.522825 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.522s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:26.536618 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<66b799ed-716a-4b29-8125-bac73213f2cf> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:26.539404 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] End _get_guest_xml xml=<domain type="qemu">
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:   <uuid>66b799ed-716a-4b29-8125-bac73213f2cf</uuid>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:   <name>instance-00000015</name>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-804870695</nova:name>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:01:25</nova:creationTime>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:         <nova:user uuid="b438796ed5e44f629535db767fe2b756">tempest-ServerRescueNegativeTestJSON-62027498-project-member</nova:user>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:         <nova:project uuid="39cbbdb9012c4992865d4f89678ef9ac">tempest-ServerRescueNegativeTestJSON-62027498</nova:project>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:         <nova:port uuid="fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2">
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     <system>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <entry name="serial">66b799ed-716a-4b29-8125-bac73213f2cf</entry>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <entry name="uuid">66b799ed-716a-4b29-8125-bac73213f2cf</entry>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     </system>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:   <os>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:   </os>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:   <features>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:   </features>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:   <devices>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.rescue"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <target dev="vdb" bus="virtio"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.config.rescue"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:b2:aa:32"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <target dev="tapfe6bdedc-0c"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     </interface>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/console.log" append="off"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     </serial>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     <video>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     </video>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     </rng>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:   </devices>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]: </domain>
May 27 03:01:26.539404 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:01:26.548542 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Took 1.59 seconds to destroy the instance on the hypervisor.
May 27 03:01:26.549820 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:01:26.550320 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:01:26.551664 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:01:26.552029 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:26.562266 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Instance destroyed successfully.
May 27 03:01:26.680983 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-fbc4d8e6-d476-4665-8710-b6b419824f26 req-77461cca-5ca2-47df-8353-ef5e1e3e35f3 service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Updated VIF entry in instance network info cache for port 9d220c08-bd01-473f-a389-4dcbeb9ecf4c. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:01:26.681423 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-fbc4d8e6-d476-4665-8710-b6b419824f26 req-77461cca-5ca2-47df-8353-ef5e1e3e35f3 service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Updating instance_info_cache with network_info: [{"id": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "address": "fa:16:3e:d1:ea:b1", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d220c08-bd", "ovs_interfaceid": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:26.691479 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:26.704639 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Attempting a stable device rescue
May 27 03:01:26.858315 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=98471) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 27 03:01:26.864481 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Instance directory exists: not creating {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 03:01:26.864816 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Creating image(s)
May 27 03:01:26.865690 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "/opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:26.866081 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "/opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:26.866821 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "/opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:26.867157 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lazy-loading 'trusted_certs' on Instance uuid f33f8709-32f7-4ce3-9967-c54609dcbb0c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:26.929423 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:26.986889 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:27.077497 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-755d8899-354d-4772-a284-0c3254365736 req-1e67128e-0bcc-4964-a66a-4b88e8cbc594 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received event network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:27.080130 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-755d8899-354d-4772-a284-0c3254365736 req-1e67128e-0bcc-4964-a66a-4b88e8cbc594 service nova] Acquiring lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:27.080267 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-755d8899-354d-4772-a284-0c3254365736 req-1e67128e-0bcc-4964-a66a-4b88e8cbc594 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:27.080416 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-755d8899-354d-4772-a284-0c3254365736 req-1e67128e-0bcc-4964-a66a-4b88e8cbc594 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:27.080688 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-755d8899-354d-4772-a284-0c3254365736 req-1e67128e-0bcc-4964-a66a-4b88e8cbc594 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] No waiting events found dispatching network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:27.080887 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-755d8899-354d-4772-a284-0c3254365736 req-1e67128e-0bcc-4964-a66a-4b88e8cbc594 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received unexpected event network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 for instance with vm_state active and task_state rescuing.
May 27 03:01:27.081065 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-755d8899-354d-4772-a284-0c3254365736 req-1e67128e-0bcc-4964-a66a-4b88e8cbc594 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received event network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:27.081283 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-755d8899-354d-4772-a284-0c3254365736 req-1e67128e-0bcc-4964-a66a-4b88e8cbc594 service nova] Acquiring lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:27.081772 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-755d8899-354d-4772-a284-0c3254365736 req-1e67128e-0bcc-4964-a66a-4b88e8cbc594 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:27.081772 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-755d8899-354d-4772-a284-0c3254365736 req-1e67128e-0bcc-4964-a66a-4b88e8cbc594 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:27.081772 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-755d8899-354d-4772-a284-0c3254365736 req-1e67128e-0bcc-4964-a66a-4b88e8cbc594 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] No waiting events found dispatching network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:27.083576 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-755d8899-354d-4772-a284-0c3254365736 req-1e67128e-0bcc-4964-a66a-4b88e8cbc594 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received unexpected event network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 for instance with vm_state active and task_state rescuing.
May 27 03:01:27.119527 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:27.186303 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fbc4d8e6-d476-4665-8710-b6b419824f26 req-77461cca-5ca2-47df-8353-ef5e1e3e35f3 service nova] Releasing lock "refresh_cache-3e5f7741-2c52-4242-9b37-566ff5f5a6a0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:27.193804 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:27.207000 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:27.327760 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-aa83e8a6-65fa-4dd6-969e-3b808435b0aa req-56869c3c-1684-45aa-87ca-eeb0325feedc service nova] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Received event network-vif-unplugged-3c806e74-b5d9-4602-8a6f-2547db207d6c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:27.328813 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa83e8a6-65fa-4dd6-969e-3b808435b0aa req-56869c3c-1684-45aa-87ca-eeb0325feedc service nova] Acquiring lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:27.329091 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa83e8a6-65fa-4dd6-969e-3b808435b0aa req-56869c3c-1684-45aa-87ca-eeb0325feedc service nova] Lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:27.329274 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa83e8a6-65fa-4dd6-969e-3b808435b0aa req-56869c3c-1684-45aa-87ca-eeb0325feedc service nova] Lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:27.329441 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-aa83e8a6-65fa-4dd6-969e-3b808435b0aa req-56869c3c-1684-45aa-87ca-eeb0325feedc service nova] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] No waiting events found dispatching network-vif-unplugged-3c806e74-b5d9-4602-8a6f-2547db207d6c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:27.329601 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-aa83e8a6-65fa-4dd6-969e-3b808435b0aa req-56869c3c-1684-45aa-87ca-eeb0325feedc service nova] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Received event network-vif-unplugged-3c806e74-b5d9-4602-8a6f-2547db207d6c for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:01:27.329816 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-aa83e8a6-65fa-4dd6-969e-3b808435b0aa req-56869c3c-1684-45aa-87ca-eeb0325feedc service nova] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Received event network-vif-plugged-9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:27.329963 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa83e8a6-65fa-4dd6-969e-3b808435b0aa req-56869c3c-1684-45aa-87ca-eeb0325feedc service nova] Acquiring lock "02fd272a-5759-4995-9e5c-cc1f3e28072b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:27.331028 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa83e8a6-65fa-4dd6-969e-3b808435b0aa req-56869c3c-1684-45aa-87ca-eeb0325feedc service nova] Lock "02fd272a-5759-4995-9e5c-cc1f3e28072b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:27.331028 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa83e8a6-65fa-4dd6-969e-3b808435b0aa req-56869c3c-1684-45aa-87ca-eeb0325feedc service nova] Lock "02fd272a-5759-4995-9e5c-cc1f3e28072b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:27.331028 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-aa83e8a6-65fa-4dd6-969e-3b808435b0aa req-56869c3c-1684-45aa-87ca-eeb0325feedc service nova] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Processing event network-vif-plugged-9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:01:27.370446 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Object Instance<f33f8709-32f7-4ce3-9967-c54609dcbb0c> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:27.370823 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "1a4f491fa90f902e207244e217e366a241e3d34c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:27.371528 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "1a4f491fa90f902e207244e217e366a241e3d34c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:27.653792 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:27.684843 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "71af628e-b06d-446d-8c2e-dcfbb232df33" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:27.684843 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:27.685238 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Attaching volume 89f6f402-75a6-40a9-b2f2-8ef5f58a4586 to /dev/vdb
May 27 03:01:27.765493 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:01:27.780774 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:01:27.811552 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:27.861403 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:01:27.861403 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:01:27.881859 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:01:27.888417 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b', 'fe80::fc16:3eff:fe1f:5a7', 'fe80::a095:90ff:feef:1465', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::fc16:3eff:fefc:b5d4', 'fe80::fc16:3eff:fe7e:904a', 'fe80::fc16:3eff:fe01:3d37', 'fe80::c805:4ff:fe3b:2374', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:fe76:5c4'] 
May 27 03:01:27.890422 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:01:27.890422 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:01:27.891406 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:01:27.892347 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Updating existing volume attachment record: a4b477ef-7dd8-49ce-bfb6-125e66e8637d {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:01:28.109378 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:28.111208 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:28.115078 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:28.115078 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No VIF found with MAC fa:16:3e:b2:aa:32, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:01:28.115078 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Using config drive
May 27 03:01:28.157691 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Took 1.61 seconds to deallocate network for instance.
May 27 03:01:28.205922 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850888.205416, 02fd272a-5759-4995-9e5c-cc1f3e28072b => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:28.206548 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] VM Started (Lifecycle Event)
May 27 03:01:28.208292 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:01:28.215098 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:01:28.223416 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Instance spawned successfully.
May 27 03:01:28.225150 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:01:28.526594 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:01:28.527779 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:01:28.527779 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:01:28.527779 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:01:28.527779 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:01:28.544949 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:01:28.546760 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:01:28.546760 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:01:28.546760 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:01:28.548276 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:01:28.550037 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:01:28.566148 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:01:28.566148 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:28.578449 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:01:28.578449 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:28.590610 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586] added
May 27 03:01:28.590610 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:01:28.590610 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:01:28.590610 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:01:28.590610 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:01:28.590610 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:01:28.590610 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:28.590610 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:01:28.590610 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0424(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:01:28.590610 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:01:28.595911 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586] added
May 27 03:01:28.595911 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:01:28.595911 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:01:28.595911 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:01:28.595911 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:01:28.595911 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:01:28.595911 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:28.596109 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:01:28.596219 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0476(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:01:28.596469 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:01:28.624900 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'ec2_ids' on Instance uuid 66b799ed-716a-4b29-8125-bac73213f2cf {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:28.654453 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:28.657018 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:28.657315 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a4f491fa90f902e207244e217e366a241e3d34c.part --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:28.678979 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:28.681561 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:28.711088 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:28.715159 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:28.741772 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:28.741772 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:28.741772 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:28.741772 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:28.741772 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:28.741772 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:28.764227 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a4f491fa90f902e207244e217e366a241e3d34c.part --force-share --output=json" returned: 0 in 0.106s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:28.765985 np0000001475 nova-compute[98471]: DEBUG nova.virt.images [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] 8f61781e-478a-47d9-ac27-c0c699d677d3 was qcow2, converting to raw {{(pid=98471) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 03:01:28.768439 np0000001475 nova-compute[98471]: DEBUG nova.privsep.utils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98471) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 03:01:28.770092 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1a4f491fa90f902e207244e217e366a241e3d34c.part /opt/stack/data/nova/instances/_base/1a4f491fa90f902e207244e217e366a241e3d34c.converted {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:29.002676 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1a4f491fa90f902e207244e217e366a241e3d34c.part /opt/stack/data/nova/instances/_base/1a4f491fa90f902e207244e217e366a241e3d34c.converted" returned: 0 in 0.233s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:29.023707 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a4f491fa90f902e207244e217e366a241e3d34c.converted --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:29.131677 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<66b799ed-716a-4b29-8125-bac73213f2cf> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:29.136578 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'keypairs' on Instance uuid 66b799ed-716a-4b29-8125-bac73213f2cf {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:29.145316 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a4f491fa90f902e207244e217e366a241e3d34c.converted --force-share --output=json" returned: 0 in 0.121s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:29.145895 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "1a4f491fa90f902e207244e217e366a241e3d34c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.774s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:29.146592 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:29.151815 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:29.152427 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "1a4f491fa90f902e207244e217e366a241e3d34c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:29.153066 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "1a4f491fa90f902e207244e217e366a241e3d34c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:29.153540 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:29.160350 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:29.163511 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a4f491fa90f902e207244e217e366a241e3d34c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:29.201132 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-823bbf88-5a18-416a-87dd-9fd82dd547c2 req-ad24ddc7-2ec8-43a6-9a74-4e7a62735d61 service nova] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Received event network-vif-deleted-3c806e74-b5d9-4602-8a6f-2547db207d6c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:29.224033 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:01:29.229847 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850889.229455, 02fd272a-5759-4995-9e5c-cc1f3e28072b => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:29.231279 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] VM Paused (Lifecycle Event)
May 27 03:01:29.254839 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Took 9.12 seconds to spawn the instance on the hypervisor.
May 27 03:01:29.260312 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:29.276635 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a4f491fa90f902e207244e217e366a241e3d34c --force-share --output=json" returned: 0 in 0.114s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:29.277917 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a4f491fa90f902e207244e217e366a241e3d34c,backing_fmt=raw /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.rescue {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:29.346781 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a4f491fa90f902e207244e217e366a241e3d34c,backing_fmt=raw /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.rescue" returned: 0 in 0.069s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:29.348016 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "1a4f491fa90f902e207244e217e366a241e3d34c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:29.348342 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lazy-loading 'migration_context' on Instance uuid f33f8709-32f7-4ce3-9967-c54609dcbb0c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:29.442169 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2e48e580-8bcb-4ad4-81fb-79b73aa35803 req-b0190a53-be6d-46a3-8591-454c536049a5 service nova] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Received event network-vif-plugged-9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:29.442414 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2e48e580-8bcb-4ad4-81fb-79b73aa35803 req-b0190a53-be6d-46a3-8591-454c536049a5 service nova] Acquiring lock "02fd272a-5759-4995-9e5c-cc1f3e28072b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:29.442603 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2e48e580-8bcb-4ad4-81fb-79b73aa35803 req-b0190a53-be6d-46a3-8591-454c536049a5 service nova] Lock "02fd272a-5759-4995-9e5c-cc1f3e28072b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:29.442959 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2e48e580-8bcb-4ad4-81fb-79b73aa35803 req-b0190a53-be6d-46a3-8591-454c536049a5 service nova] Lock "02fd272a-5759-4995-9e5c-cc1f3e28072b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:29.443252 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2e48e580-8bcb-4ad4-81fb-79b73aa35803 req-b0190a53-be6d-46a3-8591-454c536049a5 service nova] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] No waiting events found dispatching network-vif-plugged-9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:29.443515 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-2e48e580-8bcb-4ad4-81fb-79b73aa35803 req-b0190a53-be6d-46a3-8591-454c536049a5 service nova] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Received unexpected event network-vif-plugged-9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97 for instance with vm_state active and task_state None.
May 27 03:01:29.589763 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:01:29.599181 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:01:29.607041 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:01:29.607041 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:01:29.622384 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:01:29.622384 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:29.627396 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:29.634409 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:29.644540 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<66b799ed-716a-4b29-8125-bac73213f2cf> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:29.652942 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:29.658763 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:29.658763 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:29.658763 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:29.658763 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:29.658763 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:29.658763 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:29.658763 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:29.658763 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:29.658763 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:01:29.660152 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:29.660152 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:29.660152 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:29.660152 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:29.660152 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:29.660152 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:29.660152 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:29.660152 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:29.660152 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:01:29.661171 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:29.661171 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:29.661171 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:29.661171 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:29.661171 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:29.661171 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:29.661171 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:29.661171 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:29.661171 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:01:29.661761 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:29.661761 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:29.661761 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:29.661761 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:29.661761 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:29.661761 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:29.661761 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:29.661761 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:29.661761 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:01:29.718504 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:01:29.718504 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:01:29.729389 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586, portal: 192.168.50.100,3260]
May 27 03:01:29.729389 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586, portal: 192.168.50.100,3260] successful.
May 27 03:01:29.729389 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:29.740074 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:29.740074 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586, portal: 192.168.40.100,3260]
May 27 03:01:29.740074 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586, portal: 192.168.40.100,3260] successful.
May 27 03:01:29.740074 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:29.744411 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850889.7432983, 02fd272a-5759-4995-9e5c-cc1f3e28072b => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:29.744411 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] VM Resumed (Lifecycle Event)
May 27 03:01:29.749793 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:29.761042 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:29.784951 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Took 15.92 seconds to build instance.
May 27 03:01:29.789412 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:29.789412 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:29.789412 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:29.789412 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:29.789412 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:29.789412 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:29.789412 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:29.789412 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:29.789412 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:29.789412 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:29.789412 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:01:29.790567 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:29.790567 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:29.790567 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:29.790567 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:29.790567 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:29.790567 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:29.790567 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:29.790567 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:29.790567 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:29.790567 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:29.790567 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:01:29.790926 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:29.790926 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:29.790926 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:29.790926 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:29.790926 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:29.790926 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:29.790926 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:29.790926 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:29.790926 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:29.790926 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:29.790926 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:01:29.792341 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:29.792341 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:29.792341 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:29.792341 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:29.792341 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:29.792341 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:29.792341 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:29.792341 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:29.792341 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:29.792341 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:29.792341 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:01:29.792800 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.245s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:01:29.793074 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.245s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:01:29.793352 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:01:29.793640 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:01:29.796162 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] HCTL ('15', '-', '-', 0) found on session 49 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:01:29.796162 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:01:29.797588 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] HCTL ('16', '-', '-', 0) found on session 50 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:01:29.798204 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:01:29.830839 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching for a device in session 49 and hctl ['15', '*', '*', 0] yield: sdk {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:01:29.830839 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:01:29.831717 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching for a device in session 50 and hctl ['16', '*', '*', 0] yield: sdj {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:01:29.833534 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:01:29.853773 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Object Instance<f33f8709-32f7-4ce3-9967-c54609dcbb0c> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:29.855040 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:01:29.857719 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Start _get_guest_xml network_info=[{"id": "d113df60-11d0-4f48-a42a-9541589d6a45", "address": "fa:16:3e:af:c0:52", "network": {"id": "a5ee8bff-dbe9-420a-bc58-64e9082e7d84", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "vif_mac": "fa:16:3e:af:c0:52"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a7ebe6073564995b0dd1bb85437f4d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd113df60-11", "ovs_interfaceid": "d113df60-11d0-4f48-a42a-9541589d6a45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8f61781e-478a-47d9-ac27-c0c699d677d3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7dd67023-0129-4acb-99a4-6d602f2837dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, 'status': 'reserved', 'instance': 'f33f8709-32f7-4ce3-9967-c54609dcbb0c', 'attached_at': '', 'detached_at': '', 'volume_id': '7dd67023-0129-4acb-99a4-6d602f2837dc', 'serial': '7dd67023-0129-4acb-99a4-6d602f2837dc'}, 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '8662217d-d489-40e6-a7fc-ad399be06759', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:01:29.857946 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lazy-loading 'resources' on Instance uuid f33f8709-32f7-4ce3-9967-c54609dcbb0c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:29.890814 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Creating config drive at /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.config.rescue
May 27 03:01:29.897335 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzx9idky5 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:29.996600 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzx9idky5" returned: 0 in 0.099s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:30.222940 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:01:30.250433 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:30.256063 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:30.294056 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3389857c-d9d1-4e25-bb6e-4bc09139a16c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "02fd272a-5759-4995-9e5c-cc1f3e28072b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.470s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:30.361449 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Object Instance<f33f8709-32f7-4ce3-9967-c54609dcbb0c> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:30.367313 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:01:30.367313 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-2030533079', uuid='f33f8709-32f7-4ce3-9967-c54609dcbb0c'), owner=OwnerMeta(userid='d9da156cb05846c88c7da2a17f564ecd', username='tempest-ServerStableDeviceRescueTest-923030128-project-member', projectid='2a7ebe6073564995b0dd1bb85437f4d7', projectname='tempest-ServerStableDeviceRescueTest-923030128'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d113df60-11d0-4f48-a42a-9541589d6a45", "address": "fa:16:3e:af:c0:52", "network": {"id": "a5ee8bff-dbe9-420a-bc58-64e9082e7d84", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "vif_mac": "fa:16:3e:af:c0:52"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a7ebe6073564995b0dd1bb85437f4d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd113df60-11", "ovs_interfaceid": "d113df60-11d0-4f48-a42a-9541589d6a45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850890.3664312) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:01:30.371595 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:01:30.371595 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:01:30.376777 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:01:30.376777 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:01:30.376777 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:01:30.376777 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:01:30.376777 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:01:30.376777 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:01:30.376777 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:01:30.376777 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:01:30.376777 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:01:30.377621 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:01:30.377938 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:01:30.378381 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:01:30.378673 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:01:30.379016 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:01:30.379385 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lazy-loading 'vcpu_model' on Instance uuid f33f8709-32f7-4ce3-9967-c54609dcbb0c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:30.547630 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:01:30.641817 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:30.684839 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:30.753998 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.073s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:30.774489 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:30.842305 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Deleted allocations for instance 3df7da3b-46a1-47e3-99b6-3027e323b3fc
May 27 03:01:30.867051 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:30.876238 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:30.883470 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Object Instance<f33f8709-32f7-4ce3-9967-c54609dcbb0c> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:30.897569 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.config --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:30.923294 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fcb1081d-442b-4ef8-83c2-cdfe9c3d1704 req-b09c137d-9a29-44f2-a655-53904d9fccb6 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received event network-vif-plugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:30.924140 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fcb1081d-442b-4ef8-83c2-cdfe9c3d1704 req-b09c137d-9a29-44f2-a655-53904d9fccb6 service nova] Acquiring lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:30.926345 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fcb1081d-442b-4ef8-83c2-cdfe9c3d1704 req-b09c137d-9a29-44f2-a655-53904d9fccb6 service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:30.927063 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fcb1081d-442b-4ef8-83c2-cdfe9c3d1704 req-b09c137d-9a29-44f2-a655-53904d9fccb6 service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:30.928035 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fcb1081d-442b-4ef8-83c2-cdfe9c3d1704 req-b09c137d-9a29-44f2-a655-53904d9fccb6 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] No waiting events found dispatching network-vif-plugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:30.928162 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-fcb1081d-442b-4ef8-83c2-cdfe9c3d1704 req-b09c137d-9a29-44f2-a655-53904d9fccb6 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received unexpected event network-vif-plugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 for instance with vm_state active and task_state rescuing.
May 27 03:01:30.967413 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:30.981312 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:31.006153 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.config --force-share --output=json" returned: 0 in 0.109s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:31.006546 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "/opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:31.006911 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "/opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:31.007669 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "/opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:31.008794 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:01:31.008794 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7dd67023-0129-4acb-99a4-6d602f2837dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:01:31.008794 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:01:31.277210 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:31.575308 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Found WWN 330000000a6e22f98 for multipath device dm-6 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:01:31.575770 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:01:31.578925 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.568s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:01:31.578925 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7dd67023-0129-4acb-99a4-6d602f2837dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:01:31.580008 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] <== connect_volume: return (3051ms) {'type': 'block', 'scsi_wwn': '330000000a6e22f98', 'path': '/dev/dm-6', 'multipath_id': '330000000a6e22f98'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:01:31.580284 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a6e22f98', 'path': '/dev/dm-6', 'multipath_id': '330000000a6e22f98'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:01:31.589649 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'flavor' on Instance uuid 71af628e-b06d-446d-8c2e-dcfbb232df33 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:31.596158 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:01:31.597350 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:01:31.597761 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:01:31.607271 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:01:31.607787 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:01:31.608098 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.startup = automatic
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.scan = manual
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:01:31.629637 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:01:31.629637 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.startup = automatic
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.scan = manual
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:01:31.638192 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:01:31.638192 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:31.649942 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:31.660950 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:31.680467 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:31.680467 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.081s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:01:31.680467 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:01:31.682526 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] HCTL ('13', '0', '0', 0) found on session 47 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:01:31.682982 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:01:31.706023 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:31.706023 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:31.706023 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:31.706023 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:31.706023 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:31.706023 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:31.706023 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:31.706023 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:31.706023 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:31.706023 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:31.706023 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:01:31.711156 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Searching for a device in session 47 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:01:31.712702 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:31.712702 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:31.712702 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:31.712702 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:31.712702 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:31.712702 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:31.712702 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:31.712702 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:31.712702 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:31.712702 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:31.712702 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:01:31.713165 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.105s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:01:31.713165 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:01:31.713861 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] HCTL ('14', '0', '0', 0) found on session 48 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:01:31.715383 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7dd67023-0129-4acb-99a4-6d602f2837dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:01:31.715383 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:01:31.730601 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Searching for a device in session 48 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:01:31.730833 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7dd67023-0129-4acb-99a4-6d602f2837dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:01:31.841366 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:31.857848 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5c0b1fdb-f120-4a50-b6ec-5ff3c6b72029 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "3df7da3b-46a1-47e3-99b6-3027e323b3fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.422s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:31.859476 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Removed pending STOPPED event for 66b799ed-716a-4b29-8125-bac73213f2cf due to new event <LifecycleEvent: 1779850891.8590848, 66b799ed-716a-4b29-8125-bac73213f2cf => Resumed> {{(pid=98471) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 03:01:31.859778 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850891.8590848, 66b799ed-716a-4b29-8125-bac73213f2cf => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:31.859916 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] VM Resumed (Lifecycle Event)
May 27 03:01:31.866372 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-f89f6349-138f-4eaf-8b79-22038e9d2c1c tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:32.100456 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Attempting to attach volume 89f6f402-75a6-40a9-b2f2-8ef5f58a4586 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:01:32.101789 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:01:32.101789 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:01:32.101789 np0000001475 nova-compute[98471]:   <alias name="ua-89f6f402-75a6-40a9-b2f2-8ef5f58a4586"/>
May 27 03:01:32.101789 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-6"/>
May 27 03:01:32.101789 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:01:32.101789 np0000001475 nova-compute[98471]:   <serial>89f6f402-75a6-40a9-b2f2-8ef5f58a4586</serial>
May 27 03:01:32.101789 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:01:32.101789 np0000001475 nova-compute[98471]: </disk>
May 27 03:01:32.101789 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:01:32.152532 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0004510389999268227 future=<Future at 0x7557046284a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:32.152706 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:32.152838 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=7.679802820000077 future=<Future at 0x7557047a9b80 state=cancelled>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:32.154705 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Emitting event <LifecycleEvent: 1779850877.1519468, 7ebb66f2-020a-4b56-9fc1-f7162e96a609 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:32.155009 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] VM Stopped (Lifecycle Event)
May 27 03:01:32.156294 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=7.67638450100003 future=<Future at 0x7557047a9b80 state=cancelled>) was cancelled while queued, skipping {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:32.161133 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:32.161332 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=8.177373340000031 future=<Future at 0x75570473aae0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:32.161451 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=8.177235435000057 future=<Future at 0x75570473aae0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:32.349544 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] instance snapshotting
May 27 03:01:32.373987 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:32.379850 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:32.529182 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Beginning live snapshot process
May 27 03:01:32.609963 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:01:32.664541 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-80d5df31-cf54-48da-90a4-518938c629ea tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7ebb66f2-020a-4b56-9fc1-f7162e96a609] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:32.881672 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850892.8813941, 66b799ed-716a-4b29-8125-bac73213f2cf => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:32.881864 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] VM Started (Lifecycle Event)
May 27 03:01:33.066133 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4bcfcb5d-2231-46ad-aa94-4eb2e8c4b967 req-1502ca92-7337-4852-a305-32e23e3ea522 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received event network-vif-plugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:33.066346 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4bcfcb5d-2231-46ad-aa94-4eb2e8c4b967 req-1502ca92-7337-4852-a305-32e23e3ea522 service nova] Acquiring lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:33.066528 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4bcfcb5d-2231-46ad-aa94-4eb2e8c4b967 req-1502ca92-7337-4852-a305-32e23e3ea522 service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:33.066651 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4bcfcb5d-2231-46ad-aa94-4eb2e8c4b967 req-1502ca92-7337-4852-a305-32e23e3ea522 service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:33.066819 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4bcfcb5d-2231-46ad-aa94-4eb2e8c4b967 req-1502ca92-7337-4852-a305-32e23e3ea522 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] No waiting events found dispatching network-vif-plugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:33.066940 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-4bcfcb5d-2231-46ad-aa94-4eb2e8c4b967 req-1502ca92-7337-4852-a305-32e23e3ea522 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received unexpected event network-vif-plugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 for instance with vm_state rescued and task_state None.
May 27 03:01:33.385173 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:33.392364 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:33.581146 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquiring lock "156e620a-485d-4135-8c52-aab777dd8480" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:33.581378 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "156e620a-485d-4135-8c52-aab777dd8480" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:33.630980 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Found WWN 330000000a7ffbc1c for multipath device dm-5 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:01:33.631228 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.055s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:01:33.631382 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] <== connect_volume: return (2622ms) {'type': 'block', 'scsi_wwn': '330000000a7ffbc1c', 'path': '/dev/dm-5', 'multipath_id': '330000000a7ffbc1c'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:01:33.631513 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a7ffbc1c', 'path': '/dev/dm-5', 'multipath_id': '330000000a7ffbc1c'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:01:33.810586 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:33.810586 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:33.810586 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:33.811137 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No VIF found with MAC fa:16:3e:23:4b:54, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:01:33.817403 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:34.054560 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk --force-share --output=json -f qcow2 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:34.088954 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:01:34.140756 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:00:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2030533079',display_name='tempest-ServerStableDeviceRescueTest-server-2030533079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverstabledevicerescuetest-server-2030533079',id=15,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa8+CqVdw8nKJ5lReXEmt096EbGDMIc3VhRlcn+2FQfGHdmNBgrivb5lUlAyS2qoKWf32kYpLN8CS14ZT4JmO1zy/Ua7yFw8818K16/tqTyTOYQu+pF7MZ52tXxUY4mhQ==',key_name='tempest-keypair-2125337620',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:00:20Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a7ebe6073564995b0dd1bb85437f4d7',ramdisk_id='',reservation_id='r-qxkxc9ng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-923030128',owner_user_name='tempest-ServerStableDeviceRescueTest-923030128-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9da156cb05846c88c7da2a17f564ecd',uuid=f33f8709-32f7-4ce3-9967-c54609dcbb0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d113df60-11d0-4f48-a42a-9541589d6a45", "address": "fa:16:3e:af:c0:52", "network": {"id": "a5ee8bff-dbe9-420a-bc58-64e9082e7d84", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "vif_mac": "fa:16:3e:af:c0:52"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a7ebe6073564995b0dd1bb85437f4d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd113df60-11", "ovs_interfaceid": "d113df60-11d0-4f48-a42a-9541589d6a45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:01:34.143860 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Converting VIF {"id": "d113df60-11d0-4f48-a42a-9541589d6a45", "address": "fa:16:3e:af:c0:52", "network": {"id": "a5ee8bff-dbe9-420a-bc58-64e9082e7d84", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "vif_mac": "fa:16:3e:af:c0:52"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a7ebe6073564995b0dd1bb85437f4d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd113df60-11", "ovs_interfaceid": "d113df60-11d0-4f48-a42a-9541589d6a45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:34.143860 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:c0:52,bridge_name='br-int',has_traffic_filtering=True,id=d113df60-11d0-4f48-a42a-9541589d6a45,network=Network(a5ee8bff-dbe9-420a-bc58-64e9082e7d84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd113df60-11') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:34.143860 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lazy-loading 'pci_devices' on Instance uuid f33f8709-32f7-4ce3-9967-c54609dcbb0c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:34.153814 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk --force-share --output=json -f qcow2" returned: 0 in 0.096s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:34.153814 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk --force-share --output=json -f qcow2 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:34.256084 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk --force-share --output=json -f qcow2" returned: 0 in 0.103s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:34.256084 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:34.262709 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:34.263179 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:34.379102 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.116s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:34.379629 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv6hbvh8_/148566be94234fafb8d4b2bd3899ee67.delta 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:34.443763 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv6hbvh8_/148566be94234fafb8d4b2bd3899ee67.delta 1073741824" returned: 0 in 0.064s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:34.444567 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Quiescing instance not available: QEMU guest agent is not enabled.
May 27 03:01:34.648522 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Object Instance<f33f8709-32f7-4ce3-9967-c54609dcbb0c> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:34.650239 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] End _get_guest_xml xml=<domain type="qemu">
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:   <uuid>f33f8709-32f7-4ce3-9967-c54609dcbb0c</uuid>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:   <name>instance-0000000f</name>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2030533079</nova:name>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:01:30</nova:creationTime>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:         <nova:user uuid="d9da156cb05846c88c7da2a17f564ecd">tempest-ServerStableDeviceRescueTest-923030128-project-member</nova:user>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:         <nova:project uuid="2a7ebe6073564995b0dd1bb85437f4d7">tempest-ServerStableDeviceRescueTest-923030128</nova:project>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:         <nova:port uuid="d113df60-11d0-4f48-a42a-9541589d6a45">
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     <system>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <entry name="serial">f33f8709-32f7-4ce3-9967-c54609dcbb0c</entry>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <entry name="uuid">f33f8709-32f7-4ce3-9967-c54609dcbb0c</entry>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     </system>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:   <os>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:   </os>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:   <features>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:   </features>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:   <devices>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.config"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <alias name="ua-7dd67023-0129-4acb-99a4-6d602f2837dc"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-5"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <target dev="vdb" bus="virtio"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <serial>7dd67023-0129-4acb-99a4-6d602f2837dc</serial>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.rescue"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <target dev="vdc" bus="virtio"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <boot order="1"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:af:c0:52"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <target dev="tapd113df60-11"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     </interface>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/console.log" append="off"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     </serial>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     <video>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     </video>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     </rng>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:   </devices>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]: </domain>
May 27 03:01:34.650239 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:01:34.664366 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Instance destroyed successfully.
May 27 03:01:34.675894 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:34.676218 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:34.683264 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:01:34.683510 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Claim successful on node np0000001475
May 27 03:01:34.758793 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98471) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 27 03:01:34.761578 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Skipping quiescing instance: QEMU guest agent is not enabled.
May 27 03:01:34.806630 np0000001475 nova-compute[98471]: DEBUG nova.privsep.utils [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98471) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 03:01:34.806985 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv6hbvh8_/148566be94234fafb8d4b2bd3899ee67.delta /opt/stack/data/nova/instances/snapshots/tmpv6hbvh8_/148566be94234fafb8d4b2bd3899ee67 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:34.948927 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv6hbvh8_/148566be94234fafb8d4b2bd3899ee67.delta /opt/stack/data/nova/instances/snapshots/tmpv6hbvh8_/148566be94234fafb8d4b2bd3899ee67" returned: 0 in 0.139s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:34.952019 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Snapshot extracted, beginning image upload
May 27 03:01:35.134387 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:35.134876 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:35.416828 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-301fa210-e299-4161-a631-181101db122b tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.732s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:35.638899 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'flavor' on Instance uuid 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:35.661170 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Rescuing
May 27 03:01:35.661318 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "refresh_cache-4e583b08-e323-4681-9e95-01767f510590" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:35.661468 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquired lock "refresh_cache-4e583b08-e323-4681-9e95-01767f510590" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:35.661821 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:01:35.881526 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquiring lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:35.885662 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:35.980548 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:35.985525 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:36.165294 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:36.197908 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:36.198078 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:36.198186 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:36.198269 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:36.198368 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] No VIF found with MAC fa:16:3e:af:c0:52, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:01:36.198965 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Using config drive
May 27 03:01:36.388661 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:01:36.515102 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:01:36.515341 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:01:36.593493 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:36.644906 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:36.661560 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:36.703324 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lazy-loading 'ec2_ids' on Instance uuid f33f8709-32f7-4ce3-9967-c54609dcbb0c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:36.816118 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Updating instance_info_cache with network_info: [{"id": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "address": "fa:16:3e:01:3d:37", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e0fddb-8c", "ovs_interfaceid": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:36.970236 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:37.022527 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:01:37.207485 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Object Instance<f33f8709-32f7-4ce3-9967-c54609dcbb0c> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:37.207791 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lazy-loading 'keypairs' on Instance uuid f33f8709-32f7-4ce3-9967-c54609dcbb0c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:37.318581 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Releasing lock "refresh_cache-4e583b08-e323-4681-9e95-01767f510590" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:37.531199 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.855s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:37.531981 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.561s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:37.532473 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:01:37.542319 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:01:37.546005 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Claim successful on node np0000001475
May 27 03:01:37.712177 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Object Instance<f33f8709-32f7-4ce3-9967-c54609dcbb0c> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:37.717953 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:37.762675 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:37.762895 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:37.766400 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Attaching volume 89f6f402-75a6-40a9-b2f2-8ef5f58a4586 to /dev/vdb
May 27 03:01:37.830401 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:01:37.844617 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:01:37.870933 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:37.917275 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:01:37.917559 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:01:37.919535 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Snapshot image upload complete
May 27 03:01:37.919815 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-11a4d53e-fa28-445f-8193-c2caec7e7aeb tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Took 5.56 seconds to snapshot the instance on the hypervisor.
May 27 03:01:37.935955 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:01:37.940011 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Creating config drive at /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.config.rescue
May 27 03:01:37.940511 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b', 'fe80::fc16:3eff:fe1f:5a7', 'fe80::a095:90ff:feef:1465', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::fc16:3eff:fefc:b5d4', 'fe80::fc16:3eff:fe7e:904a', 'fe80::fc16:3eff:fe01:3d37', 'fe80::c805:4ff:fe3b:2374', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:fe76:5c4', 'fe80::fc16:3eff:feb2:aa32'] 
May 27 03:01:37.940648 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:01:37.940803 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:01:37.941868 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:01:37.942151 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Updating existing volume attachment record: 37fd0d20-bfc5-48c6-9d65-6de9821e8f5b {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:01:37.948984 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwhqit90z {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:38.005277 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwhqit90z" returned: 0 in 0.056s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:38.045473 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:01:38.045473 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:01:38.045943 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:38.047115 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:38.192966 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e72474ce31364e6e93613cde1d50fcf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb860bf509bc4a51ae78e4d7bea9d930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:01:38.567785 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:01:38.568963 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:01:38.568963 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:01:38.568963 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:01:38.571236 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:01:38.572935 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:01:38.577030 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:38.623559 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:38.623559 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:01:38.623559 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:01:38.623559 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:01:38.623559 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:01:38.623559 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:01:38.623559 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.startup = automatic
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.scan = manual
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:01:38.647662 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:01:38.647662 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.startup = automatic
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.scan = manual
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:01:38.657611 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:01:38.657611 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:38.665860 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:38.665860 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:38.668192 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:38.700647 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:38.704279 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:38.756198 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:38.756198 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:38.756198 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:38.756198 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:38.756198 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:38.756198 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:38.756198 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:38.756198 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:38.756198 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:38.756198 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:38.756198 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:01:38.759382 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:38.759382 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:38.759382 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:38.759382 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:38.759382 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:38.759382 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:38.759382 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:38.759382 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:38.759382 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:38.759382 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:38.759382 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:01:38.760845 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.141s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:01:38.760845 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:01:38.761096 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:38.761096 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:38.761096 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:38.761096 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:38.761096 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:38.761096 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:38.761096 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:38.761096 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:38.761096 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:38.761096 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:38.761096 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:01:38.761096 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:38.761096 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:38.761096 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:38.761096 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:38.761096 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:38.761096 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:38.761096 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:38.761096 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:38.761096 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:38.761096 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:38.761096 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:01:38.762229 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.147s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:01:38.762229 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:01:38.768257 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] HCTL ('16', '0', '0', 0) found on session 50 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:01:38.768415 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:01:38.769888 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] HCTL ('15', '0', '0', 0) found on session 49 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:01:38.769888 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:01:38.796132 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching for a device in session 50 and hctl ('16', '0', '0', 0) yield: sdj {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:01:38.796354 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:01:38.800103 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching for a device in session 49 and hctl ('15', '0', '0', 0) yield: sdk {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:01:38.800103 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:01:38.838980 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:39.011427 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:39.014639 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:39.056508 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Successfully created port: 06c763de-8d9e-470f-9c09-6494e1a6ae8a {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:01:39.062650 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:39.091260 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:01:39.188476 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:39.197050 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:39.199897 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:39.229177 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:39.245980 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:39.340668 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999640123000063 future=<Future at 0x755724191640 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:39.344980 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 4e583b08-e323-4681-9e95-01767f510590] Instance destroyed successfully.
May 27 03:01:39.345448 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'numa_topology' on Instance uuid 4e583b08-e323-4681-9e95-01767f510590 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:39.570850 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:39.577848 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:39.629909 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:01:39.760701 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:01:39.761083 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:01:39.856355 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Attempting rescue
May 27 03:01:39.856977 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98471) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 27 03:01:39.868143 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Instance directory exists: not creating {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 03:01:39.868299 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Creating image(s)
May 27 03:01:39.868896 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:39.871988 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "/opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:39.871988 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "/opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:39.871988 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4e583b08-e323-4681-9e95-01767f510590 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:39.937589 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7b62408a-3185-4c4f-af95-655b27e1946d req-b19e2214-36fe-411b-9436-47b23039acb3 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received event network-vif-unplugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:39.937589 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7b62408a-3185-4c4f-af95-655b27e1946d req-b19e2214-36fe-411b-9436-47b23039acb3 service nova] Acquiring lock "4e583b08-e323-4681-9e95-01767f510590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:39.937589 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7b62408a-3185-4c4f-af95-655b27e1946d req-b19e2214-36fe-411b-9436-47b23039acb3 service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:39.937589 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7b62408a-3185-4c4f-af95-655b27e1946d req-b19e2214-36fe-411b-9436-47b23039acb3 service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:39.937589 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7b62408a-3185-4c4f-af95-655b27e1946d req-b19e2214-36fe-411b-9436-47b23039acb3 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] No waiting events found dispatching network-vif-unplugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:39.937589 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-7b62408a-3185-4c4f-af95-655b27e1946d req-b19e2214-36fe-411b-9436-47b23039acb3 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received unexpected event network-vif-unplugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c for instance with vm_state active and task_state rescuing.
May 27 03:01:39.975837 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Successfully updated port: 06c763de-8d9e-470f-9c09-6494e1a6ae8a {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:01:40.034241 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Removed pending STOPPED event for f33f8709-32f7-4ce3-9967-c54609dcbb0c due to new event <LifecycleEvent: 1779850900.0328357, f33f8709-32f7-4ce3-9967-c54609dcbb0c => Resumed> {{(pid=98471) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 03:01:40.034241 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850900.0328357, f33f8709-32f7-4ce3-9967-c54609dcbb0c => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:40.034241 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] VM Resumed (Lifecycle Event)
May 27 03:01:40.038918 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3cc18f34-c8ed-4a7b-8972-c9122966573f tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:40.050220 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-bddb254a-04f2-4267-b0e2-0fd0001b39d1 req-42cb0843-913d-4393-9f49-efc29ae58b10 service nova] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Received event network-changed-06c763de-8d9e-470f-9c09-6494e1a6ae8a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:40.050657 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-bddb254a-04f2-4267-b0e2-0fd0001b39d1 req-42cb0843-913d-4393-9f49-efc29ae58b10 service nova] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Refreshing instance network info cache due to event network-changed-06c763de-8d9e-470f-9c09-6494e1a6ae8a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:01:40.050657 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bddb254a-04f2-4267-b0e2-0fd0001b39d1 req-42cb0843-913d-4393-9f49-efc29ae58b10 service nova] Acquiring lock "refresh_cache-156e620a-485d-4135-8c52-aab777dd8480" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:40.051482 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bddb254a-04f2-4267-b0e2-0fd0001b39d1 req-42cb0843-913d-4393-9f49-efc29ae58b10 service nova] Acquired lock "refresh_cache-156e620a-485d-4135-8c52-aab777dd8480" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:40.051673 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-bddb254a-04f2-4267-b0e2-0fd0001b39d1 req-42cb0843-913d-4393-9f49-efc29ae58b10 service nova] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Refreshing network info cache for port 06c763de-8d9e-470f-9c09-6494e1a6ae8a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:01:40.107763 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:01:40.110830 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:01:40.112268 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Creating image(s)
May 27 03:01:40.112790 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquiring lock "/opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:40.113007 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "/opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:40.117924 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "/opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:40.118186 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:40.123250 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:40.125080 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:40.249627 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.124s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:40.249920 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:40.250388 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:40.251710 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:40.257501 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:40.258579 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:40.279565 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:01:40.340176 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0009446079998269852 future=<Future at 0x75570473aae0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:40.342036 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:40.342167 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=0.8436922680000407 future=<Future at 0x75570474e270 state=cancelled>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:40.342282 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=0.8435774859999583 future=<Future at 0x75570474e270 state=cancelled>) was cancelled while queued, skipping {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:40.342338 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:40.347903 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=13.992710979000094 future=<Future at 0x755724191640 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:40.347903 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=13.992552666000165 future=<Future at 0x755724191640 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:40.350155 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] Emitting event <LifecycleEvent: 1779850885.3386295, 3df7da3b-46a1-47e3-99b6-3027e323b3fc => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:40.350588 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] VM Stopped (Lifecycle Event)
May 27 03:01:40.370291 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.112s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:40.370632 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:40.388515 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<4e583b08-e323-4681-9e95-01767f510590> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:40.394003 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:40.402975 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:40.407681 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:40.444498 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480/disk 1073741824" returned: 0 in 0.074s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:40.444859 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:40.445171 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:40.469622 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.060s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:40.469622 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:40.482078 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquiring lock "refresh_cache-156e620a-485d-4135-8c52-aab777dd8480" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:40.485377 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "ba8ef70d-8e27-48c8-82e3-6501f6130456" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:40.486011 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:40.486673 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:40.488841 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:40.537652 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:40.543854 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:40.557292 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-bddb254a-04f2-4267-b0e2-0fd0001b39d1 req-42cb0843-913d-4393-9f49-efc29ae58b10 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:40.570189 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.125s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:40.572830 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:01:40.572830 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:40.619328 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.131s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:40.620786 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.rescue {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:40.680561 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Found WWN 330000000a6e22f98 for multipath device dm-6 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:01:40.681832 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.110s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:01:40.681832 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] <== connect_volume: return (2112ms) {'type': 'block', 'scsi_wwn': '330000000a6e22f98', 'path': '/dev/dm-6', 'multipath_id': '330000000a6e22f98'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:01:40.682103 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a6e22f98', 'path': '/dev/dm-6', 'multipath_id': '330000000a6e22f98'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:01:40.692449 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'flavor' on Instance uuid 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:40.698607 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:40.699501 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Cannot resize image /opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:01:40.700241 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:01:40.700568 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Ensure instance console log exists: /opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:01:40.701259 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:40.701534 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:40.701788 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:40.705439 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.rescue" returned: 0 in 0.085s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:40.705913 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:40.706557 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'migration_context' on Instance uuid 4e583b08-e323-4681-9e95-01767f510590 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:40.731335 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-bddb254a-04f2-4267-b0e2-0fd0001b39d1 req-42cb0843-913d-4393-9f49-efc29ae58b10 service nova] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:01:40.800907 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.269s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:40.801400 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:01:40.857610 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] [instance: 3df7da3b-46a1-47e3-99b6-3027e323b3fc] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:40.902731 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-bddb254a-04f2-4267-b0e2-0fd0001b39d1 req-42cb0843-913d-4393-9f49-efc29ae58b10 service nova] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:40.982039 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:40.988238 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:41.011829 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:01:41.050771 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850901.0473962, f33f8709-32f7-4ce3-9967-c54609dcbb0c => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:41.050771 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] VM Started (Lifecycle Event)
May 27 03:01:41.197534 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Attempting to attach volume 89f6f402-75a6-40a9-b2f2-8ef5f58a4586 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:01:41.198548 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:01:41.198548 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:01:41.198548 np0000001475 nova-compute[98471]:   <alias name="ua-89f6f402-75a6-40a9-b2f2-8ef5f58a4586"/>
May 27 03:01:41.198548 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-6"/>
May 27 03:01:41.198548 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:01:41.198548 np0000001475 nova-compute[98471]:   <serial>89f6f402-75a6-40a9-b2f2-8ef5f58a4586</serial>
May 27 03:01:41.198548 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:01:41.198548 np0000001475 nova-compute[98471]: </disk>
May 27 03:01:41.198548 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:01:41.209194 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<4e583b08-e323-4681-9e95-01767f510590> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:41.209194 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:01:41.209849 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Start _get_guest_xml network_info=[{"id": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "address": "fa:16:3e:01:3d:37", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "vif_mac": "fa:16:3e:01:3d:37"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e0fddb-8c", "ovs_interfaceid": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:01:41.209849 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'resources' on Instance uuid 4e583b08-e323-4681-9e95-01767f510590 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:41.310771 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:01:41.310771 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:01:41.310771 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:41.310771 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:41.405422 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bddb254a-04f2-4267-b0e2-0fd0001b39d1 req-42cb0843-913d-4393-9f49-efc29ae58b10 service nova] Releasing lock "refresh_cache-156e620a-485d-4135-8c52-aab777dd8480" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:41.405916 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquired lock "refresh_cache-156e620a-485d-4135-8c52-aab777dd8480" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:41.406101 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:01:41.437587 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c7a2b8282d64da1b36834b8f66c35da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6178da77914825aa17d655664bb17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:01:41.554522 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:41.561970 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:41.600062 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:41.600275 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:41.603226 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:01:41.603439 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Claim successful on node np0000001475
May 27 03:01:41.716626 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<4e583b08-e323-4681-9e95-01767f510590> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:41.724163 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:01:41.728157 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1569279092', uuid='4e583b08-e323-4681-9e95-01767f510590'), owner=OwnerMeta(userid='b438796ed5e44f629535db767fe2b756', username='tempest-ServerRescueNegativeTestJSON-62027498-project-member', projectid='39cbbdb9012c4992865d4f89678ef9ac', projectname='tempest-ServerRescueNegativeTestJSON-62027498'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "address": "fa:16:3e:01:3d:37", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "vif_mac": "fa:16:3e:01:3d:37"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e0fddb-8c", "ovs_interfaceid": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850901.7275028) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:01:41.731475 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:01:41.732440 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:01:41.735840 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:01:41.736921 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:01:41.739756 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:01:41.739756 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:01:41.739756 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:01:41.739756 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:01:41.739756 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:01:41.739756 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:01:41.739756 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:01:41.739756 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:01:41.740649 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:01:41.740833 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:01:41.741097 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:01:41.741262 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:01:41.741515 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4e583b08-e323-4681-9e95-01767f510590 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:41.816263 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:01:42.019040 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:01:42.043152 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9cda3028-1521-428c-91b2-20f1efde2ecc req-a5e8e488-31a4-40fc-a898-3d3c93668873 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received event network-vif-unplugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:42.043568 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9cda3028-1521-428c-91b2-20f1efde2ecc req-a5e8e488-31a4-40fc-a898-3d3c93668873 service nova] Acquiring lock "4e583b08-e323-4681-9e95-01767f510590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:42.046457 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9cda3028-1521-428c-91b2-20f1efde2ecc req-a5e8e488-31a4-40fc-a898-3d3c93668873 service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:42.046552 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9cda3028-1521-428c-91b2-20f1efde2ecc req-a5e8e488-31a4-40fc-a898-3d3c93668873 service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:42.046724 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9cda3028-1521-428c-91b2-20f1efde2ecc req-a5e8e488-31a4-40fc-a898-3d3c93668873 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] No waiting events found dispatching network-vif-unplugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:42.047426 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-9cda3028-1521-428c-91b2-20f1efde2ecc req-a5e8e488-31a4-40fc-a898-3d3c93668873 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received unexpected event network-vif-unplugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c for instance with vm_state active and task_state rescuing.
May 27 03:01:42.063180 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Successfully created port: 1dc18a8f-bec1-42d5-96ef-84706d61147c {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:01:42.200022 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-99f7aa3a-fa66-4038-8f1b-44b222f100db tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Unrescuing
May 27 03:01:42.201130 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99f7aa3a-fa66-4038-8f1b-44b222f100db tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:42.201130 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99f7aa3a-fa66-4038-8f1b-44b222f100db tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquired lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:42.201130 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-99f7aa3a-fa66-4038-8f1b-44b222f100db tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:01:42.243693 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<4e583b08-e323-4681-9e95-01767f510590> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:42.264186 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1569279092',display_name='tempest-ServerRescueNegativeTestJSON-server-1569279092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverrescuenegativetestjson-server-1569279092',id=20,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:01:11Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39cbbdb9012c4992865d4f89678ef9ac',ramdisk_id='',reservation_id='r-noabdp10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-62027498',owner_user_name='tempest-ServerRescueNegativeTestJSON-62027498-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:12Z,user_data=None,user_id='b438796ed5e44f629535db767fe2b756',uuid=4e583b08-e323-4681-9e95-01767f510590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "address": "fa:16:3e:01:3d:37", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "vif_mac": "fa:16:3e:01:3d:37"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e0fddb-8c", "ovs_interfaceid": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:01:42.264445 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converting VIF {"id": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "address": "fa:16:3e:01:3d:37", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "vif_mac": "fa:16:3e:01:3d:37"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e0fddb-8c", "ovs_interfaceid": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:42.265526 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=40e0fddb-8cd7-4dee-81b1-860e4ca7040c,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e0fddb-8c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:42.266499 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e583b08-e323-4681-9e95-01767f510590 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:42.317618 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:01:42.707900 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-99f7aa3a-fa66-4038-8f1b-44b222f100db tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:42.762692 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Successfully updated port: 1dc18a8f-bec1-42d5-96ef-84706d61147c {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:01:42.771774 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<4e583b08-e323-4681-9e95-01767f510590> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:42.771774 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] End _get_guest_xml xml=<domain type="qemu">
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:   <uuid>4e583b08-e323-4681-9e95-01767f510590</uuid>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:   <name>instance-00000014</name>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1569279092</nova:name>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:01:41</nova:creationTime>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:         <nova:user uuid="b438796ed5e44f629535db767fe2b756">tempest-ServerRescueNegativeTestJSON-62027498-project-member</nova:user>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:         <nova:project uuid="39cbbdb9012c4992865d4f89678ef9ac">tempest-ServerRescueNegativeTestJSON-62027498</nova:project>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:         <nova:port uuid="40e0fddb-8cd7-4dee-81b1-860e4ca7040c">
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     <system>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <entry name="serial">4e583b08-e323-4681-9e95-01767f510590</entry>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <entry name="uuid">4e583b08-e323-4681-9e95-01767f510590</entry>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     </system>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:   <os>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:   </os>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:   <features>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:   </features>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:   <devices>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.rescue"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <target dev="vdb" bus="virtio"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.config.rescue"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:01:3d:37"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <target dev="tap40e0fddb-8c"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     </interface>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/console.log" append="off"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     </serial>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     <video>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     </video>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     </rng>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:   </devices>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]: </domain>
May 27 03:01:42.771774 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:01:42.778576 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 4e583b08-e323-4681-9e95-01767f510590] Instance destroyed successfully.
May 27 03:01:42.815395 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3f39e0ca-b155-41dd-860a-e128ba2de57c req-85fffe8d-c0b2-4f0c-9250-324534325648 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received event network-changed-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:42.817758 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3f39e0ca-b155-41dd-860a-e128ba2de57c req-85fffe8d-c0b2-4f0c-9250-324534325648 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Refreshing instance network info cache due to event network-changed-d113df60-11d0-4f48-a42a-9541589d6a45. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:01:42.818132 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3f39e0ca-b155-41dd-860a-e128ba2de57c req-85fffe8d-c0b2-4f0c-9250-324534325648 service nova] Acquiring lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:42.873342 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ab8426e2-f14d-4109-a3b1-02f384e12c2f req-5b80a7f7-4b37-4c92-8dd0-0fc87123790d service nova] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Received event network-changed-1dc18a8f-bec1-42d5-96ef-84706d61147c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:42.873772 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ab8426e2-f14d-4109-a3b1-02f384e12c2f req-5b80a7f7-4b37-4c92-8dd0-0fc87123790d service nova] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Refreshing instance network info cache due to event network-changed-1dc18a8f-bec1-42d5-96ef-84706d61147c. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:01:42.874464 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ab8426e2-f14d-4109-a3b1-02f384e12c2f req-5b80a7f7-4b37-4c92-8dd0-0fc87123790d service nova] Acquiring lock "refresh_cache-ff7c9673-bf7d-426f-80a6-aa94a46ad33a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:42.876570 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ab8426e2-f14d-4109-a3b1-02f384e12c2f req-5b80a7f7-4b37-4c92-8dd0-0fc87123790d service nova] Acquired lock "refresh_cache-ff7c9673-bf7d-426f-80a6-aa94a46ad33a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:42.876570 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ab8426e2-f14d-4109-a3b1-02f384e12c2f req-5b80a7f7-4b37-4c92-8dd0-0fc87123790d service nova] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Refreshing network info cache for port 1dc18a8f-bec1-42d5-96ef-84706d61147c {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:01:42.887435 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:42.887918 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:42.888468 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:42.888685 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No VIF found with MAC fa:16:3e:d1:ea:b1, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:01:42.900387 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:43.193946 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Updating instance_info_cache with network_info: [{"id": "06c763de-8d9e-470f-9c09-6494e1a6ae8a", "address": "fa:16:3e:83:02:b6", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c763de-8d", "ovs_interfaceid": "06c763de-8d9e-470f-9c09-6494e1a6ae8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:43.197164 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:43.253757 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-99f7aa3a-fa66-4038-8f1b-44b222f100db tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:43.266260 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquiring lock "refresh_cache-ff7c9673-bf7d-426f-80a6-aa94a46ad33a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:43.335099 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:01:43.337487 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:01:43.337815 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Creating image(s)
May 27 03:01:43.338707 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:43.338707 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "/opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:43.339132 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "/opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:43.339736 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:43.344499 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:43.346538 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:43.386251 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-ab8426e2-f14d-4109-a3b1-02f384e12c2f req-5b80a7f7-4b37-4c92-8dd0-0fc87123790d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:43.468004 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ab8426e2-f14d-4109-a3b1-02f384e12c2f req-5b80a7f7-4b37-4c92-8dd0-0fc87123790d service nova] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:01:43.472554 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.126s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:43.472973 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:43.473466 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:43.474008 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:43.480954 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:43.481437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:43.556132 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-99f7aa3a-fa66-4038-8f1b-44b222f100db tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Updating instance_info_cache with network_info: [{"id": "d113df60-11d0-4f48-a42a-9541589d6a45", "address": "fa:16:3e:af:c0:52", "network": {"id": "a5ee8bff-dbe9-420a-bc58-64e9082e7d84", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a7ebe6073564995b0dd1bb85437f4d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd113df60-11", "ovs_interfaceid": "d113df60-11d0-4f48-a42a-9541589d6a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:43.606347 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.125s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:43.607124 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:43.638638 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:01:43.640348 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:01:43.641203 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:01:43.641686 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:01:43.642031 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:01:43.642948 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:01:43.643297 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:01:43.643621 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:01:43.644901 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.55 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:01:43.665310 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a/disk 1073741824" returned: 0 in 0.058s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:43.665803 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:43.672012 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:43.699323 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:01:43.699323 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:01:43.706127 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Releasing lock "refresh_cache-156e620a-485d-4135-8c52-aab777dd8480" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:43.708480 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Instance network_info: |[{"id": "06c763de-8d9e-470f-9c09-6494e1a6ae8a", "address": "fa:16:3e:83:02:b6", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c763de-8d", "ovs_interfaceid": "06c763de-8d9e-470f-9c09-6494e1a6ae8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:01:43.711063 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Start _get_guest_xml network_info=[{"id": "06c763de-8d9e-470f-9c09-6494e1a6ae8a", "address": "fa:16:3e:83:02:b6", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c763de-8d", "ovs_interfaceid": "06c763de-8d9e-470f-9c09-6494e1a6ae8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:01:43.727544 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:01:43.729524 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-785323631', uuid='156e620a-485d-4135-8c52-aab777dd8480'), owner=OwnerMeta(userid='e72474ce31364e6e93613cde1d50fcf2', username='tempest-VolumesActionsTest-2104767204-project-member', projectid='cb860bf509bc4a51ae78e4d7bea9d930', projectname='tempest-VolumesActionsTest-2104767204'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "06c763de-8d9e-470f-9c09-6494e1a6ae8a", "address": "fa:16:3e:83:02:b6", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c763de-8d", "ovs_interfaceid": "06c763de-8d9e-470f-9c09-6494e1a6ae8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850903.7290373) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:01:43.732564 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:01:43.733043 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:01:43.735073 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:01:43.735277 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:01:43.736605 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:01:43.737142 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:01:43.737325 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:01:43.737462 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:01:43.737635 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:01:43.737885 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:01:43.738026 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:01:43.738221 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:01:43.738348 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:01:43.738500 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:01:43.738646 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:01:43.738828 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:01:43.752280 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-785323631',display_name='tempest-VolumesActionsTest-instance-785323631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesactionstest-instance-785323631',id=25,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb860bf509bc4a51ae78e4d7bea9d930',ramdisk_id='',reservation_id='r-6lhlukr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2104767204',owner_user_name='tempest-VolumesActionsTest-2104767204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:39Z,user_data=None,user_id='e72474ce31364e6e93613cde1d50fcf2',uuid=156e620a-485d-4135-8c52-aab777dd8480,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06c763de-8d9e-470f-9c09-6494e1a6ae8a", "address": "fa:16:3e:83:02:b6", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c763de-8d", "ovs_interfaceid": "06c763de-8d9e-470f-9c09-6494e1a6ae8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:01:43.752597 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Converting VIF {"id": "06c763de-8d9e-470f-9c09-6494e1a6ae8a", "address": "fa:16:3e:83:02:b6", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c763de-8d", "ovs_interfaceid": "06c763de-8d9e-470f-9c09-6494e1a6ae8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:43.753265 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:02:b6,bridge_name='br-int',has_traffic_filtering=True,id=06c763de-8d9e-470f-9c09-6494e1a6ae8a,network=Network(f44736fe-999d-4250-bc37-3b218a164370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c763de-8d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:43.753927 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lazy-loading 'pci_devices' on Instance uuid 156e620a-485d-4135-8c52-aab777dd8480 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:43.768249 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ab8426e2-f14d-4109-a3b1-02f384e12c2f req-5b80a7f7-4b37-4c92-8dd0-0fc87123790d service nova] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:43.781571 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.110s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:43.782785 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:01:43.783386 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:43.880148 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:43.880658 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Cannot resize image /opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:01:43.881058 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:01:43.881528 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Ensure instance console log exists: /opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:01:43.881644 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:43.882147 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:43.882147 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:44.059882 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99f7aa3a-fa66-4038-8f1b-44b222f100db tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Releasing lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:44.060555 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-99f7aa3a-fa66-4038-8f1b-44b222f100db tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lazy-loading 'flavor' on Instance uuid f33f8709-32f7-4ce3-9967-c54609dcbb0c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:44.064927 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3f39e0ca-b155-41dd-860a-e128ba2de57c req-85fffe8d-c0b2-4f0c-9250-324534325648 service nova] Acquired lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:44.065519 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-3f39e0ca-b155-41dd-860a-e128ba2de57c req-85fffe8d-c0b2-4f0c-9250-324534325648 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Refreshing network info cache for port d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:01:44.208466 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:01:44.262576 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] End _get_guest_xml xml=<domain type="qemu">
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:   <uuid>156e620a-485d-4135-8c52-aab777dd8480</uuid>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:   <name>instance-00000019</name>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <nova:name>tempest-VolumesActionsTest-instance-785323631</nova:name>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:01:43</nova:creationTime>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:         <nova:user uuid="e72474ce31364e6e93613cde1d50fcf2">tempest-VolumesActionsTest-2104767204-project-member</nova:user>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:         <nova:project uuid="cb860bf509bc4a51ae78e4d7bea9d930">tempest-VolumesActionsTest-2104767204</nova:project>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:         <nova:port uuid="06c763de-8d9e-470f-9c09-6494e1a6ae8a">
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     <system>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <entry name="serial">156e620a-485d-4135-8c52-aab777dd8480</entry>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <entry name="uuid">156e620a-485d-4135-8c52-aab777dd8480</entry>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     </system>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:   <os>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:   </os>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:   <features>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:   </features>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:   <devices>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480/disk"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480/disk.config"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:83:02:b6"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <target dev="tap06c763de-8d"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     </interface>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480/console.log" append="off"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     </serial>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     <video>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     </video>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     </rng>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:   </devices>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]: </domain>
May 27 03:01:44.262576 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:01:44.265519 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Preparing to wait for external event network-vif-plugged-06c763de-8d9e-470f-9c09-6494e1a6ae8a {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:01:44.265519 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquiring lock "156e620a-485d-4135-8c52-aab777dd8480-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:44.265519 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "156e620a-485d-4135-8c52-aab777dd8480-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:44.265519 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "156e620a-485d-4135-8c52-aab777dd8480-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:44.266182 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-785323631',display_name='tempest-VolumesActionsTest-instance-785323631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesactionstest-instance-785323631',id=25,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb860bf509bc4a51ae78e4d7bea9d930',ramdisk_id='',reservation_id='r-6lhlukr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2104767204',owner_user_name='tempest-VolumesActionsTest-2104767204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:39Z,user_data=None,user_id='e72474ce31364e6e93613cde1d50fcf2',uuid=156e620a-485d-4135-8c52-aab777dd8480,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06c763de-8d9e-470f-9c09-6494e1a6ae8a", "address": "fa:16:3e:83:02:b6", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c763de-8d", "ovs_interfaceid": "06c763de-8d9e-470f-9c09-6494e1a6ae8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:01:44.266182 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Converting VIF {"id": "06c763de-8d9e-470f-9c09-6494e1a6ae8a", "address": "fa:16:3e:83:02:b6", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c763de-8d", "ovs_interfaceid": "06c763de-8d9e-470f-9c09-6494e1a6ae8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:44.266713 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:02:b6,bridge_name='br-int',has_traffic_filtering=True,id=06c763de-8d9e-470f-9c09-6494e1a6ae8a,network=Network(f44736fe-999d-4250-bc37-3b218a164370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c763de-8d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:44.267020 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:02:b6,bridge_name='br-int',has_traffic_filtering=True,id=06c763de-8d9e-470f-9c09-6494e1a6ae8a,network=Network(f44736fe-999d-4250-bc37-3b218a164370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c763de-8d') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:01:44.267512 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:44.267945 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:44.268289 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:01:44.269358 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:44.269539 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b3ddcf40-8b15-5952-a8b4-2bb223425055', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:44.270594 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ab8426e2-f14d-4109-a3b1-02f384e12c2f req-5b80a7f7-4b37-4c92-8dd0-0fc87123790d service nova] Releasing lock "refresh_cache-ff7c9673-bf7d-426f-80a6-aa94a46ad33a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:44.272191 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:44.273093 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquired lock "refresh_cache-ff7c9673-bf7d-426f-80a6-aa94a46ad33a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:44.273350 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:01:44.277352 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:44.281384 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:44.281384 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06c763de-8d, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:44.282802 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap06c763de-8d, col_values=(('qos', UUID('bf595513-3cd4-4b06-9b79-ef159571b88f')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:44.282802 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap06c763de-8d, col_values=(('external_ids', {'iface-id': '06c763de-8d9e-470f-9c09-6494e1a6ae8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:02:b6', 'vm-uuid': '156e620a-485d-4135-8c52-aab777dd8480'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:44.286769 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:44.287860 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:44.300087 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:44.301244 np0000001475 nova-compute[98471]: INFO os_vif [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:02:b6,bridge_name='br-int',has_traffic_filtering=True,id=06c763de-8d9e-470f-9c09-6494e1a6ae8a,network=Network(f44736fe-999d-4250-bc37-3b218a164370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c763de-8d')
May 27 03:01:44.316647 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:44.316796 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:44.316905 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:44.317157 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No VIF found with MAC fa:16:3e:01:3d:37, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:01:44.318499 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Using config drive
May 27 03:01:44.504039 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b0832f5f-226a-4a24-94f5-af81b5a6392d tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.741s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:44.571676 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-3f39e0ca-b155-41dd-860a-e128ba2de57c req-85fffe8d-c0b2-4f0c-9250-324534325648 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:44.613202 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:44.616214 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:44.639518 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:44.647224 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:44.681596 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:44.717500 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.117s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:44.718377 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:01:44.823785 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'ec2_ids' on Instance uuid 4e583b08-e323-4681-9e95-01767f510590 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:44.863093 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:01:44.940406 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999669267999934 future=<Future at 0x7557241909e0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:44.942007 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Instance destroyed successfully.
May 27 03:01:44.942445 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-99f7aa3a-fa66-4038-8f1b-44b222f100db tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lazy-loading 'numa_topology' on Instance uuid f33f8709-32f7-4ce3-9967-c54609dcbb0c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:45.019951 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-85e07d7a-d8d7-4250-a935-3eee31f51aea tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "71af628e-b06d-446d-8c2e-dcfbb232df33" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:45.020139 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-85e07d7a-d8d7-4250-a935-3eee31f51aea tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:45.040953 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-05668ca9-9992-441f-b3b5-1b936632f2e7 req-a80bc92e-f546-43a7-9ba3-6acbd9ea9715 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received event network-changed-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:45.041252 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-05668ca9-9992-441f-b3b5-1b936632f2e7 req-a80bc92e-f546-43a7-9ba3-6acbd9ea9715 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Refreshing instance network info cache due to event network-changed-d113df60-11d0-4f48-a42a-9541589d6a45. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:01:45.042724 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-05668ca9-9992-441f-b3b5-1b936632f2e7 req-a80bc92e-f546-43a7-9ba3-6acbd9ea9715 service nova] Acquiring lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:45.075449 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:45.227056 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:01:45.227306 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:01:45.227448 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:45.227718 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:45.269143 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Updating instance_info_cache with network_info: [{"id": "1dc18a8f-bec1-42d5-96ef-84706d61147c", "address": "fa:16:3e:f2:4e:6c", "network": {"id": "d2dd987b-3f51-49db-b3eb-a4ce0900727c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1326496062-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df6178da77914825aa17d655664bb17c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc18a8f-be", "ovs_interfaceid": "1dc18a8f-bec1-42d5-96ef-84706d61147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:45.334651 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<4e583b08-e323-4681-9e95-01767f510590> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:45.334651 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'keypairs' on Instance uuid 4e583b08-e323-4681-9e95-01767f510590 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:45.373809 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '787c8d4d4527402cbbc2ad0475f710bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab70ea24752242a88583e819c6c34e12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:01:45.375417 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:45.388808 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-3f39e0ca-b155-41dd-860a-e128ba2de57c req-85fffe8d-c0b2-4f0c-9250-324534325648 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:45.449528 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-99f7aa3a-fa66-4038-8f1b-44b222f100db tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Object Instance<f33f8709-32f7-4ce3-9967-c54609dcbb0c> lazy-loaded attributes: flavor,numa_topology {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:45.522387 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-85e07d7a-d8d7-4250-a935-3eee31f51aea tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Detaching volume 89f6f402-75a6-40a9-b2f2-8ef5f58a4586
May 27 03:01:45.602132 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-85e07d7a-d8d7-4250-a935-3eee31f51aea tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Attempting to driver detach volume 89f6f402-75a6-40a9-b2f2-8ef5f58a4586 from mountpoint /dev/vdb
May 27 03:01:45.619056 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-85e07d7a-d8d7-4250-a935-3eee31f51aea tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Found disk vdb by alias ua-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:01:45.630115 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-85e07d7a-d8d7-4250-a935-3eee31f51aea tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Found disk vdb by alias ua-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:01:45.630297 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-85e07d7a-d8d7-4250-a935-3eee31f51aea tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Attempting to detach device vdb from instance 71af628e-b06d-446d-8c2e-dcfbb232df33 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:01:45.630993 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-85e07d7a-d8d7-4250-a935-3eee31f51aea tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:01:45.630993 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:01:45.630993 np0000001475 nova-compute[98471]:   <alias name="ua-89f6f402-75a6-40a9-b2f2-8ef5f58a4586"/>
May 27 03:01:45.630993 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-6"/>
May 27 03:01:45.630993 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:01:45.630993 np0000001475 nova-compute[98471]:   <serial>89f6f402-75a6-40a9-b2f2-8ef5f58a4586</serial>
May 27 03:01:45.630993 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:01:45.630993 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:01:45.630993 np0000001475 nova-compute[98471]: </disk>
May 27 03:01:45.630993 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:01:45.642025 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-85e07d7a-d8d7-4250-a935-3eee31f51aea tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully detached device vdb from instance 71af628e-b06d-446d-8c2e-dcfbb232df33 from the persistent domain config.
May 27 03:01:45.642200 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-85e07d7a-d8d7-4250-a935-3eee31f51aea tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] (1/8): Attempting to detach device vdb with device alias ua-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 from instance 71af628e-b06d-446d-8c2e-dcfbb232df33 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:01:45.642471 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-85e07d7a-d8d7-4250-a935-3eee31f51aea tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:01:45.642471 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:01:45.642471 np0000001475 nova-compute[98471]:   <alias name="ua-89f6f402-75a6-40a9-b2f2-8ef5f58a4586"/>
May 27 03:01:45.642471 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-6"/>
May 27 03:01:45.642471 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:01:45.642471 np0000001475 nova-compute[98471]:   <serial>89f6f402-75a6-40a9-b2f2-8ef5f58a4586</serial>
May 27 03:01:45.642471 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:01:45.642471 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:01:45.642471 np0000001475 nova-compute[98471]: </disk>
May 27 03:01:45.642471 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:01:45.664893 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-3f39e0ca-b155-41dd-860a-e128ba2de57c req-85fffe8d-c0b2-4f0c-9250-324534325648 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Updated VIF entry in instance network info cache for port d113df60-11d0-4f48-a42a-9541589d6a45. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:01:45.665146 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-3f39e0ca-b155-41dd-860a-e128ba2de57c req-85fffe8d-c0b2-4f0c-9250-324534325648 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Updating instance_info_cache with network_info: [{"id": "d113df60-11d0-4f48-a42a-9541589d6a45", "address": "fa:16:3e:af:c0:52", "network": {"id": "a5ee8bff-dbe9-420a-bc58-64e9082e7d84", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a7ebe6073564995b0dd1bb85437f4d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd113df60-11", "ovs_interfaceid": "d113df60-11d0-4f48-a42a-9541589d6a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:45.731166 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:01:45.772112 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Releasing lock "refresh_cache-ff7c9673-bf7d-426f-80a6-aa94a46ad33a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:45.772899 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Instance network_info: |[{"id": "1dc18a8f-bec1-42d5-96ef-84706d61147c", "address": "fa:16:3e:f2:4e:6c", "network": {"id": "d2dd987b-3f51-49db-b3eb-a4ce0900727c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1326496062-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df6178da77914825aa17d655664bb17c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc18a8f-be", "ovs_interfaceid": "1dc18a8f-bec1-42d5-96ef-84706d61147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:01:45.779726 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Start _get_guest_xml network_info=[{"id": "1dc18a8f-bec1-42d5-96ef-84706d61147c", "address": "fa:16:3e:f2:4e:6c", "network": {"id": "d2dd987b-3f51-49db-b3eb-a4ce0900727c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1326496062-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df6178da77914825aa17d655664bb17c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc18a8f-be", "ovs_interfaceid": "1dc18a8f-bec1-42d5-96ef-84706d61147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:01:45.788077 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:01:45.789436 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-1760055263', uuid='ff7c9673-bf7d-426f-80a6-aa94a46ad33a'), owner=OwnerMeta(userid='9c7a2b8282d64da1b36834b8f66c35da', username='tempest-ServersNegativeTestJSON-1895958758-project-member', projectid='df6178da77914825aa17d655664bb17c', projectname='tempest-ServersNegativeTestJSON-1895958758'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1dc18a8f-bec1-42d5-96ef-84706d61147c", "address": "fa:16:3e:f2:4e:6c", "network": {"id": "d2dd987b-3f51-49db-b3eb-a4ce0900727c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1326496062-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df6178da77914825aa17d655664bb17c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc18a8f-be", "ovs_interfaceid": "1dc18a8f-bec1-42d5-96ef-84706d61147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850905.7889905) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:01:45.798599 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:01:45.798599 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:01:45.799518 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:01:45.799912 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:01:45.802797 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:01:45.802797 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:01:45.802797 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:01:45.803025 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:01:45.803025 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:01:45.803197 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:01:45.803319 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:01:45.803603 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:01:45.803809 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:01:45.803914 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:01:45.804064 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:01:45.804174 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:01:45.825406 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:01:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1760055263',display_name='tempest-ServersNegativeTestJSON-server-1760055263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serversnegativetestjson-server-1760055263',id=26,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df6178da77914825aa17d655664bb17c',ramdisk_id='',reservation_id='r-pl80yf5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1895958758',owner_user_name='tempest-ServersNegativeTestJSON-1895958758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:42Z,user_data=None,user_id='9c7a2b8282d64da1b36834b8f66c35da',uuid=ff7c9673-bf7d-426f-80a6-aa94a46ad33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dc18a8f-bec1-42d5-96ef-84706d61147c", "address": "fa:16:3e:f2:4e:6c", "network": {"id": "d2dd987b-3f51-49db-b3eb-a4ce0900727c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1326496062-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df6178da77914825aa17d655664bb17c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc18a8f-be", "ovs_interfaceid": "1dc18a8f-bec1-42d5-96ef-84706d61147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:01:45.825406 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Converting VIF {"id": "1dc18a8f-bec1-42d5-96ef-84706d61147c", "address": "fa:16:3e:f2:4e:6c", "network": {"id": "d2dd987b-3f51-49db-b3eb-a4ce0900727c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1326496062-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df6178da77914825aa17d655664bb17c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc18a8f-be", "ovs_interfaceid": "1dc18a8f-bec1-42d5-96ef-84706d61147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:45.825406 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:4e:6c,bridge_name='br-int',has_traffic_filtering=True,id=1dc18a8f-bec1-42d5-96ef-84706d61147c,network=Network(d2dd987b-3f51-49db-b3eb-a4ce0900727c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc18a8f-be') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:45.828702 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lazy-loading 'pci_devices' on Instance uuid ff7c9673-bf7d-426f-80a6-aa94a46ad33a {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:45.832406 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:45.833220 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:45.833220 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] No VIF found with MAC fa:16:3e:83:02:b6, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:01:45.833220 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Using config drive
May 27 03:01:45.838657 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<4e583b08-e323-4681-9e95-01767f510590> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:45.842852 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:45.942836 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Successfully created port: aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:01:45.987296 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:46.036952 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:46.050282 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Creating config drive at /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.config.rescue
May 27 03:01:46.052196 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp9__02hq {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:46.083146 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:46.129613 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp9__02hq" returned: 0 in 0.077s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:46.171405 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3f39e0ca-b155-41dd-860a-e128ba2de57c req-85fffe8d-c0b2-4f0c-9250-324534325648 service nova] Releasing lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:46.171405 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-05668ca9-9992-441f-b3b5-1b936632f2e7 req-a80bc92e-f546-43a7-9ba3-6acbd9ea9715 service nova] Acquired lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:46.171405 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-05668ca9-9992-441f-b3b5-1b936632f2e7 req-a80bc92e-f546-43a7-9ba3-6acbd9ea9715 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Refreshing network info cache for port d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:01:46.185478 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:46.201698 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:01:46.240923 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:01:46.329711 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] End _get_guest_xml xml=<domain type="qemu">
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:   <uuid>ff7c9673-bf7d-426f-80a6-aa94a46ad33a</uuid>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:   <name>instance-0000001a</name>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServersNegativeTestJSON-server-1760055263</nova:name>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:01:45</nova:creationTime>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:         <nova:user uuid="9c7a2b8282d64da1b36834b8f66c35da">tempest-ServersNegativeTestJSON-1895958758-project-member</nova:user>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:         <nova:project uuid="df6178da77914825aa17d655664bb17c">tempest-ServersNegativeTestJSON-1895958758</nova:project>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:         <nova:port uuid="1dc18a8f-bec1-42d5-96ef-84706d61147c">
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     <system>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <entry name="serial">ff7c9673-bf7d-426f-80a6-aa94a46ad33a</entry>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <entry name="uuid">ff7c9673-bf7d-426f-80a6-aa94a46ad33a</entry>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     </system>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:   <os>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:   </os>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:   <features>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:   </features>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:   <devices>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a/disk"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a/disk.config"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:f2:4e:6c"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <target dev="tap1dc18a8f-be"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     </interface>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a/console.log" append="off"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     </serial>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     <video>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     </video>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     </rng>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:   </devices>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]: </domain>
May 27 03:01:46.329711 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:01:46.332506 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Preparing to wait for external event network-vif-plugged-1dc18a8f-bec1-42d5-96ef-84706d61147c {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:01:46.332506 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquiring lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:46.332506 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:46.332506 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:46.332506 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:01:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1760055263',display_name='tempest-ServersNegativeTestJSON-server-1760055263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serversnegativetestjson-server-1760055263',id=26,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df6178da77914825aa17d655664bb17c',ramdisk_id='',reservation_id='r-pl80yf5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1895958758',owner_user_name='tempest-ServersNegativeTestJSON-1895958758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:42Z,user_data=None,user_id='9c7a2b8282d64da1b36834b8f66c35da',uuid=ff7c9673-bf7d-426f-80a6-aa94a46ad33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dc18a8f-bec1-42d5-96ef-84706d61147c", "address": "fa:16:3e:f2:4e:6c", "network": {"id": "d2dd987b-3f51-49db-b3eb-a4ce0900727c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1326496062-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df6178da77914825aa17d655664bb17c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc18a8f-be", "ovs_interfaceid": "1dc18a8f-bec1-42d5-96ef-84706d61147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:01:46.332506 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Converting VIF {"id": "1dc18a8f-bec1-42d5-96ef-84706d61147c", "address": "fa:16:3e:f2:4e:6c", "network": {"id": "d2dd987b-3f51-49db-b3eb-a4ce0900727c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1326496062-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df6178da77914825aa17d655664bb17c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc18a8f-be", "ovs_interfaceid": "1dc18a8f-bec1-42d5-96ef-84706d61147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:46.332506 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:4e:6c,bridge_name='br-int',has_traffic_filtering=True,id=1dc18a8f-bec1-42d5-96ef-84706d61147c,network=Network(d2dd987b-3f51-49db-b3eb-a4ce0900727c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc18a8f-be') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:46.332506 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:4e:6c,bridge_name='br-int',has_traffic_filtering=True,id=1dc18a8f-bec1-42d5-96ef-84706d61147c,network=Network(d2dd987b-3f51-49db-b3eb-a4ce0900727c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc18a8f-be') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:01:46.335526 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:46.335526 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:46.336457 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:01:46.337940 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:46.344904 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34dfc153-a8bf-5035-a833-024800764577', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:46.346184 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:46.346184 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:46.350066 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:46.359949 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:46.363506 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:46.363866 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1dc18a8f-be, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:46.364473 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1dc18a8f-be, col_values=(('qos', UUID('20aab1cf-7670-46b1-9bb8-5574dd3d61e6')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:46.365235 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1dc18a8f-be, col_values=(('external_ids', {'iface-id': '1dc18a8f-bec1-42d5-96ef-84706d61147c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:4e:6c', 'vm-uuid': 'ff7c9673-bf7d-426f-80a6-aa94a46ad33a'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:46.366304 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:46.369002 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:46.387215 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:46.388191 np0000001475 nova-compute[98471]: INFO os_vif [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:4e:6c,bridge_name='br-int',has_traffic_filtering=True,id=1dc18a8f-bec1-42d5-96ef-84706d61147c,network=Network(d2dd987b-3f51-49db-b3eb-a4ce0900727c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc18a8f-be')
May 27 03:01:46.413172 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779850906.4127185, 71af628e-b06d-446d-8c2e-dcfbb232df33 => ua-89f6f402-75a6-40a9-b2f2-8ef5f58a4586> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:01:46.422027 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-85e07d7a-d8d7-4250-a935-3eee31f51aea tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 for instance 71af628e-b06d-446d-8c2e-dcfbb232df33 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:01:46.429181 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-85e07d7a-d8d7-4250-a935-3eee31f51aea tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully detached device vdb from instance 71af628e-b06d-446d-8c2e-dcfbb232df33 from the live domain config.
May 27 03:01:46.467688 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "6ad1223d-d197-46e7-a32b-a25380d409a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:46.469079 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:46.515348 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:46.540912 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:46.542507 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:46.583509 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Creating config drive at /opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480/disk.config
May 27 03:01:46.588028 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8v19s45j {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:46.602045 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:46.614522 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:46.653553 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8v19s45j" returned: 0 in 0.065s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:46.681417 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-05668ca9-9992-441f-b3b5-1b936632f2e7 req-a80bc92e-f546-43a7-9ba3-6acbd9ea9715 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:46.713620 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:46.713773 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:46.714017 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:46.714991 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:01:46.756084 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Booting with volume-backed-image bb7555b3-2f7b-4a56-b628-91b0c2265c8d at /dev/vda
May 27 03:01:46.770571 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4c16efb6-0709-4952-8d70-4bd0b7fd3971 req-ac46fdd6-e5bc-407f-a42d-4d817d1cd393 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received event network-vif-plugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:46.770946 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4c16efb6-0709-4952-8d70-4bd0b7fd3971 req-ac46fdd6-e5bc-407f-a42d-4d817d1cd393 service nova] Acquiring lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:46.771233 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4c16efb6-0709-4952-8d70-4bd0b7fd3971 req-ac46fdd6-e5bc-407f-a42d-4d817d1cd393 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:46.771546 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4c16efb6-0709-4952-8d70-4bd0b7fd3971 req-ac46fdd6-e5bc-407f-a42d-4d817d1cd393 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:46.772212 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4c16efb6-0709-4952-8d70-4bd0b7fd3971 req-ac46fdd6-e5bc-407f-a42d-4d817d1cd393 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] No waiting events found dispatching network-vif-plugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:46.772654 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-4c16efb6-0709-4952-8d70-4bd0b7fd3971 req-ac46fdd6-e5bc-407f-a42d-4d817d1cd393 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received unexpected event network-vif-plugged-d113df60-11d0-4f48-a42a-9541589d6a45 for instance with vm_state rescued and task_state unrescuing.
May 27 03:01:46.977203 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Detaching volume 0301a508-e6af-4ae2-b6af-9a5abf80f200
May 27 03:01:47.000686 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-85e07d7a-d8d7-4250-a935-3eee31f51aea tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Detected multiple connections on this host for volume: 89f6f402-75a6-40a9-b2f2-8ef5f58a4586, skipping target disconnect.
May 27 03:01:47.054706 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Attempting to driver detach volume 0301a508-e6af-4ae2-b6af-9a5abf80f200 from mountpoint /dev/vdb
May 27 03:01:47.068506 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Found disk vdb by alias ua-0301a508-e6af-4ae2-b6af-9a5abf80f200 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:01:47.071430 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Found disk vdb by alias ua-0301a508-e6af-4ae2-b6af-9a5abf80f200 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:01:47.071539 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Attempting to detach device vdb from instance 6ad1223d-d197-46e7-a32b-a25380d409a8 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:01:47.072220 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:01:47.072220 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:01:47.072220 np0000001475 nova-compute[98471]:   <alias name="ua-0301a508-e6af-4ae2-b6af-9a5abf80f200"/>
May 27 03:01:47.072220 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-4"/>
May 27 03:01:47.072220 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:01:47.072220 np0000001475 nova-compute[98471]:   <serial>0301a508-e6af-4ae2-b6af-9a5abf80f200</serial>
May 27 03:01:47.072220 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 03:01:47.072220 np0000001475 nova-compute[98471]: </disk>
May 27 03:01:47.072220 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:01:47.088170 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Successfully detached device vdb from instance 6ad1223d-d197-46e7-a32b-a25380d409a8 from the persistent domain config.
May 27 03:01:47.090364 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] (1/8): Attempting to detach device vdb with device alias ua-0301a508-e6af-4ae2-b6af-9a5abf80f200 from instance 6ad1223d-d197-46e7-a32b-a25380d409a8 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:01:47.090777 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:01:47.090777 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:01:47.090777 np0000001475 nova-compute[98471]:   <alias name="ua-0301a508-e6af-4ae2-b6af-9a5abf80f200"/>
May 27 03:01:47.090777 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-4"/>
May 27 03:01:47.090777 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:01:47.090777 np0000001475 nova-compute[98471]:   <serial>0301a508-e6af-4ae2-b6af-9a5abf80f200</serial>
May 27 03:01:47.090777 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 03:01:47.090777 np0000001475 nova-compute[98471]: </disk>
May 27 03:01:47.090777 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:01:47.212195 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-05668ca9-9992-441f-b3b5-1b936632f2e7 req-a80bc92e-f546-43a7-9ba3-6acbd9ea9715 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:47.230043 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Successfully updated port: aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:01:47.298702 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4b0d1b9b-0d0b-448c-83e2-f0b00aae7114 req-b401d794-55f0-4dd0-bf4f-5a8d0973518e service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received event network-changed-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:47.300552 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4b0d1b9b-0d0b-448c-83e2-f0b00aae7114 req-b401d794-55f0-4dd0-bf4f-5a8d0973518e service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Refreshing instance network info cache due to event network-changed-aea6a715-c60b-40d2-b064-f0b1b33a1000. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:01:47.300704 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b0d1b9b-0d0b-448c-83e2-f0b00aae7114 req-b401d794-55f0-4dd0-bf4f-5a8d0973518e service nova] Acquiring lock "refresh_cache-ba8ef70d-8e27-48c8-82e3-6501f6130456" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:47.300893 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b0d1b9b-0d0b-448c-83e2-f0b00aae7114 req-b401d794-55f0-4dd0-bf4f-5a8d0973518e service nova] Acquired lock "refresh_cache-ba8ef70d-8e27-48c8-82e3-6501f6130456" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:47.300986 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4b0d1b9b-0d0b-448c-83e2-f0b00aae7114 req-b401d794-55f0-4dd0-bf4f-5a8d0973518e service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Refreshing network info cache for port aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:01:47.387131 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:47.423873 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:47.509260 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:47.546703 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:47.591084 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-05668ca9-9992-441f-b3b5-1b936632f2e7 req-a80bc92e-f546-43a7-9ba3-6acbd9ea9715 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Updated VIF entry in instance network info cache for port d113df60-11d0-4f48-a42a-9541589d6a45. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:01:47.591358 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-05668ca9-9992-441f-b3b5-1b936632f2e7 req-a80bc92e-f546-43a7-9ba3-6acbd9ea9715 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Updating instance_info_cache with network_info: [{"id": "d113df60-11d0-4f48-a42a-9541589d6a45", "address": "fa:16:3e:af:c0:52", "network": {"id": "a5ee8bff-dbe9-420a-bc58-64e9082e7d84", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a7ebe6073564995b0dd1bb85437f4d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd113df60-11", "ovs_interfaceid": "d113df60-11d0-4f48-a42a-9541589d6a45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:47.615414 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-85e07d7a-d8d7-4250-a935-3eee31f51aea tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'flavor' on Instance uuid 71af628e-b06d-446d-8c2e-dcfbb232df33 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:47.629179 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:47.635957 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:47.733219 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "refresh_cache-ba8ef70d-8e27-48c8-82e3-6501f6130456" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:47.780994 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:47.806458 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-4b0d1b9b-0d0b-448c-83e2-f0b00aae7114 req-b401d794-55f0-4dd0-bf4f-5a8d0973518e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:47.832834 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-aef69307-63ac-4326-a99d-483bfe21dddf req-e0bb7b9f-3cf7-4c87-a554-9f2246a5eac4 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received event network-vif-plugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:47.837820 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aef69307-63ac-4326-a99d-483bfe21dddf req-e0bb7b9f-3cf7-4c87-a554-9f2246a5eac4 service nova] Acquiring lock "4e583b08-e323-4681-9e95-01767f510590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:47.838471 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aef69307-63ac-4326-a99d-483bfe21dddf req-e0bb7b9f-3cf7-4c87-a554-9f2246a5eac4 service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:47.840906 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aef69307-63ac-4326-a99d-483bfe21dddf req-e0bb7b9f-3cf7-4c87-a554-9f2246a5eac4 service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:47.840906 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-aef69307-63ac-4326-a99d-483bfe21dddf req-e0bb7b9f-3cf7-4c87-a554-9f2246a5eac4 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] No waiting events found dispatching network-vif-plugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:47.840906 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-aef69307-63ac-4326-a99d-483bfe21dddf req-e0bb7b9f-3cf7-4c87-a554-9f2246a5eac4 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received unexpected event network-vif-plugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c for instance with vm_state active and task_state rescuing.
May 27 03:01:47.915950 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4b0d1b9b-0d0b-448c-83e2-f0b00aae7114 req-b401d794-55f0-4dd0-bf4f-5a8d0973518e service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:01:47.937280 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779850907.9368906, 6ad1223d-d197-46e7-a32b-a25380d409a8 => ua-0301a508-e6af-4ae2-b6af-9a5abf80f200> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:01:47.945246 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0301a508-e6af-4ae2-b6af-9a5abf80f200 for instance 6ad1223d-d197-46e7-a32b-a25380d409a8 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:01:47.946282 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:47.946451 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:47.946630 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] No VIF found with MAC fa:16:3e:f2:4e:6c, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:01:47.947232 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Using config drive
May 27 03:01:47.954151 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Successfully detached device vdb from instance 6ad1223d-d197-46e7-a32b-a25380d409a8 from the live domain config.
May 27 03:01:47.956590 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:01:47.957157 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0301a508-e6af-4ae2-b6af-9a5abf80f200', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:01:47.957328 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:01:47.957789 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:01:47.958151 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0301a508-e6af-4ae2-b6af-9a5abf80f200', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:01:47.958320 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:01:48.006361 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:48.006361 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:48.006361 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:48.006361 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:48.006361 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:48.006361 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:48.006361 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:48.006361 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:48.006361 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:48.006361 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:48.006361 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:01:48.006680 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:48.006680 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:48.006680 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:48.006680 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:48.006680 np0000001475 nova-compute[98471]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:48.006680 np0000001475 nova-compute[98471]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200 (non-flash)
May 27 03:01:48.006680 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:48.006680 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:48.006680 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:48.006680 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:48.006680 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:01:48.006945 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', '50')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:01:48.006945 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', '45')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:01:48.009235 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200', '46')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:01:48.010407 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c3fb100>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200'): ({'sdg'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:01:48.010678 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Removing multipathed devices sdf, sdg {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:01:48.011012 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Flush multipath device 330000000d581dd7b {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:01:48.045494 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:01:48.096046 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:48.097006 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-05668ca9-9992-441f-b3b5-1b936632f2e7 req-a80bc92e-f546-43a7-9ba3-6acbd9ea9715 service nova] Releasing lock "refresh_cache-f33f8709-32f7-4ce3-9967-c54609dcbb0c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:48.103343 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:01:48.110127 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:48.112894 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:48.148128 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:48.153362 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:01:48.153362 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:01:48.159536 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:01:48.161253 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:48.182635 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:01:48.182635 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:01:48.196912 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:48.245544 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, portal: 192.168.40.100,3260]
May 27 03:01:48.245544 np0000001475 nova-compute[98471]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, portal: 192.168.40.100,3260] successful.
May 27 03:01:48.245544 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:48.266312 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4b0d1b9b-0d0b-448c-83e2-f0b00aae7114 req-b401d794-55f0-4dd0-bf4f-5a8d0973518e service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:48.271361 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:48.287668 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:48.325485 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, portal: 192.168.50.100,3260]
May 27 03:01:48.325485 np0000001475 nova-compute[98471]: Logout of [sid: 46, target: iqn.2023-03.storpool.com:os--volume-0301a508-e6af-4ae2-b6af-9a5abf80f200, portal: 192.168.50.100,3260] successful.
May 27 03:01:48.325485 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:48.357088 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:48.357245 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:01:48.357343 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] <== disconnect_volume: return (399ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:01:48.357473 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:01:48.372228 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-99f7aa3a-fa66-4038-8f1b-44b222f100db tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:48.375537 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Removed pending STOPPED event for f33f8709-32f7-4ce3-9967-c54609dcbb0c due to new event <LifecycleEvent: 1779850908.3722746, f33f8709-32f7-4ce3-9967-c54609dcbb0c => Resumed> {{(pid=98471) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 03:01:48.375787 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850908.3722746, f33f8709-32f7-4ce3-9967-c54609dcbb0c => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:48.375993 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] VM Resumed (Lifecycle Event)
May 27 03:01:48.456785 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:48.632468 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Creating config drive at /opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a/disk.config
May 27 03:01:48.637166 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-85e07d7a-d8d7-4250-a935-3eee31f51aea tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.617s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:48.641435 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptchfxdj_ {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:48.658795 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:48.659181 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:48.722544 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptchfxdj_" returned: 0 in 0.081s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:48.769271 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b0d1b9b-0d0b-448c-83e2-f0b00aae7114 req-b401d794-55f0-4dd0-bf4f-5a8d0973518e service nova] Releasing lock "refresh_cache-ba8ef70d-8e27-48c8-82e3-6501f6130456" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:48.770319 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquired lock "refresh_cache-ba8ef70d-8e27-48c8-82e3-6501f6130456" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:48.770495 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:01:48.882975 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:48.885624 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:48.899872 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received event network-vif-plugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:48.900128 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Acquiring lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:48.900361 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:48.900688 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:48.901039 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] No waiting events found dispatching network-vif-plugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:48.901039 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received unexpected event network-vif-plugged-d113df60-11d0-4f48-a42a-9541589d6a45 for instance with vm_state active and task_state None.
May 27 03:01:48.901205 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Received event network-vif-unplugged-06c763de-8d9e-470f-9c09-6494e1a6ae8a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:48.901295 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Acquiring lock "156e620a-485d-4135-8c52-aab777dd8480-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:48.901463 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Lock "156e620a-485d-4135-8c52-aab777dd8480-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:48.901621 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Lock "156e620a-485d-4135-8c52-aab777dd8480-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:48.902989 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] [instance: 156e620a-485d-4135-8c52-aab777dd8480] No event matching network-vif-unplugged-06c763de-8d9e-470f-9c09-6494e1a6ae8a in dict_keys([('network-vif-plugged', '06c763de-8d9e-470f-9c09-6494e1a6ae8a')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 03:01:48.904662 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Received unexpected event network-vif-unplugged-06c763de-8d9e-470f-9c09-6494e1a6ae8a for instance with vm_state building and task_state spawning.
May 27 03:01:48.905508 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received event network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:48.906887 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Acquiring lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] No waiting events found dispatching network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received unexpected event network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 for instance with vm_state active and task_state None.
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received event network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Acquiring lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] No waiting events found dispatching network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received unexpected event network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 for instance with vm_state active and task_state None.
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received event network-vif-plugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Acquiring lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] No waiting events found dispatching network-vif-plugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received unexpected event network-vif-plugged-d113df60-11d0-4f48-a42a-9541589d6a45 for instance with vm_state active and task_state None.
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received event network-vif-plugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Acquiring lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] No waiting events found dispatching network-vif-plugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received unexpected event network-vif-plugged-d113df60-11d0-4f48-a42a-9541589d6a45 for instance with vm_state active and task_state None.
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Received event network-vif-plugged-06c763de-8d9e-470f-9c09-6494e1a6ae8a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:48.910806 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Acquiring lock "156e620a-485d-4135-8c52-aab777dd8480-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:48.912447 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Lock "156e620a-485d-4135-8c52-aab777dd8480-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:48.912623 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] Lock "156e620a-485d-4135-8c52-aab777dd8480-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:48.913151 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1126dc9d-8a43-4761-b409-0c7ea3a97d3c req-5db2b990-01e7-4e80-b37c-68c9f24637b0 service nova] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Processing event network-vif-plugged-06c763de-8d9e-470f-9c09-6494e1a6ae8a {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:01:48.952874 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lazy-loading 'flavor' on Instance uuid 6ad1223d-d197-46e7-a32b-a25380d409a8 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:49.036763 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:01:49.039291 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-fc4a66ae-b856-42a9-a556-004221ab16c9 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:49.040181 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:01:49.047443 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Instance spawned successfully.
May 27 03:01:49.047880 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:01:49.184944 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Detaching volume 89f6f402-75a6-40a9-b2f2-8ef5f58a4586
May 27 03:01:49.201336 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:01:49.203504 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:49.275414 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Attempting to driver detach volume 89f6f402-75a6-40a9-b2f2-8ef5f58a4586 from mountpoint /dev/vdb
May 27 03:01:49.285840 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:49.300943 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Found disk vdb by alias ua-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:01:49.302375 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Found disk vdb by alias ua-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:01:49.303312 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Attempting to detach device vdb from instance 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:01:49.304636 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:01:49.304636 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:01:49.304636 np0000001475 nova-compute[98471]:   <alias name="ua-89f6f402-75a6-40a9-b2f2-8ef5f58a4586"/>
May 27 03:01:49.304636 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-6"/>
May 27 03:01:49.304636 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:01:49.304636 np0000001475 nova-compute[98471]:   <serial>89f6f402-75a6-40a9-b2f2-8ef5f58a4586</serial>
May 27 03:01:49.304636 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:01:49.304636 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:01:49.304636 np0000001475 nova-compute[98471]: </disk>
May 27 03:01:49.304636 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:01:49.317937 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:49.322892 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:49.327701 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:49.328315 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:49.351331 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully detached device vdb from instance 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 from the persistent domain config.
May 27 03:01:49.352883 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] (1/8): Attempting to detach device vdb with device alias ua-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 from instance 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:01:49.353271 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:01:49.353271 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:01:49.353271 np0000001475 nova-compute[98471]:   <alias name="ua-89f6f402-75a6-40a9-b2f2-8ef5f58a4586"/>
May 27 03:01:49.353271 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-6"/>
May 27 03:01:49.353271 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:01:49.353271 np0000001475 nova-compute[98471]:   <serial>89f6f402-75a6-40a9-b2f2-8ef5f58a4586</serial>
May 27 03:01:49.353271 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:01:49.353271 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:01:49.353271 np0000001475 nova-compute[98471]: </disk>
May 27 03:01:49.353271 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:01:49.397141 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850909.3967817, f33f8709-32f7-4ce3-9967-c54609dcbb0c => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:49.397304 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] VM Started (Lifecycle Event)
May 27 03:01:49.441785 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:49.479588 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:49.490197 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.rescue --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:49.571980 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:49.572120 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:49.572546 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:49.572797 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:49.573776 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:49.573776 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:49.644652 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:49.645310 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.rescue --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:49.754875 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk.rescue --force-share --output=json" returned: 0 in 0.109s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:49.755416 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:49.889056 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:49.893029 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:49.913893 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:49.933509 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:49.941476 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:49.954469 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:49.969978 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-64b6795b-eeba-49fc-baab-c5321de3b394 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.500s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:50.034321 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:50.040321 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:50.100895 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Took 9.99 seconds to spawn the instance on the hypervisor.
May 27 03:01:50.101543 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:50.168332 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:50.169032 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:50.222683 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:50.224157 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:50.245982 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-546d01b3-0a66-404e-aa55-8b67afa9e22a req-1870af56-e0af-4f3d-9389-0b2d244c2262 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received event network-vif-plugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:50.246153 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-546d01b3-0a66-404e-aa55-8b67afa9e22a req-1870af56-e0af-4f3d-9389-0b2d244c2262 service nova] Acquiring lock "4e583b08-e323-4681-9e95-01767f510590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:50.246252 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-546d01b3-0a66-404e-aa55-8b67afa9e22a req-1870af56-e0af-4f3d-9389-0b2d244c2262 service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:50.246429 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-546d01b3-0a66-404e-aa55-8b67afa9e22a req-1870af56-e0af-4f3d-9389-0b2d244c2262 service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:50.247461 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-546d01b3-0a66-404e-aa55-8b67afa9e22a req-1870af56-e0af-4f3d-9389-0b2d244c2262 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] No waiting events found dispatching network-vif-plugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:50.248520 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-546d01b3-0a66-404e-aa55-8b67afa9e22a req-1870af56-e0af-4f3d-9389-0b2d244c2262 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received unexpected event network-vif-plugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c for instance with vm_state rescued and task_state unrescuing.
May 27 03:01:50.257613 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:01:50.298450 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:50.308541 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:50.446191 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:50.451008 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:50.476867 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850910.4750156, 156e620a-485d-4135-8c52-aab777dd8480 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:50.477606 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 156e620a-485d-4135-8c52-aab777dd8480] VM Started (Lifecycle Event)
May 27 03:01:50.562941 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:01:50.567488 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:50.578080 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:01:50.591794 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:50.595391 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:01:50.603412 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:50.626542 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-11ed4932-1d88-4e3c-ac3f-0f9ef515e77a tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Unrescuing
May 27 03:01:50.639156 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-11ed4932-1d88-4e3c-ac3f-0f9ef515e77a tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "refresh_cache-4e583b08-e323-4681-9e95-01767f510590" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:50.649754 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-11ed4932-1d88-4e3c-ac3f-0f9ef515e77a tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquired lock "refresh_cache-4e583b08-e323-4681-9e95-01767f510590" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:50.649754 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-11ed4932-1d88-4e3c-ac3f-0f9ef515e77a tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:01:50.651060 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:50.652704 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Took 16.05 seconds to build instance.
May 27 03:01:50.707127 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:01:50.707276 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:01:50.719549 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:01:50.721047 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b', 'fe80::fc16:3eff:fe1f:5a7', 'fe80::a095:90ff:feef:1465', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::fc16:3eff:fefc:b5d4', 'fe80::fc16:3eff:fe7e:904a', 'fe80::c805:4ff:fe3b:2374', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:fe76:5c4', 'fe80::fc16:3eff:feb2:aa32', 'fe80::fc16:3eff:feaf:c052', 'fe80::20bf:faff:fe0c:5acd', 'fe80::fc16:3eff:fe01:3d37', 'fe80::fc16:3eff:fe83:2b6', 'fe80::88f3:17ff:fe19:857', 'fe80::fc16:3eff:fef2:4e6c', 'fe80::501f:4dff:feb6:d71c'] 
May 27 03:01:50.721513 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:01:50.721663 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:50.721870 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:01:50.722198 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:01:50.722479 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Updating existing volume attachment record: 30519169-e449-4d79-86b4-57eb9e67a48e {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:01:50.726171 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:50.749867 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:01:50.840312 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:50.845597 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.rescue --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:50.869098 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Updating instance_info_cache with network_info: [{"id": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "address": "fa:16:3e:db:0a:73", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea6a715-c6", "ovs_interfaceid": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:50.955931 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.rescue --force-share --output=json" returned: 0 in 0.111s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:50.956464 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.rescue --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:50.976447 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-be4ff897-245e-489a-964b-86c3f3291af4 req-6aab63b4-cd0d-4857-822a-51c5a4ac256a service nova] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Received event network-vif-plugged-06c763de-8d9e-470f-9c09-6494e1a6ae8a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:50.977373 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-be4ff897-245e-489a-964b-86c3f3291af4 req-6aab63b4-cd0d-4857-822a-51c5a4ac256a service nova] Acquiring lock "156e620a-485d-4135-8c52-aab777dd8480-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:50.977636 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-be4ff897-245e-489a-964b-86c3f3291af4 req-6aab63b4-cd0d-4857-822a-51c5a4ac256a service nova] Lock "156e620a-485d-4135-8c52-aab777dd8480-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:50.977860 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-be4ff897-245e-489a-964b-86c3f3291af4 req-6aab63b4-cd0d-4857-822a-51c5a4ac256a service nova] Lock "156e620a-485d-4135-8c52-aab777dd8480-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:50.977914 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-be4ff897-245e-489a-964b-86c3f3291af4 req-6aab63b4-cd0d-4857-822a-51c5a4ac256a service nova] [instance: 156e620a-485d-4135-8c52-aab777dd8480] No waiting events found dispatching network-vif-plugged-06c763de-8d9e-470f-9c09-6494e1a6ae8a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:50.978047 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-be4ff897-245e-489a-964b-86c3f3291af4 req-6aab63b4-cd0d-4857-822a-51c5a4ac256a service nova] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Received unexpected event network-vif-plugged-06c763de-8d9e-470f-9c09-6494e1a6ae8a for instance with vm_state active and task_state None.
May 27 03:01:50.990654 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:50.994474 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:50.998196 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:51.020279 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "6ad1223d-d197-46e7-a32b-a25380d409a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:51.020403 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:51.020579 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:51.020728 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:51.020902 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:51.024237 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Terminating instance
May 27 03:01:51.066293 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.rescue --force-share --output=json" returned: 0 in 0.110s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:51.066613 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:51.158887 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-11ed4932-1d88-4e3c-ac3f-0f9ef515e77a tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:51.170262 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:51.170363 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:51.190617 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed03d703-a710-44a2-949b-263479aa77d8 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "156e620a-485d-4135-8c52-aab777dd8480" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.606s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:51.276347 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:51.288212 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:51.366005 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:51.373897 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Releasing lock "refresh_cache-ba8ef70d-8e27-48c8-82e3-6501f6130456" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:51.376399 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Instance network_info: |[{"id": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "address": "fa:16:3e:db:0a:73", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea6a715-c6", "ovs_interfaceid": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:01:51.403657 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:51.403849 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:51.415877 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:01:51.418832 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Claim successful on node np0000001475
May 27 03:01:51.430870 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:51.434429 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:51.502920 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850911.5016088, 156e620a-485d-4135-8c52-aab777dd8480 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:51.502920 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 156e620a-485d-4135-8c52-aab777dd8480] VM Paused (Lifecycle Event)
May 27 03:01:51.529017 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:01:51.557758 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:51.562697 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:51.596028 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:51.691166 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:51.691667 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:51.809854 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:51.814781 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-11ed4932-1d88-4e3c-ac3f-0f9ef515e77a tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:51.819842 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:51.829645 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:51.830229 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:01:51.834228 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:01:51.854960 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:51.872086 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:51.893006 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:51.917791 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Instance destroyed successfully.
May 27 03:01:51.926229 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lazy-loading 'resources' on Instance uuid 6ad1223d-d197-46e7-a32b-a25380d409a8 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:52.015727 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:52.023901 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Removed pending STOPPED event for 4e583b08-e323-4681-9e95-01767f510590 due to new event <LifecycleEvent: 1779850912.023373, 4e583b08-e323-4681-9e95-01767f510590 => Resumed> {{(pid=98471) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 03:01:52.024305 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850912.023373, 4e583b08-e323-4681-9e95-01767f510590 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:52.024305 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] VM Resumed (Lifecycle Event)
May 27 03:01:52.028059 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:52.028573 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:52.057926 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-11ed4932-1d88-4e3c-ac3f-0f9ef515e77a tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Updating instance_info_cache with network_info: [{"id": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "address": "fa:16:3e:01:3d:37", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e0fddb-8c", "ovs_interfaceid": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:52.133557 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:52.142586 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:52.194684 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6b3e1de1-8328-418a-b968-fd22494f8dac req-ab2cc77b-f81c-4d8c-a226-a260b3a9b78c service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Received event network-vif-unplugged-28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:52.195612 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6b3e1de1-8328-418a-b968-fd22494f8dac req-ab2cc77b-f81c-4d8c-a226-a260b3a9b78c service nova] Acquiring lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:52.195971 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6b3e1de1-8328-418a-b968-fd22494f8dac req-ab2cc77b-f81c-4d8c-a226-a260b3a9b78c service nova] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:52.196155 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6b3e1de1-8328-418a-b968-fd22494f8dac req-ab2cc77b-f81c-4d8c-a226-a260b3a9b78c service nova] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:52.196351 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6b3e1de1-8328-418a-b968-fd22494f8dac req-ab2cc77b-f81c-4d8c-a226-a260b3a9b78c service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] No waiting events found dispatching network-vif-unplugged-28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:52.196539 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6b3e1de1-8328-418a-b968-fd22494f8dac req-ab2cc77b-f81c-4d8c-a226-a260b3a9b78c service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Received event network-vif-unplugged-28ae6612-6474-4d47-8296-02394b0dabe5 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:01:52.244326 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:52.244850 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:52.338572 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:52.343351 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:52.367618 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-581911b2-01d7-4c15-ace0-01ab5c5d6b7b req-00184915-3cae-464e-9d81-bdd9bd7610f5 service nova] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Received event network-vif-plugged-1dc18a8f-bec1-42d5-96ef-84706d61147c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:52.368232 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-581911b2-01d7-4c15-ace0-01ab5c5d6b7b req-00184915-3cae-464e-9d81-bdd9bd7610f5 service nova] Acquiring lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:52.368626 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-581911b2-01d7-4c15-ace0-01ab5c5d6b7b req-00184915-3cae-464e-9d81-bdd9bd7610f5 service nova] Lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:52.368904 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-581911b2-01d7-4c15-ace0-01ab5c5d6b7b req-00184915-3cae-464e-9d81-bdd9bd7610f5 service nova] Lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:52.369089 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-581911b2-01d7-4c15-ace0-01ab5c5d6b7b req-00184915-3cae-464e-9d81-bdd9bd7610f5 service nova] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Processing event network-vif-plugged-1dc18a8f-bec1-42d5-96ef-84706d61147c {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:01:52.369313 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-581911b2-01d7-4c15-ace0-01ab5c5d6b7b req-00184915-3cae-464e-9d81-bdd9bd7610f5 service nova] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Received event network-vif-plugged-1dc18a8f-bec1-42d5-96ef-84706d61147c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:52.369452 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-581911b2-01d7-4c15-ace0-01ab5c5d6b7b req-00184915-3cae-464e-9d81-bdd9bd7610f5 service nova] Acquiring lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:52.369588 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-581911b2-01d7-4c15-ace0-01ab5c5d6b7b req-00184915-3cae-464e-9d81-bdd9bd7610f5 service nova] Lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:52.370050 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-581911b2-01d7-4c15-ace0-01ab5c5d6b7b req-00184915-3cae-464e-9d81-bdd9bd7610f5 service nova] Lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:52.370406 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-581911b2-01d7-4c15-ace0-01ab5c5d6b7b req-00184915-3cae-464e-9d81-bdd9bd7610f5 service nova] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] No waiting events found dispatching network-vif-plugged-1dc18a8f-bec1-42d5-96ef-84706d61147c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:52.371686 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-581911b2-01d7-4c15-ace0-01ab5c5d6b7b req-00184915-3cae-464e-9d81-bdd9bd7610f5 service nova] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Received unexpected event network-vif-plugged-1dc18a8f-bec1-42d5-96ef-84706d61147c for instance with vm_state building and task_state spawning.
May 27 03:01:52.372200 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:01:52.380293 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:01:52.384026 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Instance spawned successfully.
May 27 03:01:52.384436 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:01:52.435368 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 for instance 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:01:52.443566 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T02:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-875613762',display_name='tempest-ServerActionsTestOtherA-server-1000576881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-tempest-common-compute-instance-875613762',id=13,image_ref='48155fdd-4ef0-4719-a052-7861f417b7f0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhbCOMX0cDx/uCjoD1pQ3iMb/yxZcupQyHf7uuxnrf7EdI6EEP6StEltLO6whpKYwhmElUFdPkkHXCp77KUbxPxYkUhhTpx6/EQ206sxZO2JeMp5jzBChiUJOOt29J78w==',key_name='tempest-keypair-1019067704',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:01:06Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='233d191c03874150880aca259ffd3e21',ramdisk_id='',reservation_id='r-gfwl4dxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='48155fdd-4ef0-4719-a052-7861f417b7f0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-569974590',owner_user_name='tempest-ServerActionsTestOtherA-569974590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:01:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a93dfe76ab455d8aa6e691b1fa34c5',uuid=6ad1223d-d197-46e7-a32b-a25380d409a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28ae6612-6474-4d47-8296-02394b0dabe5", "address": "fa:16:3e:fc:b5:d4", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ae6612-64", "ovs_interfaceid": "28ae6612-6474-4d47-8296-02394b0dabe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:01:52.443900 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converting VIF {"id": "28ae6612-6474-4d47-8296-02394b0dabe5", "address": "fa:16:3e:fc:b5:d4", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28ae6612-64", "ovs_interfaceid": "28ae6612-6474-4d47-8296-02394b0dabe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:52.444429 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=28ae6612-6474-4d47-8296-02394b0dabe5,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ae6612-64') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:52.444710 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=28ae6612-6474-4d47-8296-02394b0dabe5,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ae6612-64') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:01:52.456842 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:52.459367 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28ae6612-64, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:52.464705 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:52.467856 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:52.469199 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:52.473062 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:52.473330 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a39876e0-7dc2-4c32-a59c-fad87cc2f6dd) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:52.476135 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:52.493191 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:52.498579 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:52.506346 np0000001475 nova-compute[98471]: INFO os_vif [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=28ae6612-6474-4d47-8296-02394b0dabe5,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28ae6612-64')
May 27 03:01:52.507360 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Deleting instance files /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8_del
May 27 03:01:52.508373 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Deletion of /opt/stack/data/nova/instances/6ad1223d-d197-46e7-a32b-a25380d409a8_del complete
May 27 03:01:52.528630 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:52.533991 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:52.563457 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-11ed4932-1d88-4e3c-ac3f-0f9ef515e77a tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Releasing lock "refresh_cache-4e583b08-e323-4681-9e95-01767f510590" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:52.564252 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-11ed4932-1d88-4e3c-ac3f-0f9ef515e77a tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'flavor' on Instance uuid 4e583b08-e323-4681-9e95-01767f510590 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:52.574612 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:52.578817 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:01:52.580253 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:52.631101 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.051s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:52.631554 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=11293MB free_disk=74.05627059936523GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:01:52.631791 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:52.895718 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:52.895977 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:52.896909 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:52.898682 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:52.899100 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:52.902994 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:01:52.955611 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:01:52.957064 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:01:52.957404 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Creating image(s)
May 27 03:01:52.962466 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:01:52.962466 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Ensure instance console log exists: /opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:01:52.963470 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:52.963470 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:52.964903 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:52.965163 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Start _get_guest_xml network_info=[{"id": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "address": "fa:16:3e:db:0a:73", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea6a715-c6", "ovs_interfaceid": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ba8ef70d-8e27-48c8-82e3-6501f6130456', 'attached_at': '', 'detached_at': '', 'volume_id': '326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'serial': '326c1eec-4d4e-42f9-94d2-07c2e4e72085'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '30519169-e449-4d79-86b4-57eb9e67a48e', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:01:52.967906 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:01:52.969514 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-334835239', uuid='ba8ef70d-8e27-48c8-82e3-6501f6130456'), owner=OwnerMeta(userid='787c8d4d4527402cbbc2ad0475f710bb', username='tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member', projectid='ab70ea24752242a88583e819c6c34e12', projectname='tempest-ServerBootFromVolumeStableRescueTest-1976367979'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "address": "fa:16:3e:db:0a:73", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea6a715-c6", "ovs_interfaceid": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850912.9689167) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:01:52.972816 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:01:52.974542 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:01:52.980514 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:01:52.980889 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:01:52.982252 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:01:52.986042 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:01:52.986428 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:01:52.986645 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:01:52.986896 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:01:52.987014 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:01:52.987293 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:01:52.987384 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:01:52.987552 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:01:52.987717 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:01:52.989727 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:01:52.989975 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:01:53.017655 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:01:53.018607 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:01:53.018607 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:01:53.020116 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:01:53.020116 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:01:53.022551 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Took 1.49 seconds to destroy the instance on the hypervisor.
May 27 03:01:53.023545 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:01:53.023545 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:01:53.023545 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:01:53.023545 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:53.037605 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 27 03:01:53.038458 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850913.0379875, 4e583b08-e323-4681-9e95-01767f510590 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:53.038848 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] VM Started (Lifecycle Event)
May 27 03:01:53.049622 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:01:53.050408 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:01:53.050937 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:01:53.051169 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:01:53.052197 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:01:53.052197 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:01:53.088243 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:01:53.088243 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:53.096098 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:01:53.096098 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:53.109375 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085] added
May 27 03:01:53.109375 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:01:53.109375 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:01:53.109375 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:01:53.109375 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:01:53.109375 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:01:53.109375 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:53.110134 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:01:53.111620 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0584(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:01:53.111620 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:01:53.119449 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085] added
May 27 03:01:53.119449 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:01:53.119449 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:01:53.119449 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:01:53.119449 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:01:53.119449 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:01:53.119449 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:53.120852 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:01:53.120852 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0686(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:01:53.120852 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:01:53.141423 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:53.163706 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:53.199709 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:53.274567 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquiring lock "156e620a-485d-4135-8c52-aab777dd8480" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:53.274567 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "156e620a-485d-4135-8c52-aab777dd8480" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:53.274567 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquiring lock "156e620a-485d-4135-8c52-aab777dd8480-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:53.274567 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "156e620a-485d-4135-8c52-aab777dd8480-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:53.274567 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "156e620a-485d-4135-8c52-aab777dd8480-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:53.283590 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Terminating instance
May 27 03:01:53.409688 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Took 10.07 seconds to spawn the instance on the hypervisor.
May 27 03:01:53.409855 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:53.431837 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:53.450244 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:53.482261 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 4e583b08-e323-4681-9e95-01767f510590] Instance destroyed successfully.
May 27 03:01:53.484160 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-11ed4932-1d88-4e3c-ac3f-0f9ef515e77a tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'numa_topology' on Instance uuid 4e583b08-e323-4681-9e95-01767f510590 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:53.544107 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:53.552442 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850913.552038, 156e620a-485d-4135-8c52-aab777dd8480 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:53.556595 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 156e620a-485d-4135-8c52-aab777dd8480] VM Resumed (Lifecycle Event)
May 27 03:01:53.685419 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:01:53.686601 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:01:53.787397 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:53.788584 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:01:53.834022 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:53.861520 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:53.869221 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:53.905897 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:53.934901 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Took 17.04 seconds to build instance.
May 27 03:01:53.938085 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f252d644-122d-43fc-a074-b9132ecd5310 req-abc3a42d-5959-48a2-9493-9c8b132a7587 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Received event network-vif-deleted-28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:53.938323 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-f252d644-122d-43fc-a074-b9132ecd5310 req-abc3a42d-5959-48a2-9493-9c8b132a7587 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Neutron deleted interface 28ae6612-6474-4d47-8296-02394b0dabe5; detaching it from the instance and deleting it from the info cache
May 27 03:01:53.938541 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f252d644-122d-43fc-a074-b9132ecd5310 req-abc3a42d-5959-48a2-9493-9c8b132a7587 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:53.987633 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-11ed4932-1d88-4e3c-ac3f-0f9ef515e77a tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<4e583b08-e323-4681-9e95-01767f510590> lazy-loaded attributes: flavor,numa_topology {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:01:54.060642 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:54.111926 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:01:54.120770 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:01:54.130849 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:01:54.130849 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:01:54.143222 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:01:54.143222 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:54.151337 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:54.160119 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:54.169529 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:54.169529 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:54.169529 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:54.169529 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:54.169529 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:54.169529 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:54.169529 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:54.169529 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:54.169529 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:01:54.169529 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:54.169529 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:54.169529 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:54.169529 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:54.169529 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:54.169529 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:54.169529 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:54.169529 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:54.169529 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:01:54.189296 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:54.189296 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:54.189296 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:54.189296 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:54.189296 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:54.189296 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:54.189296 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:54.189296 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:54.189296 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:01:54.190500 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:01:54.198670 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:54.198670 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:54.198670 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:54.198670 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:54.198670 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:54.198670 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:54.198670 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:54.198670 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:54.198670 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:01:54.229417 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085, portal: 192.168.40.100,3260]
May 27 03:01:54.229417 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085, portal: 192.168.40.100,3260] successful.
May 27 03:01:54.229417 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:54.246916 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:54.255978 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085, portal: 192.168.50.100,3260]
May 27 03:01:54.255978 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085, portal: 192.168.50.100,3260] successful.
May 27 03:01:54.255978 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:54.259890 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850914.2580779, ff7c9673-bf7d-426f-80a6-aa94a46ad33a => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:54.259890 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] VM Started (Lifecycle Event)
May 27 03:01:54.260775 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Instance destroyed successfully.
May 27 03:01:54.261383 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lazy-loading 'resources' on Instance uuid 156e620a-485d-4135-8c52-aab777dd8480 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:54.270822 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:54.270822 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:54.270822 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:54.270822 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:54.270822 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:54.270822 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:54.270822 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:54.270822 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:54.270822 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:01:54.270822 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:01:54.270822 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:01:54.271166 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:54.271166 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:54.271166 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:54.271166 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:54.271166 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:54.271166 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:54.271166 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:54.271166 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:54.271166 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:01:54.271166 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:01:54.271166 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:01:54.271469 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.220s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:01:54.271646 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:01:54.274945 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:54.277202 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] HCTL ('11', '-', '-', 0) found on session 51 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:01:54.277202 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:01:54.299729 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:54.299729 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:54.299729 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:54.299729 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:54.299729 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:54.299729 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:54.299729 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:54.299729 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:54.299729 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:01:54.299729 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:01:54.299729 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:01:54.300482 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:54.300482 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:54.300482 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:54.300482 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:54.300482 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:54.300482 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:54.300482 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:54.300482 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:54.300482 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:01:54.300482 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:01:54.300482 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:01:54.309657 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.252s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:01:54.309657 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:01:54.309657 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Searching for a device in session 51 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:01:54.309657 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:01:54.309657 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] HCTL ('12', '-', '-', 0) found on session 52 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:01:54.309657 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:01:54.319809 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0b4f8d04-bb85-4288-a622-61ca2a8c0a6a req-a9460036-35f6-4823-be59-6d2cf1f68b75 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Received event network-vif-unplugged-28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:54.319809 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0b4f8d04-bb85-4288-a622-61ca2a8c0a6a req-a9460036-35f6-4823-be59-6d2cf1f68b75 service nova] Acquiring lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:54.319809 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0b4f8d04-bb85-4288-a622-61ca2a8c0a6a req-a9460036-35f6-4823-be59-6d2cf1f68b75 service nova] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:54.319946 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0b4f8d04-bb85-4288-a622-61ca2a8c0a6a req-a9460036-35f6-4823-be59-6d2cf1f68b75 service nova] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:54.320026 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0b4f8d04-bb85-4288-a622-61ca2a8c0a6a req-a9460036-35f6-4823-be59-6d2cf1f68b75 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] No waiting events found dispatching network-vif-unplugged-28ae6612-6474-4d47-8296-02394b0dabe5 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:54.320146 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0b4f8d04-bb85-4288-a622-61ca2a8c0a6a req-a9460036-35f6-4823-be59-6d2cf1f68b75 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Received event network-vif-unplugged-28ae6612-6474-4d47-8296-02394b0dabe5 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:01:54.337412 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Searching for a device in session 52 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:01:54.337412 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:01:54.342876 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:54.346944 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.003808989999924961 future=<Future at 0x755724191640 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:54.346944 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:54.346944 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=5.595720134999965 future=<Future at 0x7557241909e0 state=cancelled>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:54.346944 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=5.595634517000008 future=<Future at 0x7557241909e0 state=cancelled>) was cancelled while queued, skipping {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:54.346944 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:54.440861 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-77ffc949-bccf-4071-b462-042475bf00fa tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.554s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:54.449143 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f252d644-122d-43fc-a074-b9132ecd5310 req-abc3a42d-5959-48a2-9493-9c8b132a7587 service nova] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Detach interface failed, port_id=28ae6612-6474-4d47-8296-02394b0dabe5, reason: Instance 6ad1223d-d197-46e7-a32b-a25380d409a8 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:01:54.531495 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d03176f4-9fdd-437f-a08e-dfbf81a8da60 req-fdb1a6d0-520c-4145-ae08-eca07b025e3a service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received event network-vif-unplugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:54.531621 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d03176f4-9fdd-437f-a08e-dfbf81a8da60 req-fdb1a6d0-520c-4145-ae08-eca07b025e3a service nova] Acquiring lock "4e583b08-e323-4681-9e95-01767f510590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:54.531946 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d03176f4-9fdd-437f-a08e-dfbf81a8da60 req-fdb1a6d0-520c-4145-ae08-eca07b025e3a service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:54.532008 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d03176f4-9fdd-437f-a08e-dfbf81a8da60 req-fdb1a6d0-520c-4145-ae08-eca07b025e3a service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:54.532127 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d03176f4-9fdd-437f-a08e-dfbf81a8da60 req-fdb1a6d0-520c-4145-ae08-eca07b025e3a service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] No waiting events found dispatching network-vif-unplugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:54.532331 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-d03176f4-9fdd-437f-a08e-dfbf81a8da60 req-fdb1a6d0-520c-4145-ae08-eca07b025e3a service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received unexpected event network-vif-unplugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c for instance with vm_state rescued and task_state unrescuing.
May 27 03:01:54.533203 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d03176f4-9fdd-437f-a08e-dfbf81a8da60 req-fdb1a6d0-520c-4145-ae08-eca07b025e3a service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received event network-vif-unplugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:54.533203 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d03176f4-9fdd-437f-a08e-dfbf81a8da60 req-fdb1a6d0-520c-4145-ae08-eca07b025e3a service nova] Acquiring lock "4e583b08-e323-4681-9e95-01767f510590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:54.535002 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d03176f4-9fdd-437f-a08e-dfbf81a8da60 req-fdb1a6d0-520c-4145-ae08-eca07b025e3a service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:54.535239 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d03176f4-9fdd-437f-a08e-dfbf81a8da60 req-fdb1a6d0-520c-4145-ae08-eca07b025e3a service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:54.535481 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d03176f4-9fdd-437f-a08e-dfbf81a8da60 req-fdb1a6d0-520c-4145-ae08-eca07b025e3a service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] No waiting events found dispatching network-vif-unplugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:54.535663 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-d03176f4-9fdd-437f-a08e-dfbf81a8da60 req-fdb1a6d0-520c-4145-ae08-eca07b025e3a service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received unexpected event network-vif-unplugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c for instance with vm_state rescued and task_state unrescuing.
May 27 03:01:54.700918 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.297s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:54.702320 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 2.069s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:54.706012 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:01:54.752501 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:54.766039 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:01:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-785323631',display_name='tempest-VolumesActionsTest-instance-785323631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesactionstest-instance-785323631',id=25,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:01:50Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb860bf509bc4a51ae78e4d7bea9d930',ramdisk_id='',reservation_id='r-6lhlukr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2104767204',owner_user_name='tempest-VolumesActionsTest-2104767204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:01:50Z,user_data=None,user_id='e72474ce31364e6e93613cde1d50fcf2',uuid=156e620a-485d-4135-8c52-aab777dd8480,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06c763de-8d9e-470f-9c09-6494e1a6ae8a", "address": "fa:16:3e:83:02:b6", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c763de-8d", "ovs_interfaceid": "06c763de-8d9e-470f-9c09-6494e1a6ae8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:01:54.766039 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Converting VIF {"id": "06c763de-8d9e-470f-9c09-6494e1a6ae8a", "address": "fa:16:3e:83:02:b6", "network": {"id": "f44736fe-999d-4250-bc37-3b218a164370", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1951530443-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cb860bf509bc4a51ae78e4d7bea9d930", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c763de-8d", "ovs_interfaceid": "06c763de-8d9e-470f-9c09-6494e1a6ae8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:54.766294 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:02:b6,bridge_name='br-int',has_traffic_filtering=True,id=06c763de-8d9e-470f-9c09-6494e1a6ae8a,network=Network(f44736fe-999d-4250-bc37-3b218a164370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c763de-8d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:54.766732 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:02:b6,bridge_name='br-int',has_traffic_filtering=True,id=06c763de-8d9e-470f-9c09-6494e1a6ae8a,network=Network(f44736fe-999d-4250-bc37-3b218a164370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c763de-8d') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:01:54.768204 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:54.771971 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:54.778775 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:54.778775 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06c763de-8d, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:54.779524 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:54.780620 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:54.793441 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:54.797142 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:54.800400 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:54.800400 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf595513-3cd4-4b06-9b79-ef159571b88f) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:54.803404 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:54.803404 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:54.805098 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:54.809267 np0000001475 nova-compute[98471]: INFO os_vif [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:02:b6,bridge_name='br-int',has_traffic_filtering=True,id=06c763de-8d9e-470f-9c09-6494e1a6ae8a,network=Network(f44736fe-999d-4250-bc37-3b218a164370),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c763de-8d')
May 27 03:01:54.809659 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Deleting instance files /opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480_del
May 27 03:01:54.814621 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Deletion of /opt/stack/data/nova/instances/156e620a-485d-4135-8c52-aab777dd8480_del complete
May 27 03:01:54.847708 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Took 1.82 seconds to deallocate network for instance.
May 27 03:01:54.897960 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:54.988302 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:54.995123 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:55.052214 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:01:55.212836 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:01:55.213057 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:01:55.213363 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:55.213640 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:55.278442 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850915.2769053, ff7c9673-bf7d-426f-80a6-aa94a46ad33a => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:55.278442 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] VM Paused (Lifecycle Event)
May 27 03:01:55.326394 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Took 1.54 seconds to destroy the instance on the hypervisor.
May 27 03:01:55.327784 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:01:55.331890 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:01:55.332116 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 156e620a-485d-4135-8c52-aab777dd8480] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:01:55.332411 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:55.345078 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6dd385bbf9c3482aa593c41ce7795e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a54fd7b39b4a968af6ad453070ea4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:01:55.357325 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:55.421726 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:55.737983 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:01:55.780630 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:55.789032 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999566818999938 future=<Future at 0x7557343f8b30 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:55.789539 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850915.7892783, ff7c9673-bf7d-426f-80a6-aa94a46ad33a => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:55.789810 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] VM Resumed (Lifecycle Event)
May 27 03:01:55.791371 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.997431465999853 future=<Future at 0x7557343f8b30 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:55.791371 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.997234810999998 future=<Future at 0x7557343f8b30 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:55.829553 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 8d762a67-82b6-40d3-b625-0731ea01c45b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:01:55.829693 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 6ad1223d-d197-46e7-a32b-a25380d409a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:01:55.830103 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 9847a45d-ad45-4b2b-85eb-664604911991 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:01:55.830207 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance f33f8709-32f7-4ce3-9967-c54609dcbb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:01:55.830296 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance f5d36573-c0e7-43a0-a7cc-66678f093375 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:01:55.830378 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 7acda56f-e16c-4371-99b3-21eeea2904d1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:01:55.830460 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 71af628e-b06d-446d-8c2e-dcfbb232df33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:01:55.830627 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 4e583b08-e323-4681-9e95-01767f510590 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:01:55.830716 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 66b799ed-716a-4b29-8125-bac73213f2cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:01:55.830716 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:01:55.830855 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 02fd272a-5759-4995-9e5c-cc1f3e28072b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:01:55.830922 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 156e620a-485d-4135-8c52-aab777dd8480 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:01:55.830922 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance ff7c9673-bf7d-426f-80a6-aa94a46ad33a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:01:55.831314 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance ba8ef70d-8e27-48c8-82e3-6501f6130456 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:01:55.831314 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance b4f2203e-ef29-4dcf-b665-236abd72e5f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:01:55.835682 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-11ed4932-1d88-4e3c-ac3f-0f9ef515e77a tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:55.995175 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:55.999019 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquiring lock "735ab00a-a335-49f6-9b03-3dec824f8fbb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:55.999019 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "735ab00a-a335-49f6-9b03-3dec824f8fbb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:56.044402 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a327da5b-8260-4e46-b77b-b2f738ad7b8b req-5b7f6104-5c4c-4759-9a12-6e1b9cfec61f service nova] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Received event network-vif-unplugged-06c763de-8d9e-470f-9c09-6494e1a6ae8a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:56.044970 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a327da5b-8260-4e46-b77b-b2f738ad7b8b req-5b7f6104-5c4c-4759-9a12-6e1b9cfec61f service nova] Acquiring lock "156e620a-485d-4135-8c52-aab777dd8480-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:56.045175 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a327da5b-8260-4e46-b77b-b2f738ad7b8b req-5b7f6104-5c4c-4759-9a12-6e1b9cfec61f service nova] Lock "156e620a-485d-4135-8c52-aab777dd8480-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:56.045345 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a327da5b-8260-4e46-b77b-b2f738ad7b8b req-5b7f6104-5c4c-4759-9a12-6e1b9cfec61f service nova] Lock "156e620a-485d-4135-8c52-aab777dd8480-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:56.045521 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a327da5b-8260-4e46-b77b-b2f738ad7b8b req-5b7f6104-5c4c-4759-9a12-6e1b9cfec61f service nova] [instance: 156e620a-485d-4135-8c52-aab777dd8480] No waiting events found dispatching network-vif-unplugged-06c763de-8d9e-470f-9c09-6494e1a6ae8a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:56.045683 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a327da5b-8260-4e46-b77b-b2f738ad7b8b req-5b7f6104-5c4c-4759-9a12-6e1b9cfec61f service nova] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Received event network-vif-unplugged-06c763de-8d9e-470f-9c09-6494e1a6ae8a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:01:56.045882 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a327da5b-8260-4e46-b77b-b2f738ad7b8b req-5b7f6104-5c4c-4759-9a12-6e1b9cfec61f service nova] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Received event network-vif-unplugged-06c763de-8d9e-470f-9c09-6494e1a6ae8a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:56.047184 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a327da5b-8260-4e46-b77b-b2f738ad7b8b req-5b7f6104-5c4c-4759-9a12-6e1b9cfec61f service nova] Acquiring lock "156e620a-485d-4135-8c52-aab777dd8480-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:56.047184 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a327da5b-8260-4e46-b77b-b2f738ad7b8b req-5b7f6104-5c4c-4759-9a12-6e1b9cfec61f service nova] Lock "156e620a-485d-4135-8c52-aab777dd8480-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:56.047184 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a327da5b-8260-4e46-b77b-b2f738ad7b8b req-5b7f6104-5c4c-4759-9a12-6e1b9cfec61f service nova] Lock "156e620a-485d-4135-8c52-aab777dd8480-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:56.047184 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a327da5b-8260-4e46-b77b-b2f738ad7b8b req-5b7f6104-5c4c-4759-9a12-6e1b9cfec61f service nova] [instance: 156e620a-485d-4135-8c52-aab777dd8480] No waiting events found dispatching network-vif-unplugged-06c763de-8d9e-470f-9c09-6494e1a6ae8a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:56.047184 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a327da5b-8260-4e46-b77b-b2f738ad7b8b req-5b7f6104-5c4c-4759-9a12-6e1b9cfec61f service nova] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Received event network-vif-unplugged-06c763de-8d9e-470f-9c09-6494e1a6ae8a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:01:56.072341 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Found WWN 3300000008d44544e for multipath device dm-4 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:01:56.072652 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.053s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:01:56.072966 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] <== connect_volume: return (3054ms) {'type': 'block', 'scsi_wwn': '3300000008d44544e', 'path': '/dev/dm-4', 'multipath_id': '3300000008d44544e'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:01:56.073268 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008d44544e', 'path': '/dev/dm-4', 'multipath_id': '3300000008d44544e'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:01:56.093167 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Successfully created port: 65d3853b-fb46-46b8-9c5f-fd6bc698c4b5 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:01:56.259831 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:01:56.262444 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:56.292696 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:56.299529 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:56.335942 np0000001475 nova-compute[98471]: INFO nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 735ab00a-a335-49f6-9b03-3dec824f8fbb has allocations against this compute host but is not found in the database.
May 27 03:01:56.335942 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:01:56.335942 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=3392MB phys_disk=95GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:01:52 up 33 min,  2 users,  load average: 12.06, 7.08, 3.36\n', 'num_instances': '15', 'num_vm_active': '11', 'num_task_None': '11', 'num_os_type_None': '15', 'num_proj_233d191c03874150880aca259ffd3e21': '2', 'io_workload': '2', 'num_task_deleting': '2', 'num_proj_ab70ea24752242a88583e819c6c34e12': '4', 'num_proj_2a7ebe6073564995b0dd1bb85437f4d7': '1', 'num_proj_a9c48d6919e8435f876f3324616521ea': '3', 'num_vm_rescued': '2', 'num_task_unrescuing': '1', 'num_proj_39cbbdb9012c4992865d4f89678ef9ac': '2', 'num_proj_cb860bf509bc4a51ae78e4d7bea9d930': '1', 'num_proj_df6178da77914825aa17d655664bb17c': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_51a54fd7b39b4a968af6ad453070ea4d': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:01:56.398543 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-59354548-61be-4e56-8a78-d9bf485c5893 req-f0db9d11-665d-4d34-80dd-c0f7e59527ae service nova] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Received event network-vif-deleted-06c763de-8d9e-470f-9c09-6494e1a6ae8a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:56.506277 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:01:56.579812 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-334835239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverbootfromvolumestablerescuetest-server-334835239',id=27,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab70ea24752242a88583e819c6c34e12',ramdisk_id='',reservation_id='r-aeuhqiw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:46Z,user_data=None,user_id='787c8d4d4527402cbbc2ad0475f710bb',uuid=ba8ef70d-8e27-48c8-82e3-6501f6130456,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "address": "fa:16:3e:db:0a:73", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea6a715-c6", "ovs_interfaceid": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:01:56.581568 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converting VIF {"id": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "address": "fa:16:3e:db:0a:73", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea6a715-c6", "ovs_interfaceid": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:56.585126 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:0a:73,bridge_name='br-int',has_traffic_filtering=True,id=aea6a715-c60b-40d2-b064-f0b1b33a1000,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea6a715-c6') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:56.586848 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'pci_devices' on Instance uuid ba8ef70d-8e27-48c8-82e3-6501f6130456 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:56.632096 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c056dc28-ca3f-4dea-944b-fbc416c0af00 req-663af3de-f6c8-41b1-9a6c-7be81e2c946f service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received event network-vif-plugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:56.632096 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c056dc28-ca3f-4dea-944b-fbc416c0af00 req-663af3de-f6c8-41b1-9a6c-7be81e2c946f service nova] Acquiring lock "4e583b08-e323-4681-9e95-01767f510590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:56.632850 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c056dc28-ca3f-4dea-944b-fbc416c0af00 req-663af3de-f6c8-41b1-9a6c-7be81e2c946f service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:56.632850 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c056dc28-ca3f-4dea-944b-fbc416c0af00 req-663af3de-f6c8-41b1-9a6c-7be81e2c946f service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:56.632850 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c056dc28-ca3f-4dea-944b-fbc416c0af00 req-663af3de-f6c8-41b1-9a6c-7be81e2c946f service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] No waiting events found dispatching network-vif-plugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:56.632850 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c056dc28-ca3f-4dea-944b-fbc416c0af00 req-663af3de-f6c8-41b1-9a6c-7be81e2c946f service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received unexpected event network-vif-plugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c for instance with vm_state active and task_state None.
May 27 03:01:56.632850 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c056dc28-ca3f-4dea-944b-fbc416c0af00 req-663af3de-f6c8-41b1-9a6c-7be81e2c946f service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received event network-vif-plugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:56.633107 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c056dc28-ca3f-4dea-944b-fbc416c0af00 req-663af3de-f6c8-41b1-9a6c-7be81e2c946f service nova] Acquiring lock "4e583b08-e323-4681-9e95-01767f510590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:56.633107 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c056dc28-ca3f-4dea-944b-fbc416c0af00 req-663af3de-f6c8-41b1-9a6c-7be81e2c946f service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:56.635022 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c056dc28-ca3f-4dea-944b-fbc416c0af00 req-663af3de-f6c8-41b1-9a6c-7be81e2c946f service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:56.635513 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c056dc28-ca3f-4dea-944b-fbc416c0af00 req-663af3de-f6c8-41b1-9a6c-7be81e2c946f service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] No waiting events found dispatching network-vif-plugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:01:56.635513 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c056dc28-ca3f-4dea-944b-fbc416c0af00 req-663af3de-f6c8-41b1-9a6c-7be81e2c946f service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received unexpected event network-vif-plugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c for instance with vm_state active and task_state None.
May 27 03:01:56.767773 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Took 1.44 seconds to deallocate network for instance.
May 27 03:01:56.802575 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779850916.8021588, 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 => ua-89f6f402-75a6-40a9-b2f2-8ef5f58a4586> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:01:56.803338 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999762059999966 future=<Future at 0x7557046416a0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:56.803338 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999842428000193 future=<Future at 0x75573658a180 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:01:56.805344 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Removed pending STOPPED event for 4e583b08-e323-4681-9e95-01767f510590 due to new event <LifecycleEvent: 1779850916.8033183, 4e583b08-e323-4681-9e95-01767f510590 => Resumed> {{(pid=98471) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 03:01:56.805344 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850916.8033183, 4e583b08-e323-4681-9e95-01767f510590 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:56.806093 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] VM Resumed (Lifecycle Event)
May 27 03:01:56.815902 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully detached device vdb from instance 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 from the live domain config.
May 27 03:01:56.836763 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Successfully updated port: 65d3853b-fb46-46b8-9c5f-fd6bc698c4b5 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:01:56.884384 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:01:56.884847 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:01:56.885174 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:01:56.885614 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:01:56.886062 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:01:56.886260 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:01:56.918056 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:56.918056 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:56.918056 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:56.918056 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:56.918056 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:56.918056 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:56.918056 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:56.918056 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:56.918056 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:01:56.918056 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:01:56.918056 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:01:56.918337 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:56.918337 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:01:56.918337 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:56.918337 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:01:56.918337 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:56.918337 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:01:56.918337 np0000001475 nova-compute[98471]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:56.918337 np0000001475 nova-compute[98471]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586 (non-flash)
May 27 03:01:56.918337 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:01:56.918337 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:01:56.918337 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:01:56.918538 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', '50'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', '52')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:01:56.918699 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', '50')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:01:56.922762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586', '49')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:01:56.922762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755724625e40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586'): ({'sdk'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:01:56.922762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Removing multipathed devices sdj, sdk {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:01:56.922762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Flush multipath device 330000000a6e22f98 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:01:56.957594 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:01:56.996418 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:01:57.044827 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:01:57.044827 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:01:57.045796 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:01:57.070057 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:01:57.070929 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:01:57.073474 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:57.086814 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:57.094482 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] End _get_guest_xml xml=<domain type="qemu">
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:   <uuid>ba8ef70d-8e27-48c8-82e3-6501f6130456</uuid>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:   <name>instance-0000001b</name>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-334835239</nova:name>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:01:52</nova:creationTime>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:         <nova:user uuid="787c8d4d4527402cbbc2ad0475f710bb">tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member</nova:user>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:         <nova:project uuid="ab70ea24752242a88583e819c6c34e12">tempest-ServerBootFromVolumeStableRescueTest-1976367979</nova:project>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:         <nova:port uuid="aea6a715-c60b-40d2-b064-f0b1b33a1000">
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     <system>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <entry name="serial">ba8ef70d-8e27-48c8-82e3-6501f6130456</entry>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <entry name="uuid">ba8ef70d-8e27-48c8-82e3-6501f6130456</entry>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     </system>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:   <os>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:   </os>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:   <features>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:   </features>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:   <devices>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/disk.config"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <alias name="ua-326c1eec-4d4e-42f9-94d2-07c2e4e72085"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-4"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <serial>326c1eec-4d4e-42f9-94d2-07c2e4e72085</serial>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:db:0a:73"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <target dev="tapaea6a715-c6"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     </interface>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/console.log" append="off"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     </serial>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     <video>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     </video>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     </rng>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:   </devices>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]: </domain>
May 27 03:01:57.094482 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:01:57.096895 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Preparing to wait for external event network-vif-plugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:01:57.096895 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:57.096895 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:57.096895 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:57.096895 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-334835239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverbootfromvolumestablerescuetest-server-334835239',id=27,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab70ea24752242a88583e819c6c34e12',ramdisk_id='',reservation_id='r-aeuhqiw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:46Z,user_data=None,user_id='787c8d4d4527402cbbc2ad0475f710bb',uuid=ba8ef70d-8e27-48c8-82e3-6501f6130456,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "address": "fa:16:3e:db:0a:73", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea6a715-c6", "ovs_interfaceid": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:01:57.096895 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converting VIF {"id": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "address": "fa:16:3e:db:0a:73", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea6a715-c6", "ovs_interfaceid": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:57.096895 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:0a:73,bridge_name='br-int',has_traffic_filtering=True,id=aea6a715-c60b-40d2-b064-f0b1b33a1000,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea6a715-c6') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:57.097405 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:0a:73,bridge_name='br-int',has_traffic_filtering=True,id=aea6a715-c60b-40d2-b064-f0b1b33a1000,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea6a715-c6') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:01:57.098174 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:57.103025 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:57.103274 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:01:57.105892 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:57.106110 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b29ebb2-d70d-5560-ae6b-2bd67b86ff93', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:57.115587 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:57.116627 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:57.119986 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:57.120225 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaea6a715-c6, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:57.120611 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaea6a715-c6, col_values=(('qos', UUID('8b6c0d4c-ba90-4103-9e67-39820c57ccfa')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:57.120842 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaea6a715-c6, col_values=(('external_ids', {'iface-id': 'aea6a715-c60b-40d2-b064-f0b1b33a1000', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:0a:73', 'vm-uuid': 'ba8ef70d-8e27-48c8-82e3-6501f6130456'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:57.122491 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:57.124267 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:57.129557 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:57.131918 np0000001475 nova-compute[98471]: INFO os_vif [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:0a:73,bridge_name='br-int',has_traffic_filtering=True,id=aea6a715-c60b-40d2-b064-f0b1b33a1000,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea6a715-c6')
May 27 03:01:57.132949 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586, portal: 192.168.40.100,3260]
May 27 03:01:57.132949 np0000001475 nova-compute[98471]: Logout of [sid: 50, target: iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586, portal: 192.168.40.100,3260] successful.
May 27 03:01:57.132949 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:57.163315 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:57.180571 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:57.221299 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586, portal: 192.168.50.100,3260]
May 27 03:01:57.221299 np0000001475 nova-compute[98471]: Logout of [sid: 49, target: iqn.2023-03.storpool.com:os--volume-89f6f402-75a6-40a9-b2f2-8ef5f58a4586, portal: 192.168.50.100,3260] successful.
May 27 03:01:57.221299 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:57.245165 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:01:57.245510 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:01:57.245576 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] <== disconnect_volume: return (360ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:01:57.246520 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:01:57.273057 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:01:57.274496 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:01:57.274496 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Creating image(s)
May 27 03:01:57.275223 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:57.276462 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "/opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:57.284757 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:57.287725 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "/opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:57.287725 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:57.291308 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:57.293040 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:57.322039 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:57.327353 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:57.342861 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "refresh_cache-b4f2203e-ef29-4dcf-b665-236abd72e5f0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:57.342861 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquired lock "refresh_cache-b4f2203e-ef29-4dcf-b665-236abd72e5f0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:57.342861 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:01:57.415990 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.123s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:57.417034 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:57.417791 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:57.419706 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:57.425341 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:01:57.426029 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:57.518457 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:01:57.518699 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:01:57.546453 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.120s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:57.546888 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:57.598677 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0/disk 1073741824" returned: 0 in 0.051s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:57.599153 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:57.599499 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:57.690385 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.091s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:57.690973 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:01:57.691291 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:57.800017 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:57.800831 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Cannot resize image /opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:01:57.801347 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:01:57.802835 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Ensure instance console log exists: /opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:01:57.802835 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:57.802835 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:57.802835 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:57.817276 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'flavor' on Instance uuid 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:57.836167 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850917.8356936, 4e583b08-e323-4681-9e95-01767f510590 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:01:57.836300 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] VM Started (Lifecycle Event)
May 27 03:01:57.916270 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:01:58.022832 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:01:58.141764 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:58.337636 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Updating instance_info_cache with network_info: [{"id": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "address": "fa:16:3e:54:22:d6", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d3853b-fb", "ovs_interfaceid": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:01:58.339231 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:01:58.344488 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:01:58.493454 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-68eb653e-d904-4f0f-ac79-69f47c73a2d9 req-81ef32d6-e77b-42bb-aded-e33ef1aa29cc service nova] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Received event network-changed-65d3853b-fb46-46b8-9c5f-fd6bc698c4b5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:01:58.493841 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-68eb653e-d904-4f0f-ac79-69f47c73a2d9 req-81ef32d6-e77b-42bb-aded-e33ef1aa29cc service nova] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Refreshing instance network info cache due to event network-changed-65d3853b-fb46-46b8-9c5f-fd6bc698c4b5. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:01:58.494788 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-68eb653e-d904-4f0f-ac79-69f47c73a2d9 req-81ef32d6-e77b-42bb-aded-e33ef1aa29cc service nova] Acquiring lock "refresh_cache-b4f2203e-ef29-4dcf-b665-236abd72e5f0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:01:58.536190 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:01:58.536725 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.835s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:58.538723 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.180s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:58.538723 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 53.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:01:58.669929 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:58.670149 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:01:58.670272 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] No VIF found with MAC fa:16:3e:db:0a:73, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:01:58.670899 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Using config drive
May 27 03:01:58.830052 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-33fbd929-a4c8-4224-9103-bfbabab02690 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 10.171s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:58.840626 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Releasing lock "refresh_cache-b4f2203e-ef29-4dcf-b665-236abd72e5f0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:01:58.840723 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Instance network_info: |[{"id": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "address": "fa:16:3e:54:22:d6", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d3853b-fb", "ovs_interfaceid": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:01:58.841888 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-68eb653e-d904-4f0f-ac79-69f47c73a2d9 req-81ef32d6-e77b-42bb-aded-e33ef1aa29cc service nova] Acquired lock "refresh_cache-b4f2203e-ef29-4dcf-b665-236abd72e5f0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:01:58.841888 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-68eb653e-d904-4f0f-ac79-69f47c73a2d9 req-81ef32d6-e77b-42bb-aded-e33ef1aa29cc service nova] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Refreshing network info cache for port 65d3853b-fb46-46b8-9c5f-fd6bc698c4b5 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:01:58.846023 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Start _get_guest_xml network_info=[{"id": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "address": "fa:16:3e:54:22:d6", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d3853b-fb", "ovs_interfaceid": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:01:58.858765 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:01:58.860248 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-529304459', uuid='b4f2203e-ef29-4dcf-b665-236abd72e5f0'), owner=OwnerMeta(userid='6dd385bbf9c3482aa593c41ce7795e8e', username='tempest-TestEncryptedCinderVolumes-727613157-project-member', projectid='51a54fd7b39b4a968af6ad453070ea4d', projectname='tempest-TestEncryptedCinderVolumes-727613157'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "address": "fa:16:3e:54:22:d6", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d3853b-fb", "ovs_interfaceid": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850918.8595486) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:01:58.861854 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:01:58.862205 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:01:58.863210 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:01:58.863668 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:01:58.864943 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:01:58.865979 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:01:58.865979 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:01:58.865979 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:01:58.865979 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:01:58.865979 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:01:58.866228 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:01:58.866228 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:01:58.866269 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:01:58.866365 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:01:58.866560 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:01:58.866688 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:01:58.882951 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-529304459',display_name='tempest-TestEncryptedCinderVolumes-server-529304459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testencryptedcindervolumes-server-529304459',id=28,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMN50IV4XxHmJNp+ZjLzy4dJLUIo1VSD7ZYF2UIL+uNbpa3T5R3pSUshf5JOEaqwp9kX0vEG9+Do7XY40yG5qEbdTWX7a7xkLHfN+CdUlR4OrgpjdbgfzOkd+JgIsqYhng==',key_name='tempest-keypair-1836151505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51a54fd7b39b4a968af6ad453070ea4d',ramdisk_id='',reservation_id='r-m064chkg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-727613157',owner_user_name='tempest-TestEncryptedCinderVolumes-727613157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6dd385bbf9c3482aa593c41ce7795e8e',uuid=b4f2203e-ef29-4dcf-b665-236abd72e5f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "address": "fa:16:3e:54:22:d6", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d3853b-fb", "ovs_interfaceid": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:01:58.883123 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Converting VIF {"id": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "address": "fa:16:3e:54:22:d6", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d3853b-fb", "ovs_interfaceid": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:58.884664 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=65d3853b-fb46-46b8-9c5f-fd6bc698c4b5,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d3853b-fb') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:58.884664 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lazy-loading 'pci_devices' on Instance uuid b4f2203e-ef29-4dcf-b665-236abd72e5f0 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:01:59.180870 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:59.352298 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Creating config drive at /opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/disk.config
May 27 03:01:59.355802 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjrjijprb {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:01:59.370765 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-68eb653e-d904-4f0f-ac79-69f47c73a2d9 req-81ef32d6-e77b-42bb-aded-e33ef1aa29cc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:59.393049 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] End _get_guest_xml xml=<domain type="qemu">
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:   <uuid>b4f2203e-ef29-4dcf-b665-236abd72e5f0</uuid>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:   <name>instance-0000001c</name>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-529304459</nova:name>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:01:58</nova:creationTime>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:         <nova:user uuid="6dd385bbf9c3482aa593c41ce7795e8e">tempest-TestEncryptedCinderVolumes-727613157-project-member</nova:user>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:         <nova:project uuid="51a54fd7b39b4a968af6ad453070ea4d">tempest-TestEncryptedCinderVolumes-727613157</nova:project>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:         <nova:port uuid="65d3853b-fb46-46b8-9c5f-fd6bc698c4b5">
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     <system>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <entry name="serial">b4f2203e-ef29-4dcf-b665-236abd72e5f0</entry>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <entry name="uuid">b4f2203e-ef29-4dcf-b665-236abd72e5f0</entry>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     </system>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:   <os>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:   </os>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:   <features>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:   </features>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:   <devices>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0/disk"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0/disk.config"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     </disk>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:54:22:d6"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <target dev="tap65d3853b-fb"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     </interface>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0/console.log" append="off"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     </serial>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     <video>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     </video>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     </rng>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:   </devices>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]: </domain>
May 27 03:01:59.393049 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:01:59.395691 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Preparing to wait for external event network-vif-plugged-65d3853b-fb46-46b8-9c5f-fd6bc698c4b5 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:01:59.395691 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:01:59.395691 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:01:59.395691 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:01:59.397043 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-529304459',display_name='tempest-TestEncryptedCinderVolumes-server-529304459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testencryptedcindervolumes-server-529304459',id=28,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMN50IV4XxHmJNp+ZjLzy4dJLUIo1VSD7ZYF2UIL+uNbpa3T5R3pSUshf5JOEaqwp9kX0vEG9+Do7XY40yG5qEbdTWX7a7xkLHfN+CdUlR4OrgpjdbgfzOkd+JgIsqYhng==',key_name='tempest-keypair-1836151505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51a54fd7b39b4a968af6ad453070ea4d',ramdisk_id='',reservation_id='r-m064chkg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-727613157',owner_user_name='tempest-TestEncryptedCinderVolumes-727613157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:01:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6dd385bbf9c3482aa593c41ce7795e8e',uuid=b4f2203e-ef29-4dcf-b665-236abd72e5f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "address": "fa:16:3e:54:22:d6", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d3853b-fb", "ovs_interfaceid": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:01:59.397310 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Converting VIF {"id": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "address": "fa:16:3e:54:22:d6", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d3853b-fb", "ovs_interfaceid": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:01:59.399677 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=65d3853b-fb46-46b8-9c5f-fd6bc698c4b5,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d3853b-fb') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:01:59.400055 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=65d3853b-fb46-46b8-9c5f-fd6bc698c4b5,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d3853b-fb') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:01:59.402306 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:59.403125 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:59.403658 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:01:59.415596 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:59.415596 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc8906bb-1957-5554-8905-e0d6de01a90b', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:59.417223 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:59.424440 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:59.426197 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjrjijprb" returned: 0 in 0.070s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:01:59.430226 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:59.430488 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65d3853b-fb, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:59.431187 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65d3853b-fb, col_values=(('qos', UUID('f5f4ca68-f234-4ba4-bfeb-508b6eaae1fa')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:59.431416 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65d3853b-fb, col_values=(('external_ids', {'iface-id': '65d3853b-fb46-46b8-9c5f-fd6bc698c4b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:22:d6', 'vm-uuid': 'b4f2203e-ef29-4dcf-b665-236abd72e5f0'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:01:59.438011 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:01:59.446008 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:01:59.448711 np0000001475 nova-compute[98471]: INFO os_vif [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=65d3853b-fb46-46b8-9c5f-fd6bc698c4b5,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d3853b-fb')
May 27 03:01:59.647270 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:01:59.647855 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:01:59.886264 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-68eb653e-d904-4f0f-ac79-69f47c73a2d9 req-81ef32d6-e77b-42bb-aded-e33ef1aa29cc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:01:59.974666 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:00.029365 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:00.149682 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:00.154391 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:02:00.168154 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-68eb653e-d904-4f0f-ac79-69f47c73a2d9 req-81ef32d6-e77b-42bb-aded-e33ef1aa29cc service nova] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Updated VIF entry in instance network info cache for port 65d3853b-fb46-46b8-9c5f-fd6bc698c4b5. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:02:00.172072 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-68eb653e-d904-4f0f-ac79-69f47c73a2d9 req-81ef32d6-e77b-42bb-aded-e33ef1aa29cc service nova] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Updating instance_info_cache with network_info: [{"id": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "address": "fa:16:3e:54:22:d6", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d3853b-fb", "ovs_interfaceid": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:00.268104 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:00.280102 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:00.367831 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-76238bda-a4ac-4a68-99e8-e5e9fd4f98ff req-2863b143-ac1e-4264-bf23-c25b74befd59 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received event network-vif-plugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:00.369307 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-76238bda-a4ac-4a68-99e8-e5e9fd4f98ff req-2863b143-ac1e-4264-bf23-c25b74befd59 service nova] Acquiring lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:00.369307 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-76238bda-a4ac-4a68-99e8-e5e9fd4f98ff req-2863b143-ac1e-4264-bf23-c25b74befd59 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:00.369307 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-76238bda-a4ac-4a68-99e8-e5e9fd4f98ff req-2863b143-ac1e-4264-bf23-c25b74befd59 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:00.369307 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-76238bda-a4ac-4a68-99e8-e5e9fd4f98ff req-2863b143-ac1e-4264-bf23-c25b74befd59 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Processing event network-vif-plugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:02:00.676633 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.138s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:00.681642 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.604s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:00.682751 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-68eb653e-d904-4f0f-ac79-69f47c73a2d9 req-81ef32d6-e77b-42bb-aded-e33ef1aa29cc service nova] Releasing lock "refresh_cache-b4f2203e-ef29-4dcf-b665-236abd72e5f0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:00.687176 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:02:00.689837 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Claim successful on node np0000001475
May 27 03:02:00.792893 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Deleted allocations for instance 6ad1223d-d197-46e7-a32b-a25380d409a8
May 27 03:02:00.821889 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:00.822822 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:00.973182 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:00.973549 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:00.973549 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No VIF found with MAC fa:16:3e:54:22:d6, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:02:00.974379 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Using config drive
May 27 03:02:00.994667 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:01.080461 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850921.0794773, ba8ef70d-8e27-48c8-82e3-6501f6130456 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:01.081404 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:02:01.081640 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] VM Started (Lifecycle Event)
May 27 03:02:01.087250 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:02:01.087250 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Instance spawned successfully.
May 27 03:02:01.087250 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:02:01.327153 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:02:01.485089 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:01.585582 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:01.595424 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:02:01.599924 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:01.601036 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:01.601477 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:01.602097 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:01.602320 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:01.602722 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:01.695834 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:01.696190 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:01.747831 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Creating config drive at /opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0/disk.config
May 27 03:02:01.754233 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgguv6akz {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:01.818254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bc5b0b52-f068-45a4-a62f-7946ca63c31a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "6ad1223d-d197-46e7-a32b-a25380d409a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.796s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:01.834660 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgguv6akz" returned: 0 in 0.080s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:01.924448 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:02.102750 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:02:02.103327 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850922.1029747, ba8ef70d-8e27-48c8-82e3-6501f6130456 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:02.103486 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] VM Paused (Lifecycle Event)
May 27 03:02:02.114419 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Took 9.16 seconds to spawn the instance on the hypervisor.
May 27 03:02:02.117571 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:02.209248 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:02:02.478951 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:02.521816 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:02.527799 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:02.611315 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:02.620765 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850922.6195924, ba8ef70d-8e27-48c8-82e3-6501f6130456 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:02.620765 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] VM Resumed (Lifecycle Event)
May 27 03:02:02.646268 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Took 21.13 seconds to build instance.
May 27 03:02:02.662733 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a9c4602f-bd2c-4f33-ac97-134aea9a3910 req-e1dddbbf-18d0-4e42-8248-8dfe65d4ca99 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received event network-vif-plugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:02.662733 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a9c4602f-bd2c-4f33-ac97-134aea9a3910 req-e1dddbbf-18d0-4e42-8248-8dfe65d4ca99 service nova] Acquiring lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:02.664845 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a9c4602f-bd2c-4f33-ac97-134aea9a3910 req-e1dddbbf-18d0-4e42-8248-8dfe65d4ca99 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:02.664845 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a9c4602f-bd2c-4f33-ac97-134aea9a3910 req-e1dddbbf-18d0-4e42-8248-8dfe65d4ca99 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:02.664845 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a9c4602f-bd2c-4f33-ac97-134aea9a3910 req-e1dddbbf-18d0-4e42-8248-8dfe65d4ca99 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] No waiting events found dispatching network-vif-plugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:02.665735 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-a9c4602f-bd2c-4f33-ac97-134aea9a3910 req-e1dddbbf-18d0-4e42-8248-8dfe65d4ca99 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received unexpected event network-vif-plugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 for instance with vm_state active and task_state None.
May 27 03:02:02.705844 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:02.871778 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:03.016881 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d843c7f6-afd0-49a0-a30e-e3c0f52d043d req-d19f850b-062d-4c4a-b389-27dc5a1ba38e service nova] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Received event network-vif-plugged-65d3853b-fb46-46b8-9c5f-fd6bc698c4b5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:03.018837 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d843c7f6-afd0-49a0-a30e-e3c0f52d043d req-d19f850b-062d-4c4a-b389-27dc5a1ba38e service nova] Acquiring lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:03.018837 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d843c7f6-afd0-49a0-a30e-e3c0f52d043d req-d19f850b-062d-4c4a-b389-27dc5a1ba38e service nova] Lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:03.018837 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d843c7f6-afd0-49a0-a30e-e3c0f52d043d req-d19f850b-062d-4c4a-b389-27dc5a1ba38e service nova] Lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:03.018837 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d843c7f6-afd0-49a0-a30e-e3c0f52d043d req-d19f850b-062d-4c4a-b389-27dc5a1ba38e service nova] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Processing event network-vif-plugged-65d3853b-fb46-46b8-9c5f-fd6bc698c4b5 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:02:03.097404 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:03.103888 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:03.114107 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:03.130204 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:03.139786 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:02:03.147462 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:03.152124 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f211b465-4680-43c0-9625-98ddf30667b8 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.666s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:03.154391 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:03.164497 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:02:03.164651 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:02:03.674060 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:02:03.795775 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:02:03.796516 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850923.7960534, b4f2203e-ef29-4dcf-b665-236abd72e5f0 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:03.796516 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] VM Started (Lifecycle Event)
May 27 03:02:03.800207 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:02:03.805756 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Instance spawned successfully.
May 27 03:02:03.807529 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:02:04.182214 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.506s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:04.183849 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 6.898s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:04.183849 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:02:04.217861 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Rescuing
May 27 03:02:04.218035 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "refresh_cache-ba8ef70d-8e27-48c8-82e3-6501f6130456" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:04.218200 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquired lock "refresh_cache-ba8ef70d-8e27-48c8-82e3-6501f6130456" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:04.218356 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:02:04.299328 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:04.300960 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:02:04.318128 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:04.320052 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:04.320475 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:04.320782 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:04.321643 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:04.322043 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:04.436063 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:04.691135 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:02:04.692514 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:02:04.692931 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:04.693290 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:04.722962 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:04.803695 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:02:04.804036 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850924.8037872, b4f2203e-ef29-4dcf-b665-236abd72e5f0 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:04.804204 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] VM Paused (Lifecycle Event)
May 27 03:02:04.820245 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c7a2b8282d64da1b36834b8f66c35da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6178da77914825aa17d655664bb17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:02:04.829107 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Took 7.56 seconds to spawn the instance on the hypervisor.
May 27 03:02:04.829268 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:05.192478 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:02:05.312981 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:05.319610 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850925.3192332, b4f2203e-ef29-4dcf-b665-236abd72e5f0 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:05.321940 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] VM Resumed (Lifecycle Event)
May 27 03:02:05.327783 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:05.352531 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Took 14.08 seconds to build instance.
May 27 03:02:05.501889 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0305a555-8bba-4e47-93b8-b9f8ad0cb78f req-c52e7045-4d71-4fa1-9cae-f5342a6e8b9d service nova] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Received event network-vif-plugged-65d3853b-fb46-46b8-9c5f-fd6bc698c4b5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:05.501889 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0305a555-8bba-4e47-93b8-b9f8ad0cb78f req-c52e7045-4d71-4fa1-9cae-f5342a6e8b9d service nova] Acquiring lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:05.501889 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0305a555-8bba-4e47-93b8-b9f8ad0cb78f req-c52e7045-4d71-4fa1-9cae-f5342a6e8b9d service nova] Lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:05.501889 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0305a555-8bba-4e47-93b8-b9f8ad0cb78f req-c52e7045-4d71-4fa1-9cae-f5342a6e8b9d service nova] Lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:05.501889 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0305a555-8bba-4e47-93b8-b9f8ad0cb78f req-c52e7045-4d71-4fa1-9cae-f5342a6e8b9d service nova] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] No waiting events found dispatching network-vif-plugged-65d3853b-fb46-46b8-9c5f-fd6bc698c4b5 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:05.501889 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-0305a555-8bba-4e47-93b8-b9f8ad0cb78f req-c52e7045-4d71-4fa1-9cae-f5342a6e8b9d service nova] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Received unexpected event network-vif-plugged-65d3853b-fb46-46b8-9c5f-fd6bc698c4b5 for instance with vm_state active and task_state None.
May 27 03:02:05.598849 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:02:05.599128 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:02:05.612848 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Updating instance_info_cache with network_info: [{"id": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "address": "fa:16:3e:db:0a:73", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea6a715-c6", "ovs_interfaceid": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:05.637643 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Successfully created port: ff79f3be-9f53-46ab-9234-6a59d48bf529 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:02:05.711824 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:02:05.824666 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:05.827843 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:02:05.857913 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.634s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:05.998190 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:06.102781 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:02:06.116825 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Releasing lock "refresh_cache-ba8ef70d-8e27-48c8-82e3-6501f6130456" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:06.348474 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Successfully updated port: ff79f3be-9f53-46ab-9234-6a59d48bf529 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:02:06.349113 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "fcb1a3e2-e470-4773-a370-f122a79de2e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:06.349726 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:06.419050 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a8053a66-7eaa-41d7-8695-fac50054715f req-48e7dc5c-8534-405d-b258-5166638085ae service nova] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Received event network-changed-ff79f3be-9f53-46ab-9234-6a59d48bf529 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:06.419050 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a8053a66-7eaa-41d7-8695-fac50054715f req-48e7dc5c-8534-405d-b258-5166638085ae service nova] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Refreshing instance network info cache due to event network-changed-ff79f3be-9f53-46ab-9234-6a59d48bf529. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:02:06.419050 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a8053a66-7eaa-41d7-8695-fac50054715f req-48e7dc5c-8534-405d-b258-5166638085ae service nova] Acquiring lock "refresh_cache-735ab00a-a335-49f6-9b03-3dec824f8fbb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:06.420021 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a8053a66-7eaa-41d7-8695-fac50054715f req-48e7dc5c-8534-405d-b258-5166638085ae service nova] Acquired lock "refresh_cache-735ab00a-a335-49f6-9b03-3dec824f8fbb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:06.420230 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a8053a66-7eaa-41d7-8695-fac50054715f req-48e7dc5c-8534-405d-b258-5166638085ae service nova] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Refreshing network info cache for port ff79f3be-9f53-46ab-9234-6a59d48bf529 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:02:06.616156 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.434s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:06.617546 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.695s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:06.625768 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:02:06.626352 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Claim successful on node np0000001475
May 27 03:02:06.726810 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:02:06.726995 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:02:06.727377 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Creating image(s)
May 27 03:02:06.728549 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquiring lock "/opt/stack/data/nova/instances/735ab00a-a335-49f6-9b03-3dec824f8fbb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:06.728778 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "/opt/stack/data/nova/instances/735ab00a-a335-49f6-9b03-3dec824f8fbb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:06.731985 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Deleted allocations for instance 156e620a-485d-4135-8c52-aab777dd8480
May 27 03:02:06.734668 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "/opt/stack/data/nova/instances/735ab00a-a335-49f6-9b03-3dec824f8fbb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:06.738061 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:06.753499 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:06.757794 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:06.852809 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquiring lock "refresh_cache-735ab00a-a335-49f6-9b03-3dec824f8fbb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:06.858570 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:02:06.897419 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.141s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:06.898070 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:06.898926 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:06.899465 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:06.904773 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:06.904773 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:06.926457 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-a8053a66-7eaa-41d7-8695-fac50054715f req-48e7dc5c-8534-405d-b258-5166638085ae service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:07.036111 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a8053a66-7eaa-41d7-8695-fac50054715f req-48e7dc5c-8534-405d-b258-5166638085ae service nova] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:02:07.039016 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.134s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:07.039513 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/735ab00a-a335-49f6-9b03-3dec824f8fbb/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:07.111561 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/735ab00a-a335-49f6-9b03-3dec824f8fbb/disk 1073741824" returned: 0 in 0.071s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:07.112819 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:07.112998 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:07.230079 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.116s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:07.230079 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Checking if we can resize image /opt/stack/data/nova/instances/735ab00a-a335-49f6-9b03-3dec824f8fbb/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:02:07.230079 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/735ab00a-a335-49f6-9b03-3dec824f8fbb/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:07.305231 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a8053a66-7eaa-41d7-8695-fac50054715f req-48e7dc5c-8534-405d-b258-5166638085ae service nova] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:07.352144 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/735ab00a-a335-49f6-9b03-3dec824f8fbb/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:07.352144 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Cannot resize image /opt/stack/data/nova/instances/735ab00a-a335-49f6-9b03-3dec824f8fbb/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:02:07.353289 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:02:07.353289 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Ensure instance console log exists: /opt/stack/data/nova/instances/735ab00a-a335-49f6-9b03-3dec824f8fbb/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:02:07.353289 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:07.353408 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:07.353909 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:07.445505 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:07.595770 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0a85670d-b9ef-4a14-a1f4-5c2e4026959c req-0a6ea951-bd63-4eff-b901-00a587d4a843 service nova] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Received event network-changed-65d3853b-fb46-46b8-9c5f-fd6bc698c4b5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:07.596628 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0a85670d-b9ef-4a14-a1f4-5c2e4026959c req-0a6ea951-bd63-4eff-b901-00a587d4a843 service nova] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Refreshing instance network info cache due to event network-changed-65d3853b-fb46-46b8-9c5f-fd6bc698c4b5. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:02:07.597032 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0a85670d-b9ef-4a14-a1f4-5c2e4026959c req-0a6ea951-bd63-4eff-b901-00a587d4a843 service nova] Acquiring lock "refresh_cache-b4f2203e-ef29-4dcf-b665-236abd72e5f0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:07.597192 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0a85670d-b9ef-4a14-a1f4-5c2e4026959c req-0a6ea951-bd63-4eff-b901-00a587d4a843 service nova] Acquired lock "refresh_cache-b4f2203e-ef29-4dcf-b665-236abd72e5f0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:07.597364 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-0a85670d-b9ef-4a14-a1f4-5c2e4026959c req-0a6ea951-bd63-4eff-b901-00a587d4a843 service nova] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Refreshing network info cache for port 65d3853b-fb46-46b8-9c5f-fd6bc698c4b5 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:02:07.765545 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bd3b6d35-1677-42b5-ad1b-22784a9f1111 tempest-VolumesActionsTest-2104767204 tempest-VolumesActionsTest-2104767204-project-member] Lock "156e620a-485d-4135-8c52-aab777dd8480" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.491s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:07.805975 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:07.809084 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:07.813606 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a8053a66-7eaa-41d7-8695-fac50054715f req-48e7dc5c-8534-405d-b258-5166638085ae service nova] Releasing lock "refresh_cache-735ab00a-a335-49f6-9b03-3dec824f8fbb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:07.816361 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquired lock "refresh_cache-735ab00a-a335-49f6-9b03-3dec824f8fbb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:07.816644 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:02:07.843299 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:08.075170 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:08.084985 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:08.102675 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-0a85670d-b9ef-4a14-a1f4-5c2e4026959c req-0a6ea951-bd63-4eff-b901-00a587d4a843 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:08.154443 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.998962590000247 future=<Future at 0x7557247da330 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:08.155349 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Instance destroyed successfully.
May 27 03:02:08.157212 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'numa_topology' on Instance uuid ba8ef70d-8e27-48c8-82e3-6501f6130456 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:08.449373 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:02:08.527834 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-286cc581-37e6-4609-ad17-978a1e0a7db9 req-132c7607-e91b-4799-b13a-2dfe1630c796 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received event network-vif-unplugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:08.527834 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-286cc581-37e6-4609-ad17-978a1e0a7db9 req-132c7607-e91b-4799-b13a-2dfe1630c796 service nova] Acquiring lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:08.527834 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-286cc581-37e6-4609-ad17-978a1e0a7db9 req-132c7607-e91b-4799-b13a-2dfe1630c796 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:08.527834 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-286cc581-37e6-4609-ad17-978a1e0a7db9 req-132c7607-e91b-4799-b13a-2dfe1630c796 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:08.527834 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-286cc581-37e6-4609-ad17-978a1e0a7db9 req-132c7607-e91b-4799-b13a-2dfe1630c796 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] No waiting events found dispatching network-vif-unplugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:08.527834 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-286cc581-37e6-4609-ad17-978a1e0a7db9 req-132c7607-e91b-4799-b13a-2dfe1630c796 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received unexpected event network-vif-unplugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 for instance with vm_state active and task_state rescuing.
May 27 03:02:08.527834 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-286cc581-37e6-4609-ad17-978a1e0a7db9 req-132c7607-e91b-4799-b13a-2dfe1630c796 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received event network-vif-unplugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:08.529002 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-286cc581-37e6-4609-ad17-978a1e0a7db9 req-132c7607-e91b-4799-b13a-2dfe1630c796 service nova] Acquiring lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:08.529754 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-286cc581-37e6-4609-ad17-978a1e0a7db9 req-132c7607-e91b-4799-b13a-2dfe1630c796 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:08.530002 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-286cc581-37e6-4609-ad17-978a1e0a7db9 req-132c7607-e91b-4799-b13a-2dfe1630c796 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:08.530419 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-286cc581-37e6-4609-ad17-978a1e0a7db9 req-132c7607-e91b-4799-b13a-2dfe1630c796 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] No waiting events found dispatching network-vif-unplugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:08.530930 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-286cc581-37e6-4609-ad17-978a1e0a7db9 req-132c7607-e91b-4799-b13a-2dfe1630c796 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received unexpected event network-vif-unplugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 for instance with vm_state active and task_state rescuing.
May 27 03:02:08.671012 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Attempting a stable device rescue
May 27 03:02:08.726157 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-0a85670d-b9ef-4a14-a1f4-5c2e4026959c req-0a6ea951-bd63-4eff-b901-00a587d4a843 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:08.838800 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:08.910071 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98471) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 27 03:02:08.920395 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Instance directory exists: not creating {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 03:02:08.920584 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Creating image(s)
May 27 03:02:08.921457 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:08.921457 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "/opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:08.922343 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "/opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:08.923468 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'trusted_certs' on Instance uuid ba8ef70d-8e27-48c8-82e3-6501f6130456 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:09.041455 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-0a85670d-b9ef-4a14-a1f4-5c2e4026959c req-0a6ea951-bd63-4eff-b901-00a587d4a843 service nova] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Updated VIF entry in instance network info cache for port 65d3853b-fb46-46b8-9c5f-fd6bc698c4b5. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:02:09.041455 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-0a85670d-b9ef-4a14-a1f4-5c2e4026959c req-0a6ea951-bd63-4eff-b901-00a587d4a843 service nova] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Updating instance_info_cache with network_info: [{"id": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "address": "fa:16:3e:54:22:d6", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d3853b-fb", "ovs_interfaceid": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:09.130985 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Updating instance_info_cache with network_info: [{"id": "ff79f3be-9f53-46ab-9234-6a59d48bf529", "address": "fa:16:3e:b2:e2:8e", "network": {"id": "d2dd987b-3f51-49db-b3eb-a4ce0900727c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1326496062-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df6178da77914825aa17d655664bb17c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff79f3be-9f", "ovs_interfaceid": "ff79f3be-9f53-46ab-9234-6a59d48bf529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:09.185026 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:02:09.185366 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:02:09.426019 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Object Instance<ba8ef70d-8e27-48c8-82e3-6501f6130456> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:02:09.426419 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "feadacbea1a39ee1e8635d7b522303920c6fdba2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:09.427216 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "feadacbea1a39ee1e8635d7b522303920c6fdba2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:09.438287 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:09.544157 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0a85670d-b9ef-4a14-a1f4-5c2e4026959c req-0a6ea951-bd63-4eff-b901-00a587d4a843 service nova] Releasing lock "refresh_cache-b4f2203e-ef29-4dcf-b665-236abd72e5f0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:09.632927 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Releasing lock "refresh_cache-735ab00a-a335-49f6-9b03-3dec824f8fbb" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:09.633351 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Instance network_info: |[{"id": "ff79f3be-9f53-46ab-9234-6a59d48bf529", "address": "fa:16:3e:b2:e2:8e", "network": {"id": "d2dd987b-3f51-49db-b3eb-a4ce0900727c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1326496062-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df6178da77914825aa17d655664bb17c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff79f3be-9f", "ovs_interfaceid": "ff79f3be-9f53-46ab-9234-6a59d48bf529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:02:09.636938 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Start _get_guest_xml network_info=[{"id": "ff79f3be-9f53-46ab-9234-6a59d48bf529", "address": "fa:16:3e:b2:e2:8e", "network": {"id": "d2dd987b-3f51-49db-b3eb-a4ce0900727c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1326496062-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df6178da77914825aa17d655664bb17c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff79f3be-9f", "ovs_interfaceid": "ff79f3be-9f53-46ab-9234-6a59d48bf529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:02:09.641145 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:02:09.642461 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-1164922176', uuid='735ab00a-a335-49f6-9b03-3dec824f8fbb'), owner=OwnerMeta(userid='9c7a2b8282d64da1b36834b8f66c35da', username='tempest-ServersNegativeTestJSON-1895958758-project-member', projectid='df6178da77914825aa17d655664bb17c', projectname='tempest-ServersNegativeTestJSON-1895958758'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ff79f3be-9f53-46ab-9234-6a59d48bf529", "address": "fa:16:3e:b2:e2:8e", "network": {"id": "d2dd987b-3f51-49db-b3eb-a4ce0900727c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1326496062-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df6178da77914825aa17d655664bb17c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff79f3be-9f", "ovs_interfaceid": "ff79f3be-9f53-46ab-9234-6a59d48bf529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850929.6420538) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:02:09.646045 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:02:09.646936 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:02:09.648713 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:02:09.649087 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:02:09.651646 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:02:09.652535 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:02:09.655287 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:02:09.655287 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:02:09.655475 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:02:09.655697 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:02:09.655873 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:02:09.656122 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:02:09.656277 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:02:09.656449 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:02:09.656699 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:02:09.656873 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:02:09.678888 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1164922176',display_name='tempest-ServersNegativeTestJSON-server-1164922176',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serversnegativetestjson-server-1164922176',id=29,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df6178da77914825aa17d655664bb17c',ramdisk_id='',reservation_id='r-3n0af4m6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1895958758',owner_user_name='tempest-ServersNegativeTestJSON-1895958758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:02:06Z,user_data=None,user_id='9c7a2b8282d64da1b36834b8f66c35da',uuid=735ab00a-a335-49f6-9b03-3dec824f8fbb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff79f3be-9f53-46ab-9234-6a59d48bf529", "address": "fa:16:3e:b2:e2:8e", "network": {"id": "d2dd987b-3f51-49db-b3eb-a4ce0900727c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1326496062-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df6178da77914825aa17d655664bb17c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff79f3be-9f", "ovs_interfaceid": "ff79f3be-9f53-46ab-9234-6a59d48bf529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:02:09.679128 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Converting VIF {"id": "ff79f3be-9f53-46ab-9234-6a59d48bf529", "address": "fa:16:3e:b2:e2:8e", "network": {"id": "d2dd987b-3f51-49db-b3eb-a4ce0900727c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1326496062-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df6178da77914825aa17d655664bb17c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff79f3be-9f", "ovs_interfaceid": "ff79f3be-9f53-46ab-9234-6a59d48bf529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:02:09.680254 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e2:8e,bridge_name='br-int',has_traffic_filtering=True,id=ff79f3be-9f53-46ab-9234-6a59d48bf529,network=Network(d2dd987b-3f51-49db-b3eb-a4ce0900727c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff79f3be-9f') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:02:09.680464 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lazy-loading 'pci_devices' on Instance uuid 735ab00a-a335-49f6-9b03-3dec824f8fbb {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:09.689115 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:02:10.126041 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:10.129378 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:10.129737 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/feadacbea1a39ee1e8635d7b522303920c6fdba2.part --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:10.185433 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] End _get_guest_xml xml=<domain type="qemu">
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:   <uuid>735ab00a-a335-49f6-9b03-3dec824f8fbb</uuid>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:   <name>instance-0000001d</name>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServersNegativeTestJSON-server-1164922176</nova:name>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:02:09</nova:creationTime>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:         <nova:user uuid="9c7a2b8282d64da1b36834b8f66c35da">tempest-ServersNegativeTestJSON-1895958758-project-member</nova:user>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:         <nova:project uuid="df6178da77914825aa17d655664bb17c">tempest-ServersNegativeTestJSON-1895958758</nova:project>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:         <nova:port uuid="ff79f3be-9f53-46ab-9234-6a59d48bf529">
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     <system>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <entry name="serial">735ab00a-a335-49f6-9b03-3dec824f8fbb</entry>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <entry name="uuid">735ab00a-a335-49f6-9b03-3dec824f8fbb</entry>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     </system>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:   <os>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:   </os>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:   <features>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:   </features>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:   <devices>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/735ab00a-a335-49f6-9b03-3dec824f8fbb/disk"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     </disk>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/735ab00a-a335-49f6-9b03-3dec824f8fbb/disk.config"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     </disk>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:b2:e2:8e"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <target dev="tapff79f3be-9f"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     </interface>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/735ab00a-a335-49f6-9b03-3dec824f8fbb/console.log" append="off"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     </serial>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     <video>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     </video>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     </rng>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:   </devices>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]: </domain>
May 27 03:02:10.185433 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:02:10.188338 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Preparing to wait for external event network-vif-plugged-ff79f3be-9f53-46ab-9234-6a59d48bf529 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:02:10.188338 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquiring lock "735ab00a-a335-49f6-9b03-3dec824f8fbb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:10.188338 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "735ab00a-a335-49f6-9b03-3dec824f8fbb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:10.188338 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "735ab00a-a335-49f6-9b03-3dec824f8fbb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:10.188338 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1164922176',display_name='tempest-ServersNegativeTestJSON-server-1164922176',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serversnegativetestjson-server-1164922176',id=29,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df6178da77914825aa17d655664bb17c',ramdisk_id='',reservation_id='r-3n0af4m6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1895958758',owner_user_name='tempest-ServersNegativeTestJSON-1895958758-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:02:06Z,user_data=None,user_id='9c7a2b8282d64da1b36834b8f66c35da',uuid=735ab00a-a335-49f6-9b03-3dec824f8fbb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff79f3be-9f53-46ab-9234-6a59d48bf529", "address": "fa:16:3e:b2:e2:8e", "network": {"id": "d2dd987b-3f51-49db-b3eb-a4ce0900727c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1326496062-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df6178da77914825aa17d655664bb17c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff79f3be-9f", "ovs_interfaceid": "ff79f3be-9f53-46ab-9234-6a59d48bf529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:02:10.188941 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Converting VIF {"id": "ff79f3be-9f53-46ab-9234-6a59d48bf529", "address": "fa:16:3e:b2:e2:8e", "network": {"id": "d2dd987b-3f51-49db-b3eb-a4ce0900727c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1326496062-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df6178da77914825aa17d655664bb17c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff79f3be-9f", "ovs_interfaceid": "ff79f3be-9f53-46ab-9234-6a59d48bf529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:02:10.189913 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e2:8e,bridge_name='br-int',has_traffic_filtering=True,id=ff79f3be-9f53-46ab-9234-6a59d48bf529,network=Network(d2dd987b-3f51-49db-b3eb-a4ce0900727c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff79f3be-9f') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:02:10.190303 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e2:8e,bridge_name='br-int',has_traffic_filtering=True,id=ff79f3be-9f53-46ab-9234-6a59d48bf529,network=Network(d2dd987b-3f51-49db-b3eb-a4ce0900727c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff79f3be-9f') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:02:10.191431 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:10.191431 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:10.191431 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:02:10.193221 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:10.197761 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 7.334s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:10.198183 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '012a0566-68f9-5289-8094-292f1c9c14f2', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:10.201420 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.580s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:10.201820 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:02:10.205522 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:10.206795 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:10.209280 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:02:10.209491 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Claim successful on node np0000001475
May 27 03:02:10.214708 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:10.218337 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:10.218337 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff79f3be-9f, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:10.218337 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff79f3be-9f, col_values=(('qos', UUID('fcc3070a-a531-47c1-9770-e4742ff911a4')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:10.218337 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff79f3be-9f, col_values=(('external_ids', {'iface-id': 'ff79f3be-9f53-46ab-9234-6a59d48bf529', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:e2:8e', 'vm-uuid': '735ab00a-a335-49f6-9b03-3dec824f8fbb'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:10.220758 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:10.220758 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:10.234007 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/feadacbea1a39ee1e8635d7b522303920c6fdba2.part --force-share --output=json" returned: 0 in 0.104s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:10.234315 np0000001475 nova-compute[98471]: DEBUG nova.virt.images [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] 20c17e06-2633-4eea-9ad5-06a20ddb89e0 was qcow2, converting to raw {{(pid=98471) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 03:02:10.234826 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:10.236164 np0000001475 nova-compute[98471]: DEBUG nova.privsep.utils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98471) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 03:02:10.237368 np0000001475 nova-compute[98471]: INFO os_vif [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e2:8e,bridge_name='br-int',has_traffic_filtering=True,id=ff79f3be-9f53-46ab-9234-6a59d48bf529,network=Network(d2dd987b-3f51-49db-b3eb-a4ce0900727c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff79f3be-9f')
May 27 03:02:10.238668 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/feadacbea1a39ee1e8635d7b522303920c6fdba2.part /opt/stack/data/nova/instances/_base/feadacbea1a39ee1e8635d7b522303920c6fdba2.converted {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:10.356388 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/feadacbea1a39ee1e8635d7b522303920c6fdba2.part /opt/stack/data/nova/instances/_base/feadacbea1a39ee1e8635d7b522303920c6fdba2.converted" returned: 0 in 0.119s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:10.362189 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/feadacbea1a39ee1e8635d7b522303920c6fdba2.converted --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:10.463463 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/feadacbea1a39ee1e8635d7b522303920c6fdba2.converted --force-share --output=json" returned: 0 in 0.101s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:10.464218 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "feadacbea1a39ee1e8635d7b522303920c6fdba2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.037s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:10.464797 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:10.468523 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:10.469695 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "feadacbea1a39ee1e8635d7b522303920c6fdba2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:10.470246 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "feadacbea1a39ee1e8635d7b522303920c6fdba2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:10.470607 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:10.473543 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:10.473919 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/feadacbea1a39ee1e8635d7b522303920c6fdba2 --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:10.572114 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/feadacbea1a39ee1e8635d7b522303920c6fdba2 --force-share --output=json" returned: 0 in 0.098s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:10.572689 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/feadacbea1a39ee1e8635d7b522303920c6fdba2,backing_fmt=raw /opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/disk.rescue {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:10.633315 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/feadacbea1a39ee1e8635d7b522303920c6fdba2,backing_fmt=raw /opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/disk.rescue" returned: 0 in 0.060s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:10.634209 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "feadacbea1a39ee1e8635d7b522303920c6fdba2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.164s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:10.634819 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'migration_context' on Instance uuid ba8ef70d-8e27-48c8-82e3-6501f6130456 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:10.718104 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:02:10.718104 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:02:10.720302 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:10.720302 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:10.789184 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0005750210000314837 future=<Future at 0x7557343f8b30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:10.789891 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Emitting event <LifecycleEvent: 1779850915.788496, 6ad1223d-d197-46e7-a32b-a25380d409a8 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:10.790051 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:10.790328 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=1.0124859069999275 future=<Future at 0x7557046416a0 state=cancelled>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:10.790400 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=1.0123528510000597 future=<Future at 0x7557046416a0 state=cancelled>) was cancelled while queued, skipping {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:10.790450 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:10.790567 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=1.0125065650001943 future=<Future at 0x75573658a180 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:10.790652 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=1.012401150000187 future=<Future at 0x75573658a180 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:10.792028 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] VM Stopped (Lifecycle Event)
May 27 03:02:10.833864 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '092604511a8a467ba4ecb56261cb531f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c48d6919e8435f876f3324616521ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:02:11.002133 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:11.138443 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Object Instance<ba8ef70d-8e27-48c8-82e3-6501f6130456> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:02:11.138760 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:02:11.139528 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Start _get_guest_xml network_info=[{"id": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "address": "fa:16:3e:db:0a:73", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "vif_mac": "fa:16:3e:db:0a:73"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea6a715-c6", "ovs_interfaceid": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '20c17e06-2633-4eea-9ad5-06a20ddb89e0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, 'status': 'reserved', 'instance': 'ba8ef70d-8e27-48c8-82e3-6501f6130456', 'attached_at': '', 'detached_at': '', 'volume_id': '326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'serial': '326c1eec-4d4e-42f9-94d2-07c2e4e72085'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '30519169-e449-4d79-86b4-57eb9e67a48e', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:02:11.139838 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'resources' on Instance uuid ba8ef70d-8e27-48c8-82e3-6501f6130456 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:11.220771 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:02:11.297025 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: 6ad1223d-d197-46e7-a32b-a25380d409a8] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:11.457912 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Successfully created port: a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:02:11.642164 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Object Instance<ba8ef70d-8e27-48c8-82e3-6501f6130456> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:02:11.647150 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:02:11.648551 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-334835239', uuid='ba8ef70d-8e27-48c8-82e3-6501f6130456'), owner=OwnerMeta(userid='787c8d4d4527402cbbc2ad0475f710bb', username='tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member', projectid='ab70ea24752242a88583e819c6c34e12', projectname='tempest-ServerBootFromVolumeStableRescueTest-1976367979'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "address": "fa:16:3e:db:0a:73", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "vif_mac": "fa:16:3e:db:0a:73"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea6a715-c6", "ovs_interfaceid": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850931.648141) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:02:11.650018 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:02:11.650477 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:02:11.651885 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:02:11.652122 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:02:11.653753 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:02:11.654190 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:02:11.654389 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:02:11.654537 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:02:11.655370 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:02:11.655655 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:02:11.655843 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:02:11.656085 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:02:11.656240 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:02:11.657173 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:02:11.657173 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:02:11.657173 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:02:11.657173 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'vcpu_model' on Instance uuid ba8ef70d-8e27-48c8-82e3-6501f6130456 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:11.730606 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:02:11.796823 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:11.797376 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:11.797527 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] No VIF found with MAC fa:16:3e:b2:e2:8e, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:02:11.798502 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Using config drive
May 27 03:02:11.804254 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0004205719999390567 future=<Future at 0x75573658a180 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:11.805768 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] Emitting event <LifecycleEvent: 1779850916.8030198, 156e620a-485d-4135-8c52-aab777dd8480 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:11.806145 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:11.806508 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] [instance: 156e620a-485d-4135-8c52-aab777dd8480] VM Stopped (Lifecycle Event)
May 27 03:02:11.809966 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=11.345157022000194 future=<Future at 0x7557247da330 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:11.810292 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=11.342633520000163 future=<Future at 0x7557247da330 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:12.146256 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Successfully updated port: a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:02:12.161914 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Object Instance<ba8ef70d-8e27-48c8-82e3-6501f6130456> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:02:12.186359 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/disk.config --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:12.222776 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0b77ec30-1d23-4381-9129-b6920e9e87ad req-00abdf42-2b6d-4873-ac02-2fbd876ab648 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received event network-changed-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:12.222776 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0b77ec30-1d23-4381-9129-b6920e9e87ad req-00abdf42-2b6d-4873-ac02-2fbd876ab648 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Refreshing instance network info cache due to event network-changed-a2498912-5a39-4f70-a141-dae495d11b2a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:02:12.224085 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0b77ec30-1d23-4381-9129-b6920e9e87ad req-00abdf42-2b6d-4873-ac02-2fbd876ab648 service nova] Acquiring lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:12.226761 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0b77ec30-1d23-4381-9129-b6920e9e87ad req-00abdf42-2b6d-4873-ac02-2fbd876ab648 service nova] Acquired lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:12.227831 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-0b77ec30-1d23-4381-9129-b6920e9e87ad req-00abdf42-2b6d-4873-ac02-2fbd876ab648 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Refreshing network info cache for port a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:02:12.288714 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:02:12.289239 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:02:12.298390 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/disk.config --force-share --output=json" returned: 0 in 0.112s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:12.299297 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:12.299966 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "/opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:12.304624 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:12.307265 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "/opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:12.308161 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:02:12.309477 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:02:12.310396 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:02:12.313562 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] [instance: 156e620a-485d-4135-8c52-aab777dd8480] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:12.456322 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Creating config drive at /opt/stack/data/nova/instances/735ab00a-a335-49f6-9b03-3dec824f8fbb/disk.config
May 27 03:02:12.460939 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/735ab00a-a335-49f6-9b03-3dec824f8fbb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphw0baa42 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:12.529556 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/735ab00a-a335-49f6-9b03-3dec824f8fbb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphw0baa42" returned: 0 in 0.068s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:12.607653 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.297s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:02:12.607983 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:02:12.623860 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:02:12.625790 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:02:12.626548 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:02:12.626963 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:02:12.627172 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:02:12.627321 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.startup = automatic
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.scan = manual
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:02:12.643818 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:02:12.643818 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:12.651814 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.startup = automatic
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.scan = manual
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:02:12.654760 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:02:12.654760 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:12.667196 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:12.680358 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:12.702774 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:12.702774 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.075s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:02:12.702774 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:02:12.703535 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] HCTL ('11', '0', '0', 0) found on session 51 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:02:12.703535 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:12.704805 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:12.704805 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.077s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:02:12.704805 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:02:12.709395 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] HCTL ('12', '0', '0', 0) found on session 52 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:02:12.709395 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:02:12.719651 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Searching for a device in session 51 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:02:12.719651 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:02:12.722964 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Searching for a device in session 52 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:02:12.723190 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:02:12.735026 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-0b77ec30-1d23-4381-9129-b6920e9e87ad req-00abdf42-2b6d-4873-ac02-2fbd876ab648 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:12.751763 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:02:12.756428 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:02:12.756817 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Creating image(s)
May 27 03:02:12.758072 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:12.758072 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "/opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:12.763169 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "/opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:12.763882 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:12.769506 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:12.773819 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:12.805814 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:02:12.862713 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-0b77ec30-1d23-4381-9129-b6920e9e87ad req-00abdf42-2b6d-4873-ac02-2fbd876ab648 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:02:12.865779 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.095s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:12.869774 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:12.869774 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:12.869774 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:12.872152 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:12.873156 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:12.988233 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.115s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:12.990800 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:13.052727 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk 1073741824" returned: 0 in 0.064s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:13.056811 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:13.056811 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:13.110062 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-0b77ec30-1d23-4381-9129-b6920e9e87ad req-00abdf42-2b6d-4873-ac02-2fbd876ab648 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:13.117987 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:13.146463 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.092s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:13.150145 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:02:13.150145 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:13.164733 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:13.242710 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:13.243160 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Cannot resize image /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:02:13.243533 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:02:13.243773 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Ensure instance console log exists: /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:02:13.244078 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:13.244325 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:13.244520 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:13.254026 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:13.311142 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:13.317064 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:13.320715 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.122s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:13.320715 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:02:13.323675 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 5.879s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:13.333922 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:02:13.334156 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Claim successful on node np0000001475
May 27 03:02:13.378234 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e50ecddc-9ecc-4190-9b1c-4229fcd8104d req-892e4958-5aca-4ece-9fc3-2a3bbe4a305c service nova] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Received event network-vif-plugged-ff79f3be-9f53-46ab-9234-6a59d48bf529 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:13.378465 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e50ecddc-9ecc-4190-9b1c-4229fcd8104d req-892e4958-5aca-4ece-9fc3-2a3bbe4a305c service nova] Acquiring lock "735ab00a-a335-49f6-9b03-3dec824f8fbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:13.378628 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e50ecddc-9ecc-4190-9b1c-4229fcd8104d req-892e4958-5aca-4ece-9fc3-2a3bbe4a305c service nova] Lock "735ab00a-a335-49f6-9b03-3dec824f8fbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:13.378804 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e50ecddc-9ecc-4190-9b1c-4229fcd8104d req-892e4958-5aca-4ece-9fc3-2a3bbe4a305c service nova] Lock "735ab00a-a335-49f6-9b03-3dec824f8fbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:13.378917 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e50ecddc-9ecc-4190-9b1c-4229fcd8104d req-892e4958-5aca-4ece-9fc3-2a3bbe4a305c service nova] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Processing event network-vif-plugged-ff79f3be-9f53-46ab-9234-6a59d48bf529 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:02:13.615006 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0b77ec30-1d23-4381-9129-b6920e9e87ad req-00abdf42-2b6d-4873-ac02-2fbd876ab648 service nova] Releasing lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:13.616078 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquired lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:13.616078 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:02:13.628477 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:02:13.828907 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:02:13.829456 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:02:13.833604 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:13.834145 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:13.940325 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b438796ed5e44f629535db767fe2b756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39cbbdb9012c4992865d4f89678ef9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:02:14.130417 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850934.1300027, 735ab00a-a335-49f6-9b03-3dec824f8fbb => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:14.130528 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] VM Started (Lifecycle Event)
May 27 03:02:14.132310 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:02:14.138625 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:02:14.141980 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Instance spawned successfully.
May 27 03:02:14.142701 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:02:14.215139 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:02:14.345264 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:02:14.451125 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:14.638029 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:14.645445 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:02:14.654261 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Found WWN 3300000008d44544e for multipath device dm-4 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:02:14.654649 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.047s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:02:14.654967 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] <== connect_volume: return (2344ms) {'type': 'block', 'scsi_wwn': '3300000008d44544e', 'path': '/dev/dm-4', 'multipath_id': '3300000008d44544e'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:02:14.654967 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008d44544e', 'path': '/dev/dm-4', 'multipath_id': '3300000008d44544e'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:02:14.662582 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Successfully created port: 1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:02:14.667140 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:14.667374 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:14.667964 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:14.668462 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:14.670071 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:14.670071 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:14.702804 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Updating instance_info_cache with network_info: [{"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:14.853593 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:02:15.149500 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:02:15.150584 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850935.1495898, 735ab00a-a335-49f6-9b03-3dec824f8fbb => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:15.150734 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] VM Paused (Lifecycle Event)
May 27 03:02:15.180354 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Took 8.45 seconds to spawn the instance on the hypervisor.
May 27 03:02:15.184187 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:15.185446 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-334835239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverbootfromvolumestablerescuetest-server-334835239',id=27,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:02:02Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab70ea24752242a88583e819c6c34e12',ramdisk_id='',reservation_id='r-aeuhqiw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:02:02Z,user_data=None,user_id='787c8d4d4527402cbbc2ad0475f710bb',uuid=ba8ef70d-8e27-48c8-82e3-6501f6130456,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "address": "fa:16:3e:db:0a:73", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "vif_mac": "fa:16:3e:db:0a:73"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea6a715-c6", "ovs_interfaceid": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:02:15.193308 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converting VIF {"id": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "address": "fa:16:3e:db:0a:73", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "vif_mac": "fa:16:3e:db:0a:73"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea6a715-c6", "ovs_interfaceid": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:02:15.194618 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:0a:73,bridge_name='br-int',has_traffic_filtering=True,id=aea6a715-c60b-40d2-b064-f0b1b33a1000,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea6a715-c6') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:02:15.206699 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'pci_devices' on Instance uuid ba8ef70d-8e27-48c8-82e3-6501f6130456 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:15.210781 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Releasing lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:15.214573 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Instance network_info: |[{"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:02:15.219595 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Start _get_guest_xml network_info=[{"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:02:15.221447 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:15.225941 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:02:15.229301 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='c2a5e735-d573-4ac4-bff0-d4a12648718e'), owner=OwnerMeta(userid='092604511a8a467ba4ecb56261cb531f', username='tempest-AttachVolumeMultiAttachTest-774919822-project-member', projectid='a9c48d6919e8435f876f3324616521ea', projectname='tempest-AttachVolumeMultiAttachTest-774919822'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850935.2287543) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:02:15.233972 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:02:15.235197 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:02:15.239910 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:02:15.242174 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:02:15.246915 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:02:15.246915 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:02:15.246915 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:02:15.246915 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:02:15.246915 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:02:15.246915 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:02:15.246915 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:02:15.246915 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:02:15.246915 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:02:15.246915 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:02:15.246915 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:02:15.246915 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:02:15.272054 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='multiattach-server-0',id=30,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7X60AtOl0SsfuAMV1LtNGpvh0yvi8THxioUm4x62ykVhuM7q4sXRNe3S5fa56OsOiAX0ZbtOowRZ4+AKeGhch21Oc/NUN3hQGbbFxrwclVqtJHRu4HOLbwt9JgM8J0mA==',key_name='tempest-keypair-1333870124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-7nyxrr7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:02:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092604511a8a467ba4ecb56261cb531f',uuid=c2a5e735-d573-4ac4-bff0-d4a12648718e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:02:15.273345 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:02:15.273345 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a2498912-5a39-4f70-a141-dae495d11b2a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2498912-5a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:02:15.274895 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'pci_devices' on Instance uuid c2a5e735-d573-4ac4-bff0-d4a12648718e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:15.477791 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Successfully updated port: 1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:02:15.500391 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7d69a0f9-8346-438a-8973-98c40bdf09b4 req-5db40eda-92d3-4a93-a62b-09460b24b463 service nova] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Received event network-vif-plugged-ff79f3be-9f53-46ab-9234-6a59d48bf529 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:15.502887 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7d69a0f9-8346-438a-8973-98c40bdf09b4 req-5db40eda-92d3-4a93-a62b-09460b24b463 service nova] Acquiring lock "735ab00a-a335-49f6-9b03-3dec824f8fbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:15.503593 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7d69a0f9-8346-438a-8973-98c40bdf09b4 req-5db40eda-92d3-4a93-a62b-09460b24b463 service nova] Lock "735ab00a-a335-49f6-9b03-3dec824f8fbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:15.506017 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7d69a0f9-8346-438a-8973-98c40bdf09b4 req-5db40eda-92d3-4a93-a62b-09460b24b463 service nova] Lock "735ab00a-a335-49f6-9b03-3dec824f8fbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:15.506611 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7d69a0f9-8346-438a-8973-98c40bdf09b4 req-5db40eda-92d3-4a93-a62b-09460b24b463 service nova] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] No waiting events found dispatching network-vif-plugged-ff79f3be-9f53-46ab-9234-6a59d48bf529 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:15.506611 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-7d69a0f9-8346-438a-8973-98c40bdf09b4 req-5db40eda-92d3-4a93-a62b-09460b24b463 service nova] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Received unexpected event network-vif-plugged-ff79f3be-9f53-46ab-9234-6a59d48bf529 for instance with vm_state active and task_state None.
May 27 03:02:15.562883 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-13122d39-a00e-4a4d-a9bd-564d145cadbd req-0717421b-6f3e-4e48-834e-9e3d2319de86 service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received event network-changed-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:15.562883 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-13122d39-a00e-4a4d-a9bd-564d145cadbd req-0717421b-6f3e-4e48-834e-9e3d2319de86 service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Refreshing instance network info cache due to event network-changed-1133d110-d517-4b72-bbce-faf3064e5946. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:02:15.562883 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-13122d39-a00e-4a4d-a9bd-564d145cadbd req-0717421b-6f3e-4e48-834e-9e3d2319de86 service nova] Acquiring lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:15.562883 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-13122d39-a00e-4a4d-a9bd-564d145cadbd req-0717421b-6f3e-4e48-834e-9e3d2319de86 service nova] Acquired lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:15.562883 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-13122d39-a00e-4a4d-a9bd-564d145cadbd req-0717421b-6f3e-4e48-834e-9e3d2319de86 service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Refreshing network info cache for port 1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:02:15.654883 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:15.656965 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850935.6566558, 735ab00a-a335-49f6-9b03-3dec824f8fbb => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:15.657092 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] VM Resumed (Lifecycle Event)
May 27 03:02:15.714030 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Object Instance<ba8ef70d-8e27-48c8-82e3-6501f6130456> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:02:15.715615 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] End _get_guest_xml xml=<domain type="qemu">
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:   <uuid>ba8ef70d-8e27-48c8-82e3-6501f6130456</uuid>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:   <name>instance-0000001b</name>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-334835239</nova:name>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:02:11</nova:creationTime>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:         <nova:user uuid="787c8d4d4527402cbbc2ad0475f710bb">tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member</nova:user>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:         <nova:project uuid="ab70ea24752242a88583e819c6c34e12">tempest-ServerBootFromVolumeStableRescueTest-1976367979</nova:project>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:         <nova:port uuid="aea6a715-c60b-40d2-b064-f0b1b33a1000">
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     <system>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <entry name="serial">ba8ef70d-8e27-48c8-82e3-6501f6130456</entry>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <entry name="uuid">ba8ef70d-8e27-48c8-82e3-6501f6130456</entry>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     </system>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:   <os>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:   </os>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:   <features>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:   </features>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:   <devices>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/disk.config"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     </disk>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <alias name="ua-326c1eec-4d4e-42f9-94d2-07c2e4e72085"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-4"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <serial>326c1eec-4d4e-42f9-94d2-07c2e4e72085</serial>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     </disk>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/disk.rescue"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <target dev="vdb" bus="virtio"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <boot order="1"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     </disk>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:db:0a:73"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <target dev="tapaea6a715-c6"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     </interface>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/console.log" append="off"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     </serial>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     <video>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     </video>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     </rng>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:   </devices>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]: </domain>
May 27 03:02:15.715615 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:02:15.722240 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Took 18.71 seconds to build instance.
May 27 03:02:15.725313 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Instance destroyed successfully.
May 27 03:02:15.779634 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] End _get_guest_xml xml=<domain type="qemu">
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:   <uuid>c2a5e735-d573-4ac4-bff0-d4a12648718e</uuid>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:   <name>instance-0000001e</name>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <nova:name>multiattach-server-0</nova:name>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:02:15</nova:creationTime>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:         <nova:user uuid="092604511a8a467ba4ecb56261cb531f">tempest-AttachVolumeMultiAttachTest-774919822-project-member</nova:user>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:         <nova:project uuid="a9c48d6919e8435f876f3324616521ea">tempest-AttachVolumeMultiAttachTest-774919822</nova:project>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:         <nova:port uuid="a2498912-5a39-4f70-a141-dae495d11b2a">
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     <system>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <entry name="serial">c2a5e735-d573-4ac4-bff0-d4a12648718e</entry>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <entry name="uuid">c2a5e735-d573-4ac4-bff0-d4a12648718e</entry>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     </system>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:   <os>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:   </os>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:   <features>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:   </features>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:   <devices>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     </disk>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk.config"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     </disk>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:5c:30:71"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <target dev="tapa2498912-5a"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     </interface>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/console.log" append="off"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     </serial>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     <video>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     </video>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     </rng>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:   </devices>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]: </domain>
May 27 03:02:15.779634 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:02:15.786346 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Preparing to wait for external event network-vif-plugged-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:02:15.786346 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:15.786346 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:15.786346 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:15.786346 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='multiattach-server-0',id=30,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7X60AtOl0SsfuAMV1LtNGpvh0yvi8THxioUm4x62ykVhuM7q4sXRNe3S5fa56OsOiAX0ZbtOowRZ4+AKeGhch21Oc/NUN3hQGbbFxrwclVqtJHRu4HOLbwt9JgM8J0mA==',key_name='tempest-keypair-1333870124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-7nyxrr7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:02:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092604511a8a467ba4ecb56261cb531f',uuid=c2a5e735-d573-4ac4-bff0-d4a12648718e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:02:15.786346 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:02:15.786346 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a2498912-5a39-4f70-a141-dae495d11b2a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2498912-5a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:02:15.786346 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a2498912-5a39-4f70-a141-dae495d11b2a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2498912-5a') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:02:15.786346 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:15.789505 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:15.789505 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:02:15.789505 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:15.789627 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e734878d-b3ef-53c0-9e90-dec8818783f0', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:15.791677 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:15.793236 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:15.801808 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:02:15.802067 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:02:15.807430 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:15.809457 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:15.811445 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2498912-5a, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:15.811445 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2498912-5a, col_values=(('qos', UUID('71697198-9000-4cd3-aa14-1fcd30418875')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:15.811445 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2498912-5a, col_values=(('external_ids', {'iface-id': 'a2498912-5a39-4f70-a141-dae495d11b2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:30:71', 'vm-uuid': 'c2a5e735-d573-4ac4-bff0-d4a12648718e'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:15.812825 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:15.815068 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:15.825695 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:15.829242 np0000001475 nova-compute[98471]: INFO os_vif [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a2498912-5a39-4f70-a141-dae495d11b2a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2498912-5a')
May 27 03:02:15.866853 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:02:15.868999 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:02:15.871818 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Creating image(s)
May 27 03:02:15.871818 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:15.871818 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "/opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:15.871818 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "/opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:15.871818 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:15.874694 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:15.876213 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:15.980991 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:15.995087 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.119s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:15.996085 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:15.996280 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:15.996896 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:16.000681 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:16.005805 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:16.009432 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:16.067589 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-13122d39-a00e-4a4d-a9bd-564d145cadbd req-0717421b-6f3e-4e48-834e-9e3d2319de86 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:16.114672 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.109s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:16.115182 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:16.160327 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-13122d39-a00e-4a4d-a9bd-564d145cadbd req-0717421b-6f3e-4e48-834e-9e3d2319de86 service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:02:16.166233 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:16.170550 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:02:16.184667 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk 1073741824" returned: 0 in 0.069s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:16.185186 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:16.185509 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:16.224821 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "735ab00a-a335-49f6-9b03-3dec824f8fbb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.225s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:16.286968 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.101s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:16.287460 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:02:16.287813 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:16.315387 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:02:16.391113 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-13122d39-a00e-4a4d-a9bd-564d145cadbd req-0717421b-6f3e-4e48-834e-9e3d2319de86 service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:16.405025 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:16.405025 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Cannot resize image /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:02:16.405257 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:02:16.405257 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Ensure instance console log exists: /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:02:16.405613 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:16.405894 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:16.406166 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:16.832097 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.508s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:16.832805 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:02:16.905131 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-13122d39-a00e-4a4d-a9bd-564d145cadbd req-0717421b-6f3e-4e48-834e-9e3d2319de86 service nova] Releasing lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:16.905705 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquired lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:16.905779 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:02:17.258457 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:17.258650 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:17.258829 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:17.258935 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] No VIF found with MAC fa:16:3e:db:0a:73, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:02:17.259628 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Using config drive
May 27 03:02:17.345102 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:02:17.351594 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:02:17.355765 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:17.355765 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:17.364528 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:17.365847 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:17.366548 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No VIF found with MAC fa:16:3e:5c:30:71, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:02:17.367515 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Using config drive
May 27 03:02:17.375400 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquiring lock "735ab00a-a335-49f6-9b03-3dec824f8fbb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:17.379986 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "735ab00a-a335-49f6-9b03-3dec824f8fbb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:17.379986 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquiring lock "735ab00a-a335-49f6-9b03-3dec824f8fbb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:17.379986 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "735ab00a-a335-49f6-9b03-3dec824f8fbb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:17.379986 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "735ab00a-a335-49f6-9b03-3dec824f8fbb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:17.389175 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Terminating instance
May 27 03:02:17.490802 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4a93dfe76ab455d8aa6e691b1fa34c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233d191c03874150880aca259ffd3e21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:02:17.514916 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:02:17.765765 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'ec2_ids' on Instance uuid ba8ef70d-8e27-48c8-82e3-6501f6130456 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:17.801672 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:17.853700 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:02:17.877554 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:17.894643 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:02:17.950062 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:17.952664 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:17.980347 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:18.056649 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Updating instance_info_cache with network_info: [{"id": "1133d110-d517-4b72-bbce-faf3064e5946", "address": "fa:16:3e:d9:1c:3f", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1133d110-d5", "ovs_interfaceid": "1133d110-d517-4b72-bbce-faf3064e5946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:18.176982 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Creating config drive at /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk.config
May 27 03:02:18.179158 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:18.183699 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpalfofnax {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:18.196969 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:18.249281 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Successfully created port: ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:02:18.253504 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpalfofnax" returned: 0 in 0.070s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:18.256502 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.997765744000162 future=<Future at 0x75572c1245c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:18.262853 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Instance destroyed successfully.
May 27 03:02:18.263374 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lazy-loading 'resources' on Instance uuid 735ab00a-a335-49f6-9b03-3dec824f8fbb {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:18.274217 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Object Instance<ba8ef70d-8e27-48c8-82e3-6501f6130456> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:02:18.274402 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'keypairs' on Instance uuid ba8ef70d-8e27-48c8-82e3-6501f6130456 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:18.293286 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3455a41a-a3ae-4f17-bd8b-1aa2def96e9e req-13a8439f-0760-4f98-81c1-d99a2e356116 service nova] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Received event network-vif-unplugged-ff79f3be-9f53-46ab-9234-6a59d48bf529 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:18.293286 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3455a41a-a3ae-4f17-bd8b-1aa2def96e9e req-13a8439f-0760-4f98-81c1-d99a2e356116 service nova] Acquiring lock "735ab00a-a335-49f6-9b03-3dec824f8fbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:18.293286 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3455a41a-a3ae-4f17-bd8b-1aa2def96e9e req-13a8439f-0760-4f98-81c1-d99a2e356116 service nova] Lock "735ab00a-a335-49f6-9b03-3dec824f8fbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:18.293286 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3455a41a-a3ae-4f17-bd8b-1aa2def96e9e req-13a8439f-0760-4f98-81c1-d99a2e356116 service nova] Lock "735ab00a-a335-49f6-9b03-3dec824f8fbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:18.293286 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3455a41a-a3ae-4f17-bd8b-1aa2def96e9e req-13a8439f-0760-4f98-81c1-d99a2e356116 service nova] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] No waiting events found dispatching network-vif-unplugged-ff79f3be-9f53-46ab-9234-6a59d48bf529 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:18.293286 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3455a41a-a3ae-4f17-bd8b-1aa2def96e9e req-13a8439f-0760-4f98-81c1-d99a2e356116 service nova] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Received event network-vif-unplugged-ff79f3be-9f53-46ab-9234-6a59d48bf529 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:02:18.361267 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:02:18.562553 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Releasing lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:18.562553 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Instance network_info: |[{"id": "1133d110-d517-4b72-bbce-faf3064e5946", "address": "fa:16:3e:d9:1c:3f", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1133d110-d5", "ovs_interfaceid": "1133d110-d517-4b72-bbce-faf3064e5946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:02:18.566207 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Start _get_guest_xml network_info=[{"id": "1133d110-d517-4b72-bbce-faf3064e5946", "address": "fa:16:3e:d9:1c:3f", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1133d110-d5", "ovs_interfaceid": "1133d110-d517-4b72-bbce-faf3064e5946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:02:18.572039 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:02:18.576048 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1395902965', uuid='ca2e5c3f-b9be-4bfb-9858-c22cbb4177da'), owner=OwnerMeta(userid='b438796ed5e44f629535db767fe2b756', username='tempest-ServerRescueNegativeTestJSON-62027498-project-member', projectid='39cbbdb9012c4992865d4f89678ef9ac', projectname='tempest-ServerRescueNegativeTestJSON-62027498'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1133d110-d517-4b72-bbce-faf3064e5946", "address": "fa:16:3e:d9:1c:3f", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1133d110-d5", "ovs_interfaceid": "1133d110-d517-4b72-bbce-faf3064e5946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850938.57521) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:02:18.579877 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:02:18.580359 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:02:18.584480 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:02:18.584480 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:02:18.585473 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:02:18.585473 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:02:18.585473 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:02:18.585473 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:02:18.586804 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:02:18.586804 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:02:18.586804 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:02:18.586804 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:02:18.586804 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:02:18.587258 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:02:18.587258 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:02:18.587258 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:02:18.612660 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1395902965',display_name='tempest-ServerRescueNegativeTestJSON-server-1395902965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverrescuenegativetestjson-server-1395902965',id=31,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzS05hQU82r7289dzCq091Kq0hKDY8vlIghFsejL46c9qOyIGwMDUj2tsi4gbzjp70mEziyTz5NLouHNw4zIeC77WZdjsM5xeXJ8F2FHPRHi+ROTn7Bnw2TX4fYLvq7NA==',key_name='tempest-keypair-363341517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39cbbdb9012c4992865d4f89678ef9ac',ramdisk_id='',reservation_id='r-7zpndcla',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-62027498',owner_user_name='tempest-ServerRescueNegativeTestJSON-62027498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:02:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b438796ed5e44f629535db767fe2b756',uuid=ca2e5c3f-b9be-4bfb-9858-c22cbb4177da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1133d110-d517-4b72-bbce-faf3064e5946", "address": "fa:16:3e:d9:1c:3f", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1133d110-d5", "ovs_interfaceid": "1133d110-d517-4b72-bbce-faf3064e5946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:02:18.613319 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converting VIF {"id": "1133d110-d517-4b72-bbce-faf3064e5946", "address": "fa:16:3e:d9:1c:3f", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1133d110-d5", "ovs_interfaceid": "1133d110-d517-4b72-bbce-faf3064e5946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:02:18.613498 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:1c:3f,bridge_name='br-int',has_traffic_filtering=True,id=1133d110-d517-4b72-bbce-faf3064e5946,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1133d110-d5') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:02:18.614530 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'pci_devices' on Instance uuid ca2e5c3f-b9be-4bfb-9858-c22cbb4177da {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:18.768483 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1164922176',display_name='tempest-ServersNegativeTestJSON-server-1164922176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serversnegativetestjson-server-1164922176',id=29,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:02:15Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df6178da77914825aa17d655664bb17c',ramdisk_id='',reservation_id='r-3n0af4m6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1895958758',owner_user_name='tempest-ServersNegativeTestJSON-1895958758-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:02:15Z,user_data=None,user_id='9c7a2b8282d64da1b36834b8f66c35da',uuid=735ab00a-a335-49f6-9b03-3dec824f8fbb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff79f3be-9f53-46ab-9234-6a59d48bf529", "address": "fa:16:3e:b2:e2:8e", "network": {"id": "d2dd987b-3f51-49db-b3eb-a4ce0900727c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1326496062-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df6178da77914825aa17d655664bb17c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff79f3be-9f", "ovs_interfaceid": "ff79f3be-9f53-46ab-9234-6a59d48bf529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:02:18.768847 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Converting VIF {"id": "ff79f3be-9f53-46ab-9234-6a59d48bf529", "address": "fa:16:3e:b2:e2:8e", "network": {"id": "d2dd987b-3f51-49db-b3eb-a4ce0900727c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1326496062-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df6178da77914825aa17d655664bb17c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff79f3be-9f", "ovs_interfaceid": "ff79f3be-9f53-46ab-9234-6a59d48bf529", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:02:18.769567 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e2:8e,bridge_name='br-int',has_traffic_filtering=True,id=ff79f3be-9f53-46ab-9234-6a59d48bf529,network=Network(d2dd987b-3f51-49db-b3eb-a4ce0900727c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff79f3be-9f') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:02:18.770082 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e2:8e,bridge_name='br-int',has_traffic_filtering=True,id=ff79f3be-9f53-46ab-9234-6a59d48bf529,network=Network(d2dd987b-3f51-49db-b3eb-a4ce0900727c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff79f3be-9f') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:02:18.771832 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:18.772126 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff79f3be-9f, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:18.774503 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:18.775249 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:18.782874 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Object Instance<ba8ef70d-8e27-48c8-82e3-6501f6130456> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:02:18.786691 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:18.788640 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:18.796727 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:18.797009 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fcc3070a-a531-47c1-9770-e4742ff911a4) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:18.801132 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:18.801132 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:18.813325 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:18.820288 np0000001475 nova-compute[98471]: INFO os_vif [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e2:8e,bridge_name='br-int',has_traffic_filtering=True,id=ff79f3be-9f53-46ab-9234-6a59d48bf529,network=Network(d2dd987b-3f51-49db-b3eb-a4ce0900727c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff79f3be-9f')
May 27 03:02:18.820974 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Deleting instance files /opt/stack/data/nova/instances/735ab00a-a335-49f6-9b03-3dec824f8fbb_del
May 27 03:02:18.821433 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Deletion of /opt/stack/data/nova/instances/735ab00a-a335-49f6-9b03-3dec824f8fbb_del complete
May 27 03:02:18.831322 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:18.868607 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Booting with volume 4f6a6a1f-0542-4c3d-b318-52f71fb19705 at /dev/vda
May 27 03:02:18.885418 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:18.970695 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:02:18.988469 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:18.991813 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:02:19.029950 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:19.081147 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Creating config drive at /opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/disk.config.rescue
May 27 03:02:19.081774 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:02:19.081774 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:02:19.087645 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbl8zx1f3 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:19.104502 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:02:19.110845 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b', 'fe80::fc16:3eff:fe1f:5a7', 'fe80::a095:90ff:feef:1465', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::fc16:3eff:fe7e:904a', 'fe80::c805:4ff:fe3b:2374', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:fe76:5c4', 'fe80::fc16:3eff:feb2:aa32', 'fe80::fc16:3eff:feaf:c052', 'fe80::20bf:faff:fe0c:5acd', 'fe80::fc16:3eff:fef2:4e6c', 'fe80::501f:4dff:feb6:d71c', 'fe80::fc16:3eff:fe01:3d37', 'fe80::fc16:3eff:fe54:22d6', 'fe80::88ab:28ff:fedb:6e99', 'fe80::fc16:3eff:fe5c:3071'] 
May 27 03:02:19.111015 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:02:19.111191 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:02:19.112294 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:02:19.112294 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Updating existing volume attachment record: 1c5f0800-5bc8-4ead-86c3-0451d571201c {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:02:19.126172 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] End _get_guest_xml xml=<domain type="qemu">
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:   <uuid>ca2e5c3f-b9be-4bfb-9858-c22cbb4177da</uuid>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:   <name>instance-0000001f</name>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1395902965</nova:name>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:02:18</nova:creationTime>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:         <nova:user uuid="b438796ed5e44f629535db767fe2b756">tempest-ServerRescueNegativeTestJSON-62027498-project-member</nova:user>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:         <nova:project uuid="39cbbdb9012c4992865d4f89678ef9ac">tempest-ServerRescueNegativeTestJSON-62027498</nova:project>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:         <nova:port uuid="1133d110-d517-4b72-bbce-faf3064e5946">
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     <system>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <entry name="serial">ca2e5c3f-b9be-4bfb-9858-c22cbb4177da</entry>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <entry name="uuid">ca2e5c3f-b9be-4bfb-9858-c22cbb4177da</entry>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     </system>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:   <os>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:   </os>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:   <features>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:   </features>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:   <devices>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     </disk>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk.config"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     </disk>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:d9:1c:3f"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <target dev="tap1133d110-d5"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     </interface>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/console.log" append="off"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     </serial>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     <video>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     </video>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     </rng>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:   </devices>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]: </domain>
May 27 03:02:19.126172 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:02:19.129265 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Preparing to wait for external event network-vif-plugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:02:19.129265 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:19.129265 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:19.129265 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:19.132044 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1395902965',display_name='tempest-ServerRescueNegativeTestJSON-server-1395902965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverrescuenegativetestjson-server-1395902965',id=31,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzS05hQU82r7289dzCq091Kq0hKDY8vlIghFsejL46c9qOyIGwMDUj2tsi4gbzjp70mEziyTz5NLouHNw4zIeC77WZdjsM5xeXJ8F2FHPRHi+ROTn7Bnw2TX4fYLvq7NA==',key_name='tempest-keypair-363341517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39cbbdb9012c4992865d4f89678ef9ac',ramdisk_id='',reservation_id='r-7zpndcla',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-62027498',owner_user_name='tempest-ServerRescueNegativeTestJSON-62027498-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:02:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b438796ed5e44f629535db767fe2b756',uuid=ca2e5c3f-b9be-4bfb-9858-c22cbb4177da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1133d110-d517-4b72-bbce-faf3064e5946", "address": "fa:16:3e:d9:1c:3f", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1133d110-d5", "ovs_interfaceid": "1133d110-d517-4b72-bbce-faf3064e5946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:02:19.133231 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converting VIF {"id": "1133d110-d517-4b72-bbce-faf3064e5946", "address": "fa:16:3e:d9:1c:3f", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1133d110-d5", "ovs_interfaceid": "1133d110-d517-4b72-bbce-faf3064e5946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:02:19.134365 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:1c:3f,bridge_name='br-int',has_traffic_filtering=True,id=1133d110-d517-4b72-bbce-faf3064e5946,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1133d110-d5') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:02:19.137076 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:1c:3f,bridge_name='br-int',has_traffic_filtering=True,id=1133d110-d517-4b72-bbce-faf3064e5946,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1133d110-d5') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:02:19.137847 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:19.141876 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:19.141876 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:02:19.146282 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:19.146924 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04224dfd-f2bf-56cc-a7b1-1757987e3b69', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:19.149825 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:19.150890 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:19.157423 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:19.162079 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:19.163879 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1133d110-d5, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:19.163879 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1133d110-d5, col_values=(('qos', UUID('b7e81eee-2143-4ed5-a019-68a1e1349d5c')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:19.163879 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1133d110-d5, col_values=(('external_ids', {'iface-id': '1133d110-d517-4b72-bbce-faf3064e5946', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:1c:3f', 'vm-uuid': 'ca2e5c3f-b9be-4bfb-9858-c22cbb4177da'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:19.168130 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:19.181397 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:19.184100 np0000001475 nova-compute[98471]: INFO os_vif [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:1c:3f,bridge_name='br-int',has_traffic_filtering=True,id=1133d110-d517-4b72-bbce-faf3064e5946,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1133d110-d5')
May 27 03:02:19.188367 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbl8zx1f3" returned: 0 in 0.101s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:19.233049 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b19797a2-1af0-4b31-9fa1-9d27608d111f req-a988776f-bc5b-42cf-b905-c907baa37704 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received event network-vif-plugged-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:19.234040 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b19797a2-1af0-4b31-9fa1-9d27608d111f req-a988776f-bc5b-42cf-b905-c907baa37704 service nova] Acquiring lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:19.234270 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b19797a2-1af0-4b31-9fa1-9d27608d111f req-a988776f-bc5b-42cf-b905-c907baa37704 service nova] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:19.234453 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b19797a2-1af0-4b31-9fa1-9d27608d111f req-a988776f-bc5b-42cf-b905-c907baa37704 service nova] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:19.234658 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b19797a2-1af0-4b31-9fa1-9d27608d111f req-a988776f-bc5b-42cf-b905-c907baa37704 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Processing event network-vif-plugged-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:02:19.240602 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Successfully updated port: ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:02:19.330585 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Took 1.44 seconds to destroy the instance on the hypervisor.
May 27 03:02:19.333033 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:02:19.333797 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:02:19.334016 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:02:19.334925 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:19.451434 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:19.744278 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "refresh_cache-fcb1a3e2-e470-4773-a370-f122a79de2e6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:19.746300 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquired lock "refresh_cache-fcb1a3e2-e470-4773-a370-f122a79de2e6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:19.746300 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:02:19.780346 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:19.837334 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:19.950622 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:20.116037 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:20.124342 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:20.234813 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:02:20.236456 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850940.2360642, c2a5e735-d573-4ac4-bff0-d4a12648718e => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:20.237343 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] VM Started (Lifecycle Event)
May 27 03:02:20.243314 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:02:20.252463 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Instance spawned successfully.
May 27 03:02:20.255507 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:02:20.380147 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:02:20.414034 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4efc7c93-fbd9-4379-83a5-e8ef31a5983e req-0004c94e-2d8d-4b26-8089-cd2f0a8f11a8 service nova] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Received event network-vif-unplugged-ff79f3be-9f53-46ab-9234-6a59d48bf529 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:20.415791 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4efc7c93-fbd9-4379-83a5-e8ef31a5983e req-0004c94e-2d8d-4b26-8089-cd2f0a8f11a8 service nova] Acquiring lock "735ab00a-a335-49f6-9b03-3dec824f8fbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:20.415791 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4efc7c93-fbd9-4379-83a5-e8ef31a5983e req-0004c94e-2d8d-4b26-8089-cd2f0a8f11a8 service nova] Lock "735ab00a-a335-49f6-9b03-3dec824f8fbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:20.415791 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4efc7c93-fbd9-4379-83a5-e8ef31a5983e req-0004c94e-2d8d-4b26-8089-cd2f0a8f11a8 service nova] Lock "735ab00a-a335-49f6-9b03-3dec824f8fbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:20.415791 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4efc7c93-fbd9-4379-83a5-e8ef31a5983e req-0004c94e-2d8d-4b26-8089-cd2f0a8f11a8 service nova] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] No waiting events found dispatching network-vif-unplugged-ff79f3be-9f53-46ab-9234-6a59d48bf529 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:20.415791 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4efc7c93-fbd9-4379-83a5-e8ef31a5983e req-0004c94e-2d8d-4b26-8089-cd2f0a8f11a8 service nova] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Received event network-vif-unplugged-ff79f3be-9f53-46ab-9234-6a59d48bf529 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:02:20.415791 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4efc7c93-fbd9-4379-83a5-e8ef31a5983e req-0004c94e-2d8d-4b26-8089-cd2f0a8f11a8 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Received event network-changed-ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:20.415791 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4efc7c93-fbd9-4379-83a5-e8ef31a5983e req-0004c94e-2d8d-4b26-8089-cd2f0a8f11a8 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Refreshing instance network info cache due to event network-changed-ee0e1172-e06e-46db-bda6-c793c47ec9a9. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:02:20.416254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4efc7c93-fbd9-4379-83a5-e8ef31a5983e req-0004c94e-2d8d-4b26-8089-cd2f0a8f11a8 service nova] Acquiring lock "refresh_cache-fcb1a3e2-e470-4773-a370-f122a79de2e6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:20.424337 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:20.726281 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:20.726281 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:20.726523 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No VIF found with MAC fa:16:3e:d9:1c:3f, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:02:20.727705 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Using config drive
May 27 03:02:20.730149 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:20.741387 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:20.745139 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:02:20.778818 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:20.779160 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:20.779725 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:20.780549 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:20.780701 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:20.784146 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:20.931529 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Took 1.60 seconds to deallocate network for instance.
May 27 03:02:20.955497 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Updating instance_info_cache with network_info: [{"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:21.007020 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:21.143378 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3018196c-cec5-402c-a0f1-b4c1da909fb4 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:21.247765 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:21.252624 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:02:21.252624 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850941.2521935, c2a5e735-d573-4ac4-bff0-d4a12648718e => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:21.255011 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] VM Paused (Lifecycle Event)
May 27 03:02:21.291191 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Took 8.54 seconds to spawn the instance on the hypervisor.
May 27 03:02:21.291716 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:21.326462 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:02:21.334132 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:02:21.336366 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Creating image(s)
May 27 03:02:21.336366 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:02:21.336366 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Ensure instance console log exists: /opt/stack/data/nova/instances/fcb1a3e2-e470-4773-a370-f122a79de2e6/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:02:21.342996 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:21.343135 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:21.343568 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:21.444428 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:21.447087 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.006s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:21.450263 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1cb374b0-8cb9-4349-a1ff-8bc84ad51d2b req-e080d1d5-0ec1-4271-853f-760e17c1a272 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received event network-vif-plugged-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:21.450263 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1cb374b0-8cb9-4349-a1ff-8bc84ad51d2b req-e080d1d5-0ec1-4271-853f-760e17c1a272 service nova] Acquiring lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:21.450546 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1cb374b0-8cb9-4349-a1ff-8bc84ad51d2b req-e080d1d5-0ec1-4271-853f-760e17c1a272 service nova] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:21.450546 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1cb374b0-8cb9-4349-a1ff-8bc84ad51d2b req-e080d1d5-0ec1-4271-853f-760e17c1a272 service nova] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:21.451194 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1cb374b0-8cb9-4349-a1ff-8bc84ad51d2b req-e080d1d5-0ec1-4271-853f-760e17c1a272 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] No waiting events found dispatching network-vif-plugged-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:21.451837 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-1cb374b0-8cb9-4349-a1ff-8bc84ad51d2b req-e080d1d5-0ec1-4271-853f-760e17c1a272 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received unexpected event network-vif-plugged-a2498912-5a39-4f70-a141-dae495d11b2a for instance with vm_state active and task_state None.
May 27 03:02:21.452205 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1cb374b0-8cb9-4349-a1ff-8bc84ad51d2b req-e080d1d5-0ec1-4271-853f-760e17c1a272 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received event network-vif-plugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:21.452278 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1cb374b0-8cb9-4349-a1ff-8bc84ad51d2b req-e080d1d5-0ec1-4271-853f-760e17c1a272 service nova] Acquiring lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:21.454045 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1cb374b0-8cb9-4349-a1ff-8bc84ad51d2b req-e080d1d5-0ec1-4271-853f-760e17c1a272 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:21.454045 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1cb374b0-8cb9-4349-a1ff-8bc84ad51d2b req-e080d1d5-0ec1-4271-853f-760e17c1a272 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:21.458398 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1cb374b0-8cb9-4349-a1ff-8bc84ad51d2b req-e080d1d5-0ec1-4271-853f-760e17c1a272 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] No waiting events found dispatching network-vif-plugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:21.458398 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-1cb374b0-8cb9-4349-a1ff-8bc84ad51d2b req-e080d1d5-0ec1-4271-853f-760e17c1a272 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received unexpected event network-vif-plugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 for instance with vm_state rescued and task_state None.
May 27 03:02:21.458398 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1cb374b0-8cb9-4349-a1ff-8bc84ad51d2b req-e080d1d5-0ec1-4271-853f-760e17c1a272 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received event network-vif-plugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:21.458398 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1cb374b0-8cb9-4349-a1ff-8bc84ad51d2b req-e080d1d5-0ec1-4271-853f-760e17c1a272 service nova] Acquiring lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:21.458398 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1cb374b0-8cb9-4349-a1ff-8bc84ad51d2b req-e080d1d5-0ec1-4271-853f-760e17c1a272 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:21.458398 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1cb374b0-8cb9-4349-a1ff-8bc84ad51d2b req-e080d1d5-0ec1-4271-853f-760e17c1a272 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:21.458398 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1cb374b0-8cb9-4349-a1ff-8bc84ad51d2b req-e080d1d5-0ec1-4271-853f-760e17c1a272 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] No waiting events found dispatching network-vif-plugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:21.458398 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-1cb374b0-8cb9-4349-a1ff-8bc84ad51d2b req-e080d1d5-0ec1-4271-853f-760e17c1a272 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received unexpected event network-vif-plugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 for instance with vm_state rescued and task_state None.
May 27 03:02:21.460504 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Releasing lock "refresh_cache-fcb1a3e2-e470-4773-a370-f122a79de2e6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:21.460504 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Instance network_info: |[{"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:02:21.464482 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Start _get_guest_xml network_info=[{"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'fcb1a3e2-e470-4773-a370-f122a79de2e6', 'attached_at': '', 'detached_at': '', 'volume_id': '4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'serial': '4f6a6a1f-0542-4c3d-b318-52f71fb19705'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '1c5f0800-5bc8-4ead-86c3-0451d571201c', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:02:21.464482 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4efc7c93-fbd9-4379-83a5-e8ef31a5983e req-0004c94e-2d8d-4b26-8089-cd2f0a8f11a8 service nova] Acquired lock "refresh_cache-fcb1a3e2-e470-4773-a370-f122a79de2e6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:21.464482 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4efc7c93-fbd9-4379-83a5-e8ef31a5983e req-0004c94e-2d8d-4b26-8089-cd2f0a8f11a8 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Refreshing network info cache for port ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:02:21.481922 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:02:21.481922 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1319467240', uuid='fcb1a3e2-e470-4773-a370-f122a79de2e6'), owner=OwnerMeta(userid='d4a93dfe76ab455d8aa6e691b1fa34c5', username='tempest-ServerActionsTestOtherA-569974590-project-member', projectid='233d191c03874150880aca259ffd3e21', projectname='tempest-ServerActionsTestOtherA-569974590'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850941.479548) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:02:21.492809 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:02:21.495273 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:02:21.500513 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:02:21.503310 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:02:21.505175 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:02:21.507291 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:02:21.508015 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:02:21.508819 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:02:21.509070 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:02:21.509217 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:02:21.509351 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:02:21.509546 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:02:21.509803 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:02:21.510286 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:02:21.510286 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:02:21.514286 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:02:21.568148 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:02:21.568734 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:02:21.568734 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:02:21.569927 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:02:21.569927 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:02:21.616085 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:02:21.619860 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:02:21.621768 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:02:21.627083 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:02:21.627695 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:02:21.627989 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:02:21.651600 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Creating config drive at /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk.config
May 27 03:02:21.657421 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:02:21.657421 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:21.661286 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2343oylh {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:21.698439 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705] added
May 27 03:02:21.698439 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:02:21.698439 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:02:21.698439 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:02:21.698439 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:02:21.698439 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:02:21.698439 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:21.708860 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:02:21.708860 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0884(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:02:21.709212 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:02:21.721139 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:02:21.721139 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:21.742842 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705] added
May 27 03:02:21.742842 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:02:21.742842 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:02:21.742842 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:02:21.742842 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:02:21.742842 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:02:21.742842 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:21.743076 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:02:21.746430 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.115(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:02:21.746430 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:02:21.759603 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2343oylh" returned: 0 in 0.100s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:21.765788 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:21.826855 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850941.8250878, c2a5e735-d573-4ac4-bff0-d4a12648718e => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:21.826855 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] VM Resumed (Lifecycle Event)
May 27 03:02:21.834124 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Took 20.00 seconds to build instance.
May 27 03:02:21.973587 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-4efc7c93-fbd9-4379-83a5-e8ef31a5983e req-0004c94e-2d8d-4b26-8089-cd2f0a8f11a8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:22.314300 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:22.314300 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:22.345244 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-144076b5-23c6-47b1-a261-7aacfb2f4fe6 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.522s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:22.350145 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:22.359092 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:02:22.544302 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-267909e4-efba-478f-898f-723b9b0b275c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Unrescuing
May 27 03:02:22.544562 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-267909e4-efba-478f-898f-723b9b0b275c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "refresh_cache-ba8ef70d-8e27-48c8-82e3-6501f6130456" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:22.544754 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-267909e4-efba-478f-898f-723b9b0b275c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquired lock "refresh_cache-ba8ef70d-8e27-48c8-82e3-6501f6130456" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:22.544958 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-267909e4-efba-478f-898f-723b9b0b275c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:02:22.616974 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-4efc7c93-fbd9-4379-83a5-e8ef31a5983e req-0004c94e-2d8d-4b26-8089-cd2f0a8f11a8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:22.720778 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:22.722902 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:02:22.753519 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:02:22.760030 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:02:22.776259 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:02:22.776259 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:02:22.793116 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:02:22.793116 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:22.813654 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:22.830972 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Detaching volume 7dd67023-0129-4acb-99a4-6d602f2837dc
May 27 03:02:22.838303 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:22.854242 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:22.854242 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:22.854242 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:22.854242 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:22.854242 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:22.854242 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:22.854242 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:22.854242 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:22.854242 np0000001475 nova-compute[98471]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:22.854242 np0000001475 nova-compute[98471]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:22.854242 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:22.854778 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:22.854778 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:22.854778 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:22.854778 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:22.854778 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:22.854778 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:22.854778 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:22.854778 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:22.854778 np0000001475 nova-compute[98471]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:22.854778 np0000001475 nova-compute[98471]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:22.854778 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:22.877772 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Removed pending STOPPED event for ba8ef70d-8e27-48c8-82e3-6501f6130456 due to new event <LifecycleEvent: 1779850942.8725247, ba8ef70d-8e27-48c8-82e3-6501f6130456 => Resumed> {{(pid=98471) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 03:02:22.877772 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850942.8725247, ba8ef70d-8e27-48c8-82e3-6501f6130456 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:22.878767 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] VM Resumed (Lifecycle Event)
May 27 03:02:22.891249 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:22.891249 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:22.891249 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:22.891249 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:22.891249 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:22.891249 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:22.891249 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:22.891249 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:22.891249 np0000001475 nova-compute[98471]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:22.891249 np0000001475 nova-compute[98471]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:22.891249 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:22.893766 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:22.893766 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:22.893766 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:22.893766 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:22.893766 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:22.893766 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:22.893766 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:22.893766 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:22.893766 np0000001475 nova-compute[98471]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:22.893766 np0000001475 nova-compute[98471]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:22.893766 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:22.934147 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705, portal: 192.168.40.100,3260]
May 27 03:02:22.934147 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705, portal: 192.168.40.100,3260] successful.
May 27 03:02:22.934147 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:22.946148 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4efc7c93-fbd9-4379-83a5-e8ef31a5983e req-0004c94e-2d8d-4b26-8089-cd2f0a8f11a8 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Updated VIF entry in instance network info cache for port ee0e1172-e06e-46db-bda6-c793c47ec9a9. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:02:22.946148 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4efc7c93-fbd9-4379-83a5-e8ef31a5983e req-0004c94e-2d8d-4b26-8089-cd2f0a8f11a8 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Updating instance_info_cache with network_info: [{"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:22.974428 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:22.992508 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Attempting to driver detach volume 7dd67023-0129-4acb-99a4-6d602f2837dc from mountpoint /dev/vdb
May 27 03:02:23.006958 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705, portal: 192.168.50.100,3260]
May 27 03:02:23.006958 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705, portal: 192.168.50.100,3260] successful.
May 27 03:02:23.006958 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:23.022198 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Found disk vdb by alias ua-7dd67023-0129-4acb-99a4-6d602f2837dc {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:02:23.028576 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Found disk vdb by alias ua-7dd67023-0129-4acb-99a4-6d602f2837dc {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:02:23.033045 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Attempting to detach device vdb from instance f33f8709-32f7-4ce3-9967-c54609dcbb0c from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:02:23.033275 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:02:23.033275 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:02:23.033275 np0000001475 nova-compute[98471]:   <alias name="ua-7dd67023-0129-4acb-99a4-6d602f2837dc"/>
May 27 03:02:23.033275 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:02:23.033275 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:02:23.033275 np0000001475 nova-compute[98471]:   <serial>7dd67023-0129-4acb-99a4-6d602f2837dc</serial>
May 27 03:02:23.033275 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:02:23.033275 np0000001475 nova-compute[98471]: </disk>
May 27 03:02:23.033275 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:02:23.034433 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:23.038237 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.417s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] HCTL ('17', '-', '-', 0) found on session 55 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:02:23.038237 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:02:23.056617 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-267909e4-efba-478f-898f-723b9b0b275c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:23.085343 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Searching for a device in session 55 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:02:23.091373 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Successfully detached device vdb from instance f33f8709-32f7-4ce3-9967-c54609dcbb0c from the persistent domain config.
May 27 03:02:23.091373 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:02:23.091373 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] (1/8): Attempting to detach device vdb with device alias ua-7dd67023-0129-4acb-99a4-6d602f2837dc from instance f33f8709-32f7-4ce3-9967-c54609dcbb0c from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:02:23.091373 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:02:23.091373 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:02:23.091373 np0000001475 nova-compute[98471]:   <alias name="ua-7dd67023-0129-4acb-99a4-6d602f2837dc"/>
May 27 03:02:23.091373 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:02:23.091373 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:02:23.091373 np0000001475 nova-compute[98471]:   <serial>7dd67023-0129-4acb-99a4-6d602f2837dc</serial>
May 27 03:02:23.091373 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:02:23.091373 np0000001475 nova-compute[98471]: </disk>
May 27 03:02:23.091373 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:23.122416 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:23.123313 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.495s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:02:23.123313 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:02:23.131789 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] HCTL ('18', '-', '-', 0) found on session 56 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:02:23.131789 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:02:23.160576 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0021794689996568195 future=<Future at 0x7557247da330 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:23.160576 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:23.160576 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=10.098861309000313 future=<Future at 0x75572c1245c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:23.160576 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=10.098777702000007 future=<Future at 0x75572c1245c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:23.160576 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Searching for a device in session 56 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:02:23.160576 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:02:23.175551 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:23.227027 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:23.232185 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:23.403894 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:23.415833 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:02:23.454730 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4efc7c93-fbd9-4379-83a5-e8ef31a5983e req-0004c94e-2d8d-4b26-8089-cd2f0a8f11a8 service nova] Releasing lock "refresh_cache-fcb1a3e2-e470-4773-a370-f122a79de2e6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:23.455116 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4efc7c93-fbd9-4379-83a5-e8ef31a5983e req-0004c94e-2d8d-4b26-8089-cd2f0a8f11a8 service nova] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Received event network-vif-deleted-ff79f3be-9f53-46ab-9234-6a59d48bf529 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:23.459306 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-4efc7c93-fbd9-4379-83a5-e8ef31a5983e req-0004c94e-2d8d-4b26-8089-cd2f0a8f11a8 service nova] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Neutron deleted interface ff79f3be-9f53-46ab-9234-6a59d48bf529; detaching it from the instance and deleting it from the info cache
May 27 03:02:23.482842 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4efc7c93-fbd9-4379-83a5-e8ef31a5983e req-0004c94e-2d8d-4b26-8089-cd2f0a8f11a8 service nova] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:23.633165 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:02:23.776769 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-08f125b3-ac10-4594-8e81-d8bdc17ff307 req-51bfe816-490f-49d2-b0e9-81ac8d4d65f2 service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received event network-vif-plugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:23.784502 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-08f125b3-ac10-4594-8e81-d8bdc17ff307 req-51bfe816-490f-49d2-b0e9-81ac8d4d65f2 service nova] Acquiring lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:23.787829 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-08f125b3-ac10-4594-8e81-d8bdc17ff307 req-51bfe816-490f-49d2-b0e9-81ac8d4d65f2 service nova] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:23.787829 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-08f125b3-ac10-4594-8e81-d8bdc17ff307 req-51bfe816-490f-49d2-b0e9-81ac8d4d65f2 service nova] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:23.787829 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-08f125b3-ac10-4594-8e81-d8bdc17ff307 req-51bfe816-490f-49d2-b0e9-81ac8d4d65f2 service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Processing event network-vif-plugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:02:23.928830 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 27 03:02:23.928974 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850943.9286494, ba8ef70d-8e27-48c8-82e3-6501f6130456 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:23.929149 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] VM Started (Lifecycle Event)
May 27 03:02:24.004825 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4efc7c93-fbd9-4379-83a5-e8ef31a5983e req-0004c94e-2d8d-4b26-8089-cd2f0a8f11a8 service nova] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Detach interface failed, port_id=ff79f3be-9f53-46ab-9234-6a59d48bf529, reason: Instance 735ab00a-a335-49f6-9b03-3dec824f8fbb could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:02:24.105817 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:02:24.105817 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:02:24.166357 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:24.284698 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-267909e4-efba-478f-898f-723b9b0b275c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:24.439137 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:24.453254 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:02:24.465157 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7dd67023-0129-4acb-99a4-6d602f2837dc for instance f33f8709-32f7-4ce3-9967-c54609dcbb0c {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:02:24.598241 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-267909e4-efba-478f-898f-723b9b0b275c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Updating instance_info_cache with network_info: [{"id": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "address": "fa:16:3e:db:0a:73", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea6a715-c6", "ovs_interfaceid": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:24.611764 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:02:24.666653 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Found WWN 3300000005ccab551 for multipath device dm-9 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:02:24.667907 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.098s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:02:24.667907 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] <== connect_volume: return (3098ms) {'type': 'block', 'scsi_wwn': '3300000005ccab551', 'path': '/dev/dm-9', 'multipath_id': '3300000005ccab551'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:02:24.670970 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005ccab551', 'path': '/dev/dm-9', 'multipath_id': '3300000005ccab551'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:02:24.734735 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:02:24.738141 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:02:24.746477 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Instance spawned successfully.
May 27 03:02:24.747137 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:02:24.959208 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 27 03:02:24.959667 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779850944.9593737, f33f8709-32f7-4ce3-9967-c54609dcbb0c => ua-7dd67023-0129-4acb-99a4-6d602f2837dc> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:02:24.961508 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850944.961264, ca2e5c3f-b9be-4bfb-9858-c22cbb4177da => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:24.961685 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] VM Started (Lifecycle Event)
May 27 03:02:24.963302 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Successfully detached device vdb from instance f33f8709-32f7-4ce3-9967-c54609dcbb0c from the live domain config.
May 27 03:02:24.964398 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:02:24.964830 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7dd67023-0129-4acb-99a4-6d602f2837dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:02:24.965001 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:02:24.965434 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:02:24.965850 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7dd67023-0129-4acb-99a4-6d602f2837dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:02:24.966037 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:02:25.031382 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:25.031382 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:25.031382 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:25.031382 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:25.031382 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:25.031382 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:25.031382 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:25.031382 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:25.031382 np0000001475 nova-compute[98471]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:25.031382 np0000001475 nova-compute[98471]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:25.031382 np0000001475 nova-compute[98471]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:25.031382 np0000001475 nova-compute[98471]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:25.031382 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:25.032151 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:25.032151 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:25.032151 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:25.032151 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:25.032151 np0000001475 nova-compute[98471]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:25.032151 np0000001475 nova-compute[98471]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc (non-flash)
May 27 03:02:25.032151 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:25.032151 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:25.032151 np0000001475 nova-compute[98471]: tcp: [53] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:25.032151 np0000001475 nova-compute[98471]: tcp: [54] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:25.032151 np0000001475 nova-compute[98471]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:25.032151 np0000001475 nova-compute[98471]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:25.032151 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:25.032151 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129', '53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', '56')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:02:25.032151 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', '47')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:02:25.034448 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc', '48')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:02:25.034448 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c29f6a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc'): ({'sdi'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:02:25.034734 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Removing multipathed devices sdi, sdh {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:02:25.038998 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Flush multipath device 330000000a7ffbc1c {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:02:25.070674 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:02:25.103913 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-267909e4-efba-478f-898f-723b9b0b275c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Releasing lock "refresh_cache-ba8ef70d-8e27-48c8-82e3-6501f6130456" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:25.103913 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-267909e4-efba-478f-898f-723b9b0b275c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'flavor' on Instance uuid ba8ef70d-8e27-48c8-82e3-6501f6130456 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:25.126372 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 3.678s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:25.133668 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:02:25.185977 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:02:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1319467240',display_name='tempest-ServerActionsTestOtherA-server-1319467240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serveractionstestothera-server-1319467240',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVtCwqB5huD2R7WzeA2srtQrNLcY+5mh0PDFl9uXrLaNb8RbC2WmzNWR2uyfN3usptF21zcnp9tnWTIUBUOIX7SXlA+BK0+YEfHYyX09pbtKTE7qcopOd9351hytyFXVA==',key_name='tempest-keypair-2100360487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='233d191c03874150880aca259ffd3e21',ramdisk_id='',reservation_id='r-xaz3c7w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-569974590',owner_user_name='tempest-ServerActionsTestOtherA-569974590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:02:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a93dfe76ab455d8aa6e691b1fa34c5',uuid=fcb1a3e2-e470-4773-a370-f122a79de2e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:02:25.185977 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converting VIF {"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:02:25.192957 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=ee0e1172-e06e-46db-bda6-c793c47ec9a9,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e1172-e0') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:02:25.194032 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lazy-loading 'pci_devices' on Instance uuid fcb1a3e2-e470-4773-a370-f122a79de2e6 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:25.195249 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:02:25.196298 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:02:25.198164 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:02:25.215970 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:02:25.217767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:02:25.236494 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:25.272727 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:25.272727 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:25.272727 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:25.272727 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:25.274788 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:25.274788 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:25.288968 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Deleted allocations for instance 735ab00a-a335-49f6-9b03-3dec824f8fbb
May 27 03:02:25.320833 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc, portal: 192.168.40.100,3260]
May 27 03:02:25.320833 np0000001475 nova-compute[98471]: Logout of [sid: 47, target: iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc, portal: 192.168.40.100,3260] successful.
May 27 03:02:25.320833 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:25.369773 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:25.395202 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:25.465124 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc, portal: 192.168.50.100,3260]
May 27 03:02:25.465124 np0000001475 nova-compute[98471]: Logout of [sid: 48, target: iqn.2023-03.storpool.com:os--volume-7dd67023-0129-4acb-99a4-6d602f2837dc, portal: 192.168.50.100,3260] successful.
May 27 03:02:25.465124 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:25.472029 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:25.478793 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:02:25.502517 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:25.502517 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.535s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:02:25.502517 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] <== disconnect_volume: return (535ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:02:25.502517 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:02:25.666152 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:25.679126 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:25.702689 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] End _get_guest_xml xml=<domain type="qemu">
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:   <uuid>fcb1a3e2-e470-4773-a370-f122a79de2e6</uuid>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:   <name>instance-00000020</name>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerActionsTestOtherA-server-1319467240</nova:name>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:02:21</nova:creationTime>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:         <nova:user uuid="d4a93dfe76ab455d8aa6e691b1fa34c5">tempest-ServerActionsTestOtherA-569974590-project-member</nova:user>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:         <nova:project uuid="233d191c03874150880aca259ffd3e21">tempest-ServerActionsTestOtherA-569974590</nova:project>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:         <nova:port uuid="ee0e1172-e06e-46db-bda6-c793c47ec9a9">
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     <system>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <entry name="serial">fcb1a3e2-e470-4773-a370-f122a79de2e6</entry>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <entry name="uuid">fcb1a3e2-e470-4773-a370-f122a79de2e6</entry>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     </system>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:   <os>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:   </os>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:   <features>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:   </features>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:   <devices>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/fcb1a3e2-e470-4773-a370-f122a79de2e6/disk.config"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     </disk>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <alias name="ua-4f6a6a1f-0542-4c3d-b318-52f71fb19705"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-9"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <serial>4f6a6a1f-0542-4c3d-b318-52f71fb19705</serial>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     </disk>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:75:cb:49"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <target dev="tapee0e1172-e0"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     </interface>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/fcb1a3e2-e470-4773-a370-f122a79de2e6/console.log" append="off"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     </serial>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     <video>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     </video>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     </rng>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:   </devices>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]: </domain>
May 27 03:02:25.702689 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:02:25.702689 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Preparing to wait for external event network-vif-plugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:02:25.702689 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:25.702689 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:25.711133 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:25.711133 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:02:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1319467240',display_name='tempest-ServerActionsTestOtherA-server-1319467240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serveractionstestothera-server-1319467240',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVtCwqB5huD2R7WzeA2srtQrNLcY+5mh0PDFl9uXrLaNb8RbC2WmzNWR2uyfN3usptF21zcnp9tnWTIUBUOIX7SXlA+BK0+YEfHYyX09pbtKTE7qcopOd9351hytyFXVA==',key_name='tempest-keypair-2100360487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='233d191c03874150880aca259ffd3e21',ramdisk_id='',reservation_id='r-xaz3c7w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-569974590',owner_user_name='tempest-ServerActionsTestOtherA-569974590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:02:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a93dfe76ab455d8aa6e691b1fa34c5',uuid=fcb1a3e2-e470-4773-a370-f122a79de2e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:02:25.711133 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converting VIF {"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:02:25.711133 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=ee0e1172-e06e-46db-bda6-c793c47ec9a9,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e1172-e0') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:02:25.711133 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=ee0e1172-e06e-46db-bda6-c793c47ec9a9,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e1172-e0') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:02:25.711133 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:25.711133 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:25.711133 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:02:25.715301 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:25.715301 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6675a084-f956-50a7-a164-5032430b3946', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:25.715301 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:25.715301 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:25.721233 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:25.723966 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:25.724893 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee0e1172-e0, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:25.725399 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee0e1172-e0, col_values=(('qos', UUID('00759c55-861d-4548-b717-10d47d0502da')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:25.725568 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee0e1172-e0, col_values=(('external_ids', {'iface-id': 'ee0e1172-e06e-46db-bda6-c793c47ec9a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:cb:49', 'vm-uuid': 'fcb1a3e2-e470-4773-a370-f122a79de2e6'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:25.727306 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:25.731440 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:25.749870 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:25.750655 np0000001475 nova-compute[98471]: INFO os_vif [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=ee0e1172-e06e-46db-bda6-c793c47ec9a9,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e1172-e0')
May 27 03:02:25.798911 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Took 9.93 seconds to spawn the instance on the hypervisor.
May 27 03:02:25.798911 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:25.991340 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:02:25.991515 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850945.9911938, ca2e5c3f-b9be-4bfb-9858-c22cbb4177da => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:25.991606 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] VM Paused (Lifecycle Event)
May 27 03:02:26.025246 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:26.064085 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received event network-vif-plugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:26.072416 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] Acquiring lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:26.073003 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:26.076548 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:26.076548 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] No waiting events found dispatching network-vif-plugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:26.076548 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received unexpected event network-vif-plugged-1133d110-d517-4b72-bbce-faf3064e5946 for instance with vm_state active and task_state None.
May 27 03:02:26.076548 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Received event network-changed-9d220c08-bd01-473f-a389-4dcbeb9ecf4c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:26.076548 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Refreshing instance network info cache due to event network-changed-9d220c08-bd01-473f-a389-4dcbeb9ecf4c. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:02:26.076548 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] Acquiring lock "refresh_cache-3e5f7741-2c52-4242-9b37-566ff5f5a6a0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:26.076548 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] Acquired lock "refresh_cache-3e5f7741-2c52-4242-9b37-566ff5f5a6a0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:26.076548 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Refreshing network info cache for port 9d220c08-bd01-473f-a389-4dcbeb9ecf4c {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:02:26.082002 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:26.090471 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Instance destroyed successfully.
May 27 03:02:26.091860 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-267909e4-efba-478f-898f-723b9b0b275c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'numa_topology' on Instance uuid ba8ef70d-8e27-48c8-82e3-6501f6130456 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:26.106885 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:26.154690 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lazy-loading 'flavor' on Instance uuid f33f8709-32f7-4ce3-9967-c54609dcbb0c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:26.312775 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5daccc5-51be-45e9-b147-4308c5c28cfc tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "735ab00a-a335-49f6-9b03-3dec824f8fbb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.935s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:26.350172 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Took 23.63 seconds to build instance.
May 27 03:02:26.494925 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:26.499668 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850946.4993312, ca2e5c3f-b9be-4bfb-9858-c22cbb4177da => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:26.499937 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] VM Resumed (Lifecycle Event)
May 27 03:02:26.580780 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:26.596154 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-267909e4-efba-478f-898f-723b9b0b275c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Object Instance<ba8ef70d-8e27-48c8-82e3-6501f6130456> lazy-loaded attributes: flavor,numa_topology {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:02:26.860731 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-15ddbf4f-eeb8-4a74-b6bc-7c81900d49f8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.164s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:27.010257 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:27.025850 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:02:27.180303 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6fc80319-421a-4e45-97a3-a0dd889ec539 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.869s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:27.213283 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:27.230207 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:27.283012 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:27.285708 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:27.306060 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:27.306219 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:27.306364 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No VIF found with MAC fa:16:3e:75:cb:49, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:02:27.306879 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Using config drive
May 27 03:02:27.394456 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:27.529151 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:27.540295 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999698304000049 future=<Future at 0x75572466a7e0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:27.540295 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:27.548384 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Updated VIF entry in instance network info cache for port 9d220c08-bd01-473f-a389-4dcbeb9ecf4c. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:02:27.548384 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Updating instance_info_cache with network_info: [{"id": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "address": "fa:16:3e:d1:ea:b1", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d220c08-bd", "ovs_interfaceid": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:27.561064 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "d7f71824-f631-423e-a5ea-8ae72642a95e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:27.561385 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:27.827443 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:28.052240 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] Releasing lock "refresh_cache-3e5f7741-2c52-4242-9b37-566ff5f5a6a0" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:28.052470 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received event network-changed-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:28.052635 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Refreshing instance network info cache due to event network-changed-a2498912-5a39-4f70-a141-dae495d11b2a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:02:28.052853 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] Acquiring lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:28.052975 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] Acquired lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:28.053123 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Refreshing network info cache for port a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:02:28.072946 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:02:28.096733 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Creating config drive at /opt/stack/data/nova/instances/fcb1a3e2-e470-4773-a370-f122a79de2e6/disk.config
May 27 03:02:28.115963 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fcb1a3e2-e470-4773-a370-f122a79de2e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk0o3rttx {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:28.232806 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fcb1a3e2-e470-4773-a370-f122a79de2e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk0o3rttx" returned: 0 in 0.118s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:28.322072 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c499cd87-dfe2-4779-acfa-1d71d2a4b208 req-fea30e34-0c46-4d2a-819f-aa7d3e3c3106 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received event network-vif-unplugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:28.325470 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c499cd87-dfe2-4779-acfa-1d71d2a4b208 req-fea30e34-0c46-4d2a-819f-aa7d3e3c3106 service nova] Acquiring lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:28.326067 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c499cd87-dfe2-4779-acfa-1d71d2a4b208 req-fea30e34-0c46-4d2a-819f-aa7d3e3c3106 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:28.326067 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c499cd87-dfe2-4779-acfa-1d71d2a4b208 req-fea30e34-0c46-4d2a-819f-aa7d3e3c3106 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:28.326067 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c499cd87-dfe2-4779-acfa-1d71d2a4b208 req-fea30e34-0c46-4d2a-819f-aa7d3e3c3106 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] No waiting events found dispatching network-vif-unplugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:28.326258 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c499cd87-dfe2-4779-acfa-1d71d2a4b208 req-fea30e34-0c46-4d2a-819f-aa7d3e3c3106 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received unexpected event network-vif-unplugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 for instance with vm_state rescued and task_state unrescuing.
May 27 03:02:28.326368 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c499cd87-dfe2-4779-acfa-1d71d2a4b208 req-fea30e34-0c46-4d2a-819f-aa7d3e3c3106 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received event network-vif-unplugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:28.327445 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c499cd87-dfe2-4779-acfa-1d71d2a4b208 req-fea30e34-0c46-4d2a-819f-aa7d3e3c3106 service nova] Acquiring lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:28.327445 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c499cd87-dfe2-4779-acfa-1d71d2a4b208 req-fea30e34-0c46-4d2a-819f-aa7d3e3c3106 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:28.327445 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c499cd87-dfe2-4779-acfa-1d71d2a4b208 req-fea30e34-0c46-4d2a-819f-aa7d3e3c3106 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:28.327445 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c499cd87-dfe2-4779-acfa-1d71d2a4b208 req-fea30e34-0c46-4d2a-819f-aa7d3e3c3106 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] No waiting events found dispatching network-vif-unplugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:28.327445 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c499cd87-dfe2-4779-acfa-1d71d2a4b208 req-fea30e34-0c46-4d2a-819f-aa7d3e3c3106 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received unexpected event network-vif-unplugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 for instance with vm_state rescued and task_state unrescuing.
May 27 03:02:28.327445 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c499cd87-dfe2-4779-acfa-1d71d2a4b208 req-fea30e34-0c46-4d2a-819f-aa7d3e3c3106 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received event network-vif-plugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:28.327445 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c499cd87-dfe2-4779-acfa-1d71d2a4b208 req-fea30e34-0c46-4d2a-819f-aa7d3e3c3106 service nova] Acquiring lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:28.327445 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c499cd87-dfe2-4779-acfa-1d71d2a4b208 req-fea30e34-0c46-4d2a-819f-aa7d3e3c3106 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:28.327819 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c499cd87-dfe2-4779-acfa-1d71d2a4b208 req-fea30e34-0c46-4d2a-819f-aa7d3e3c3106 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:28.327819 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c499cd87-dfe2-4779-acfa-1d71d2a4b208 req-fea30e34-0c46-4d2a-819f-aa7d3e3c3106 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] No waiting events found dispatching network-vif-plugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:28.328070 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c499cd87-dfe2-4779-acfa-1d71d2a4b208 req-fea30e34-0c46-4d2a-819f-aa7d3e3c3106 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received unexpected event network-vif-plugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 for instance with vm_state rescued and task_state unrescuing.
May 27 03:02:28.485767 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1f60197c-f313-48da-952b-928c6e1141d5 req-901aef86-d7e1-4d9c-99f2-c051be1bce2b service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received event network-changed-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:28.485767 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1f60197c-f313-48da-952b-928c6e1141d5 req-901aef86-d7e1-4d9c-99f2-c051be1bce2b service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Refreshing instance network info cache due to event network-changed-1133d110-d517-4b72-bbce-faf3064e5946. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:02:28.485913 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1f60197c-f313-48da-952b-928c6e1141d5 req-901aef86-d7e1-4d9c-99f2-c051be1bce2b service nova] Acquiring lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:28.486409 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1f60197c-f313-48da-952b-928c6e1141d5 req-901aef86-d7e1-4d9c-99f2-c051be1bce2b service nova] Acquired lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:28.486585 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-1f60197c-f313-48da-952b-928c6e1141d5 req-901aef86-d7e1-4d9c-99f2-c051be1bce2b service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Refreshing network info cache for port 1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:02:28.531791 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Removed pending STOPPED event for ba8ef70d-8e27-48c8-82e3-6501f6130456 due to new event <LifecycleEvent: 1779850948.5312934, ba8ef70d-8e27-48c8-82e3-6501f6130456 => Resumed> {{(pid=98471) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 03:02:28.535500 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850948.5312934, ba8ef70d-8e27-48c8-82e3-6501f6130456 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:28.535500 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-267909e4-efba-478f-898f-723b9b0b275c tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:28.535698 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] VM Resumed (Lifecycle Event)
May 27 03:02:28.564352 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:28.688963 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:28.689239 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:28.696269 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:02:28.696490 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Claim successful on node np0000001475
May 27 03:02:28.778544 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:28.778712 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:28.779234 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:28.779234 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:28.779234 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:28.783906 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Terminating instance
May 27 03:02:28.861192 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:28.895878 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:28.903668 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:28.990803 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-1f60197c-f313-48da-952b-928c6e1141d5 req-901aef86-d7e1-4d9c-99f2-c051be1bce2b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:29.041708 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:29.041708 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:29.062496 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:02:29.135861 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:29.138057 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:29.225637 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:29.292033 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:02:29.327460 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:29.333943 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:29.369130 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:29.398011 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:29.401405 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:29.567667 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850949.5671341, ba8ef70d-8e27-48c8-82e3-6501f6130456 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:29.567667 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] VM Started (Lifecycle Event)
May 27 03:02:29.625269 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Updated VIF entry in instance network info cache for port a2498912-5a39-4f70-a141-dae495d11b2a. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:02:29.626122 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Updating instance_info_cache with network_info: [{"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:29.645162 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:29.660868 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:29.701046 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Instance destroyed successfully.
May 27 03:02:29.701204 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lazy-loading 'resources' on Instance uuid f33f8709-32f7-4ce3-9967-c54609dcbb0c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:29.720473 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-1f60197c-f313-48da-952b-928c6e1141d5 req-901aef86-d7e1-4d9c-99f2-c051be1bce2b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:29.895145 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-bcacf598-9624-4fd8-8ea7-af1ae849488c req-0024e79f-14fd-4cef-8c0a-222d4bee7ffb service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received event network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:29.898425 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bcacf598-9624-4fd8-8ea7-af1ae849488c req-0024e79f-14fd-4cef-8c0a-222d4bee7ffb service nova] Acquiring lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:29.898496 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bcacf598-9624-4fd8-8ea7-af1ae849488c req-0024e79f-14fd-4cef-8c0a-222d4bee7ffb service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:29.898808 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bcacf598-9624-4fd8-8ea7-af1ae849488c req-0024e79f-14fd-4cef-8c0a-222d4bee7ffb service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:29.898883 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-bcacf598-9624-4fd8-8ea7-af1ae849488c req-0024e79f-14fd-4cef-8c0a-222d4bee7ffb service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] No waiting events found dispatching network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:29.899059 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-bcacf598-9624-4fd8-8ea7-af1ae849488c req-0024e79f-14fd-4cef-8c0a-222d4bee7ffb service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received event network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:02:29.981587 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-1f60197c-f313-48da-952b-928c6e1141d5 req-901aef86-d7e1-4d9c-99f2-c051be1bce2b service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Updated VIF entry in instance network info cache for port 1133d110-d517-4b72-bbce-faf3064e5946. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:02:29.983079 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-1f60197c-f313-48da-952b-928c6e1141d5 req-901aef86-d7e1-4d9c-99f2-c051be1bce2b service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Updating instance_info_cache with network_info: [{"id": "1133d110-d517-4b72-bbce-faf3064e5946", "address": "fa:16:3e:d9:1c:3f", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1133d110-d5", "ovs_interfaceid": "1133d110-d517-4b72-bbce-faf3064e5946", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:30.071335 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:30.084775 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:02:30.128844 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3ca6053-7d69-428a-8551-523a54a2bc6b req-1b955cbd-188a-44a9-86f8-058f008a7f4f service nova] Releasing lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:30.204681 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:00:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2030533079',display_name='tempest-ServerStableDeviceRescueTest-server-2030533079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverstabledevicerescuetest-server-2030533079',id=15,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa8+CqVdw8nKJ5lReXEmt096EbGDMIc3VhRlcn+2FQfGHdmNBgrivb5lUlAyS2qoKWf32kYpLN8CS14ZT4JmO1zy/Ua7yFw8818K16/tqTyTOYQu+pF7MZ52tXxUY4mhQ==',key_name='tempest-keypair-2125337620',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:01:40Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a7ebe6073564995b0dd1bb85437f4d7',ramdisk_id='',reservation_id='r-qxkxc9ng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-923030128',owner_user_name='tempest-ServerStableDeviceRescueTest-923030128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9da156cb05846c88c7da2a17f564ecd',uuid=f33f8709-32f7-4ce3-9967-c54609dcbb0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d113df60-11d0-4f48-a42a-9541589d6a45", "address": "fa:16:3e:af:c0:52", "network": {"id": "a5ee8bff-dbe9-420a-bc58-64e9082e7d84", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a7ebe6073564995b0dd1bb85437f4d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd113df60-11", "ovs_interfaceid": "d113df60-11d0-4f48-a42a-9541589d6a45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:02:30.205047 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Converting VIF {"id": "d113df60-11d0-4f48-a42a-9541589d6a45", "address": "fa:16:3e:af:c0:52", "network": {"id": "a5ee8bff-dbe9-420a-bc58-64e9082e7d84", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1936612696-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2a7ebe6073564995b0dd1bb85437f4d7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd113df60-11", "ovs_interfaceid": "d113df60-11d0-4f48-a42a-9541589d6a45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:02:30.205966 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:c0:52,bridge_name='br-int',has_traffic_filtering=True,id=d113df60-11d0-4f48-a42a-9541589d6a45,network=Network(a5ee8bff-dbe9-420a-bc58-64e9082e7d84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd113df60-11') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:02:30.206294 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:c0:52,bridge_name='br-int',has_traffic_filtering=True,id=d113df60-11d0-4f48-a42a-9541589d6a45,network=Network(a5ee8bff-dbe9-420a-bc58-64e9082e7d84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd113df60-11') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:02:30.207939 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:30.208300 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd113df60-11, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:30.209766 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:30.211857 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:30.213702 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:30.213702 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eeee486a-3bad-4bf9-ae0e-3c5253b991c3) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:30.215282 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:30.217419 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:30.220958 np0000001475 nova-compute[98471]: INFO os_vif [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:c0:52,bridge_name='br-int',has_traffic_filtering=True,id=d113df60-11d0-4f48-a42a-9541589d6a45,network=Network(a5ee8bff-dbe9-420a-bc58-64e9082e7d84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd113df60-11')
May 27 03:02:30.221366 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Deleting instance files /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c_del
May 27 03:02:30.222393 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Deletion of /opt/stack/data/nova/instances/f33f8709-32f7-4ce3-9967-c54609dcbb0c_del complete
May 27 03:02:30.427469 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4b0c0f4b-0214-4d20-a0bf-f8610c738de7 req-ae19ec63-4a22-46b6-938d-7e656913e7ba service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received event network-vif-plugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:30.427469 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b0c0f4b-0214-4d20-a0bf-f8610c738de7 req-ae19ec63-4a22-46b6-938d-7e656913e7ba service nova] Acquiring lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:30.427469 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b0c0f4b-0214-4d20-a0bf-f8610c738de7 req-ae19ec63-4a22-46b6-938d-7e656913e7ba service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:30.427469 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b0c0f4b-0214-4d20-a0bf-f8610c738de7 req-ae19ec63-4a22-46b6-938d-7e656913e7ba service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:30.427469 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4b0c0f4b-0214-4d20-a0bf-f8610c738de7 req-ae19ec63-4a22-46b6-938d-7e656913e7ba service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] No waiting events found dispatching network-vif-plugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:30.427469 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-4b0c0f4b-0214-4d20-a0bf-f8610c738de7 req-ae19ec63-4a22-46b6-938d-7e656913e7ba service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received unexpected event network-vif-plugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 for instance with vm_state active and task_state deleting.
May 27 03:02:30.484945 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1f60197c-f313-48da-952b-928c6e1141d5 req-901aef86-d7e1-4d9c-99f2-c051be1bce2b service nova] Releasing lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:30.584493 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999690528999963 future=<Future at 0x75572c274f80 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:30.585090 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850950.5846112, fcb1a3e2-e470-4773-a370-f122a79de2e6 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:30.585090 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] VM Started (Lifecycle Event)
May 27 03:02:30.600271 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-72264af4-8615-4ed6-b24f-08361a473c4a req-f0c6d5d8-c3af-4940-ba18-76eade1dc062 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Received event network-vif-plugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:30.600616 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-72264af4-8615-4ed6-b24f-08361a473c4a req-f0c6d5d8-c3af-4940-ba18-76eade1dc062 service nova] Acquiring lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:30.600685 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-72264af4-8615-4ed6-b24f-08361a473c4a req-f0c6d5d8-c3af-4940-ba18-76eade1dc062 service nova] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:30.600913 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-72264af4-8615-4ed6-b24f-08361a473c4a req-f0c6d5d8-c3af-4940-ba18-76eade1dc062 service nova] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:30.602505 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-72264af4-8615-4ed6-b24f-08361a473c4a req-f0c6d5d8-c3af-4940-ba18-76eade1dc062 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Processing event network-vif-plugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:02:30.602708 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-72264af4-8615-4ed6-b24f-08361a473c4a req-f0c6d5d8-c3af-4940-ba18-76eade1dc062 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Received event network-vif-plugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:30.603073 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-72264af4-8615-4ed6-b24f-08361a473c4a req-f0c6d5d8-c3af-4940-ba18-76eade1dc062 service nova] Acquiring lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:30.603118 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-72264af4-8615-4ed6-b24f-08361a473c4a req-f0c6d5d8-c3af-4940-ba18-76eade1dc062 service nova] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:30.603253 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-72264af4-8615-4ed6-b24f-08361a473c4a req-f0c6d5d8-c3af-4940-ba18-76eade1dc062 service nova] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:30.603363 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-72264af4-8615-4ed6-b24f-08361a473c4a req-f0c6d5d8-c3af-4940-ba18-76eade1dc062 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] No waiting events found dispatching network-vif-plugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:30.603478 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-72264af4-8615-4ed6-b24f-08361a473c4a req-f0c6d5d8-c3af-4940-ba18-76eade1dc062 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Received unexpected event network-vif-plugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 for instance with vm_state building and task_state spawning.
May 27 03:02:30.604677 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:02:30.612613 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:02:30.615721 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Instance spawned successfully.
May 27 03:02:30.621031 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:02:30.738382 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Took 1.45 seconds to destroy the instance on the hypervisor.
May 27 03:02:30.738382 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:02:30.738593 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:02:30.738801 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:02:30.739331 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:30.761736 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "ba8ef70d-8e27-48c8-82e3-6501f6130456" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:30.762000 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:30.762267 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:30.762427 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:30.762611 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:30.765309 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Terminating instance
May 27 03:02:30.906320 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:31.030492 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:02:31.030492 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:02:31.045552 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:31.087560 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:31.090430 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:02:31.127938 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:31.128114 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:31.128563 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:31.129064 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:31.129414 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:31.129537 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:31.275545 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:02:31.310083 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:31.314100 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:31.341708 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:31.510896 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:31.516867 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:31.535058 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:02:31.593733 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:02:31.595720 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850951.5946352, fcb1a3e2-e470-4773-a370-f122a79de2e6 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:31.595720 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] VM Paused (Lifecycle Event)
May 27 03:02:31.603778 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:31.614210 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:31.629883 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Instance destroyed successfully.
May 27 03:02:31.630309 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'resources' on Instance uuid ba8ef70d-8e27-48c8-82e3-6501f6130456 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:31.638494 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Took 10.32 seconds to spawn the instance on the hypervisor.
May 27 03:02:31.638726 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:32.017549 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-520fadfb-fe22-4521-9b0e-bd695881995c req-5cd69ca5-af61-4fb0-8809-bffc70b1d8e2 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received event network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:32.020237 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-520fadfb-fe22-4521-9b0e-bd695881995c req-5cd69ca5-af61-4fb0-8809-bffc70b1d8e2 service nova] Acquiring lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:32.021188 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-520fadfb-fe22-4521-9b0e-bd695881995c req-5cd69ca5-af61-4fb0-8809-bffc70b1d8e2 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:32.021326 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-520fadfb-fe22-4521-9b0e-bd695881995c req-5cd69ca5-af61-4fb0-8809-bffc70b1d8e2 service nova] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:32.021466 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-520fadfb-fe22-4521-9b0e-bd695881995c req-5cd69ca5-af61-4fb0-8809-bffc70b1d8e2 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] No waiting events found dispatching network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:32.021585 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-520fadfb-fe22-4521-9b0e-bd695881995c req-5cd69ca5-af61-4fb0-8809-bffc70b1d8e2 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received event network-vif-unplugged-d113df60-11d0-4f48-a42a-9541589d6a45 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:02:32.047942 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.358s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:32.048182 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:02:32.099593 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:32.105521 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850952.105112, fcb1a3e2-e470-4773-a370-f122a79de2e6 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:32.105778 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] VM Resumed (Lifecycle Event)
May 27 03:02:32.136387 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-334835239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverbootfromvolumestablerescuetest-server-334835239',id=27,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:02:21Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab70ea24752242a88583e819c6c34e12',ramdisk_id='',reservation_id='r-aeuhqiw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:02:29Z,user_data=None,user_id='787c8d4d4527402cbbc2ad0475f710bb',uuid=ba8ef70d-8e27-48c8-82e3-6501f6130456,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "address": "fa:16:3e:db:0a:73", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea6a715-c6", "ovs_interfaceid": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:02:32.136715 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converting VIF {"id": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "address": "fa:16:3e:db:0a:73", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea6a715-c6", "ovs_interfaceid": "aea6a715-c60b-40d2-b064-f0b1b33a1000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:02:32.137389 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:0a:73,bridge_name='br-int',has_traffic_filtering=True,id=aea6a715-c60b-40d2-b064-f0b1b33a1000,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea6a715-c6') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:02:32.137655 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:0a:73,bridge_name='br-int',has_traffic_filtering=True,id=aea6a715-c60b-40d2-b064-f0b1b33a1000,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea6a715-c6') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:02:32.140588 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:32.140906 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaea6a715-c6, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:32.142258 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:32.143327 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:32.145197 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:32.146265 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:32.146566 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b6c0d4c-ba90-4103-9e67-39820c57ccfa) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:32.147195 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:32.147976 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:32.149273 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:32.152506 np0000001475 nova-compute[98471]: INFO os_vif [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:0a:73,bridge_name='br-int',has_traffic_filtering=True,id=aea6a715-c60b-40d2-b064-f0b1b33a1000,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea6a715-c6')
May 27 03:02:32.161769 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Took 24.79 seconds to build instance.
May 27 03:02:32.161769 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:02:32.161769 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:02:32.161769 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:02:32.225213 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:32.523641 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f51fdbd6-e54a-4c0d-bb06-cb9059933fe3 req-cfdd8f86-4c60-499c-a0f4-77315f4aa658 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received event network-vif-unplugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:32.524026 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f51fdbd6-e54a-4c0d-bb06-cb9059933fe3 req-cfdd8f86-4c60-499c-a0f4-77315f4aa658 service nova] Acquiring lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:32.524255 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f51fdbd6-e54a-4c0d-bb06-cb9059933fe3 req-cfdd8f86-4c60-499c-a0f4-77315f4aa658 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:32.524409 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f51fdbd6-e54a-4c0d-bb06-cb9059933fe3 req-cfdd8f86-4c60-499c-a0f4-77315f4aa658 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:32.524563 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f51fdbd6-e54a-4c0d-bb06-cb9059933fe3 req-cfdd8f86-4c60-499c-a0f4-77315f4aa658 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] No waiting events found dispatching network-vif-unplugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:32.524713 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f51fdbd6-e54a-4c0d-bb06-cb9059933fe3 req-cfdd8f86-4c60-499c-a0f4-77315f4aa658 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received event network-vif-unplugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:02:32.524946 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f51fdbd6-e54a-4c0d-bb06-cb9059933fe3 req-cfdd8f86-4c60-499c-a0f4-77315f4aa658 service nova] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Received event network-vif-deleted-d113df60-11d0-4f48-a42a-9541589d6a45 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:32.525109 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f51fdbd6-e54a-4c0d-bb06-cb9059933fe3 req-cfdd8f86-4c60-499c-a0f4-77315f4aa658 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received event network-vif-unplugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:32.525453 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f51fdbd6-e54a-4c0d-bb06-cb9059933fe3 req-cfdd8f86-4c60-499c-a0f4-77315f4aa658 service nova] Acquiring lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:32.525453 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f51fdbd6-e54a-4c0d-bb06-cb9059933fe3 req-cfdd8f86-4c60-499c-a0f4-77315f4aa658 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:32.525567 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f51fdbd6-e54a-4c0d-bb06-cb9059933fe3 req-cfdd8f86-4c60-499c-a0f4-77315f4aa658 service nova] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:32.525711 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f51fdbd6-e54a-4c0d-bb06-cb9059933fe3 req-cfdd8f86-4c60-499c-a0f4-77315f4aa658 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] No waiting events found dispatching network-vif-unplugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:32.526476 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f51fdbd6-e54a-4c0d-bb06-cb9059933fe3 req-cfdd8f86-4c60-499c-a0f4-77315f4aa658 service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received event network-vif-unplugged-aea6a715-c60b-40d2-b064-f0b1b33a1000 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:02:32.559888 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:02:32.560413 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:02:32.562046 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:32.563330 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:32.611516 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:32.614667 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:02:32.665246 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-05a9a234-46db-4196-9a86-c7e5d1472d8f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.315s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:32.667877 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '092604511a8a467ba4ecb56261cb531f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c48d6919e8435f876f3324616521ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:02:32.727495 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Took 1.99 seconds to deallocate network for instance.
May 27 03:02:33.068581 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:02:33.117781 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999698954999985 future=<Future at 0x755724776390 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:33.233870 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8fe2a6ff-eb1e-4617-aab0-b43121837b4c req-31bbc4b7-5148-4df0-9c38-d38b3fb27d34 service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Received event network-changed-2104125d-e30e-4450-8186-54d776011dcd {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:33.237183 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:33.238168 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8fe2a6ff-eb1e-4617-aab0-b43121837b4c req-31bbc4b7-5148-4df0-9c38-d38b3fb27d34 service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Refreshing instance network info cache due to event network-changed-2104125d-e30e-4450-8186-54d776011dcd. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:02:33.238555 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:33.238979 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8fe2a6ff-eb1e-4617-aab0-b43121837b4c req-31bbc4b7-5148-4df0-9c38-d38b3fb27d34 service nova] Acquiring lock "refresh_cache-8d762a67-82b6-40d3-b625-0731ea01c45b" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:33.239224 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8fe2a6ff-eb1e-4617-aab0-b43121837b4c req-31bbc4b7-5148-4df0-9c38-d38b3fb27d34 service nova] Acquired lock "refresh_cache-8d762a67-82b6-40d3-b625-0731ea01c45b" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:33.239416 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-8fe2a6ff-eb1e-4617-aab0-b43121837b4c req-31bbc4b7-5148-4df0-9c38-d38b3fb27d34 service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Refreshing network info cache for port 2104125d-e30e-4450-8186-54d776011dcd {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:02:33.256213 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0019489100000100734 future=<Future at 0x75572c1245c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:33.256764 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:33.256897 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=9.27733151800021 future=<Future at 0x75572466a7e0 state=cancelled>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:33.257003 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=9.277218876999996 future=<Future at 0x75572466a7e0 state=cancelled>) was cancelled while queued, skipping {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:33.257075 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:33.257197 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=12.326925459999984 future=<Future at 0x75572c274f80 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:33.257290 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=12.326828828000089 future=<Future at 0x75572c274f80 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:33.257900 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Emitting event <LifecycleEvent: 1779850938.2541516, 735ab00a-a335-49f6-9b03-3dec824f8fbb => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:33.258082 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] VM Stopped (Lifecycle Event)
May 27 03:02:33.289064 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Successfully created port: 57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:02:33.573262 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:02:33.747415 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-8fe2a6ff-eb1e-4617-aab0-b43121837b4c req-31bbc4b7-5148-4df0-9c38-d38b3fb27d34 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:33.762557 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: 735ab00a-a335-49f6-9b03-3dec824f8fbb] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:33.825199 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.663s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:02:33.825199 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '326c1eec-4d4e-42f9-94d2-07c2e4e72085', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:02:33.825199 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:33.861478 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: tcp: [51] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: tcp: [52] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085 (non-flash)
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129 (non-flash)
May 27 03:02:33.861478 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', '51'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', '52'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be872cf8-af98-4c35-9520-88627860e129', '58')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', '51')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:02:33.861478 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085', '52')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:02:33.866366 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755724645f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085'): ({'sdg'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:02:33.866826 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Removing multipathed devices sdf, sdg {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:02:33.867235 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Flush multipath device 3300000008d44544e {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:02:33.920796 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:02:33.953633 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Successfully updated port: 57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:02:33.968624 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:02:34.011937 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:02:34.018993 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:02:34.018993 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:02:34.031419 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:02:34.031654 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:02:34.044075 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:34.091767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085, portal: 192.168.40.100,3260]
May 27 03:02:34.091767 np0000001475 nova-compute[98471]: Logout of [sid: 51, target: iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085, portal: 192.168.40.100,3260] successful.
May 27 03:02:34.091767 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:34.102485 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-bf756bf8-380f-4033-8ee8-3f8e54e7f550 req-fe5017ee-8865-417d-a068-a1b932f5f65d service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Received event network-changed-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:34.102485 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-bf756bf8-380f-4033-8ee8-3f8e54e7f550 req-fe5017ee-8865-417d-a068-a1b932f5f65d service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Refreshing instance network info cache due to event network-changed-57af91c5-42f3-4f9f-ac26-aad2418fdfe3. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:02:34.102485 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bf756bf8-380f-4033-8ee8-3f8e54e7f550 req-fe5017ee-8865-417d-a068-a1b932f5f65d service nova] Acquiring lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:34.102485 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bf756bf8-380f-4033-8ee8-3f8e54e7f550 req-fe5017ee-8865-417d-a068-a1b932f5f65d service nova] Acquired lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:34.102485 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-bf756bf8-380f-4033-8ee8-3f8e54e7f550 req-fe5017ee-8865-417d-a068-a1b932f5f65d service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Refreshing network info cache for port 57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:02:34.115216 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:34.137913 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:34.185362 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085, portal: 192.168.50.100,3260]
May 27 03:02:34.185362 np0000001475 nova-compute[98471]: Logout of [sid: 52, target: iqn.2023-03.storpool.com:os--volume-326c1eec-4d4e-42f9-94d2-07c2e4e72085, portal: 192.168.50.100,3260] successful.
May 27 03:02:34.185362 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:34.214492 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:34.215077 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:02:34.215364 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] <== disconnect_volume: return (2054ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:02:34.215498 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:02:34.215753 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Deleting instance files /opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456_del
May 27 03:02:34.216236 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Deletion of /opt/stack/data/nova/instances/ba8ef70d-8e27-48c8-82e3-6501f6130456_del complete
May 27 03:02:34.222433 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-8fe2a6ff-eb1e-4617-aab0-b43121837b4c req-31bbc4b7-5148-4df0-9c38-d38b3fb27d34 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:34.315097 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:02:34.316295 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:02:34.409664 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-8fe2a6ff-eb1e-4617-aab0-b43121837b4c req-31bbc4b7-5148-4df0-9c38-d38b3fb27d34 service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Updated VIF entry in instance network info cache for port 2104125d-e30e-4450-8186-54d776011dcd. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:02:34.410169 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-8fe2a6ff-eb1e-4617-aab0-b43121837b4c req-31bbc4b7-5148-4df0-9c38-d38b3fb27d34 service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Updating instance_info_cache with network_info: [{"id": "2104125d-e30e-4450-8186-54d776011dcd", "address": "fa:16:3e:9d:6d:1f", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2104125d-e3", "ovs_interfaceid": "2104125d-e30e-4450-8186-54d776011dcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:34.455857 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:34.594707 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:02:34.595926 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:02:34.596226 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Creating image(s)
May 27 03:02:34.597732 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:34.598129 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "/opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:34.599182 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "/opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:34.600107 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:34.603394 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:34.604681 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:34.625029 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-bf756bf8-380f-4033-8ee8-3f8e54e7f550 req-fe5017ee-8865-417d-a068-a1b932f5f65d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:34.707411 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.103s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:34.708646 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:34.709323 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:34.709897 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:34.715001 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:02:34.716440 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:34.758536 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-bf756bf8-380f-4033-8ee8-3f8e54e7f550 req-fe5017ee-8865-417d-a068-a1b932f5f65d service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:02:34.766763 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Took 3.49 seconds to destroy the instance on the hypervisor.
May 27 03:02:34.769666 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:02:34.770842 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:02:34.772188 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:02:34.772578 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:34.818798 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.102s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:34.820434 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:02:34.836682 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:34.913110 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:34.918759 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8fe2a6ff-eb1e-4617-aab0-b43121837b4c req-31bbc4b7-5148-4df0-9c38-d38b3fb27d34 service nova] Releasing lock "refresh_cache-8d762a67-82b6-40d3-b625-0731ea01c45b" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:34.922137 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk 1073741824" returned: 0 in 0.101s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:34.922568 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:34.922967 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:35.007980 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquiring lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:35.007980 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:35.008123 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquiring lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:35.008303 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:35.008467 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:35.014435 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Terminating instance
May 27 03:02:35.044322 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.120s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:35.044322 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:02:35.044899 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:35.091318 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-bf756bf8-380f-4033-8ee8-3f8e54e7f550 req-fe5017ee-8865-417d-a068-a1b932f5f65d service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:35.170998 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:35.173236 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Cannot resize image /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:02:35.173236 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:02:35.173236 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Ensure instance console log exists: /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:02:35.173236 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:35.173236 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:35.173236 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:35.323968 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6558f14b-319b-458f-a00e-0559f54137a2 req-43a0fb4b-4fb3-4806-99e3-1aaa901a5857 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Received event network-changed-ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:35.324937 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6558f14b-319b-458f-a00e-0559f54137a2 req-43a0fb4b-4fb3-4806-99e3-1aaa901a5857 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Refreshing instance network info cache due to event network-changed-ee0e1172-e06e-46db-bda6-c793c47ec9a9. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:02:35.325100 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6558f14b-319b-458f-a00e-0559f54137a2 req-43a0fb4b-4fb3-4806-99e3-1aaa901a5857 service nova] Acquiring lock "refresh_cache-fcb1a3e2-e470-4773-a370-f122a79de2e6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:35.325195 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6558f14b-319b-458f-a00e-0559f54137a2 req-43a0fb4b-4fb3-4806-99e3-1aaa901a5857 service nova] Acquired lock "refresh_cache-fcb1a3e2-e470-4773-a370-f122a79de2e6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:35.325301 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-6558f14b-319b-458f-a00e-0559f54137a2 req-43a0fb4b-4fb3-4806-99e3-1aaa901a5857 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Refreshing network info cache for port ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:02:35.339807 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.101s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:35.411053 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Deleted allocations for instance f33f8709-32f7-4ce3-9967-c54609dcbb0c
May 27 03:02:35.535647 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:02:35.541170 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Stashing vm_state: active {{(pid=98471) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 27 03:02:35.576401 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:35.584207 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:35.598130 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bf756bf8-380f-4033-8ee8-3f8e54e7f550 req-fe5017ee-8865-417d-a068-a1b932f5f65d service nova] Releasing lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:35.598841 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquired lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:35.600377 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:02:35.612963 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:35.645238 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:35.646450 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:35.769202 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:35.832589 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-6558f14b-319b-458f-a00e-0559f54137a2 req-43a0fb4b-4fb3-4806-99e3-1aaa901a5857 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:35.880175 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c58758ea-3020-4341-9029-f51d439d9a5d req-6316ce21-658c-418f-bc7b-51b4b15febd9 service nova] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Received event network-vif-unplugged-1dc18a8f-bec1-42d5-96ef-84706d61147c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:35.882359 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c58758ea-3020-4341-9029-f51d439d9a5d req-6316ce21-658c-418f-bc7b-51b4b15febd9 service nova] Acquiring lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:35.882602 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c58758ea-3020-4341-9029-f51d439d9a5d req-6316ce21-658c-418f-bc7b-51b4b15febd9 service nova] Lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:35.883869 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c58758ea-3020-4341-9029-f51d439d9a5d req-6316ce21-658c-418f-bc7b-51b4b15febd9 service nova] Lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:35.884203 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c58758ea-3020-4341-9029-f51d439d9a5d req-6316ce21-658c-418f-bc7b-51b4b15febd9 service nova] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] No waiting events found dispatching network-vif-unplugged-1dc18a8f-bec1-42d5-96ef-84706d61147c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:35.884203 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c58758ea-3020-4341-9029-f51d439d9a5d req-6316ce21-658c-418f-bc7b-51b4b15febd9 service nova] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Received event network-vif-unplugged-1dc18a8f-bec1-42d5-96ef-84706d61147c for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:02:35.898797 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999623041999712 future=<Future at 0x75572c2a0ce0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:35.903569 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Instance destroyed successfully.
May 27 03:02:35.904407 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lazy-loading 'resources' on Instance uuid ff7c9673-bf7d-426f-80a6-aa94a46ad33a {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:36.049907 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:36.128676 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:36.129169 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:36.213523 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:02:36.274674 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Took 1.50 seconds to deallocate network for instance.
May 27 03:02:36.376168 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-6558f14b-319b-458f-a00e-0559f54137a2 req-43a0fb4b-4fb3-4806-99e3-1aaa901a5857 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:36.408945 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:01:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1760055263',display_name='tempest-ServersNegativeTestJSON-server-1760055263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serversnegativetestjson-server-1760055263',id=26,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:01:53Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df6178da77914825aa17d655664bb17c',ramdisk_id='',reservation_id='r-pl80yf5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1895958758',owner_user_name='tempest-ServersNegativeTestJSON-1895958758-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:01:53Z,user_data=None,user_id='9c7a2b8282d64da1b36834b8f66c35da',uuid=ff7c9673-bf7d-426f-80a6-aa94a46ad33a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dc18a8f-bec1-42d5-96ef-84706d61147c", "address": "fa:16:3e:f2:4e:6c", "network": {"id": "d2dd987b-3f51-49db-b3eb-a4ce0900727c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1326496062-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df6178da77914825aa17d655664bb17c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc18a8f-be", "ovs_interfaceid": "1dc18a8f-bec1-42d5-96ef-84706d61147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:02:36.409152 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Converting VIF {"id": "1dc18a8f-bec1-42d5-96ef-84706d61147c", "address": "fa:16:3e:f2:4e:6c", "network": {"id": "d2dd987b-3f51-49db-b3eb-a4ce0900727c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1326496062-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "df6178da77914825aa17d655664bb17c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc18a8f-be", "ovs_interfaceid": "1dc18a8f-bec1-42d5-96ef-84706d61147c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:02:36.410187 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:4e:6c,bridge_name='br-int',has_traffic_filtering=True,id=1dc18a8f-bec1-42d5-96ef-84706d61147c,network=Network(d2dd987b-3f51-49db-b3eb-a4ce0900727c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc18a8f-be') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:02:36.410187 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:4e:6c,bridge_name='br-int',has_traffic_filtering=True,id=1dc18a8f-bec1-42d5-96ef-84706d61147c,network=Network(d2dd987b-3f51-49db-b3eb-a4ce0900727c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc18a8f-be') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:02:36.411996 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:36.412351 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1dc18a8f-be, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:36.419876 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:36.420379 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:36.422214 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:36.425673 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20aab1cf-7670-46b1-9bb8-5574dd3d61e6) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:36.432210 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:36.433577 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b544592c-38f4-4f83-ac95-f74fd0b7ae07 tempest-ServerStableDeviceRescueTest-923030128 tempest-ServerStableDeviceRescueTest-923030128-project-member] Lock "f33f8709-32f7-4ce3-9967-c54609dcbb0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.655s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:36.436599 np0000001475 nova-compute[98471]: INFO os_vif [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:4e:6c,bridge_name='br-int',has_traffic_filtering=True,id=1dc18a8f-bec1-42d5-96ef-84706d61147c,network=Network(d2dd987b-3f51-49db-b3eb-a4ce0900727c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc18a8f-be')
May 27 03:02:36.437040 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Deleting instance files /opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a_del
May 27 03:02:36.437885 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Deletion of /opt/stack/data/nova/instances/ff7c9673-bf7d-426f-80a6-aa94a46ad33a_del complete
May 27 03:02:36.500562 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:36.590167 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-6558f14b-319b-458f-a00e-0559f54137a2 req-43a0fb4b-4fb3-4806-99e3-1aaa901a5857 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Updated VIF entry in instance network info cache for port ee0e1172-e06e-46db-bda6-c793c47ec9a9. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:02:36.590373 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-6558f14b-319b-458f-a00e-0559f54137a2 req-43a0fb4b-4fb3-4806-99e3-1aaa901a5857 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Updating instance_info_cache with network_info: [{"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:36.641466 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:02:36.641603 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Claim successful on node np0000001475
May 27 03:02:36.679550 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Updating instance_info_cache with network_info: [{"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:36.858613 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Took 0.58 seconds to detach 1 volumes for instance.
May 27 03:02:36.864395 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Deleting volume: 326c1eec-4d4e-42f9-94d2-07c2e4e72085 {{(pid=98471) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 27 03:02:36.945675 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Took 1.41 seconds to destroy the instance on the hypervisor.
May 27 03:02:36.946955 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:02:36.947142 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:02:36.947227 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:02:36.947454 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:37.066045 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:37.093335 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6558f14b-319b-458f-a00e-0559f54137a2 req-43a0fb4b-4fb3-4806-99e3-1aaa901a5857 service nova] Releasing lock "refresh_cache-fcb1a3e2-e470-4773-a370-f122a79de2e6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:37.151528 np0000001475 nova-compute[98471]: INFO nova.compute.resource_tracker [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Updating resource usage from migration 188cb323-3b79-4ff9-a9b6-fdc35858e34e
May 27 03:02:37.186267 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Releasing lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:37.186267 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Instance network_info: |[{"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:02:37.187647 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Start _get_guest_xml network_info=[{"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:02:37.193242 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:02:37.194890 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='d7f71824-f631-423e-a5ea-8ae72642a95e'), owner=OwnerMeta(userid='092604511a8a467ba4ecb56261cb531f', username='tempest-AttachVolumeMultiAttachTest-774919822-project-member', projectid='a9c48d6919e8435f876f3324616521ea', projectname='tempest-AttachVolumeMultiAttachTest-774919822'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850957.194404) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:02:37.196187 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:02:37.196652 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:02:37.198078 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:02:37.198324 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:02:37.199628 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:02:37.200057 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:02:37.200242 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:02:37.200384 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:02:37.200533 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:02:37.202929 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:02:37.202929 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:02:37.202929 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:02:37.202929 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:02:37.202929 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:02:37.202929 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:02:37.202929 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:02:37.221852 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='multiattach-server-1',id=33,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7X60AtOl0SsfuAMV1LtNGpvh0yvi8THxioUm4x62ykVhuM7q4sXRNe3S5fa56OsOiAX0ZbtOowRZ4+AKeGhch21Oc/NUN3hQGbbFxrwclVqtJHRu4HOLbwt9JgM8J0mA==',key_name='tempest-keypair-1333870124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-ki851fh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:02:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092604511a8a467ba4ecb56261cb531f',uuid=d7f71824-f631-423e-a5ea-8ae72642a95e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:02:37.222107 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:02:37.223768 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:48:d5,bridge_name='br-int',has_traffic_filtering=True,id=57af91c5-42f3-4f9f-ac26-aad2418fdfe3,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57af91c5-42') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:02:37.223768 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'pci_devices' on Instance uuid d7f71824-f631-423e-a5ea-8ae72642a95e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:37.432235 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:37.436308 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-adf43353-2a6f-4544-9c08-0547848c9b4c req-e9c2331b-7a99-4fca-970e-85e3c5a9153e service nova] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Received event network-vif-deleted-aea6a715-c60b-40d2-b064-f0b1b33a1000 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:37.485465 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-44150610-c1f7-4ed7-bbf7-256b31e44a6d req-7649993e-62b8-4fa2-8549-aefb7be03c23 service nova] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Received event network-vif-deleted-1dc18a8f-bec1-42d5-96ef-84706d61147c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:37.485465 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-44150610-c1f7-4ed7-bbf7-256b31e44a6d req-7649993e-62b8-4fa2-8549-aefb7be03c23 service nova] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Neutron deleted interface 1dc18a8f-bec1-42d5-96ef-84706d61147c; detaching it from the instance and deleting it from the info cache
May 27 03:02:37.485465 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-44150610-c1f7-4ed7-bbf7-256b31e44a6d req-7649993e-62b8-4fa2-8549-aefb7be03c23 service nova] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:37.728053 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] End _get_guest_xml xml=<domain type="qemu">
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:   <uuid>d7f71824-f631-423e-a5ea-8ae72642a95e</uuid>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:   <name>instance-00000021</name>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <nova:name>multiattach-server-1</nova:name>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:02:37</nova:creationTime>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:         <nova:user uuid="092604511a8a467ba4ecb56261cb531f">tempest-AttachVolumeMultiAttachTest-774919822-project-member</nova:user>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:         <nova:project uuid="a9c48d6919e8435f876f3324616521ea">tempest-AttachVolumeMultiAttachTest-774919822</nova:project>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:         <nova:port uuid="57af91c5-42f3-4f9f-ac26-aad2418fdfe3">
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     <system>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <entry name="serial">d7f71824-f631-423e-a5ea-8ae72642a95e</entry>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <entry name="uuid">d7f71824-f631-423e-a5ea-8ae72642a95e</entry>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     </system>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:   <os>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:   </os>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:   <features>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:   </features>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:   <devices>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     </disk>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk.config"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     </disk>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:88:48:d5"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <target dev="tap57af91c5-42"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     </interface>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/console.log" append="off"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     </serial>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     <video>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     </video>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     </rng>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:   </devices>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]: </domain>
May 27 03:02:37.728053 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:02:37.734653 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Preparing to wait for external event network-vif-plugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:02:37.734653 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:37.734653 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:37.734653 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:37.734653 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='multiattach-server-1',id=33,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7X60AtOl0SsfuAMV1LtNGpvh0yvi8THxioUm4x62ykVhuM7q4sXRNe3S5fa56OsOiAX0ZbtOowRZ4+AKeGhch21Oc/NUN3hQGbbFxrwclVqtJHRu4HOLbwt9JgM8J0mA==',key_name='tempest-keypair-1333870124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-ki851fh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:02:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092604511a8a467ba4ecb56261cb531f',uuid=d7f71824-f631-423e-a5ea-8ae72642a95e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:02:37.734653 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:02:37.734653 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:48:d5,bridge_name='br-int',has_traffic_filtering=True,id=57af91c5-42f3-4f9f-ac26-aad2418fdfe3,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57af91c5-42') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:02:37.734653 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:48:d5,bridge_name='br-int',has_traffic_filtering=True,id=57af91c5-42f3-4f9f-ac26-aad2418fdfe3,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57af91c5-42') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:02:37.734653 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:37.734653 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:37.736073 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:02:37.739166 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:37.741696 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08fc82db-545e-5228-ba83-fe7855350b56', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:37.749280 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:37.755407 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:37.757300 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57af91c5-42, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:37.762587 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57af91c5-42, col_values=(('qos', UUID('e1f94e43-c58b-448f-b0e9-e5fd6333769e')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:37.762912 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57af91c5-42, col_values=(('external_ids', {'iface-id': '57af91c5-42f3-4f9f-ac26-aad2418fdfe3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:48:d5', 'vm-uuid': 'd7f71824-f631-423e-a5ea-8ae72642a95e'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:37.766210 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:37.767397 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:37.773750 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:37.775234 np0000001475 nova-compute[98471]: INFO os_vif [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:48:d5,bridge_name='br-int',has_traffic_filtering=True,id=57af91c5-42f3-4f9f-ac26-aad2418fdfe3,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57af91c5-42')
May 27 03:02:37.907972 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:37.972473 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ac0716f1-9b72-4118-a934-32fc528cc103 req-c8b50184-aae3-448e-a23b-e61a2938c5cd service nova] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Received event network-vif-unplugged-1dc18a8f-bec1-42d5-96ef-84706d61147c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:37.976316 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ac0716f1-9b72-4118-a934-32fc528cc103 req-c8b50184-aae3-448e-a23b-e61a2938c5cd service nova] Acquiring lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:37.976581 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ac0716f1-9b72-4118-a934-32fc528cc103 req-c8b50184-aae3-448e-a23b-e61a2938c5cd service nova] Lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:37.976813 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ac0716f1-9b72-4118-a934-32fc528cc103 req-c8b50184-aae3-448e-a23b-e61a2938c5cd service nova] Lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:37.978101 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ac0716f1-9b72-4118-a934-32fc528cc103 req-c8b50184-aae3-448e-a23b-e61a2938c5cd service nova] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] No waiting events found dispatching network-vif-unplugged-1dc18a8f-bec1-42d5-96ef-84706d61147c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:37.978259 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ac0716f1-9b72-4118-a934-32fc528cc103 req-c8b50184-aae3-448e-a23b-e61a2938c5cd service nova] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Received event network-vif-unplugged-1dc18a8f-bec1-42d5-96ef-84706d61147c for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:02:37.989365 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-44150610-c1f7-4ed7-bbf7-256b31e44a6d req-7649993e-62b8-4fa2-8549-aefb7be03c23 service nova] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Detach interface failed, port_id=1dc18a8f-bec1-42d5-96ef-84706d61147c, reason: Instance ff7c9673-bf7d-426f-80a6-aa94a46ad33a could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:02:38.410857 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Took 1.46 seconds to deallocate network for instance.
May 27 03:02:38.439713 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:02:38.440113 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:02:38.921735 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:38.945811 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:02:39.305283 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:39.305475 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:39.305644 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No VIF found with MAC fa:16:3e:88:48:d5, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:02:39.306337 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Using config drive
May 27 03:02:39.456499 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 3.327s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:39.456728 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Migrating
May 27 03:02:39.457370 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.025s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:39.457370 np0000001475 nova-compute[98471]: DEBUG nova.compute.rpcapi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98471) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 03:02:39.816512 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:39.980630 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "refresh_cache-fcb1a3e2-e470-4773-a370-f122a79de2e6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:39.981129 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquired lock "refresh_cache-fcb1a3e2-e470-4773-a370-f122a79de2e6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:39.981129 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:02:40.017762 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Creating config drive at /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk.config
May 27 03:02:40.022171 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn_vwd6d3 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:40.090451 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn_vwd6d3" returned: 0 in 0.068s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:40.468070 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:02:40.468308 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:02:40.487822 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:40.624496 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:40.674119 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:40.858311 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:40.871333 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:40.877054 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:40.974949 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:02:40.984426 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:41.055534 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:41.064444 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c4c56fc7-ca7b-4442-a506-0b9cbe999424 req-c7d10859-f7a5-470d-934e-3d1b64f8afe0 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Received event network-vif-plugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:41.066019 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c4c56fc7-ca7b-4442-a506-0b9cbe999424 req-c7d10859-f7a5-470d-934e-3d1b64f8afe0 service nova] Acquiring lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:41.066250 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c4c56fc7-ca7b-4442-a506-0b9cbe999424 req-c7d10859-f7a5-470d-934e-3d1b64f8afe0 service nova] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:41.066436 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c4c56fc7-ca7b-4442-a506-0b9cbe999424 req-c7d10859-f7a5-470d-934e-3d1b64f8afe0 service nova] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:41.067057 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c4c56fc7-ca7b-4442-a506-0b9cbe999424 req-c7d10859-f7a5-470d-934e-3d1b64f8afe0 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Processing event network-vif-plugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:02:41.166271 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Updating instance_info_cache with network_info: [{"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:41.488877 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.032s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:41.491455 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.568s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:41.587831 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Deleted allocations for instance ba8ef70d-8e27-48c8-82e3-6501f6130456
May 27 03:02:41.668487 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Releasing lock "refresh_cache-fcb1a3e2-e470-4773-a370-f122a79de2e6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:41.678935 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850961.6785817, d7f71824-f631-423e-a5ea-8ae72642a95e => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:41.679069 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] VM Started (Lifecycle Event)
May 27 03:02:41.682337 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:02:41.689759 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:02:41.693317 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Instance spawned successfully.
May 27 03:02:41.696091 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:02:42.184668 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:42.203952 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:02:42.208052 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:42.210873 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:42.210873 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:42.210873 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:42.210873 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:42.210873 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:02:42.471434 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:02:42.471600 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:02:42.600681 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-27efda26-95cf-464a-9049-d9828cb50317 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "ba8ef70d-8e27-48c8-82e3-6501f6130456" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.839s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:42.715506 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:02:42.715904 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850962.7155895, d7f71824-f631-423e-a5ea-8ae72642a95e => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:42.715904 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] VM Paused (Lifecycle Event)
May 27 03:02:42.718311 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Took 8.12 seconds to spawn the instance on the hypervisor.
May 27 03:02:42.718483 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:42.772149 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:42.974148 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:02:43.152430 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-af64144b-b864-4eb2-89db-e1479d5c0e1f req-a5c52cee-3463-4f03-a922-a8403bd87c1a service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Received event network-vif-plugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:43.152614 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-af64144b-b864-4eb2-89db-e1479d5c0e1f req-a5c52cee-3463-4f03-a922-a8403bd87c1a service nova] Acquiring lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:43.153760 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-af64144b-b864-4eb2-89db-e1479d5c0e1f req-a5c52cee-3463-4f03-a922-a8403bd87c1a service nova] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:43.153760 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-af64144b-b864-4eb2-89db-e1479d5c0e1f req-a5c52cee-3463-4f03-a922-a8403bd87c1a service nova] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:43.158454 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-af64144b-b864-4eb2-89db-e1479d5c0e1f req-a5c52cee-3463-4f03-a922-a8403bd87c1a service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] No waiting events found dispatching network-vif-plugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:43.159644 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-af64144b-b864-4eb2-89db-e1479d5c0e1f req-a5c52cee-3463-4f03-a922-a8403bd87c1a service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Received unexpected event network-vif-plugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 for instance with vm_state active and task_state None.
May 27 03:02:43.194789 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Starting migrate_disk_and_power_off {{(pid=98471) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 27 03:02:43.222015 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:43.222015 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:43.223603 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:43.231798 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850963.2304778, d7f71824-f631-423e-a5ea-8ae72642a95e => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:43.231798 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] VM Resumed (Lifecycle Event)
May 27 03:02:43.239134 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Took 14.65 seconds to build instance.
May 27 03:02:43.256773 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:43.405767 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:43.415874 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:43.489608 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:43.547095 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-89ed8918-b502-4c70-ac93-596809394fae req-e450a623-282d-4823-8404-d3724887c34a service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Received event network-vif-unplugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:43.547095 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-89ed8918-b502-4c70-ac93-596809394fae req-e450a623-282d-4823-8404-d3724887c34a service nova] Acquiring lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:43.547095 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-89ed8918-b502-4c70-ac93-596809394fae req-e450a623-282d-4823-8404-d3724887c34a service nova] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:43.547095 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-89ed8918-b502-4c70-ac93-596809394fae req-e450a623-282d-4823-8404-d3724887c34a service nova] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:43.547095 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-89ed8918-b502-4c70-ac93-596809394fae req-e450a623-282d-4823-8404-d3724887c34a service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] No waiting events found dispatching network-vif-unplugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:43.547095 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-89ed8918-b502-4c70-ac93-596809394fae req-e450a623-282d-4823-8404-d3724887c34a service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Received unexpected event network-vif-unplugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 for instance with vm_state active and task_state resize_migrating.
May 27 03:02:43.566473 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Instance destroyed successfully.
May 27 03:02:43.569185 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1319467240',display_name='tempest-ServerActionsTestOtherA-server-1319467240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serveractionstestothera-server-1319467240',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVtCwqB5huD2R7WzeA2srtQrNLcY+5mh0PDFl9uXrLaNb8RbC2WmzNWR2uyfN3usptF21zcnp9tnWTIUBUOIX7SXlA+BK0+YEfHYyX09pbtKTE7qcopOd9351hytyFXVA==',key_name='tempest-keypair-2100360487',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:02:31Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='233d191c03874150880aca259ffd3e21',ramdisk_id='',reservation_id='r-xaz3c7w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-569974590',owner_user_name='tempest-ServerActionsTestOtherA-569974590-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a93dfe76ab455d8aa6e691b1fa34c5',uuid=fcb1a3e2-e470-4773-a370-f122a79de2e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-926404961-network", "vif_mac": "fa:16:3e:75:cb:49"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:02:43.569521 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converting VIF {"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-926404961-network", "vif_mac": "fa:16:3e:75:cb:49"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:02:43.570127 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=ee0e1172-e06e-46db-bda6-c793c47ec9a9,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e1172-e0') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:02:43.570462 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=ee0e1172-e06e-46db-bda6-c793c47ec9a9,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e1172-e0') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:02:43.574580 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:43.574903 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee0e1172-e0, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:43.576472 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:43.578927 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:43.582276 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:43.582276 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00759c55-861d-4548-b717-10d47d0502da) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:43.582276 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:43.582513 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:43.583911 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:43.586295 np0000001475 nova-compute[98471]: INFO os_vif [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=ee0e1172-e06e-46db-bda6-c793c47ec9a9,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e1172-e0')
May 27 03:02:43.587398 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Deleted allocations for instance ff7c9673-bf7d-426f-80a6-aa94a46ad33a
May 27 03:02:43.592125 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:02:43.592584 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:02:43.592735 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:02:43.593503 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:02:43.593852 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:02:43.594000 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:02:43.596089 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "02fd272a-5759-4995-9e5c-cc1f3e28072b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:43.596291 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "02fd272a-5759-4995-9e5c-cc1f3e28072b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:43.596513 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "02fd272a-5759-4995-9e5c-cc1f3e28072b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:43.596829 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "02fd272a-5759-4995-9e5c-cc1f3e28072b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:43.596916 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "02fd272a-5759-4995-9e5c-cc1f3e28072b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:43.606252 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Terminating instance
May 27 03:02:43.637221 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:43.637221 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:43.637221 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:43.637221 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:43.637221 np0000001475 nova-compute[98471]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:43.637221 np0000001475 nova-compute[98471]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:43.637221 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:43.637221 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:43.637221 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:43.637221 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:43.637221 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:43.637221 np0000001475 nova-compute[98471]: tcp: [55] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:43.637221 np0000001475 nova-compute[98471]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:43.637221 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:43.637221 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', '56')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:02:43.637221 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', '55')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:02:43.637221 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', '56')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:02:43.637221 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7557247c89a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705'): ({'sdm'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:02:43.637221 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Removing multipathed devices sdm, sdl {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:02:43.640623 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Flush multipath device 3300000005ccab551 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:02:43.700605 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:02:43.738118 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:43.740362 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:02:43.743519 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:02:43.744203 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.183s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:43.770084 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:43.770879 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:43.794170 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:02:43.794322 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:02:43.795259 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:02:43.807952 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:02:43.808211 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:02:43.820697 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:43.856204 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705, portal: 192.168.40.100,3260]
May 27 03:02:43.856204 np0000001475 nova-compute[98471]: Logout of [sid: 55, target: iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705, portal: 192.168.40.100,3260] successful.
May 27 03:02:43.856204 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:43.873518 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:43.884561 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:43.914049 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705, portal: 192.168.50.100,3260]
May 27 03:02:43.914049 np0000001475 nova-compute[98471]: Logout of [sid: 56, target: iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705, portal: 192.168.50.100,3260] successful.
May 27 03:02:43.914049 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:43.929479 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:43.929479 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:02:43.929479 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] <== disconnect_volume: return (336ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:02:43.929479 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:02:43.931778 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] skipping disk /dev/dm-9 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:02:43.932343 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/fcb1a3e2-e470-4773-a370-f122a79de2e6_resize/disk.config /opt/stack/data/nova/instances/fcb1a3e2-e470-4773-a370-f122a79de2e6/disk.config {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:43.981158 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "cp -r /opt/stack/data/nova/instances/fcb1a3e2-e470-4773-a370-f122a79de2e6_resize/disk.config /opt/stack/data/nova/instances/fcb1a3e2-e470-4773-a370-f122a79de2e6/disk.config" returned: 0 in 0.048s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:44.116415 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:02:44.147082 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:44.152655 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:44.178609 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:44.245729 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999658659000033 future=<Future at 0x755724738ce0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:44.276037 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lazy-loading 'flavor' on Instance uuid b4f2203e-ef29-4dcf-b665-236abd72e5f0 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:44.342215 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:44.349665 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:44.482638 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999666315000013 future=<Future at 0x755724778620 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:44.484104 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Instance destroyed successfully.
May 27 03:02:44.484720 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'resources' on Instance uuid 02fd272a-5759-4995-9e5c-cc1f3e28072b {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:44.600306 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c89ff42e-7a62-4529-b24e-6d914b1aec3e tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Lock "ff7c9673-bf7d-426f-80a6-aa94a46ad33a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.592s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:44.988282 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-878350560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverbootfromvolumestablerescuetest-server-878350560',id=24,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:01:29Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab70ea24752242a88583e819c6c34e12',ramdisk_id='',reservation_id='r-v9i46y3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:01:38Z,user_data=None,user_id='787c8d4d4527402cbbc2ad0475f710bb',uuid=02fd272a-5759-4995-9e5c-cc1f3e28072b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97", "address": "fa:16:3e:76:05:c4", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3f3f0b-8b", "ovs_interfaceid": "9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:02:44.988282 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converting VIF {"id": "9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97", "address": "fa:16:3e:76:05:c4", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c3f3f0b-8b", "ovs_interfaceid": "9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:02:44.988605 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:05:c4,bridge_name='br-int',has_traffic_filtering=True,id=9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3f3f0b-8b') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:02:44.989776 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:05:c4,bridge_name='br-int',has_traffic_filtering=True,id=9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3f3f0b-8b') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:02:44.991721 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:44.991721 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c3f3f0b-8b, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:44.992931 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:44.994856 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:44.995780 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:44.996317 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=723786a0-0db7-45dc-bfcf-4d529a602433) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:44.997776 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:44.997776 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:44.999233 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:45.000597 np0000001475 nova-compute[98471]: INFO os_vif [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:05:c4,bridge_name='br-int',has_traffic_filtering=True,id=9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c3f3f0b-8b')
May 27 03:02:45.000852 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Deleting instance files /opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b_del
May 27 03:02:45.001545 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Deletion of /opt/stack/data/nova/instances/02fd272a-5759-4995-9e5c-cc1f3e28072b_del complete
May 27 03:02:45.138385 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:45.138648 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:45.282881 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:45.367168 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Port ee0e1172-e06e-46db-bda6-c793c47ec9a9 binding to destination host np0000001475 is already ACTIVE {{(pid=98471) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 27 03:02:45.509001 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Took 1.39 seconds to destroy the instance on the hypervisor.
May 27 03:02:45.511352 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:02:45.511593 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:02:45.511686 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:02:45.511950 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:45.584701 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0004183089999969525 future=<Future at 0x75572c274f80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:45.584701 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:45.585038 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=2.5326211719998355 future=<Future at 0x755724776390 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:45.585038 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=2.532511316000182 future=<Future at 0x755724776390 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:45.585475 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Emitting event <LifecycleEvent: 1779850950.5840526, f33f8709-32f7-4ce3-9967-c54609dcbb0c => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:45.585626 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] VM Stopped (Lifecycle Event)
May 27 03:02:45.933686 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Received event network-vif-unplugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:45.934084 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] Acquiring lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:45.934084 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:45.934161 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:45.934370 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] No waiting events found dispatching network-vif-unplugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:45.934523 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Received unexpected event network-vif-unplugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 for instance with vm_state active and task_state resize_migrating.
May 27 03:02:45.934691 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Received event network-vif-unplugged-9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:45.935479 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] Acquiring lock "02fd272a-5759-4995-9e5c-cc1f3e28072b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:45.935856 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] Lock "02fd272a-5759-4995-9e5c-cc1f3e28072b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:45.935856 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] Lock "02fd272a-5759-4995-9e5c-cc1f3e28072b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:45.936000 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] No waiting events found dispatching network-vif-unplugged-9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:45.936131 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Received event network-vif-unplugged-9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:02:45.936340 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Received event network-vif-unplugged-9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:45.936474 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] Acquiring lock "02fd272a-5759-4995-9e5c-cc1f3e28072b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:45.936638 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] Lock "02fd272a-5759-4995-9e5c-cc1f3e28072b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:45.936793 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] Lock "02fd272a-5759-4995-9e5c-cc1f3e28072b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:45.936935 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] No waiting events found dispatching network-vif-unplugged-9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:45.937085 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Received event network-vif-unplugged-9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:02:45.937218 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received event network-changed-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:45.937358 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Refreshing instance network info cache due to event network-changed-a2498912-5a39-4f70-a141-dae495d11b2a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:02:45.937597 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] Acquiring lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:45.938347 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] Acquired lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:45.938347 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Refreshing network info cache for port a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:02:45.963769 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:46.056991 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:46.089072 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: f33f8709-32f7-4ce3-9967-c54609dcbb0c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:46.383865 np0000001475 nova-compute[98471]: DEBUG nova.compute.rpcapi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98471) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 03:02:46.393217 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:46.393414 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:46.393548 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:46.423949 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:46.424096 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:46.424320 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Attaching volume 3ee979db-8a4b-4b81-ae9b-554ed390eedc to /dev/vdb
May 27 03:02:46.433782 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:46.443915 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:46.485352 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:02:46.497322 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:02:46.526770 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:46.570491 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:02:46.571416 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:02:46.582290 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:02:46.586319 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b', 'fe80::fc16:3eff:fe1f:5a7', 'fe80::a095:90ff:feef:1465', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::fc16:3eff:fe7e:904a', 'fe80::c805:4ff:fe3b:2374', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:feb2:aa32', 'fe80::fc16:3eff:fe01:3d37', 'fe80::fc16:3eff:fe54:22d6', 'fe80::88ab:28ff:fedb:6e99', 'fe80::fc16:3eff:fe5c:3071', 'fe80::fc16:3eff:fed9:1c3f', 'fe80::fc16:3eff:fe88:48d5'] 
May 27 03:02:46.586319 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:02:46.586319 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:02:46.586628 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:02:46.587497 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Updating existing volume attachment record: cebefad8-92f6-4b87-aae7-54e7f76a715d {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:02:46.631569 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-66077f99-6b4e-446a-99a6-d7a48fd62460 req-85754b08-5d7a-461b-9e9a-a62dd3ec0147 service nova] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Received event network-vif-deleted-9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:46.632322 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-66077f99-6b4e-446a-99a6-d7a48fd62460 req-85754b08-5d7a-461b-9e9a-a62dd3ec0147 service nova] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Neutron deleted interface 9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97; detaching it from the instance and deleting it from the info cache
May 27 03:02:46.632322 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-66077f99-6b4e-446a-99a6-d7a48fd62460 req-85754b08-5d7a-461b-9e9a-a62dd3ec0147 service nova] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:46.878335 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:46.943185 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:47.059490 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:47.138834 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-66077f99-6b4e-446a-99a6-d7a48fd62460 req-85754b08-5d7a-461b-9e9a-a62dd3ec0147 service nova] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Detach interface failed, port_id=9c3f3f0b-8b0a-4ec5-8105-8fdfa5423b97, reason: Instance 02fd272a-5759-4995-9e5c-cc1f3e28072b could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:02:47.188390 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'b4f2203e-ef29-4dcf-b665-236abd72e5f0', 'attached_at': '', 'detached_at': '', 'volume_id': '3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'serial': '3ee979db-8a4b-4b81-ae9b-554ed390eedc'} {{(pid=98471) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 03:02:47.192111 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:02:47.192481 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:02:47.192712 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:02:47.193309 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:02:47.193590 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:02:47.208702 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:02:47.209413 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:02:47.210102 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:02:47.210289 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:02:47.211178 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:02:47.211719 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:02:47.221932 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:02:47.221932 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:47.231623 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:02:47.231623 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:47.241905 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc] added
May 27 03:02:47.241905 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:02:47.241905 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:02:47.241905 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:02:47.241905 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:02:47.241905 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:02:47.241905 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:47.241905 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:02:47.241905 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0302(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:02:47.241905 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:02:47.248722 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc] added
May 27 03:02:47.248722 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:02:47.248722 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:02:47.248722 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:02:47.248722 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:02:47.248722 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:02:47.248722 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:47.248995 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:02:47.249200 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0375(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:02:47.249363 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:02:47.408344 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:47.483967 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:47.495850 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "refresh_cache-fcb1a3e2-e470-4773-a370-f122a79de2e6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:47.496031 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquired lock "refresh_cache-fcb1a3e2-e470-4773-a370-f122a79de2e6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:47.496168 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:02:47.560952 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Took 2.05 seconds to deallocate network for instance.
May 27 03:02:47.798316 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Updated VIF entry in instance network info cache for port a2498912-5a39-4f70-a141-dae495d11b2a. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:02:47.798639 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Updating instance_info_cache with network_info: [{"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:47.999823 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:48.067965 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:48.068160 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:48.117922 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.00044897599991600146 future=<Future at 0x755724776390 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:48.118609 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Emitting event <LifecycleEvent: 1779850953.1173732, ba8ef70d-8e27-48c8-82e3-6501f6130456 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:48.118822 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] VM Stopped (Lifecycle Event)
May 27 03:02:48.120193 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:48.120193 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=2.778282554999805 future=<Future at 0x75572c2a0ce0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:48.120193 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=2.7781507669997154 future=<Future at 0x75572c2a0ce0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:48.243451 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:02:48.252629 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:02:48.270415 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:02:48.270415 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:02:48.284721 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:02:48.284721 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:48.289482 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:48.301804 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] Releasing lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:48.301941 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Received event network-changed-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:48.303052 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Refreshing instance network info cache due to event network-changed-57af91c5-42f3-4f9f-ac26-aad2418fdfe3. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:02:48.303810 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] Acquiring lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:48.303810 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] Acquired lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:48.303810 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Refreshing network info cache for port 57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:02:48.304764 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:48.310813 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:48.311119 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:48.317985 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:48.317985 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:48.317985 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:48.317985 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:48.317985 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:48.317985 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:48.317985 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:48.317985 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:48.317985 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:48.317985 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:48.326473 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:48.326473 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:48.326473 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:48.326473 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:48.326473 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:48.326473 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:48.326473 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:48.326473 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:48.326473 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:48.326473 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:48.360231 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc, portal: 192.168.50.100,3260]
May 27 03:02:48.360231 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc, portal: 192.168.50.100,3260] successful.
May 27 03:02:48.360231 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:48.366048 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc, portal: 192.168.40.100,3260]
May 27 03:02:48.366048 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc, portal: 192.168.40.100,3260] successful.
May 27 03:02:48.366048 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:48.381183 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:48.381806 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:48.408570 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:48.408570 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:48.408570 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:48.408570 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:48.408570 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:48.408570 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:48.408570 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:48.408570 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:48.408570 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:48.408570 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:48.408570 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:48.408570 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:48.408570 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:48.408570 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:48.418171 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:02:48.421265 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:48.421265 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:48.421265 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:48.421265 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:48.421265 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:48.421265 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:48.421265 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:48.421265 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:02:48.422999 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:48.422999 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:48.422999 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:48.422999 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:48.422999 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:48.422999 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:48.422999 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:48.423377 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.213s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:02:48.425774 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:02:48.428090 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] HCTL ('11', '-', '-', 0) found on session 59 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:02:48.428266 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:02:48.429103 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] HCTL ('12', '-', '-', 0) found on session 60 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:02:48.429292 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:02:48.467397 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Searching for a device in session 59 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:02:48.470966 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:48.470966 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:02:48.471539 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Searching for a device in session 60 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:02:48.471820 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:02:48.629599 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: ba8ef70d-8e27-48c8-82e3-6501f6130456] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:48.811478 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:48.817167 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'flavor' on Instance uuid c2a5e735-d573-4ac4-bff0-d4a12648718e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:49.068056 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:02:49.068411 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:02:49.214156 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:02:49.437206 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Updating instance_info_cache with network_info: [{"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:49.571828 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:02:49.827841 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:49.943037 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Releasing lock "refresh_cache-fcb1a3e2-e470-4773-a370-f122a79de2e6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:50.000845 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:50.077967 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:50.081750 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.014s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:50.164937 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Deleted allocations for instance 02fd272a-5759-4995-9e5c-cc1f3e28072b
May 27 03:02:50.232369 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Found WWN 3300000007a8ef14c for multipath device dm-4 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:02:50.232369 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:02:50.235452 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '3300000007a8ef14c', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '3300000007a8ef14c'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:02:50.235452 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007a8ef14c', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '3300000007a8ef14c'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:02:50.237714 np0000001475 nova-compute[98471]: WARNING stevedore.named [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 03:02:50.237714 np0000001475 nova-compute[98471]: WARNING castellan.key_manager [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:02:50.240845 np0000001475 nova-compute[98471]: WARNING nova.keymgr.conf_key_mgr [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:02:50.242805 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x75572c4c2db0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': 'b4f2203e-ef29-4dcf-b665-236abd72e5f0', 'attached_at': '', 'detached_at': '', 'volume_id': '3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'serial': '3ee979db-8a4b-4b81-ae9b-554ed390eedc'} {{(pid=98471) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 27 03:02:50.243495 np0000001475 nova-compute[98471]: WARNING os_brick.encryptors.cryptsetup [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Deprecated: The plain CryptsetupEncryptor is deprecated and will be removed in a future release. Existing users are encouraged to retype any existing volumes using this encryptor to the 'luks' LuksEncryptor or 'luks2' Luks2Encryptor encryptors as soon as possible.
May 27 03:02:50.243864 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98471) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 27 03:02:50.244199 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors.cryptsetup [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] opening encrypted volume /dev/dm-4 {{(pid=98471) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:104}}
May 27 03:02:50.360554 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:50.364648 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lazy-loading 'flavor' on Instance uuid b4f2203e-ef29-4dcf-b665-236abd72e5f0 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:50.450835 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:02:50.462182 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:02:50.489015 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:50.538275 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:02:50.538275 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:02:50.550573 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:02:50.552472 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b', 'fe80::fc16:3eff:fe1f:5a7', 'fe80::a095:90ff:feef:1465', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::fc16:3eff:fe7e:904a', 'fe80::c805:4ff:fe3b:2374', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:feb2:aa32', 'fe80::fc16:3eff:fe01:3d37', 'fe80::fc16:3eff:fe54:22d6', 'fe80::88ab:28ff:fedb:6e99', 'fe80::fc16:3eff:fe5c:3071', 'fe80::fc16:3eff:fed9:1c3f', 'fe80::fc16:3eff:fe88:48d5'] 
May 27 03:02:50.552886 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:02:50.553058 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:02:50.553442 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:02:50.601645 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Updated VIF entry in instance network info cache for port 57af91c5-42f3-4f9f-ac26-aad2418fdfe3. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:02:50.601645 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Updating instance_info_cache with network_info: [{"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:50.870819 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Attempting to attach volume 3ee979db-8a4b-4b81-ae9b-554ed390eedc with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:02:50.873625 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:02:50.873625 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:02:50.873625 np0000001475 nova-compute[98471]:   <alias name="ua-3ee979db-8a4b-4b81-ae9b-554ed390eedc"/>
May 27 03:02:50.873625 np0000001475 nova-compute[98471]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 27 03:02:50.873625 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:02:50.873625 np0000001475 nova-compute[98471]:   <serial>3ee979db-8a4b-4b81-ae9b-554ed390eedc</serial>
May 27 03:02:50.873625 np0000001475 nova-compute[98471]: </disk>
May 27 03:02:50.873625 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:02:50.899497 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0006468710002991429 future=<Future at 0x75572c2a0ce0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:50.899497 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:50.899497 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=8.345940727000198 future=<Future at 0x755724738ce0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:50.899703 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=8.34581729599995 future=<Future at 0x755724738ce0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:50.900929 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Emitting event <LifecycleEvent: 1779850955.8982587, ff7c9673-bf7d-426f-80a6-aa94a46ad33a => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:50.902893 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] VM Stopped (Lifecycle Event)
May 27 03:02:50.923044 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:50.923452 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:50.923763 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Attaching volume 8cd7c930-2109-4c04-85a8-31ac0ce9341e to /dev/vdb
May 27 03:02:50.982072 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:02:50.996536 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:02:51.019344 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:51.060503 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:51.074810 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:02:51.075237 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:02:51.085787 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:02:51.089407 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b', 'fe80::fc16:3eff:fe1f:5a7', 'fe80::a095:90ff:feef:1465', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::fc16:3eff:fe7e:904a', 'fe80::c805:4ff:fe3b:2374', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:feb2:aa32', 'fe80::fc16:3eff:fe01:3d37', 'fe80::fc16:3eff:fe54:22d6', 'fe80::88ab:28ff:fedb:6e99', 'fe80::fc16:3eff:fe5c:3071', 'fe80::fc16:3eff:fed9:1c3f', 'fe80::fc16:3eff:fe88:48d5'] 
May 27 03:02:51.090757 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:02:51.090968 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:02:51.092009 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:02:51.092009 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Updating existing volume attachment record: 22509f0f-c1b5-422b-82da-0499c77d646d {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:02:51.107770 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8ca833d-7914-41f0-9631-46bcf9d74d51 req-c909894c-a148-4323-b4ad-77c974b6e9a7 service nova] Releasing lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:02:51.181728 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-360da4ee-7301-49c4-83de-19ee59a773f6 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "02fd272a-5759-4995-9e5c-cc1f3e28072b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.585s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:51.407800 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: ff7c9673-bf7d-426f-80a6-aa94a46ad33a] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:51.537229 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:02:51.537736 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:02:51.537856 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:02:51.538220 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:02:51.538430 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:02:51.538679 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:02:51.538946 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:02:51.539508 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:02:51.539682 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:02:51.539888 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:02:51.663904 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:02:51.664319 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:02:51.664605 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:02:51.665156 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:02:51.665393 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:02:51.681666 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:02:51.682796 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:02:51.683204 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:02:51.683472 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:02:51.684052 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:02:51.684258 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:02:51.694619 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:02:51.694619 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:51.703054 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:02:51.703054 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:51.710956 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e] added
May 27 03:02:51.710956 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:02:51.710956 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:02:51.710956 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:02:51.710956 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:02:51.710956 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:02:51.710956 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:51.710956 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:02:51.710956 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0272(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:02:51.710956 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:02:51.717937 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e] added
May 27 03:02:51.717937 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:02:51.717937 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:02:51.717937 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:02:51.717937 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:02:51.717937 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:02:51.717937 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:51.717937 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:02:51.717937 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.032(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:02:51.717937 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:02:51.761418 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Starting finish_migration {{(pid=98471) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 27 03:02:51.763393 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Instance directory exists: not creating {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 03:02:51.763569 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Creating image(s)
May 27 03:02:51.764017 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:02:51.764317 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Ensure instance console log exists: /opt/stack/data/nova/instances/fcb1a3e2-e470-4773-a370-f122a79de2e6/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:02:51.764559 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:51.764747 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:51.764920 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:51.765780 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Start _get_guest_xml network_info=[{"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-926404961-network", "vif_mac": "fa:16:3e:75:cb:49"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'fcb1a3e2-e470-4773-a370-f122a79de2e6', 'attached_at': '2026-05-27T03:02:51.000000', 'detached_at': '', 'volume_id': '4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'serial': '4f6a6a1f-0542-4c3d-b318-52f71fb19705'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '58212078-38d6-472e-99f1-d855a0cfab8c', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:02:51.769628 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:02:51.774005 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1319467240', uuid='fcb1a3e2-e470-4773-a370-f122a79de2e6'), owner=OwnerMeta(userid='d4a93dfe76ab455d8aa6e691b1fa34c5', username='tempest-ServerActionsTestOtherA-569974590-project-member', projectid='233d191c03874150880aca259ffd3e21', projectname='tempest-ServerActionsTestOtherA-569974590'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-926404961-network", "vif_mac": "fa:16:3e:75:cb:49"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850971.773453) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:02:51.776194 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:02:51.776631 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:02:51.777894 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:02:51.778151 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:02:51.779615 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:02:51.779956 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:02:51.780152 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:02:51.780281 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:02:51.780446 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:02:51.780582 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:02:51.780713 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:02:51.780928 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:02:51.781072 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:02:51.781235 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:02:51.781375 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:02:51.781530 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:02:51.796043 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb1a3e2-e470-4773-a370-f122a79de2e6/disk.config --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:51.810768 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:51.914311 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb1a3e2-e470-4773-a370-f122a79de2e6/disk.config --force-share --output=json" returned: 0 in 0.117s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:51.914311 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcb1a3e2-e470-4773-a370-f122a79de2e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:51.914311 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "/opt/stack/data/nova/instances/fcb1a3e2-e470-4773-a370-f122a79de2e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:51.914311 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "/opt/stack/data/nova/instances/fcb1a3e2-e470-4773-a370-f122a79de2e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:51.914671 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:02:51.914938 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:02:51.915109 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:02:52.045505 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:52.045773 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:52.046042 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:52.046179 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:02:52.254797 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:52.367061 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "7acda56f-e16c-4371-99b3-21eeea2904d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:52.367262 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:52.367434 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:52.367558 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:52.367667 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:52.370821 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Terminating instance
May 27 03:02:52.582150 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:52.583163 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:52.583163 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:52.583163 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No VIF found with MAC fa:16:3e:54:22:d6, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:02:52.712436 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:02:52.718051 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:02:52.728487 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:02:52.728487 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:02:52.738071 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:02:52.738071 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:52.745241 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:52.753201 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:52.762097 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:52.762097 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:52.762097 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:52.762097 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:52.762097 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:52.762097 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:52.762097 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:52.762432 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:52.762432 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:52.762432 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:52.762432 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:52.762432 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:52.762432 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:52.762432 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:52.772475 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:52.772475 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:52.772475 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:52.772475 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:52.772475 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:52.772475 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:52.772475 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:52.772475 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:52.772475 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:52.772475 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:52.772475 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:52.772475 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:52.772475 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:52.772475 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:52.813115 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e, portal: 192.168.40.100,3260]
May 27 03:02:52.813115 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e, portal: 192.168.40.100,3260] successful.
May 27 03:02:52.813115 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:52.828299 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e, portal: 192.168.50.100,3260]
May 27 03:02:52.828299 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e, portal: 192.168.50.100,3260] successful.
May 27 03:02:52.828299 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:52.829714 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:52.845698 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:52.858104 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:52.858104 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:52.858104 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:52.858104 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:52.858104 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:52.858104 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:52.858104 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:52.858104 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:52.858104 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:52.858438 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:52.858438 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:52.858438 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:52.858438 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:52.858438 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:52.858438 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:52.858438 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:52.858438 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:52.858438 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:52.858846 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:02:52.858947 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:02:52.860334 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] HCTL ('13', '-', '-', 0) found on session 61 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:02:52.860334 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:02:52.862862 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:52.862862 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:52.862862 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:52.862862 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:52.862862 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:52.862862 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:52.862862 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:52.862862 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:52.862862 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:52.863889 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:52.863889 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:52.863889 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:52.863889 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:52.863889 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:52.863889 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:52.863889 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:52.863889 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:52.863889 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:52.863889 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:02:52.863889 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:02:52.865719 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] HCTL ('14', '-', '-', 0) found on session 62 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:02:52.865719 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:02:52.874927 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:02:52.909600 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching for a device in session 61 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:02:52.909600 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:02:52.909600 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching for a device in session 62 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:02:52.909600 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:02:52.912383 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:52.918837 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:52.945430 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:53.131051 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:53.171508 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:53.180025 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:53.256462 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:53.258275 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99800136399972 future=<Future at 0x75572c126f00 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:53.261979 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:53.278045 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Instance destroyed successfully.
May 27 03:02:53.279403 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'resources' on Instance uuid 7acda56f-e16c-4371-99b3-21eeea2904d1 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:53.375713 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:53.379634 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-9 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:02:53.382541 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:53.486508 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:53.489766 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:53.585319 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:53.590069 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:53.667550 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:53.667550 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:53.685918 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:02:53.698303 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:53.700770 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:53.787316 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-125761252',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverbootfromvolumestablerescuetest-server-125761252',id=17,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:01:02Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab70ea24752242a88583e819c6c34e12',ramdisk_id='',reservation_id='r-nn9dht37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:01:10Z,user_data=None,user_id='787c8d4d4527402cbbc2ad0475f710bb',uuid=7acda56f-e16c-4371-99b3-21eeea2904d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "address": "fa:16:3e:7e:90:4a", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped993fcc-f7", "ovs_interfaceid": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:02:53.787595 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converting VIF {"id": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "address": "fa:16:3e:7e:90:4a", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped993fcc-f7", "ovs_interfaceid": "ed993fcc-f75a-4549-937f-26a3a42c5fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:02:53.789252 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:90:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed993fcc-f75a-4549-937f-26a3a42c5fe8,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped993fcc-f7') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:02:53.789252 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:90:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed993fcc-f75a-4549-937f-26a3a42c5fe8,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped993fcc-f7') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:02:53.791462 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:53.792239 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:53.792617 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped993fcc-f7, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:53.796275 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:53.812106 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:53.816312 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:53.819125 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:53.819448 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1cd40d9d-07e2-492b-8f8a-c81235b3e283) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:53.820417 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:53.820943 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:53.821611 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:53.824548 np0000001475 nova-compute[98471]: INFO os_vif [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:90:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed993fcc-f75a-4549-937f-26a3a42c5fe8,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped993fcc-f7')
May 27 03:02:53.829118 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:02:53.829866 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:02:53.830196 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:02:53.870542 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:53.894196 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:53.896773 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:53.993399 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:53.998771 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:54.110849 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:54.112673 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:54.172062 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:02:54.192546 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d5cb13a-542c-46e9-9b32-975996423933 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.768s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:54.230798 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:54.238727 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:54.372040 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:54.372040 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:54.486301 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:54.491630 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:02:54.495727 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.rescue --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:54.617992 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.rescue --force-share --output=json" returned: 0 in 0.122s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:54.617992 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.rescue --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:54.701413 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:54.712230 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Found WWN 3300000007d606cb0 for multipath device dm-6 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:02:54.714218 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.049s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:02:54.715767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] <== connect_volume: return (3049ms) {'type': 'block', 'scsi_wwn': '3300000007d606cb0', 'path': '/dev/dm-6', 'multipath_id': '3300000007d606cb0'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:02:54.715767 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007d606cb0', 'path': '/dev/dm-6', 'multipath_id': '3300000007d606cb0'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:02:54.715767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.800s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:02:54.715767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:02:54.720768 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'flavor' on Instance uuid c2a5e735-d573-4ac4-bff0-d4a12648718e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:54.727715 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.rescue --force-share --output=json" returned: 0 in 0.110s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:54.728456 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:54.761351 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:02:54.765495 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:02:54.769372 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:02:54.769372 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:02:54.771097 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.011s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:02:54.771446 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:02:54.785881 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:54.786272 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:54.787206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:02:54.787206 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:54.791795 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:02:54.792029 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Claim successful on node np0000001475
May 27 03:02:54.800942 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:02:54.800942 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:54.804914 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705] added
May 27 03:02:54.804914 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:02:54.804914 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:02:54.804914 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:02:54.804914 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:02:54.804914 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:02:54.804914 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:54.805196 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:02:54.806799 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0361(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:02:54.806799 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:02:54.815460 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705] added
May 27 03:02:54.815460 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:02:54.815460 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:02:54.815460 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:02:54.815460 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:02:54.815460 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:02:54.815460 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:54.815776 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:02:54.815982 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0445(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:02:54.816066 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:02:54.858441 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:54.859273 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:54.959593 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:54.965767 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:55.064867 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:55.064867 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:55.163869 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:55.165974 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-4 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:02:55.169916 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:55.227466 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Attempting to attach volume 8cd7c930-2109-4c04-85a8-31ac0ce9341e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:02:55.231097 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:02:55.231097 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:02:55.231097 np0000001475 nova-compute[98471]:   <alias name="ua-8cd7c930-2109-4c04-85a8-31ac0ce9341e"/>
May 27 03:02:55.231097 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-6"/>
May 27 03:02:55.231097 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:02:55.231097 np0000001475 nova-compute[98471]:   <serial>8cd7c930-2109-4c04-85a8-31ac0ce9341e</serial>
May 27 03:02:55.231097 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:02:55.231097 np0000001475 nova-compute[98471]: </disk>
May 27 03:02:55.231097 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:02:55.266062 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:55.269608 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:55.371942 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:55.378878 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:55.459559 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:55.460411 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:55.486811 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:55.488771 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:55.596673 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:55.603265 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:02:55.606469 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:02:55.608042 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:02:55.651846 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:02:55.653148 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=10405MB free_disk=73.0298080444336GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:02:55.653148 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:55.806729 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:02:55.822817 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:02:55.833967 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:02:55.833967 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:02:55.845733 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:02:55.845733 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:55.859776 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:55.864841 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:55.886455 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:55.886455 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:55.886455 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:55.886455 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:55.886455 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:55.886455 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:55.886455 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:55.886455 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:55.886455 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:55.886729 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:55.886729 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:55.886729 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:55.886729 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:55.886729 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:55.886729 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:55.886729 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:55.886729 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:55.886729 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:55.888382 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:55.888382 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:55.888382 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:55.888382 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:55.888382 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:55.888382 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:55.888382 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:55.888382 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:55.888382 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:55.888799 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:55.888799 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:55.888799 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:55.888799 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:55.888799 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:55.888799 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:55.888799 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:55.888799 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:55.888799 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:55.940345 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705, portal: 192.168.50.100,3260]
May 27 03:02:55.940345 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705, portal: 192.168.50.100,3260] successful.
May 27 03:02:55.940345 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:55.950009 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705, portal: 192.168.40.100,3260]
May 27 03:02:55.950009 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705, portal: 192.168.40.100,3260] successful.
May 27 03:02:55.950009 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:55.955371 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:55.964062 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Detaching volume 3ee979db-8a4b-4b81-ae9b-554ed390eedc
May 27 03:02:55.966377 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:55.984369 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:55.984369 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:55.984369 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:55.984369 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:55.984369 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:55.984369 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:55.984369 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:55.984369 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:55.984369 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:55.984369 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:55.984369 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:55.984807 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:55.984807 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:55.984807 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:55.984807 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:55.984807 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:55.984807 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:55.984807 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:55.984807 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:55.984807 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:55.984807 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:55.984807 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:55.985386 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.216s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:02:55.985941 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:02:55.987733 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] HCTL ('15', '-', '-', 0) found on session 63 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:02:55.987915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:55.998326 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:55.998326 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.227s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:02:55.998326 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:02:56.000805 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] HCTL ('16', '-', '-', 0) found on session 64 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:02:56.000945 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:02:56.015670 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Searching for a device in session 63 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:02:56.015914 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:02:56.029621 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Searching for a device in session 64 and hctl ['16', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:02:56.036496 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Attempting to driver detach volume 3ee979db-8a4b-4b81-ae9b-554ed390eedc from mountpoint /dev/vdb
May 27 03:02:56.068232 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:56.099454 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': 'b4f2203e-ef29-4dcf-b665-236abd72e5f0', 'attached_at': '', 'detached_at': '', 'volume_id': '3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'serial': '3ee979db-8a4b-4b81-ae9b-554ed390eedc'} {{(pid=98471) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 03:02:56.105844 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Found disk vdb by alias ua-3ee979db-8a4b-4b81-ae9b-554ed390eedc {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:02:56.110229 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Found disk vdb by alias ua-3ee979db-8a4b-4b81-ae9b-554ed390eedc {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:02:56.110229 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Attempting to detach device vdb from instance b4f2203e-ef29-4dcf-b665-236abd72e5f0 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:02:56.110229 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:02:56.110229 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:02:56.110229 np0000001475 nova-compute[98471]:   <alias name="ua-3ee979db-8a4b-4b81-ae9b-554ed390eedc"/>
May 27 03:02:56.110229 np0000001475 nova-compute[98471]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 27 03:02:56.110229 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:02:56.110229 np0000001475 nova-compute[98471]:   <serial>3ee979db-8a4b-4b81-ae9b-554ed390eedc</serial>
May 27 03:02:56.110229 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:02:56.110229 np0000001475 nova-compute[98471]: </disk>
May 27 03:02:56.110229 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:02:56.120954 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Successfully detached device vdb from instance b4f2203e-ef29-4dcf-b665-236abd72e5f0 from the persistent domain config.
May 27 03:02:56.120954 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] (1/8): Attempting to detach device vdb with device alias ua-3ee979db-8a4b-4b81-ae9b-554ed390eedc from instance b4f2203e-ef29-4dcf-b665-236abd72e5f0 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:02:56.120954 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:02:56.120954 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:02:56.120954 np0000001475 nova-compute[98471]:   <alias name="ua-3ee979db-8a4b-4b81-ae9b-554ed390eedc"/>
May 27 03:02:56.120954 np0000001475 nova-compute[98471]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 27 03:02:56.120954 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:02:56.120954 np0000001475 nova-compute[98471]:   <serial>3ee979db-8a4b-4b81-ae9b-554ed390eedc</serial>
May 27 03:02:56.120954 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:02:56.120954 np0000001475 nova-compute[98471]: </disk>
May 27 03:02:56.120954 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:02:56.322976 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:56.824176 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779850976.823688, b4f2203e-ef29-4dcf-b665-236abd72e5f0 => ua-3ee979db-8a4b-4b81-ae9b-554ed390eedc> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:02:56.825771 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3ee979db-8a4b-4b81-ae9b-554ed390eedc for instance b4f2203e-ef29-4dcf-b665-236abd72e5f0 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:02:56.835477 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Successfully detached device vdb from instance b4f2203e-ef29-4dcf-b665-236abd72e5f0 from the live domain config.
May 27 03:02:56.842841 np0000001475 nova-compute[98471]: WARNING stevedore.named [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 03:02:56.843018 np0000001475 nova-compute[98471]: WARNING castellan.key_manager [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:02:56.843280 np0000001475 nova-compute[98471]: WARNING nova.keymgr.conf_key_mgr [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:02:56.844435 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x7557047f3e30>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': 'b4f2203e-ef29-4dcf-b665-236abd72e5f0', 'attached_at': '', 'detached_at': '', 'volume_id': '3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'serial': '3ee979db-8a4b-4b81-ae9b-554ed390eedc'} {{(pid=98471) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 27 03:02:56.844569 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors.cryptsetup [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] closing encrypted volume /dev/dm-5 {{(pid=98471) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:153}}
May 27 03:02:56.873988 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:02:56.875270 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:02:56.875673 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:02:56.922785 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:56.923005 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:56.923107 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:56.923417 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No VIF found with MAC fa:16:3e:5c:30:71, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:02:56.943335 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:02:56.943713 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:02:57.030339 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Searching for a device in session 64 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:02:57.030448 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:02:57.447054 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:02:57.795880 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Found WWN 3300000005ccab551 for multipath device dm-7 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:02:57.795880 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.080s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:02:57.795880 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] <== connect_volume: return (5881ms) {'type': 'block', 'scsi_wwn': '3300000005ccab551', 'path': '/dev/dm-7', 'multipath_id': '3300000005ccab551'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:02:57.796111 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005ccab551', 'path': '/dev/dm-7', 'multipath_id': '3300000005ccab551'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:02:57.796816 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.967s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:02:57.797197 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6a1921ec-dd47-422c-af8e-b1cbf29ad186', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:02:57.797414 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:02:57.835979 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:57.835979 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:57.835979 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:57.835979 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:57.835979 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:57.835979 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:57.835979 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:57.835979 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:57.835979 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:57.835979 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:57.835979 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:57.839234 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:57.839234 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:57.839234 np0000001475 nova-compute[98471]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:57.839234 np0000001475 nova-compute[98471]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186 (non-flash)
May 27 03:02:57.839234 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:57.839234 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:57.839234 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:57.839234 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:57.839234 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:57.839234 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:57.839234 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:57.839234 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', '59'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', '60'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', '64')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:02:57.839234 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', '39')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:02:57.839234 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186', '40')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:02:57.839234 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c113ce0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186'): ({'sdc'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:02:57.839234 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Removing multipathed devices sdb, sdc {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:02:57.840322 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Flush multipath device 330000000ea028c01 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:02:57.885058 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:02:57.887470 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5f428103-c6df-41b6-9e51-afdf00c2f32f req-d6f7af71-b889-42f1-a283-5b9105877472 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received event network-vif-unplugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:57.887470 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5f428103-c6df-41b6-9e51-afdf00c2f32f req-d6f7af71-b889-42f1-a283-5b9105877472 service nova] Acquiring lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:57.887608 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5f428103-c6df-41b6-9e51-afdf00c2f32f req-d6f7af71-b889-42f1-a283-5b9105877472 service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:57.887684 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5f428103-c6df-41b6-9e51-afdf00c2f32f req-d6f7af71-b889-42f1-a283-5b9105877472 service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:57.887862 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5f428103-c6df-41b6-9e51-afdf00c2f32f req-d6f7af71-b889-42f1-a283-5b9105877472 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] No waiting events found dispatching network-vif-unplugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:57.888841 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5f428103-c6df-41b6-9e51-afdf00c2f32f req-d6f7af71-b889-42f1-a283-5b9105877472 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received event network-vif-unplugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:02:57.927198 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:02:57.954113 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.168s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:57.954798 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:02:57.958450 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 2.302s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:57.974611 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:02:57.974787 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:02:57.975950 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:02:57.991817 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:02:57.992264 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:02:58.009784 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:58.057344 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186, portal: 192.168.40.100,3260]
May 27 03:02:58.057344 np0000001475 nova-compute[98471]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186, portal: 192.168.40.100,3260] successful.
May 27 03:02:58.057344 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:58.078771 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:58.089660 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:58.135264 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186, portal: 192.168.50.100,3260]
May 27 03:02:58.135264 np0000001475 nova-compute[98471]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-6a1921ec-dd47-422c-af8e-b1cbf29ad186, portal: 192.168.50.100,3260] successful.
May 27 03:02:58.135264 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:58.158261 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:58.158601 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:02:58.158835 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] <== disconnect_volume: return (4329ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:02:58.159356 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:02:58.159690 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Deleting instance files /opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1_del
May 27 03:02:58.160367 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Deletion of /opt/stack/data/nova/instances/7acda56f-e16c-4371-99b3-21eeea2904d1_del complete
May 27 03:02:58.162926 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.284s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:02:58.163348 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee979db-8a4b-4b81-ae9b-554ed390eedc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:02:58.163523 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:02:58.206238 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:58.206238 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:58.206238 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:58.206238 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:58.206238 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:58.206238 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:58.206238 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:58.206238 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:58.206238 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:02:58.206238 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:58.206238 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:02:58.206238 np0000001475 nova-compute[98471]: tcp: [59] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:58.206238 np0000001475 nova-compute[98471]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc (non-flash)
May 27 03:02:58.206238 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:58.206238 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:02:58.206238 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:58.206238 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:02:58.206238 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:02:58.206238 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', '59'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', '60'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', '64')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:02:58.206238 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', '60')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:02:58.207116 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc', '59')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:02:58.211767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c113ce0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc'): ({'sdf'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:02:58.211767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Removing multipathed devices sdf, sdg {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:02:58.211767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Flush multipath device 3300000007a8ef14c {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:02:58.245988 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:02:58.293580 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:02:58.307547 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1319467240',display_name='tempest-ServerActionsTestOtherA-server-1319467240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001475',hostname='tempest-serveractionstestothera-server-1319467240',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVtCwqB5huD2R7WzeA2srtQrNLcY+5mh0PDFl9uXrLaNb8RbC2WmzNWR2uyfN3usptF21zcnp9tnWTIUBUOIX7SXlA+BK0+YEfHYyX09pbtKTE7qcopOd9351hytyFXVA==',key_name='tempest-keypair-2100360487',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:02:31Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001475',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='233d191c03874150880aca259ffd3e21',ramdisk_id='',reservation_id='r-xaz3c7w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-569974590',owner_user_name='tempest-ServerActionsTestOtherA-569974590-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:02:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a93dfe76ab455d8aa6e691b1fa34c5',uuid=fcb1a3e2-e470-4773-a370-f122a79de2e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-926404961-network", "vif_mac": "fa:16:3e:75:cb:49"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:02:58.307844 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converting VIF {"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-926404961-network", "vif_mac": "fa:16:3e:75:cb:49"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:02:58.312756 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=ee0e1172-e06e-46db-bda6-c793c47ec9a9,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e1172-e0') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:02:58.318202 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] End _get_guest_xml xml=<domain type="qemu">
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:   <uuid>fcb1a3e2-e470-4773-a370-f122a79de2e6</uuid>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:   <name>instance-00000020</name>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:   <memory>262144</memory>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerActionsTestOtherA-server-1319467240</nova:name>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:02:51</nova:creationTime>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.micro" id="84">
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:         <nova:memory>256</nova:memory>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:         <nova:user uuid="d4a93dfe76ab455d8aa6e691b1fa34c5">tempest-ServerActionsTestOtherA-569974590-project-member</nova:user>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:         <nova:project uuid="233d191c03874150880aca259ffd3e21">tempest-ServerActionsTestOtherA-569974590</nova:project>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:         <nova:port uuid="ee0e1172-e06e-46db-bda6-c793c47ec9a9">
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     <system>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <entry name="serial">fcb1a3e2-e470-4773-a370-f122a79de2e6</entry>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <entry name="uuid">fcb1a3e2-e470-4773-a370-f122a79de2e6</entry>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     </system>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:   <os>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:   </os>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:   <features>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:   </features>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:   <devices>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/fcb1a3e2-e470-4773-a370-f122a79de2e6/disk.config"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     </disk>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <alias name="ua-4f6a6a1f-0542-4c3d-b318-52f71fb19705"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-7"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <serial>4f6a6a1f-0542-4c3d-b318-52f71fb19705</serial>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     </disk>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:75:cb:49"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <target dev="tapee0e1172-e0"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     </interface>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/fcb1a3e2-e470-4773-a370-f122a79de2e6/console.log" append="off"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     </serial>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     <video>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     </video>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     </rng>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:   </devices>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]: </domain>
May 27 03:02:58.318202 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:02:58.320413 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1319467240',display_name='tempest-ServerActionsTestOtherA-server-1319467240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001475',hostname='tempest-serveractionstestothera-server-1319467240',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVtCwqB5huD2R7WzeA2srtQrNLcY+5mh0PDFl9uXrLaNb8RbC2WmzNWR2uyfN3usptF21zcnp9tnWTIUBUOIX7SXlA+BK0+YEfHYyX09pbtKTE7qcopOd9351hytyFXVA==',key_name='tempest-keypair-2100360487',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:02:31Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001475',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='233d191c03874150880aca259ffd3e21',ramdisk_id='',reservation_id='r-xaz3c7w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-569974590',owner_user_name='tempest-ServerActionsTestOtherA-569974590-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:02:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a93dfe76ab455d8aa6e691b1fa34c5',uuid=fcb1a3e2-e470-4773-a370-f122a79de2e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-926404961-network", "vif_mac": "fa:16:3e:75:cb:49"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:02:58.320413 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converting VIF {"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-926404961-network", "vif_mac": "fa:16:3e:75:cb:49"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:02:58.320413 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=ee0e1172-e06e-46db-bda6-c793c47ec9a9,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e1172-e0') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:02:58.322670 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=ee0e1172-e06e-46db-bda6-c793c47ec9a9,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e1172-e0') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:02:58.322670 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:58.323424 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:58.324093 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:02:58.325715 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:58.325715 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6675a084-f956-50a7-a164-5032430b3946', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:58.327859 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "d7f71824-f631-423e-a5ea-8ae72642a95e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:58.328529 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:58.338771 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:58.340442 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:58.343037 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:58.343237 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee0e1172-e0, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:58.344074 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee0e1172-e0, col_values=(('qos', UUID('58a4d926-0626-4922-b539-2db621f33bdd')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:58.344386 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee0e1172-e0, col_values=(('external_ids', {'iface-id': 'ee0e1172-e06e-46db-bda6-c793c47ec9a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:cb:49', 'vm-uuid': 'fcb1a3e2-e470-4773-a370-f122a79de2e6'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:02:58.350087 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:02:58.351521 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:02:58.352046 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:02:58.353660 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:02:58.354140 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:02:58.358170 np0000001475 nova-compute[98471]: INFO os_vif [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=ee0e1172-e06e-46db-bda6-c793c47ec9a9,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e1172-e0')
May 27 03:02:58.374451 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:02:58.375094 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:02:58.388997 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:58.428304 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc, portal: 192.168.40.100,3260]
May 27 03:02:58.428304 np0000001475 nova-compute[98471]: Logout of [sid: 60, target: iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc, portal: 192.168.40.100,3260] successful.
May 27 03:02:58.428304 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:58.449849 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:58.463408 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:58.470487 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:02:58.470487 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:02:58.470487 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:58.471042 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:58.506833 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-96a032f0-e36f-4710-9c4c-009798c635d7 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.583s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:58.510936 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc, portal: 192.168.50.100,3260]
May 27 03:02:58.510936 np0000001475 nova-compute[98471]: Logout of [sid: 59, target: iqn.2023-03.storpool.com:os--volume-3ee979db-8a4b-4b81-ae9b-554ed390eedc, portal: 192.168.50.100,3260] successful.
May 27 03:02:58.510936 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:58.532842 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:02:58.535504 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:02:58.535725 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] <== disconnect_volume: return (1659ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:02:58.536477 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:02:58.632426 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0d83ca7002c41e0897c39e7b8d91bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3c6a3942eb41e8b6aefddc5faca789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:02:58.673454 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Took 5.80 seconds to destroy the instance on the hypervisor.
May 27 03:02:58.674728 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:02:58.674728 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:02:58.674728 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:02:58.675019 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:58.708696 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "1efec6a6-a26c-46fa-9370-60859f41c1a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:58.708696 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:58.827791 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:02:58.843075 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'flavor' on Instance uuid d7f71824-f631-423e-a5ea-8ae72642a95e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:58.985623 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Applying migration context for instance fcb1a3e2-e470-4773-a370-f122a79de2e6 as it has an incoming, in-progress migration 188cb323-3b79-4ff9-a9b6-fdc35858e34e. Migration status is post-migrating {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 27 03:02:58.988230 np0000001475 nova-compute[98471]: INFO nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Updating resource usage from migration 188cb323-3b79-4ff9-a9b6-fdc35858e34e
May 27 03:02:58.994335 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:02:59.073151 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 8d762a67-82b6-40d3-b625-0731ea01c45b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:02:59.073567 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 9847a45d-ad45-4b2b-85eb-664604911991 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:02:59.073871 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance f5d36573-c0e7-43a0-a7cc-66678f093375 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:02:59.074242 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 7acda56f-e16c-4371-99b3-21eeea2904d1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:02:59.074242 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 71af628e-b06d-446d-8c2e-dcfbb232df33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:02:59.074653 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 4e583b08-e323-4681-9e95-01767f510590 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:02:59.074817 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 66b799ed-716a-4b29-8125-bac73213f2cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:02:59.075039 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:02:59.075185 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance b4f2203e-ef29-4dcf-b665-236abd72e5f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:02:59.075356 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance c2a5e735-d573-4ac4-bff0-d4a12648718e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:02:59.075589 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance ca2e5c3f-b9be-4bfb-9858-c22cbb4177da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:02:59.075760 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance d7f71824-f631-423e-a5ea-8ae72642a95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:02:59.075975 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Migration 188cb323-3b79-4ff9-a9b6-fdc35858e34e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 27 03:02:59.076011 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance fcb1a3e2-e470-4773-a370-f122a79de2e6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:02:59.076139 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance bb06d928-2b8c-46f2-b61d-fdb19af4017e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:02:59.125563 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lazy-loading 'flavor' on Instance uuid b4f2203e-ef29-4dcf-b665-236abd72e5f0 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:02:59.180415 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Successfully created port: f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:02:59.209133 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:02:59.245965 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0005595980001089629 future=<Future at 0x755724738ce0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:59.246150 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:59.246150 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=0.23611978899998576 future=<Future at 0x755724778620 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:59.246293 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=0.23605521899980886 future=<Future at 0x755724778620 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:59.246411 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] Emitting event <LifecycleEvent: 1779850964.245294, fcb1a3e2-e470-4773-a370-f122a79de2e6 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:59.246520 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] VM Stopped (Lifecycle Event)
May 27 03:02:59.482681 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0003129199999420962 future=<Future at 0x755724778620 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:59.483835 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Emitting event <LifecycleEvent: 1779850964.4822083, 02fd272a-5759-4995-9e5c-cc1f3e28072b => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:02:59.483993 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:59.484099 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] VM Stopped (Lifecycle Event)
May 27 03:02:59.485323 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=8.770921928000007 future=<Future at 0x75572c126f00 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:59.485476 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=8.770780192000075 future=<Future at 0x75572c126f00 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:02:59.498401 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:02:59.580881 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 1efec6a6-a26c-46fa-9370-60859f41c1a5 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 27 03:02:59.580995 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:02:59.581059 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=3456MB phys_disk=95GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:02:55 up 34 min,  2 users,  load average: 12.44, 8.23, 4.02\n', 'num_instances': '14', 'num_vm_active': '12', 'num_task_None': '12', 'num_os_type_None': '14', 'num_proj_233d191c03874150880aca259ffd3e21': '2', 'io_workload': '1', 'num_proj_ab70ea24752242a88583e819c6c34e12': '2', 'num_proj_a9c48d6919e8435f876f3324616521ea': '5', 'num_task_deleting': '1', 'num_proj_39cbbdb9012c4992865d4f89678ef9ac': '3', 'num_vm_rescued': '1', 'num_proj_51a54fd7b39b4a968af6ad453070ea4d': '1', 'num_task_resize_finish': '1', 'num_vm_building': '1', 'num_proj_ca3c6a3942eb41e8b6aefddc5faca789': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:02:59.753853 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:02:59.757390 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0198e2b1-f466-453c-bfee-ebd105f7a266 req-55e71b66-8070-488c-a3fe-eda554c6a4b6 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received event network-vif-deleted-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:59.758657 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-0198e2b1-f466-453c-bfee-ebd105f7a266 req-55e71b66-8070-488c-a3fe-eda554c6a4b6 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Neutron deleted interface ed993fcc-f75a-4549-937f-26a3a42c5fe8; detaching it from the instance and deleting it from the info cache
May 27 03:02:59.758848 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-0198e2b1-f466-453c-bfee-ebd105f7a266 req-55e71b66-8070-488c-a3fe-eda554c6a4b6 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:02:59.761671 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:02:59.791309 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:59.807049 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Successfully updated port: f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:02:59.849969 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.521s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:59.867786 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-96da596d-89ea-469a-aaf3-70ba659478bc req-db34b117-83e2-4fa4-9d79-cd61c34ea52c service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received event network-changed-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:59.870428 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-96da596d-89ea-469a-aaf3-70ba659478bc req-db34b117-83e2-4fa4-9d79-cd61c34ea52c service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Refreshing instance network info cache due to event network-changed-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:02:59.870428 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-96da596d-89ea-469a-aaf3-70ba659478bc req-db34b117-83e2-4fa4-9d79-cd61c34ea52c service nova] Acquiring lock "refresh_cache-bb06d928-2b8c-46f2-b61d-fdb19af4017e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:02:59.871834 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-96da596d-89ea-469a-aaf3-70ba659478bc req-db34b117-83e2-4fa4-9d79-cd61c34ea52c service nova] Acquired lock "refresh_cache-bb06d928-2b8c-46f2-b61d-fdb19af4017e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:02:59.871834 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-96da596d-89ea-469a-aaf3-70ba659478bc req-db34b117-83e2-4fa4-9d79-cd61c34ea52c service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Refreshing network info cache for port f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:02:59.879819 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:59.879990 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:02:59.880086 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] No VIF found with MAC fa:16:3e:75:cb:49, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:02:59.880579 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Using config drive
May 27 03:02:59.982332 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-76cfb02f-5c2e-40f4-a1d0-3aede0a7ff34 req-abdd3505-0cce-4abf-9722-59c92685dfcf service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received event network-vif-unplugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:02:59.982571 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-76cfb02f-5c2e-40f4-a1d0-3aede0a7ff34 req-abdd3505-0cce-4abf-9722-59c92685dfcf service nova] Acquiring lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:02:59.982794 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-76cfb02f-5c2e-40f4-a1d0-3aede0a7ff34 req-abdd3505-0cce-4abf-9722-59c92685dfcf service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:02:59.982963 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-76cfb02f-5c2e-40f4-a1d0-3aede0a7ff34 req-abdd3505-0cce-4abf-9722-59c92685dfcf service nova] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:02:59.983625 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-76cfb02f-5c2e-40f4-a1d0-3aede0a7ff34 req-abdd3505-0cce-4abf-9722-59c92685dfcf service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] No waiting events found dispatching network-vif-unplugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:02:59.983797 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-76cfb02f-5c2e-40f4-a1d0-3aede0a7ff34 req-abdd3505-0cce-4abf-9722-59c92685dfcf service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Received event network-vif-unplugged-ed993fcc-f75a-4549-937f-26a3a42c5fe8 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:02:59.987700 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 02fd272a-5759-4995-9e5c-cc1f3e28072b] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:00.134679 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-be2f2f71-e760-4c7b-abbd-6d8209bb06e3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.675s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:00.150687 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:00.268173 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 27 03:03:00.269458 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0198e2b1-f466-453c-bfee-ebd105f7a266 req-55e71b66-8070-488c-a3fe-eda554c6a4b6 service nova] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Detach interface failed, port_id=ed993fcc-f75a-4549-937f-26a3a42c5fe8, reason: Instance 7acda56f-e16c-4371-99b3-21eeea2904d1 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:03:00.313201 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "refresh_cache-bb06d928-2b8c-46f2-b61d-fdb19af4017e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:00.377419 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-96da596d-89ea-469a-aaf3-70ba659478bc req-db34b117-83e2-4fa4-9d79-cd61c34ea52c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:00.405147 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:00.450373 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:00.456192 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:00.511798 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-96da596d-89ea-469a-aaf3-70ba659478bc req-db34b117-83e2-4fa4-9d79-cd61c34ea52c service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:03:00.520020 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:03:00.521534 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:03:00.522327 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Creating image(s)
May 27 03:03:00.522902 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:00.523432 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "/opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:00.524172 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "/opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:00.525349 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:03:00.530609 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:03:00.537825 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:00.559072 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:00.658074 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Took 1.98 seconds to deallocate network for instance.
May 27 03:03:00.676596 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:00.687524 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:00.697598 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.162s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:00.698437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:00.699161 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:00.701098 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:03:00.704615 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:03:00.705758 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:00.820693 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:03:00.821110 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:03:00.849065 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.144s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:00.850369 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:00.934834 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-96da596d-89ea-469a-aaf3-70ba659478bc req-db34b117-83e2-4fa4-9d79-cd61c34ea52c service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:00.944075 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk 1073741824" returned: 0 in 0.091s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:00.944720 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:00.946313 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:00.987630 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "d7f71824-f631-423e-a5ea-8ae72642a95e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:00.989422 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:00.990764 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Attaching volume 8cd7c930-2109-4c04-85a8-31ac0ce9341e to /dev/vdb
May 27 03:03:01.077088 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:03:01.077088 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.132s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:01.077351 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:03:01.080241 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:01.080241 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:01.106525 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:03:01.107397 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:01.108648 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:01.109404 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:01.109807 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:01.110154 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:01.116018 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Terminating instance
May 27 03:03:01.140673 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:01.193034 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:01.197416 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Cannot resize image /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:03:01.197416 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:03:01.197416 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Ensure instance console log exists: /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:03:01.197416 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:03:01.197416 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:03:01.200683 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:03:01.201765 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:01.203196 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:01.203549 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:01.212260 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:03:01.213838 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b', 'fe80::fc16:3eff:fe1f:5a7', 'fe80::a095:90ff:feef:1465', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::c805:4ff:fe3b:2374', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:feb2:aa32', 'fe80::fc16:3eff:fe01:3d37', 'fe80::fc16:3eff:fe54:22d6', 'fe80::88ab:28ff:fedb:6e99', 'fe80::fc16:3eff:fe5c:3071', 'fe80::fc16:3eff:fed9:1c3f', 'fe80::fc16:3eff:fe88:48d5', 'fe80::fc16:3eff:fe75:cb49'] 
May 27 03:03:01.213996 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:03:01.214057 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:03:01.214357 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:03:01.214524 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Updating existing volume attachment record: ae946156-5f43-4257-9a5a-181021f5e217 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:03:01.231519 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Took 0.57 seconds to detach 1 volumes for instance.
May 27 03:03:01.235211 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Deleting volume: 6a1921ec-dd47-422c-af8e-b1cbf29ad186 {{(pid=98471) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 27 03:03:01.326515 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:03:01.447834 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-96da596d-89ea-469a-aaf3-70ba659478bc req-db34b117-83e2-4fa4-9d79-cd61c34ea52c service nova] Releasing lock "refresh_cache-bb06d928-2b8c-46f2-b61d-fdb19af4017e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:01.447834 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquired lock "refresh_cache-bb06d928-2b8c-46f2-b61d-fdb19af4017e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:01.447834 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:03:01.622084 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:03:01.626386 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850981.625647, fcb1a3e2-e470-4773-a370-f122a79de2e6 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:01.626619 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] VM Resumed (Lifecycle Event)
May 27 03:03:01.630772 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Instance event wait completed in 0 seconds for  {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:03:01.635421 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Instance running successfully.
May 27 03:03:01.639083 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Failed to set time: agent not configured {{(pid=98471) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 27 03:03:01.639328 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-347eb1d9-405f-4bb1-af89-acfae8fd3d0f tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] finish_migration finished successfully. {{(pid=98471) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 27 03:03:01.653901 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:01.659784 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:01.687053 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:01.692884 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:01.712732 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:01.718931 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:01.802185 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:03:01.802636 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:03:01.802836 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:03:01.803278 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:03:01.803488 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:03:01.815996 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:03:01.816452 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:03:01.816822 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:03:01.817019 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:03:01.819146 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:01.822463 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:03:01.822463 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.startup = automatic
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.scan = manual
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:03:01.836496 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:03:01.836496 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:01.841332 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:03:01.841332 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.885s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:01.841332 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:03:01.843940 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.053s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:01.852872 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:03:01.852872 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Claim successful on node np0000001475
May 27 03:03:01.859140 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.startup = automatic
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.scan = manual
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:03:01.860425 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:03:01.860425 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:01.876296 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:01.889916 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:01.889916 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:01.889916 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:01.889916 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:01.889916 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:01.889916 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:01.889916 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:03:01.892723 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:01.892723 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:01.892723 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:01.892723 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:01.892723 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:01.892723 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:01.892723 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:03:01.893223 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.072s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:03:01.894414 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4b996698-1677-42a7-ace9-e7d7e745afb0 req-c92e688b-c2f0-4758-8a48-1d34fc0796d4 service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received event network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:01.894790 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:03:01.896597 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b996698-1677-42a7-ace9-e7d7e745afb0 req-c92e688b-c2f0-4758-8a48-1d34fc0796d4 service nova] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:01.896597 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b996698-1677-42a7-ace9-e7d7e745afb0 req-c92e688b-c2f0-4758-8a48-1d34fc0796d4 service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:01.896597 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b996698-1677-42a7-ace9-e7d7e745afb0 req-c92e688b-c2f0-4758-8a48-1d34fc0796d4 service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:01.897081 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4b996698-1677-42a7-ace9-e7d7e745afb0 req-c92e688b-c2f0-4758-8a48-1d34fc0796d4 service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] No waiting events found dispatching network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:01.897605 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-4b996698-1677-42a7-ace9-e7d7e745afb0 req-c92e688b-c2f0-4758-8a48-1d34fc0796d4 service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received unexpected event network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 for instance with vm_state building and task_state spawning.
May 27 03:03:01.898996 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4b996698-1677-42a7-ace9-e7d7e745afb0 req-c92e688b-c2f0-4758-8a48-1d34fc0796d4 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Received event network-vif-plugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:01.898996 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b996698-1677-42a7-ace9-e7d7e745afb0 req-c92e688b-c2f0-4758-8a48-1d34fc0796d4 service nova] Acquiring lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:01.898996 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b996698-1677-42a7-ace9-e7d7e745afb0 req-c92e688b-c2f0-4758-8a48-1d34fc0796d4 service nova] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:01.898996 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b996698-1677-42a7-ace9-e7d7e745afb0 req-c92e688b-c2f0-4758-8a48-1d34fc0796d4 service nova] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:01.898996 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4b996698-1677-42a7-ace9-e7d7e745afb0 req-c92e688b-c2f0-4758-8a48-1d34fc0796d4 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] No waiting events found dispatching network-vif-plugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:01.900672 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-4b996698-1677-42a7-ace9-e7d7e745afb0 req-c92e688b-c2f0-4758-8a48-1d34fc0796d4 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Received unexpected event network-vif-plugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 for instance with vm_state active and task_state resize_finish.
May 27 03:03:01.900899 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4b996698-1677-42a7-ace9-e7d7e745afb0 req-c92e688b-c2f0-4758-8a48-1d34fc0796d4 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Received event network-vif-plugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:01.901099 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b996698-1677-42a7-ace9-e7d7e745afb0 req-c92e688b-c2f0-4758-8a48-1d34fc0796d4 service nova] Acquiring lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:01.901279 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b996698-1677-42a7-ace9-e7d7e745afb0 req-c92e688b-c2f0-4758-8a48-1d34fc0796d4 service nova] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:01.901427 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4b996698-1677-42a7-ace9-e7d7e745afb0 req-c92e688b-c2f0-4758-8a48-1d34fc0796d4 service nova] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:01.901565 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4b996698-1677-42a7-ace9-e7d7e745afb0 req-c92e688b-c2f0-4758-8a48-1d34fc0796d4 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] No waiting events found dispatching network-vif-plugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:01.901781 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-4b996698-1677-42a7-ace9-e7d7e745afb0 req-c92e688b-c2f0-4758-8a48-1d34fc0796d4 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Received unexpected event network-vif-plugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 for instance with vm_state active and task_state resize_finish.
May 27 03:03:01.902829 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:01.902829 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:01.902829 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:01.902829 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:01.902829 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:01.902829 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:01.902829 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:03:01.903311 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] HCTL ('14', '0', '0', 0) found on session 62 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:03:01.905665 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:01.905665 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:01.905665 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:01.905665 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:01.905665 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:01.905665 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:01.905665 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:03:01.906114 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:03:01.906448 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.089s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:03:01.906653 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:03:01.907349 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] HCTL ('13', '0', '0', 0) found on session 61 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:03:01.907522 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:03:01.922535 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching for a device in session 62 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:03:01.922726 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:03:01.931479 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching for a device in session 61 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:03:01.931479 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:03:01.976895 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:01.988197 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:02.011459 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Instance destroyed successfully.
May 27 03:03:02.012309 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lazy-loading 'resources' on Instance uuid b4f2203e-ef29-4dcf-b665-236abd72e5f0 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:02.064702 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:03:02.134091 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:02.140410 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:03:02.411397 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:02.517223 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-529304459',display_name='tempest-TestEncryptedCinderVolumes-server-529304459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testencryptedcindervolumes-server-529304459',id=28,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMN50IV4XxHmJNp+ZjLzy4dJLUIo1VSD7ZYF2UIL+uNbpa3T5R3pSUshf5JOEaqwp9kX0vEG9+Do7XY40yG5qEbdTWX7a7xkLHfN+CdUlR4OrgpjdbgfzOkd+JgIsqYhng==',key_name='tempest-keypair-1836151505',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:02:04Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51a54fd7b39b4a968af6ad453070ea4d',ramdisk_id='',reservation_id='r-m064chkg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-727613157',owner_user_name='tempest-TestEncryptedCinderVolumes-727613157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:02:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6dd385bbf9c3482aa593c41ce7795e8e',uuid=b4f2203e-ef29-4dcf-b665-236abd72e5f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "address": "fa:16:3e:54:22:d6", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d3853b-fb", "ovs_interfaceid": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:03:02.517509 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Converting VIF {"id": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "address": "fa:16:3e:54:22:d6", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d3853b-fb", "ovs_interfaceid": "65d3853b-fb46-46b8-9c5f-fd6bc698c4b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:03:02.518236 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=65d3853b-fb46-46b8-9c5f-fd6bc698c4b5,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d3853b-fb') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:03:02.518668 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=65d3853b-fb46-46b8-9c5f-fd6bc698c4b5,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d3853b-fb') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:03:02.521488 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:02.521488 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65d3853b-fb, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:02.526441 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:02.526441 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:03:02.531531 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:02.532603 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5f4ca68-f234-4ba4-bfeb-508b6eaae1fa) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:02.533905 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:03:02.534804 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:02.536561 np0000001475 nova-compute[98471]: INFO os_vif [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:22:d6,bridge_name='br-int',has_traffic_filtering=True,id=65d3853b-fb46-46b8-9c5f-fd6bc698c4b5,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d3853b-fb')
May 27 03:03:02.537316 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Deleting instance files /opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0_del
May 27 03:03:02.538114 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Deletion of /opt/stack/data/nova/instances/b4f2203e-ef29-4dcf-b665-236abd72e5f0_del complete
May 27 03:03:02.642803 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 27 03:03:02.647434 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850982.6458342, fcb1a3e2-e470-4773-a370-f122a79de2e6 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:02.647434 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] VM Started (Lifecycle Event)
May 27 03:03:02.760118 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Updating instance_info_cache with network_info: [{"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:02.819364 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:03:02.878013 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:03.054378 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Took 1.43 seconds to destroy the instance on the hypervisor.
May 27 03:03:03.055140 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:03:03.062147 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:03:03.062390 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:03:03.062628 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:03.150963 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:03.155997 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:03:03.162955 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "fcb1a3e2-e470-4773-a370-f122a79de2e6" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:03.163541 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:03.163541 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Going to confirm migration 2 {{(pid=98471) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 27 03:03:03.203607 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:03.262646 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Releasing lock "refresh_cache-bb06d928-2b8c-46f2-b61d-fdb19af4017e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:03.262823 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Instance network_info: |[{"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:03:03.265171 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Start _get_guest_xml network_info=[{"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:03:03.270371 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:03:03.271652 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1752019004', uuid='bb06d928-2b8c-46f2-b61d-fdb19af4017e'), owner=OwnerMeta(userid='f0d83ca7002c41e0897c39e7b8d91bff', username='tempest-AttachVolumeTestJSON-1635503347-project-member', projectid='ca3c6a3942eb41e8b6aefddc5faca789', projectname='tempest-AttachVolumeTestJSON-1635503347'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850983.271273) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:03:03.274210 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:03:03.274210 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:03:03.277920 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:03:03.277920 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:03:03.277920 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:03:03.277920 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:03:03.277920 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:03:03.278338 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:03:03.278338 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:03:03.278338 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:03:03.278338 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:03:03.278547 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:03:03.278547 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:03:03.279009 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:03:03.279009 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:03:03.279187 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:03:03.303493 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1752019004',display_name='tempest-AttachVolumeTestJSON-server-1752019004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumetestjson-server-1752019004',id=34,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnCyl+g1Ye4tCJK/b/EmMSENQNCevd73XcwcJq7MM0QjAHn7OQTuI/rqxlNGXTk7F/U6HedbzcDuONEX5G9MqYrebfqRT8YlVYqtYPepNOx2xjMDNgKF5JW2yc7DR5vwA==',key_name='tempest-keypair-224254834',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca3c6a3942eb41e8b6aefddc5faca789',ramdisk_id='',reservation_id='r-b5nd7f2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1635503347',owner_user_name='tempest-AttachVolumeTestJSON-1635503347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:03:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0d83ca7002c41e0897c39e7b8d91bff',uuid=bb06d928-2b8c-46f2-b61d-fdb19af4017e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:03:03.303671 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converting VIF {"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:03:03.304667 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:03:03.304927 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'pci_devices' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:03.659013 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999633964000168 future=<Future at 0x7557247d9c70 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:03.669916 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:03.811139 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] End _get_guest_xml xml=<domain type="qemu">
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:   <uuid>bb06d928-2b8c-46f2-b61d-fdb19af4017e</uuid>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:   <name>instance-00000022</name>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <nova:name>tempest-AttachVolumeTestJSON-server-1752019004</nova:name>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:03:03</nova:creationTime>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:         <nova:user uuid="f0d83ca7002c41e0897c39e7b8d91bff">tempest-AttachVolumeTestJSON-1635503347-project-member</nova:user>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:         <nova:project uuid="ca3c6a3942eb41e8b6aefddc5faca789">tempest-AttachVolumeTestJSON-1635503347</nova:project>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:         <nova:port uuid="f4f71bc7-6b31-42c9-8f6c-2bc91e87a157">
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     <system>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <entry name="serial">bb06d928-2b8c-46f2-b61d-fdb19af4017e</entry>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <entry name="uuid">bb06d928-2b8c-46f2-b61d-fdb19af4017e</entry>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     </system>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:   <os>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:   </os>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:   <features>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:   </features>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:   <devices>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     </disk>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk.config"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     </disk>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:58:79:ce"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <target dev="tapf4f71bc7-6b"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     </interface>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/console.log" append="off"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     </serial>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     <video>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     </video>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     </rng>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:   </devices>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]: </domain>
May 27 03:03:03.811139 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:03:03.813992 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Preparing to wait for external event network-vif-plugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:03:03.813992 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:03.813992 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:03.813992 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:03.813992 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1752019004',display_name='tempest-AttachVolumeTestJSON-server-1752019004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumetestjson-server-1752019004',id=34,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnCyl+g1Ye4tCJK/b/EmMSENQNCevd73XcwcJq7MM0QjAHn7OQTuI/rqxlNGXTk7F/U6HedbzcDuONEX5G9MqYrebfqRT8YlVYqtYPepNOx2xjMDNgKF5JW2yc7DR5vwA==',key_name='tempest-keypair-224254834',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca3c6a3942eb41e8b6aefddc5faca789',ramdisk_id='',reservation_id='r-b5nd7f2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1635503347',owner_user_name='tempest-AttachVolumeTestJSON-1635503347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:03:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0d83ca7002c41e0897c39e7b8d91bff',uuid=bb06d928-2b8c-46f2-b61d-fdb19af4017e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:03:03.813992 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converting VIF {"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:03:03.813992 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:03:03.813992 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:03:03.814765 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:03.814973 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:03.815179 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:03:03.820795 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:03.820987 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5c2e64e-bf8d-5466-bd31-3b3c07150ed3', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:03.822874 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:03.823674 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:03:03.826492 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:03.827772 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "refresh_cache-fcb1a3e2-e470-4773-a370-f122a79de2e6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:03.827936 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquired lock "refresh_cache-fcb1a3e2-e470-4773-a370-f122a79de2e6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:03.828087 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:03:03.828237 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lazy-loading 'info_cache' on Instance uuid fcb1a3e2-e470-4773-a370-f122a79de2e6 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:03.831122 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:03.831336 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4f71bc7-6b, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:03.831779 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4f71bc7-6b, col_values=(('qos', UUID('ea4d7afb-ffc6-4ee0-b83b-8e1699011ade')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:03.831936 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4f71bc7-6b, col_values=(('external_ids', {'iface-id': 'f4f71bc7-6b31-42c9-8f6c-2bc91e87a157', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:79:ce', 'vm-uuid': 'bb06d928-2b8c-46f2-b61d-fdb19af4017e'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:03.834634 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:03.834634 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:03:03.837018 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Found WWN 3300000007d606cb0 for multipath device dm-6 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:03:03.837018 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.033s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:03:03.837018 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] <== connect_volume: return (2033ms) {'type': 'block', 'scsi_wwn': '3300000007d606cb0', 'path': '/dev/dm-6', 'multipath_id': '3300000007d606cb0'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:03:03.837018 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007d606cb0', 'path': '/dev/dm-6', 'multipath_id': '3300000007d606cb0'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:03:03.842136 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:03.842646 np0000001475 nova-compute[98471]: INFO os_vif [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b')
May 27 03:03:03.852577 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'flavor' on Instance uuid d7f71824-f631-423e-a5ea-8ae72642a95e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:03.910539 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:03:03.911480 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:03:03.969050 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7a99910f-ab63-476d-bbc8-a2c417407d09 req-88c7dc09-48ae-4ca3-80cb-5dff9a9570d1 service nova] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Received event network-vif-deleted-65d3853b-fb46-46b8-9c5f-fd6bc698c4b5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:03.969477 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-7a99910f-ab63-476d-bbc8-a2c417407d09 req-88c7dc09-48ae-4ca3-80cb-5dff9a9570d1 service nova] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Neutron deleted interface 65d3853b-fb46-46b8-9c5f-fd6bc698c4b5; detaching it from the instance and deleting it from the info cache
May 27 03:03:03.969646 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7a99910f-ab63-476d-bbc8-a2c417407d09 req-88c7dc09-48ae-4ca3-80cb-5dff9a9570d1 service nova] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:04.193845 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:04.366257 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Attempting to attach volume 8cd7c930-2109-4c04-85a8-31ac0ce9341e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:03:04.371486 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:03:04.371486 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:03:04.371486 np0000001475 nova-compute[98471]:   <alias name="ua-8cd7c930-2109-4c04-85a8-31ac0ce9341e"/>
May 27 03:03:04.371486 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-6"/>
May 27 03:03:04.371486 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:03:04.371486 np0000001475 nova-compute[98471]:   <serial>8cd7c930-2109-4c04-85a8-31ac0ce9341e</serial>
May 27 03:03:04.371486 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:03:04.371486 np0000001475 nova-compute[98471]: </disk>
May 27 03:03:04.371486 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:03:04.414772 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:03:04.476912 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7a99910f-ab63-476d-bbc8-a2c417407d09 req-88c7dc09-48ae-4ca3-80cb-5dff9a9570d1 service nova] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Detach interface failed, port_id=65d3853b-fb46-46b8-9c5f-fd6bc698c4b5, reason: Instance b4f2203e-ef29-4dcf-b665-236abd72e5f0 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:03:04.696709 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Took 1.63 seconds to deallocate network for instance.
May 27 03:03:04.838015 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:04.927504 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.082s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:04.927504 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:03:04.930795 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.111s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:05.011990 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:05.012193 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:05.203453 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:05.322525 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:05.377412 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:05.377599 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:05.378207 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No VIF found with MAC fa:16:3e:58:79:ce, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:03:05.378356 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Using config drive
May 27 03:03:05.438637 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:03:05.439119 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:03:05.439491 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:05.439812 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:05.519267 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Updating instance_info_cache with network_info: [{"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:05.523719 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'flavor' on Instance uuid ca2e5c3f-b9be-4bfb-9858-c22cbb4177da {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:05.569356 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca42144366ef44eb81e5c4a23624d281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1801e95925498cac899f1414f2b202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:03:05.883801 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:05.936495 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:03:06.019105 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:03:06.019392 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:03:06.034279 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Releasing lock "refresh_cache-fcb1a3e2-e470-4773-a370-f122a79de2e6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:06.034279 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lazy-loading 'migration_context' on Instance uuid fcb1a3e2-e470-4773-a370-f122a79de2e6 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:06.057946 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Creating config drive at /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk.config
May 27 03:03:06.063337 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwdjk9gjn {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:06.076759 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:06.091541 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:06.093760 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:06.093760 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:06.093760 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No VIF found with MAC fa:16:3e:88:48:d5, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:03:06.125524 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Successfully created port: dab9dc9d-db9a-4cd4-a59a-fe204f719f1a {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:03:06.135011 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwdjk9gjn" returned: 0 in 0.071s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:06.439987 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:03:06.524282 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:03:06.537784 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.525s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:06.540112 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Object Instance<fcb1a3e2-e470-4773-a370-f122a79de2e6> lazy-loaded attributes: info_cache,migration_context {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:03:06.542834 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:06.637350 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:06.675473 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:06.769826 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:06.843126 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Successfully updated port: dab9dc9d-db9a-4cd4-a59a-fe204f719f1a {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:03:06.921196 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7924c2ae-7d61-4fd4-aba7-b7cb7506deb9 req-c6c73855-a3ce-4d7e-9943-f72dd650bd60 service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received event network-vif-plugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:06.921596 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7924c2ae-7d61-4fd4-aba7-b7cb7506deb9 req-c6c73855-a3ce-4d7e-9943-f72dd650bd60 service nova] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:06.921887 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7924c2ae-7d61-4fd4-aba7-b7cb7506deb9 req-c6c73855-a3ce-4d7e-9943-f72dd650bd60 service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:06.922132 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7924c2ae-7d61-4fd4-aba7-b7cb7506deb9 req-c6c73855-a3ce-4d7e-9943-f72dd650bd60 service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:06.923861 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7924c2ae-7d61-4fd4-aba7-b7cb7506deb9 req-c6c73855-a3ce-4d7e-9943-f72dd650bd60 service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Processing event network-vif-plugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:03:06.944770 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f5635ed-767d-4a09-8c8f-2958882710a2 req-c3a14933-3b12-4cc1-907c-50d589a387c1 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Received event network-changed-dab9dc9d-db9a-4cd4-a59a-fe204f719f1a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:06.945355 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f5635ed-767d-4a09-8c8f-2958882710a2 req-c3a14933-3b12-4cc1-907c-50d589a387c1 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Refreshing instance network info cache due to event network-changed-dab9dc9d-db9a-4cd4-a59a-fe204f719f1a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:03:06.945355 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5635ed-767d-4a09-8c8f-2958882710a2 req-c3a14933-3b12-4cc1-907c-50d589a387c1 service nova] Acquiring lock "refresh_cache-1efec6a6-a26c-46fa-9370-60859f41c1a5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:06.945355 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5635ed-767d-4a09-8c8f-2958882710a2 req-c3a14933-3b12-4cc1-907c-50d589a387c1 service nova] Acquired lock "refresh_cache-1efec6a6-a26c-46fa-9370-60859f41c1a5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:06.945593 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-6f5635ed-767d-4a09-8c8f-2958882710a2 req-c3a14933-3b12-4cc1-907c-50d589a387c1 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Refreshing network info cache for port dab9dc9d-db9a-4cd4-a59a-fe204f719f1a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:03:07.032079 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.101s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:07.035028 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.829s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:07.094202 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:07.100421 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:07.106235 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:07.123786 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Deleted allocations for instance 7acda56f-e16c-4371-99b3-21eeea2904d1
May 27 03:03:07.133101 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:07.345792 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "refresh_cache-1efec6a6-a26c-46fa-9370-60859f41c1a5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:07.421941 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Acquiring lock "de33390e-64b1-4034-a1f1-dcc935cf25fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:07.422159 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:07.451105 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-6f5635ed-767d-4a09-8c8f-2958882710a2 req-c3a14933-3b12-4cc1-907c-50d589a387c1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:07.456120 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:03:07.457327 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:03:07.457612 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Creating image(s)
May 27 03:03:07.458175 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "/opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:07.458395 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "/opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:07.459286 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "/opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:07.459892 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:03:07.463586 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:03:07.464837 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:07.573988 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-6f5635ed-767d-4a09-8c8f-2958882710a2 req-c3a14933-3b12-4cc1-907c-50d589a387c1 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:03:07.587894 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.123s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:07.588484 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:07.589079 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:07.589593 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:03:07.592858 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:03:07.593152 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:07.669570 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:07.670135 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:07.670412 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Attaching volume 0717598c-54dc-4dab-9fc9-882e4b55c907 to /dev/vdb
May 27 03:03:07.683765 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:03:07.687422 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850987.6864426, bb06d928-2b8c-46f2-b61d-fdb19af4017e => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:07.688726 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-25ded55d-7d05-416d-8e5f-112bb1d57a92 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.699s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:07.697296 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] VM Started (Lifecycle Event)
May 27 03:03:07.701536 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:03:07.706229 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Instance spawned successfully.
May 27 03:03:07.707381 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:03:07.711482 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.118s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:07.712884 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:07.771196 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:03:07.797651 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk 1073741824" returned: 0 in 0.085s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:07.799434 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:03:07.801000 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:07.801470 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:07.847542 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:07.900080 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:03:07.900080 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:03:07.906356 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.105s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:07.907820 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:03:07.908123 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:07.931899 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:03:07.956492 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:03:07.961523 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-6f5635ed-767d-4a09-8c8f-2958882710a2 req-c3a14933-3b12-4cc1-907c-50d589a387c1 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:07.964209 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b', 'fe80::fc16:3eff:fe1f:5a7', 'fe80::a095:90ff:feef:1465', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::c805:4ff:fe3b:2374', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:feb2:aa32', 'fe80::fc16:3eff:fe01:3d37', 'fe80::fc16:3eff:fe5c:3071', 'fe80::fc16:3eff:fed9:1c3f', 'fe80::fc16:3eff:fe88:48d5', 'fe80::fc16:3eff:fe75:cb49', 'fe80::fc16:3eff:fe58:79ce', 'fe80::8cdc:9fff:fe79:9907'] 
May 27 03:03:07.970045 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:03:07.970202 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:03:07.970765 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:03:07.971122 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Updating existing volume attachment record: ea87a527-cd28-4fcc-89d8-1d968ddc9eb3 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:03:08.022253 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:08.022807 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Cannot resize image /opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:03:08.024962 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:03:08.024962 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Ensure instance console log exists: /opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:03:08.025445 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:08.025933 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:08.026208 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:08.163490 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-832cf5c2-2c5a-4eac-b33a-181161196837 tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "7acda56f-e16c-4371-99b3-21eeea2904d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.796s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:08.204790 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:08.215845 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:03:08.226003 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:08.226213 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:08.226698 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:08.227069 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:08.227495 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:08.229852 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:08.257650 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0010539140002947534 future=<Future at 0x75572c126f00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:08.257650 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:08.257650 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=10.400931230999959 future=<Future at 0x7557247d9c70 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:08.258131 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=10.40076682300014 future=<Future at 0x7557247d9c70 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:08.258471 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Emitting event <LifecycleEvent: 1779850973.2561207, 7acda56f-e16c-4371-99b3-21eeea2904d1 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:08.258858 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] VM Stopped (Lifecycle Event)
May 27 03:03:08.286385 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:03:08.286901 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:03:08.466287 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6f5635ed-767d-4a09-8c8f-2958882710a2 req-c3a14933-3b12-4cc1-907c-50d589a387c1 service nova] Releasing lock "refresh_cache-1efec6a6-a26c-46fa-9370-60859f41c1a5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:08.467029 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquired lock "refresh_cache-1efec6a6-a26c-46fa-9370-60859f41c1a5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:08.467430 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:03:08.523505 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:08.556040 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:03:08.556468 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907', 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0717598c-54dc-4dab-9fc9-882e4b55c907', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:03:08.557049 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:03:08.557121 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:03:08.557410 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907', 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0717598c-54dc-4dab-9fc9-882e4b55c907', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:03:08.573544 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:03:08.574216 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:03:08.574891 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:03:08.575163 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:03:08.575771 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:03:08.576082 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:03:08.594136 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:03:08.594136 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:08.605783 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:03:08.605783 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:08.616014 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907] added
May 27 03:03:08.616014 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:03:08.616014 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:03:08.616014 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:03:08.616014 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:03:08.616014 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:03:08.616014 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:08.616014 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:03:08.616546 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0411(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:03:08.616546 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:03:08.624528 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907] added
May 27 03:03:08.624528 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:03:08.624528 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:03:08.624528 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:03:08.624528 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:03:08.624528 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:03:08.624528 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:08.626156 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:03:08.626868 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0507(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:03:08.627101 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:03:08.720915 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:03:08.720915 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850988.7206223, bb06d928-2b8c-46f2-b61d-fdb19af4017e => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:08.721062 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] VM Paused (Lifecycle Event)
May 27 03:03:08.735612 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Took 8.22 seconds to spawn the instance on the hypervisor.
May 27 03:03:08.736017 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:08.763329 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7d079fcc-96a9-46f1-9584-549c4416c405 req-d99f32f1-ae44-4267-9456-6363c9abf5f4 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Received event network-vif-unplugged-dab9dc9d-db9a-4cd4-a59a-fe204f719f1a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:08.764184 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7d079fcc-96a9-46f1-9584-549c4416c405 req-d99f32f1-ae44-4267-9456-6363c9abf5f4 service nova] Acquiring lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:08.764847 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7d079fcc-96a9-46f1-9584-549c4416c405 req-d99f32f1-ae44-4267-9456-6363c9abf5f4 service nova] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:08.766133 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7d079fcc-96a9-46f1-9584-549c4416c405 req-d99f32f1-ae44-4267-9456-6363c9abf5f4 service nova] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:08.767407 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7d079fcc-96a9-46f1-9584-549c4416c405 req-d99f32f1-ae44-4267-9456-6363c9abf5f4 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] No waiting events found dispatching network-vif-unplugged-dab9dc9d-db9a-4cd4-a59a-fe204f719f1a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:08.768216 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 7acda56f-e16c-4371-99b3-21eeea2904d1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:08.768460 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-7d079fcc-96a9-46f1-9584-549c4416c405 req-d99f32f1-ae44-4267-9456-6363c9abf5f4 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Received unexpected event network-vif-unplugged-dab9dc9d-db9a-4cd4-a59a-fe204f719f1a for instance with vm_state building and task_state spawning.
May 27 03:03:08.791952 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:03:08.839044 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:09.005705 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e27dbd16-f029-46d3-b873-d5c38a8985b3 req-a8afa43c-a1f9-46a5-aa42-bab97868071f service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received event network-vif-plugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:09.006063 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e27dbd16-f029-46d3-b873-d5c38a8985b3 req-a8afa43c-a1f9-46a5-aa42-bab97868071f service nova] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:09.006104 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e27dbd16-f029-46d3-b873-d5c38a8985b3 req-a8afa43c-a1f9-46a5-aa42-bab97868071f service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:09.006196 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e27dbd16-f029-46d3-b873-d5c38a8985b3 req-a8afa43c-a1f9-46a5-aa42-bab97868071f service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:09.006399 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e27dbd16-f029-46d3-b873-d5c38a8985b3 req-a8afa43c-a1f9-46a5-aa42-bab97868071f service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] No waiting events found dispatching network-vif-plugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:09.006524 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-e27dbd16-f029-46d3-b873-d5c38a8985b3 req-a8afa43c-a1f9-46a5-aa42-bab97868071f service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received unexpected event network-vif-plugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 for instance with vm_state active and task_state None.
May 27 03:03:09.040204 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:03:09.223477 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:09.225120 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850989.2248929, bb06d928-2b8c-46f2-b61d-fdb19af4017e => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:09.225259 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] VM Resumed (Lifecycle Event)
May 27 03:03:09.228840 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:09.252535 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Took 14.57 seconds to build instance.
May 27 03:03:09.306472 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.274s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:09.312493 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 2.765s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:09.345914 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Stashing vm_state: active {{(pid=98471) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 27 03:03:09.395725 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Deleted allocations for instance b4f2203e-ef29-4dcf-b665-236abd72e5f0
May 27 03:03:09.441077 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Updating instance_info_cache with network_info: [{"id": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "address": "fa:16:3e:2d:76:bb", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab9dc9d-db", "ovs_interfaceid": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:09.616770 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:03:09.627940 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:03:09.627940 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:09.630292 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:03:09.641165 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:03:09.642094 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:03:09.642094 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:09.659173 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:09.659173 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:09.659173 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:09.659173 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:09.659173 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:09.659173 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:09.659173 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:03:09.659417 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:09.659417 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:09.659417 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:09.659417 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:09.659417 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:09.659417 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:09.659417 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:03:09.667047 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:09.686702 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:09.686702 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:09.686702 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:09.686702 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:09.686702 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:09.686702 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:09.686702 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:03:09.686702 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:09.686702 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:09.686702 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:09.686702 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:09.686702 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:09.686702 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:09.686702 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:03:09.698526 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907, portal: 192.168.50.100,3260]
May 27 03:03:09.698526 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907, portal: 192.168.50.100,3260] successful.
May 27 03:03:09.698526 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:09.713433 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:09.732778 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:09.734320 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907, portal: 192.168.40.100,3260]
May 27 03:03:09.734320 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907, portal: 192.168.40.100,3260] successful.
May 27 03:03:09.734320 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:09.734951 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:03:09.736791 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:09.736791 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:09.736791 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:09.736791 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:09.736791 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:09.736791 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:09.736791 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:09.736791 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:09.736791 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:03:09.737187 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:09.737187 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:09.737187 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:09.737187 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:09.737187 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:09.737187 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:09.737187 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:09.737187 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:09.737187 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:03:09.737422 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:03:09.737422 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:03:09.739464 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] HCTL ('7', '-', '-', 0) found on session 65 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:03:09.739630 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:03:09.747541 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:09.755251 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.089s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:09.763963 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Searching for a device in session 65 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:03:09.764204 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0717598c-54dc-4dab-9fc9-882e4b55c907', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:03:09.770199 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "9847a45d-ad45-4b2b-85eb-664604911991" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:09.770302 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "9847a45d-ad45-4b2b-85eb-664604911991" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:09.770660 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "9847a45d-ad45-4b2b-85eb-664604911991-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:09.770660 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "9847a45d-ad45-4b2b-85eb-664604911991-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:09.770801 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "9847a45d-ad45-4b2b-85eb-664604911991-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:09.772292 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:09.772292 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:09.772292 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:09.772292 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:09.772292 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:09.772292 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:09.772292 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:09.772292 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:09.772292 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:03:09.772649 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:09.772649 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:09.772649 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:09.772649 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:09.772649 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:09.772649 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:09.772649 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:09.772649 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:09.772649 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:03:09.772909 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:03:09.773002 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:03:09.773795 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Terminating instance
May 27 03:03:09.776967 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] HCTL ('8', '-', '-', 0) found on session 66 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:03:09.777061 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:03:09.794687 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Searching for a device in session 66 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:03:09.794687 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0717598c-54dc-4dab-9fc9-882e4b55c907', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:03:09.943192 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Releasing lock "refresh_cache-1efec6a6-a26c-46fa-9370-60859f41c1a5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:09.943475 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Instance network_info: |[{"id": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "address": "fa:16:3e:2d:76:bb", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab9dc9d-db", "ovs_interfaceid": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:03:09.946157 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Start _get_guest_xml network_info=[{"id": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "address": "fa:16:3e:2d:76:bb", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab9dc9d-db", "ovs_interfaceid": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:03:09.951388 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:03:09.958196 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:09.960548 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1340861760', uuid='1efec6a6-a26c-46fa-9370-60859f41c1a5'), owner=OwnerMeta(userid='ca42144366ef44eb81e5c4a23624d281', username='tempest-AttachVolumeNegativeTest-1854580419-project-member', projectid='5f1801e95925498cac899f1414f2b202', projectname='tempest-AttachVolumeNegativeTest-1854580419'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "address": "fa:16:3e:2d:76:bb", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab9dc9d-db", "ovs_interfaceid": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779850989.955937) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:03:09.966912 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:03:09.967347 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:03:09.969941 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:03:09.970429 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:03:09.971541 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:03:09.971983 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:03:09.972151 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:03:09.972251 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:03:09.972401 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:03:09.972511 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:03:09.972633 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:03:09.972805 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:03:09.972923 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:03:09.973161 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:03:09.973161 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:03:09.973258 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:03:09.996422 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1340861760',display_name='tempest-AttachVolumeNegativeTest-server-1340861760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumenegativetest-server-1340861760',id=35,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVHH0IguZBlDv00sDx71oMd2+F33DWWdUbt05w4Mu7RTsI2o6x6EPq3H8GCS+kKFv3PHXMFRuVZtOYSdMj8L+J6rV9q0Hisg0lpkL0j1Vy4T6Fgu44k6NuzSnzNv+v4Kw==',key_name='tempest-keypair-276585317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1801e95925498cac899f1414f2b202',ramdisk_id='',reservation_id='r-9ls66omb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1854580419',owner_user_name='tempest-AttachVolumeNegativeTest-1854580419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:03:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca42144366ef44eb81e5c4a23624d281',uuid=1efec6a6-a26c-46fa-9370-60859f41c1a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "address": "fa:16:3e:2d:76:bb", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab9dc9d-db", "ovs_interfaceid": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:03:09.996652 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converting VIF {"id": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "address": "fa:16:3e:2d:76:bb", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab9dc9d-db", "ovs_interfaceid": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:03:09.997886 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:76:bb,bridge_name='br-int',has_traffic_filtering=True,id=dab9dc9d-db9a-4cd4-a59a-fe204f719f1a,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab9dc9d-db') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:03:09.999214 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lazy-loading 'pci_devices' on Instance uuid 1efec6a6-a26c-46fa-9370-60859f41c1a5 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:10.167059 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2567f6d1-5d9d-4c11-96bf-521bbcb7c9b8 req-fbf13793-43f3-4a06-a7f4-8b1d204ca36a service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received event network-changed-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:10.167578 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2567f6d1-5d9d-4c11-96bf-521bbcb7c9b8 req-fbf13793-43f3-4a06-a7f4-8b1d204ca36a service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Refreshing instance network info cache due to event network-changed-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:03:10.167578 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2567f6d1-5d9d-4c11-96bf-521bbcb7c9b8 req-fbf13793-43f3-4a06-a7f4-8b1d204ca36a service nova] Acquiring lock "refresh_cache-bb06d928-2b8c-46f2-b61d-fdb19af4017e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:10.167578 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2567f6d1-5d9d-4c11-96bf-521bbcb7c9b8 req-fbf13793-43f3-4a06-a7f4-8b1d204ca36a service nova] Acquired lock "refresh_cache-bb06d928-2b8c-46f2-b61d-fdb19af4017e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:10.167875 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-2567f6d1-5d9d-4c11-96bf-521bbcb7c9b8 req-fbf13793-43f3-4a06-a7f4-8b1d204ca36a service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Refreshing network info cache for port f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:03:10.278239 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:03:10.316935 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:10.321111 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:10.344678 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:10.353048 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:10.380083 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:10.407076 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-76b9ac08-4426-4069-a252-a1dbf2107776 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "b4f2203e-ef29-4dcf-b665-236abd72e5f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.298s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:10.502711 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] End _get_guest_xml xml=<domain type="qemu">
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:   <uuid>1efec6a6-a26c-46fa-9370-60859f41c1a5</uuid>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:   <name>instance-00000023</name>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1340861760</nova:name>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:03:09</nova:creationTime>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:         <nova:user uuid="ca42144366ef44eb81e5c4a23624d281">tempest-AttachVolumeNegativeTest-1854580419-project-member</nova:user>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:         <nova:project uuid="5f1801e95925498cac899f1414f2b202">tempest-AttachVolumeNegativeTest-1854580419</nova:project>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:         <nova:port uuid="dab9dc9d-db9a-4cd4-a59a-fe204f719f1a">
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     <system>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <entry name="serial">1efec6a6-a26c-46fa-9370-60859f41c1a5</entry>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <entry name="uuid">1efec6a6-a26c-46fa-9370-60859f41c1a5</entry>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     </system>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:   <os>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:   </os>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:   <features>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:   </features>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:   <devices>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     </disk>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk.config"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     </disk>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:2d:76:bb"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <target dev="tapdab9dc9d-db"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     </interface>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/console.log" append="off"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     </serial>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     <video>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     </video>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     </rng>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:   </devices>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]: </domain>
May 27 03:03:10.502711 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:03:10.504999 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Preparing to wait for external event network-vif-plugged-dab9dc9d-db9a-4cd4-a59a-fe204f719f1a {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:03:10.504999 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:10.504999 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:10.504999 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:10.504999 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1340861760',display_name='tempest-AttachVolumeNegativeTest-server-1340861760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumenegativetest-server-1340861760',id=35,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVHH0IguZBlDv00sDx71oMd2+F33DWWdUbt05w4Mu7RTsI2o6x6EPq3H8GCS+kKFv3PHXMFRuVZtOYSdMj8L+J6rV9q0Hisg0lpkL0j1Vy4T6Fgu44k6NuzSnzNv+v4Kw==',key_name='tempest-keypair-276585317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1801e95925498cac899f1414f2b202',ramdisk_id='',reservation_id='r-9ls66omb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1854580419',owner_user_name='tempest-AttachVolumeNegativeTest-1854580419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:03:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca42144366ef44eb81e5c4a23624d281',uuid=1efec6a6-a26c-46fa-9370-60859f41c1a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "address": "fa:16:3e:2d:76:bb", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab9dc9d-db", "ovs_interfaceid": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:03:10.504999 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converting VIF {"id": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "address": "fa:16:3e:2d:76:bb", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab9dc9d-db", "ovs_interfaceid": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:03:10.511775 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:76:bb,bridge_name='br-int',has_traffic_filtering=True,id=dab9dc9d-db9a-4cd4-a59a-fe204f719f1a,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab9dc9d-db') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:03:10.511775 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:76:bb,bridge_name='br-int',has_traffic_filtering=True,id=dab9dc9d-db9a-4cd4-a59a-fe204f719f1a,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab9dc9d-db') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:03:10.511775 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:10.511775 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:10.511775 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:03:10.515885 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:10.516275 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c15f27fa-7962-5d86-8409-5285fc551feb', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:10.519288 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:10.520229 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:03:10.530502 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:10.535110 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:10.535390 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdab9dc9d-db, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:10.535735 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdab9dc9d-db, col_values=(('qos', UUID('8e388c57-9134-4bd9-b5fc-03e0a644d729')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:10.536009 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdab9dc9d-db, col_values=(('external_ids', {'iface-id': 'dab9dc9d-db9a-4cd4-a59a-fe204f719f1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:76:bb', 'vm-uuid': '1efec6a6-a26c-46fa-9370-60859f41c1a5'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:10.538960 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:10.540661 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:03:10.549967 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:10.551601 np0000001475 nova-compute[98471]: INFO os_vif [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:76:bb,bridge_name='br-int',has_traffic_filtering=True,id=dab9dc9d-db9a-4cd4-a59a-fe204f719f1a,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab9dc9d-db')
May 27 03:03:10.575941 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:03:10.675035 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-2567f6d1-5d9d-4c11-96bf-521bbcb7c9b8 req-fbf13793-43f3-4a06-a7f4-8b1d204ca36a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:10.684025 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999524048999774 future=<Future at 0x755704729f10 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:10.686218 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Instance destroyed successfully.
May 27 03:03:10.687168 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lazy-loading 'resources' on Instance uuid 9847a45d-ad45-4b2b-85eb-664604911991 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:11.018409 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:03:11.018409 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:03:11.078070 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:11.093086 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ad0edb2c-2514-427e-908e-1dde90a90d55 req-61b5568a-331c-49bd-a9f4-84b94f93386b service nova] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Received event network-vif-unplugged-4432f2b9-dbaf-43f2-a9b4-7eee5883de22 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:11.093334 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ad0edb2c-2514-427e-908e-1dde90a90d55 req-61b5568a-331c-49bd-a9f4-84b94f93386b service nova] Acquiring lock "9847a45d-ad45-4b2b-85eb-664604911991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:11.093543 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ad0edb2c-2514-427e-908e-1dde90a90d55 req-61b5568a-331c-49bd-a9f4-84b94f93386b service nova] Lock "9847a45d-ad45-4b2b-85eb-664604911991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:11.093997 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ad0edb2c-2514-427e-908e-1dde90a90d55 req-61b5568a-331c-49bd-a9f4-84b94f93386b service nova] Lock "9847a45d-ad45-4b2b-85eb-664604911991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:11.094176 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ad0edb2c-2514-427e-908e-1dde90a90d55 req-61b5568a-331c-49bd-a9f4-84b94f93386b service nova] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] No waiting events found dispatching network-vif-unplugged-4432f2b9-dbaf-43f2-a9b4-7eee5883de22 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:11.094327 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ad0edb2c-2514-427e-908e-1dde90a90d55 req-61b5568a-331c-49bd-a9f4-84b94f93386b service nova] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Received event network-vif-unplugged-4432f2b9-dbaf-43f2-a9b4-7eee5883de22 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:03:11.094460 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ad0edb2c-2514-427e-908e-1dde90a90d55 req-61b5568a-331c-49bd-a9f4-84b94f93386b service nova] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Received event network-vif-unplugged-4432f2b9-dbaf-43f2-a9b4-7eee5883de22 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:11.094619 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ad0edb2c-2514-427e-908e-1dde90a90d55 req-61b5568a-331c-49bd-a9f4-84b94f93386b service nova] Acquiring lock "9847a45d-ad45-4b2b-85eb-664604911991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:11.094809 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ad0edb2c-2514-427e-908e-1dde90a90d55 req-61b5568a-331c-49bd-a9f4-84b94f93386b service nova] Lock "9847a45d-ad45-4b2b-85eb-664604911991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:11.094939 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ad0edb2c-2514-427e-908e-1dde90a90d55 req-61b5568a-331c-49bd-a9f4-84b94f93386b service nova] Lock "9847a45d-ad45-4b2b-85eb-664604911991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:11.095320 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ad0edb2c-2514-427e-908e-1dde90a90d55 req-61b5568a-331c-49bd-a9f4-84b94f93386b service nova] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] No waiting events found dispatching network-vif-unplugged-4432f2b9-dbaf-43f2-a9b4-7eee5883de22 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:11.095320 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ad0edb2c-2514-427e-908e-1dde90a90d55 req-61b5568a-331c-49bd-a9f4-84b94f93386b service nova] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Received event network-vif-unplugged-4432f2b9-dbaf-43f2-a9b4-7eee5883de22 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:03:11.190086 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:59:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-443350888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverbootfromvolumestablerescuetest-server-443350888',id=14,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:00:12Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab70ea24752242a88583e819c6c34e12',ramdisk_id='',reservation_id='r-1f156n6k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:00:22Z,user_data=None,user_id='787c8d4d4527402cbbc2ad0475f710bb',uuid=9847a45d-ad45-4b2b-85eb-664604911991,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4432f2b9-dbaf-43f2-a9b4-7eee5883de22", "address": "fa:16:3e:1f:05:a7", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4432f2b9-db", "ovs_interfaceid": "4432f2b9-dbaf-43f2-a9b4-7eee5883de22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:03:11.190675 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converting VIF {"id": "4432f2b9-dbaf-43f2-a9b4-7eee5883de22", "address": "fa:16:3e:1f:05:a7", "network": {"id": "6f4f2faf-404a-4d40-8390-9dffe8221a05", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312950322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab70ea24752242a88583e819c6c34e12", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4432f2b9-db", "ovs_interfaceid": "4432f2b9-dbaf-43f2-a9b4-7eee5883de22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:03:11.190937 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:05:a7,bridge_name='br-int',has_traffic_filtering=True,id=4432f2b9-dbaf-43f2-a9b4-7eee5883de22,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4432f2b9-db') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:03:11.191225 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:05:a7,bridge_name='br-int',has_traffic_filtering=True,id=4432f2b9-dbaf-43f2-a9b4-7eee5883de22,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4432f2b9-db') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:03:11.194853 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:11.195146 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4432f2b9-db, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:11.196335 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:11.197122 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:03:11.202857 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:11.204084 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:11.204761 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf672c1b-f7e5-44ee-8b17-f8e6c92beaad) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:11.205166 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:11.205894 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:03:11.212854 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:11.217209 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-2567f6d1-5d9d-4c11-96bf-521bbcb7c9b8 req-fbf13793-43f3-4a06-a7f4-8b1d204ca36a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:11.219412 np0000001475 nova-compute[98471]: INFO os_vif [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:05:a7,bridge_name='br-int',has_traffic_filtering=True,id=4432f2b9-dbaf-43f2-a9b4-7eee5883de22,network=Network(6f4f2faf-404a-4d40-8390-9dffe8221a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4432f2b9-db')
May 27 03:03:11.219752 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Deleting instance files /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991_del
May 27 03:03:11.221176 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Deletion of /opt/stack/data/nova/instances/9847a45d-ad45-4b2b-85eb-664604911991_del complete
May 27 03:03:11.401590 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-2567f6d1-5d9d-4c11-96bf-521bbcb7c9b8 req-fbf13793-43f3-4a06-a7f4-8b1d204ca36a service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Updated VIF entry in instance network info cache for port f4f71bc7-6b31-42c9-8f6c-2bc91e87a157. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:03:11.401653 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-2567f6d1-5d9d-4c11-96bf-521bbcb7c9b8 req-fbf13793-43f3-4a06-a7f4-8b1d204ca36a service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Updating instance_info_cache with network_info: [{"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:11.518471 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:03:11.595619 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Found WWN 330000000bd2d2572 for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:03:11.595945 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:03:11.596129 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000bd2d2572', 'path': '/dev/dm-0', 'multipath_id': '330000000bd2d2572'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:03:11.596298 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bd2d2572', 'path': '/dev/dm-0', 'multipath_id': '330000000bd2d2572'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:03:11.599257 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'flavor' on Instance uuid ca2e5c3f-b9be-4bfb-9858-c22cbb4177da {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:11.731231 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Took 1.45 seconds to destroy the instance on the hypervisor.
May 27 03:03:11.732039 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:03:11.732482 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:03:11.732702 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:03:11.733003 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:11.829506 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:11.907546 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2567f6d1-5d9d-4c11-96bf-521bbcb7c9b8 req-fbf13793-43f3-4a06-a7f4-8b1d204ca36a service nova] Releasing lock "refresh_cache-bb06d928-2b8c-46f2-b61d-fdb19af4017e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:12.085231 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:12.085231 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:12.085231 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No VIF found with MAC fa:16:3e:2d:76:bb, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:03:12.085896 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Using config drive
May 27 03:03:12.103932 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Attempting to attach volume 0717598c-54dc-4dab-9fc9-882e4b55c907 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:03:12.106710 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:03:12.106710 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:03:12.106710 np0000001475 nova-compute[98471]:   <alias name="ua-0717598c-54dc-4dab-9fc9-882e4b55c907"/>
May 27 03:03:12.106710 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-0"/>
May 27 03:03:12.106710 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:03:12.106710 np0000001475 nova-compute[98471]:   <serial>0717598c-54dc-4dab-9fc9-882e4b55c907</serial>
May 27 03:03:12.106710 np0000001475 nova-compute[98471]: </disk>
May 27 03:03:12.106710 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:03:12.532373 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 3.224s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:12.535781 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.010s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:12.541152 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:03:12.541287 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Claim successful on node np0000001475
May 27 03:03:12.595859 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:12.605013 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:12.763120 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Creating config drive at /opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk.config
May 27 03:03:12.768418 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6lrxho4r {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:12.827996 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6lrxho4r" returned: 0 in 0.059s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:13.110466 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Took 1.38 seconds to deallocate network for instance.
May 27 03:03:13.192266 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e82723bc-8c7e-4120-9c72-a3f9705db0c7 req-03df6383-800a-4ebe-9feb-3054da1a2555 service nova] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Received event network-vif-deleted-4432f2b9-dbaf-43f2-a9b4-7eee5883de22 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:13.225681 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Deleted allocation for migration 188cb323-3b79-4ff9-a9b6-fdc35858e34e
May 27 03:03:13.373297 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:13.414934 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:13.419306 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:13.533186 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:13.618944 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:13.732028 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7403683e-4906-4a2b-9e90-66466d7efcb1 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 10.569s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:13.780978 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2f34b274-f035-4f11-afaa-2c0605ed57ea req-2dd945fa-1568-4a2f-84ac-27c9f1f5ee32 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Received event network-vif-plugged-dab9dc9d-db9a-4cd4-a59a-fe204f719f1a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:13.781539 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2f34b274-f035-4f11-afaa-2c0605ed57ea req-2dd945fa-1568-4a2f-84ac-27c9f1f5ee32 service nova] Acquiring lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:13.781862 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2f34b274-f035-4f11-afaa-2c0605ed57ea req-2dd945fa-1568-4a2f-84ac-27c9f1f5ee32 service nova] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:13.782000 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2f34b274-f035-4f11-afaa-2c0605ed57ea req-2dd945fa-1568-4a2f-84ac-27c9f1f5ee32 service nova] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:13.782188 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2f34b274-f035-4f11-afaa-2c0605ed57ea req-2dd945fa-1568-4a2f-84ac-27c9f1f5ee32 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Processing event network-vif-plugged-dab9dc9d-db9a-4cd4-a59a-fe204f719f1a {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:03:13.799374 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:13.799557 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:13.799729 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:13.799925 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No VIF found with MAC fa:16:3e:d9:1c:3f, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:03:13.859223 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ed384027-5a2c-419d-925d-46978d7c644c tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Get console output
May 27 03:03:13.894058 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:13.909371 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:13.940097 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:13.941159 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:13.969068 np0000001475 nova-compute[98471]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 27 03:03:14.516669 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850994.5161543, 1efec6a6-a26c-46fa-9370-60859f41c1a5 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:14.516942 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] VM Started (Lifecycle Event)
May 27 03:03:14.519813 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:03:14.522533 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:03:14.526301 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Instance spawned successfully.
May 27 03:03:14.526689 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:03:14.538600 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:03:14.539004 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:03:15.022178 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:15.027242 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:03:15.039944 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:15.040126 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:15.040581 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:15.040878 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:15.046388 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:15.046938 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:03:15.054162 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:15.372187 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a1b5df14-eb31-4ea9-a333-3175dc767571 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.701s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:15.530511 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:03:15.530681 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850995.5304153, 1efec6a6-a26c-46fa-9370-60859f41c1a5 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:15.530734 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] VM Paused (Lifecycle Event)
May 27 03:03:15.562272 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.030s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:15.562834 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:03:15.571346 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 5.610s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:15.571985 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Took 8.11 seconds to spawn the instance on the hypervisor.
May 27 03:03:15.572272 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:15.672813 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Rescuing
May 27 03:03:15.673023 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:15.673242 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquired lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:15.673705 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:03:15.842918 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5d7c041a-2c63-431a-aadb-b324936f04c0 req-e49f52f2-59fc-48fb-b91f-4e200979841a service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Received event network-vif-plugged-dab9dc9d-db9a-4cd4-a59a-fe204f719f1a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:15.843349 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5d7c041a-2c63-431a-aadb-b324936f04c0 req-e49f52f2-59fc-48fb-b91f-4e200979841a service nova] Acquiring lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:15.843349 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5d7c041a-2c63-431a-aadb-b324936f04c0 req-e49f52f2-59fc-48fb-b91f-4e200979841a service nova] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:15.843349 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5d7c041a-2c63-431a-aadb-b324936f04c0 req-e49f52f2-59fc-48fb-b91f-4e200979841a service nova] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:15.843600 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5d7c041a-2c63-431a-aadb-b324936f04c0 req-e49f52f2-59fc-48fb-b91f-4e200979841a service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] No waiting events found dispatching network-vif-plugged-dab9dc9d-db9a-4cd4-a59a-fe204f719f1a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:15.843692 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-5d7c041a-2c63-431a-aadb-b324936f04c0 req-e49f52f2-59fc-48fb-b91f-4e200979841a service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Received unexpected event network-vif-plugged-dab9dc9d-db9a-4cd4-a59a-fe204f719f1a for instance with vm_state active and task_state None.
May 27 03:03:16.036667 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:16.039883 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779850996.0395489, 1efec6a6-a26c-46fa-9370-60859f41c1a5 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:16.040079 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] VM Resumed (Lifecycle Event)
May 27 03:03:16.077616 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:03:16.079918 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:03:16.090022 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:16.090685 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:03:16.090865 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Claim successful on node np0000001475
May 27 03:03:16.094408 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:16.094979 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:16.100805 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Took 16.38 seconds to build instance.
May 27 03:03:16.177010 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:16.183095 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e79920811e0436ab5cc75631e778110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23965b01217144d29b9cc5ef0d064a47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:03:16.206264 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:16.241076 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "e17e8031-6811-4553-b8ce-7150f690a4ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:16.241076 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:16.544022 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:16.546683 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:03:16.588251 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:03:16.601400 np0000001475 nova-compute[98471]: INFO nova.compute.resource_tracker [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Updating resource usage from migration 62d6dcad-c244-4aae-bee1-3d2f426e2db7
May 27 03:03:16.606764 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.899s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:16.613721 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:16.744198 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:03:16.847792 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Updating instance_info_cache with network_info: [{"id": "1133d110-d517-4b72-bbce-faf3064e5946", "address": "fa:16:3e:d9:1c:3f", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1133d110-d5", "ovs_interfaceid": "1133d110-d517-4b72-bbce-faf3064e5946", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:16.957706 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Successfully created port: c87aaa49-f608-4ea5-ae24-f72634311e87 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:03:17.092466 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:03:17.321677 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:17.349875 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Releasing lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:17.507625 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Successfully updated port: c87aaa49-f608-4ea5-ae24-f72634311e87 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:03:17.566618 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f4be6208-bacc-49f9-bddd-2cbc0c784036 req-fcd894ee-047a-41e7-b69e-2b7f3961a017 service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Received event network-changed-c87aaa49-f608-4ea5-ae24-f72634311e87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:17.567212 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f4be6208-bacc-49f9-bddd-2cbc0c784036 req-fcd894ee-047a-41e7-b69e-2b7f3961a017 service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Refreshing instance network info cache due to event network-changed-c87aaa49-f608-4ea5-ae24-f72634311e87. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:03:17.567417 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f4be6208-bacc-49f9-bddd-2cbc0c784036 req-fcd894ee-047a-41e7-b69e-2b7f3961a017 service nova] Acquiring lock "refresh_cache-de33390e-64b1-4034-a1f1-dcc935cf25fd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:17.567570 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f4be6208-bacc-49f9-bddd-2cbc0c784036 req-fcd894ee-047a-41e7-b69e-2b7f3961a017 service nova] Acquired lock "refresh_cache-de33390e-64b1-4034-a1f1-dcc935cf25fd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:17.568134 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f4be6208-bacc-49f9-bddd-2cbc0c784036 req-fcd894ee-047a-41e7-b69e-2b7f3961a017 service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Refreshing network info cache for port c87aaa49-f608-4ea5-ae24-f72634311e87 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:03:17.621568 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:03:17.622041 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:03:17.920439 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-40759efd-e132-463e-8dac-bee8e8092683 req-0ca259ef-3f4c-4346-91b7-4608d0756902 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Received event network-changed-dab9dc9d-db9a-4cd4-a59a-fe204f719f1a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:17.920808 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-40759efd-e132-463e-8dac-bee8e8092683 req-0ca259ef-3f4c-4346-91b7-4608d0756902 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Refreshing instance network info cache due to event network-changed-dab9dc9d-db9a-4cd4-a59a-fe204f719f1a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:03:17.921025 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-40759efd-e132-463e-8dac-bee8e8092683 req-0ca259ef-3f4c-4346-91b7-4608d0756902 service nova] Acquiring lock "refresh_cache-1efec6a6-a26c-46fa-9370-60859f41c1a5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:17.921179 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-40759efd-e132-463e-8dac-bee8e8092683 req-0ca259ef-3f4c-4346-91b7-4608d0756902 service nova] Acquired lock "refresh_cache-1efec6a6-a26c-46fa-9370-60859f41c1a5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:17.921321 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-40759efd-e132-463e-8dac-bee8e8092683 req-0ca259ef-3f4c-4346-91b7-4608d0756902 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Refreshing network info cache for port dab9dc9d-db9a-4cd4-a59a-fe204f719f1a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:03:18.009412 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Acquiring lock "refresh_cache-de33390e-64b1-4034-a1f1-dcc935cf25fd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:18.070157 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f4be6208-bacc-49f9-bddd-2cbc0c784036 req-fcd894ee-047a-41e7-b69e-2b7f3961a017 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:18.109100 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:03:18.110591 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:03:18.110882 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Creating image(s)
May 27 03:03:18.111406 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Acquiring lock "/opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:18.111649 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "/opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:18.112151 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "/opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:18.113142 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:03:18.117831 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:03:18.119050 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:18.135413 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:03:18.188528 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f4be6208-bacc-49f9-bddd-2cbc0c784036 req-fcd894ee-047a-41e7-b69e-2b7f3961a017 service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:03:18.213720 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.094s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:18.214121 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:18.214539 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:18.214980 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:03:18.217575 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:03:18.217904 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:18.331012 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.113s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:18.331615 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:18.384980 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f4be6208-bacc-49f9-bddd-2cbc0c784036 req-fcd894ee-047a-41e7-b69e-2b7f3961a017 service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:18.396572 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd/disk 1073741824" returned: 0 in 0.065s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:18.397437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:18.397928 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:18.426503 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-40759efd-e132-463e-8dac-bee8e8092683 req-0ca259ef-3f4c-4346-91b7-4608d0756902 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:18.516821 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.119s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:18.521857 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:03:18.522337 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:18.621541 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:18.622922 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Cannot resize image /opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:03:18.622922 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:03:18.622922 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Ensure instance console log exists: /opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:03:18.623361 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:18.623393 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:18.624805 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:18.651049 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 3.088s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:18.651321 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 5.033s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:18.652807 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Migrating
May 27 03:03:18.653068 np0000001475 nova-compute[98471]: DEBUG nova.compute.rpcapi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98471) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 03:03:18.661107 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0024766960000306426 future=<Future at 0x7557247d9c70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:18.661236 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:18.661433 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=7.022198295999715 future=<Future at 0x755704729f10 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:18.661433 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=7.022109148999789 future=<Future at 0x755704729f10 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:18.665112 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Emitting event <LifecycleEvent: 1779850983.6585128, b4f2203e-ef29-4dcf-b665-236abd72e5f0 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:18.666017 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] VM Stopped (Lifecycle Event)
May 27 03:03:18.818204 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-40759efd-e132-463e-8dac-bee8e8092683 req-0ca259ef-3f4c-4346-91b7-4608d0756902 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:18.889453 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f4be6208-bacc-49f9-bddd-2cbc0c784036 req-fcd894ee-047a-41e7-b69e-2b7f3961a017 service nova] Releasing lock "refresh_cache-de33390e-64b1-4034-a1f1-dcc935cf25fd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:18.890951 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Acquired lock "refresh_cache-de33390e-64b1-4034-a1f1-dcc935cf25fd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:18.890951 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:03:18.977138 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-40759efd-e132-463e-8dac-bee8e8092683 req-0ca259ef-3f4c-4346-91b7-4608d0756902 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Updated VIF entry in instance network info cache for port dab9dc9d-db9a-4cd4-a59a-fe204f719f1a. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:03:18.977445 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-40759efd-e132-463e-8dac-bee8e8092683 req-0ca259ef-3f4c-4346-91b7-4608d0756902 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Updating instance_info_cache with network_info: [{"id": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "address": "fa:16:3e:2d:76:bb", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab9dc9d-db", "ovs_interfaceid": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:19.000206 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:19.004539 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:19.038955 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:19.179766 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c2cdc1f5-dd9d-4d8f-a935-5aca5b87b97b tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: b4f2203e-ef29-4dcf-b665-236abd72e5f0] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:19.180201 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:19.180367 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquired lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:19.183043 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:03:19.213607 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:19.221983 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:19.334515 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999611201999869 future=<Future at 0x75572c13bfe0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:19.338896 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Instance destroyed successfully.
May 27 03:03:19.339614 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'numa_topology' on Instance uuid ca2e5c3f-b9be-4bfb-9858-c22cbb4177da {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:19.481308 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-40759efd-e132-463e-8dac-bee8e8092683 req-0ca259ef-3f4c-4346-91b7-4608d0756902 service nova] Releasing lock "refresh_cache-1efec6a6-a26c-46fa-9370-60859f41c1a5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:19.485355 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:03:19.675590 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:03:19.676135 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:03:19.681708 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:19.683862 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:19.847099 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Attempting rescue
May 27 03:03:19.850695 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98471) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 27 03:03:19.856903 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Instance directory exists: not creating {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 03:03:19.857034 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Creating image(s)
May 27 03:03:19.861764 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:19.862049 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "/opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:19.862650 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "/opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:19.862860 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'trusted_certs' on Instance uuid ca2e5c3f-b9be-4bfb-9858-c22cbb4177da {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:19.870289 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Updating instance_info_cache with network_info: [{"id": "c87aaa49-f608-4ea5-ae24-f72634311e87", "address": "fa:16:3e:ea:f3:4f", "network": {"id": "9248ef89-2536-49ef-91a8-4cc5e166006b", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1769250526-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23965b01217144d29b9cc5ef0d064a47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87aaa49-f6", "ovs_interfaceid": "c87aaa49-f608-4ea5-ae24-f72634311e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:19.994961 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c6f18ec9-a8f3-4158-915e-d7b8295d2726 req-8cb3f811-5e27-4ccc-bd9a-c3e3bdefddce service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received event network-vif-unplugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:19.995276 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c6f18ec9-a8f3-4158-915e-d7b8295d2726 req-8cb3f811-5e27-4ccc-bd9a-c3e3bdefddce service nova] Acquiring lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:19.995883 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c6f18ec9-a8f3-4158-915e-d7b8295d2726 req-8cb3f811-5e27-4ccc-bd9a-c3e3bdefddce service nova] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:19.995883 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c6f18ec9-a8f3-4158-915e-d7b8295d2726 req-8cb3f811-5e27-4ccc-bd9a-c3e3bdefddce service nova] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:19.995883 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c6f18ec9-a8f3-4158-915e-d7b8295d2726 req-8cb3f811-5e27-4ccc-bd9a-c3e3bdefddce service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] No waiting events found dispatching network-vif-unplugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:19.995998 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c6f18ec9-a8f3-4158-915e-d7b8295d2726 req-8cb3f811-5e27-4ccc-bd9a-c3e3bdefddce service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received unexpected event network-vif-unplugged-1133d110-d517-4b72-bbce-faf3064e5946 for instance with vm_state active and task_state rescuing.
May 27 03:03:19.996103 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c6f18ec9-a8f3-4158-915e-d7b8295d2726 req-8cb3f811-5e27-4ccc-bd9a-c3e3bdefddce service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received event network-vif-unplugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:19.996278 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c6f18ec9-a8f3-4158-915e-d7b8295d2726 req-8cb3f811-5e27-4ccc-bd9a-c3e3bdefddce service nova] Acquiring lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:19.996459 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c6f18ec9-a8f3-4158-915e-d7b8295d2726 req-8cb3f811-5e27-4ccc-bd9a-c3e3bdefddce service nova] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:19.996627 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c6f18ec9-a8f3-4158-915e-d7b8295d2726 req-8cb3f811-5e27-4ccc-bd9a-c3e3bdefddce service nova] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:19.996790 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c6f18ec9-a8f3-4158-915e-d7b8295d2726 req-8cb3f811-5e27-4ccc-bd9a-c3e3bdefddce service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] No waiting events found dispatching network-vif-unplugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:19.997325 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c6f18ec9-a8f3-4158-915e-d7b8295d2726 req-8cb3f811-5e27-4ccc-bd9a-c3e3bdefddce service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received unexpected event network-vif-unplugged-1133d110-d517-4b72-bbce-faf3064e5946 for instance with vm_state active and task_state rescuing.
May 27 03:03:20.037526 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:20.179140 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:03:20.194438 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Updating instance_info_cache with network_info: [{"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:20.365392 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<ca2e5c3f-b9be-4bfb-9858-c22cbb4177da> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:03:20.366045 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:03:20.369417 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:03:20.371907 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:20.372824 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Releasing lock "refresh_cache-de33390e-64b1-4034-a1f1-dcc935cf25fd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:20.373230 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Instance network_info: |[{"id": "c87aaa49-f608-4ea5-ae24-f72634311e87", "address": "fa:16:3e:ea:f3:4f", "network": {"id": "9248ef89-2536-49ef-91a8-4cc5e166006b", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1769250526-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23965b01217144d29b9cc5ef0d064a47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87aaa49-f6", "ovs_interfaceid": "c87aaa49-f608-4ea5-ae24-f72634311e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:03:20.375480 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:20.376068 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Start _get_guest_xml network_info=[{"id": "c87aaa49-f608-4ea5-ae24-f72634311e87", "address": "fa:16:3e:ea:f3:4f", "network": {"id": "9248ef89-2536-49ef-91a8-4cc5e166006b", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1769250526-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23965b01217144d29b9cc5ef0d064a47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87aaa49-f6", "ovs_interfaceid": "c87aaa49-f608-4ea5-ae24-f72634311e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:03:20.376389 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:03:20.381059 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:03:20.381806 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:20.406506 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:03:20.409972 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-VolumesExtendAttachedTest-instance-1508426012', uuid='de33390e-64b1-4034-a1f1-dcc935cf25fd'), owner=OwnerMeta(userid='8e79920811e0436ab5cc75631e778110', username='tempest-VolumesExtendAttachedTest-1858923834-project-member', projectid='23965b01217144d29b9cc5ef0d064a47', projectname='tempest-VolumesExtendAttachedTest-1858923834'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c87aaa49-f608-4ea5-ae24-f72634311e87", "address": "fa:16:3e:ea:f3:4f", "network": {"id": "9248ef89-2536-49ef-91a8-4cc5e166006b", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1769250526-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23965b01217144d29b9cc5ef0d064a47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87aaa49-f6", "ovs_interfaceid": "c87aaa49-f608-4ea5-ae24-f72634311e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851000.40899) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:03:20.411733 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:03:20.412322 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:03:20.415451 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:03:20.416155 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:03:20.417895 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:03:20.419158 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:03:20.419774 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:03:20.419947 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:03:20.420053 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:03:20.420158 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:03:20.420288 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:03:20.420538 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:03:20.420697 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:03:20.421284 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:03:20.421284 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:03:20.421284 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:03:20.438909 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1508426012',display_name='tempest-VolumesExtendAttachedTest-instance-1508426012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesextendattachedtest-instance-1508426012',id=36,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6KN9Rj63+8v0EzE3wHaWCV/BPqAOZ7k4+62hMSd1VVnupfGRHRL7/1Luk0K8JHLVcfEwK3/KakPNxxoJM2eNQ3ZacOej9n2nyf05wkTrACHzq0SPPCM6kyaYPdSSu5zA==',key_name='tempest-keypair-975408864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23965b01217144d29b9cc5ef0d064a47',ramdisk_id='',reservation_id='r-diocpn6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-1858923834',owner_user_name='tempest-VolumesExtendAttachedTest-1858923834-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e79920811e0436ab5cc75631e778110',uuid=de33390e-64b1-4034-a1f1-dcc935cf25fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c87aaa49-f608-4ea5-ae24-f72634311e87", "address": "fa:16:3e:ea:f3:4f", "network": {"id": "9248ef89-2536-49ef-91a8-4cc5e166006b", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1769250526-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23965b01217144d29b9cc5ef0d064a47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87aaa49-f6", "ovs_interfaceid": "c87aaa49-f608-4ea5-ae24-f72634311e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:03:20.439210 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Converting VIF {"id": "c87aaa49-f608-4ea5-ae24-f72634311e87", "address": "fa:16:3e:ea:f3:4f", "network": {"id": "9248ef89-2536-49ef-91a8-4cc5e166006b", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1769250526-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23965b01217144d29b9cc5ef0d064a47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87aaa49-f6", "ovs_interfaceid": "c87aaa49-f608-4ea5-ae24-f72634311e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:03:20.440024 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:4f,bridge_name='br-int',has_traffic_filtering=True,id=c87aaa49-f608-4ea5-ae24-f72634311e87,network=Network(9248ef89-2536-49ef-91a8-4cc5e166006b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc87aaa49-f6') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:03:20.440784 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lazy-loading 'pci_devices' on Instance uuid de33390e-64b1-4034-a1f1-dcc935cf25fd {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:20.483191 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.101s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:20.483597 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk.rescue {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:20.538524 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk.rescue" returned: 0 in 0.055s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:20.539455 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.166s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:20.539844 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'migration_context' on Instance uuid ca2e5c3f-b9be-4bfb-9858-c22cbb4177da {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:20.687500 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.036s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:20.690136 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.366s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:20.694593 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:03:20.694754 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Claim successful on node np0000001475
May 27 03:03:20.699705 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Releasing lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:20.742400 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Deleted allocations for instance 9847a45d-ad45-4b2b-85eb-664604911991
May 27 03:03:20.946472 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] End _get_guest_xml xml=<domain type="qemu">
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:   <uuid>de33390e-64b1-4034-a1f1-dcc935cf25fd</uuid>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:   <name>instance-00000024</name>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <nova:name>tempest-VolumesExtendAttachedTest-instance-1508426012</nova:name>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:03:20</nova:creationTime>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:         <nova:user uuid="8e79920811e0436ab5cc75631e778110">tempest-VolumesExtendAttachedTest-1858923834-project-member</nova:user>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:         <nova:project uuid="23965b01217144d29b9cc5ef0d064a47">tempest-VolumesExtendAttachedTest-1858923834</nova:project>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:         <nova:port uuid="c87aaa49-f608-4ea5-ae24-f72634311e87">
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     <system>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <entry name="serial">de33390e-64b1-4034-a1f1-dcc935cf25fd</entry>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <entry name="uuid">de33390e-64b1-4034-a1f1-dcc935cf25fd</entry>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     </system>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:   <os>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:   </os>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:   <features>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:   </features>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:   <devices>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd/disk"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     </disk>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd/disk.config"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     </disk>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:ea:f3:4f"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <target dev="tapc87aaa49-f6"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     </interface>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd/console.log" append="off"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     </serial>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     <video>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     </video>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     </rng>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:   </devices>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]: </domain>
May 27 03:03:20.946472 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:03:20.946472 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Preparing to wait for external event network-vif-plugged-c87aaa49-f608-4ea5-ae24-f72634311e87 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:03:20.946472 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Acquiring lock "de33390e-64b1-4034-a1f1-dcc935cf25fd-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:20.946472 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:20.950340 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:20.950340 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1508426012',display_name='tempest-VolumesExtendAttachedTest-instance-1508426012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesextendattachedtest-instance-1508426012',id=36,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6KN9Rj63+8v0EzE3wHaWCV/BPqAOZ7k4+62hMSd1VVnupfGRHRL7/1Luk0K8JHLVcfEwK3/KakPNxxoJM2eNQ3ZacOej9n2nyf05wkTrACHzq0SPPCM6kyaYPdSSu5zA==',key_name='tempest-keypair-975408864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23965b01217144d29b9cc5ef0d064a47',ramdisk_id='',reservation_id='r-diocpn6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-1858923834',owner_user_name='tempest-VolumesExtendAttachedTest-1858923834-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e79920811e0436ab5cc75631e778110',uuid=de33390e-64b1-4034-a1f1-dcc935cf25fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c87aaa49-f608-4ea5-ae24-f72634311e87", "address": "fa:16:3e:ea:f3:4f", "network": {"id": "9248ef89-2536-49ef-91a8-4cc5e166006b", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1769250526-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23965b01217144d29b9cc5ef0d064a47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87aaa49-f6", "ovs_interfaceid": "c87aaa49-f608-4ea5-ae24-f72634311e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:03:20.950340 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Converting VIF {"id": "c87aaa49-f608-4ea5-ae24-f72634311e87", "address": "fa:16:3e:ea:f3:4f", "network": {"id": "9248ef89-2536-49ef-91a8-4cc5e166006b", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1769250526-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23965b01217144d29b9cc5ef0d064a47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87aaa49-f6", "ovs_interfaceid": "c87aaa49-f608-4ea5-ae24-f72634311e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:03:20.950340 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:4f,bridge_name='br-int',has_traffic_filtering=True,id=c87aaa49-f608-4ea5-ae24-f72634311e87,network=Network(9248ef89-2536-49ef-91a8-4cc5e166006b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc87aaa49-f6') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:03:20.950340 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:4f,bridge_name='br-int',has_traffic_filtering=True,id=c87aaa49-f608-4ea5-ae24-f72634311e87,network=Network(9248ef89-2536-49ef-91a8-4cc5e166006b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc87aaa49-f6') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:03:20.950720 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:20.950973 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:20.951253 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:03:20.952421 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:20.952648 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'defe8965-32d2-5ee7-a741-001f0522b30e', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:20.953736 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:20.954624 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:03:20.960485 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:20.963671 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:20.963939 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc87aaa49-f6, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:20.964421 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc87aaa49-f6, col_values=(('qos', UUID('0685b132-8a7f-4570-b6c4-63a533d02412')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:20.964729 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc87aaa49-f6, col_values=(('external_ids', {'iface-id': 'c87aaa49-f608-4ea5-ae24-f72634311e87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:f3:4f', 'vm-uuid': 'de33390e-64b1-4034-a1f1-dcc935cf25fd'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:20.966012 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:20.968008 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:03:20.980091 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:20.981286 np0000001475 nova-compute[98471]: INFO os_vif [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f3:4f,bridge_name='br-int',has_traffic_filtering=True,id=c87aaa49-f608-4ea5-ae24-f72634311e87,network=Network(9248ef89-2536-49ef-91a8-4cc5e166006b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc87aaa49-f6')
May 27 03:03:21.043246 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<ca2e5c3f-b9be-4bfb-9858-c22cbb4177da> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:03:21.043564 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:03:21.044186 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Start _get_guest_xml network_info=[{"id": "1133d110-d517-4b72-bbce-faf3064e5946", "address": "fa:16:3e:d9:1c:3f", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.67", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "vif_mac": "fa:16:3e:d9:1c:3f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1133d110-d5", "ovs_interfaceid": "1133d110-d517-4b72-bbce-faf3064e5946", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:03:21.044383 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'resources' on Instance uuid ca2e5c3f-b9be-4bfb-9858-c22cbb4177da {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:21.091553 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:21.546775 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<ca2e5c3f-b9be-4bfb-9858-c22cbb4177da> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:03:21.550138 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:03:21.551914 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1395902965', uuid='ca2e5c3f-b9be-4bfb-9858-c22cbb4177da'), owner=OwnerMeta(userid='b438796ed5e44f629535db767fe2b756', username='tempest-ServerRescueNegativeTestJSON-62027498-project-member', projectid='39cbbdb9012c4992865d4f89678ef9ac', projectname='tempest-ServerRescueNegativeTestJSON-62027498'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1133d110-d517-4b72-bbce-faf3064e5946", "address": "fa:16:3e:d9:1c:3f", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.67", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "vif_mac": "fa:16:3e:d9:1c:3f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1133d110-d5", "ovs_interfaceid": "1133d110-d517-4b72-bbce-faf3064e5946", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851001.5510814) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:03:21.553910 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:03:21.554242 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:03:21.555238 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:03:21.555465 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:03:21.556354 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:03:21.556669 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:03:21.556835 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:03:21.556929 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:03:21.557040 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:03:21.557126 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:03:21.557232 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:03:21.557366 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:03:21.557540 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:03:21.557642 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:03:21.558078 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:03:21.558078 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:03:21.558078 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'vcpu_model' on Instance uuid ca2e5c3f-b9be-4bfb-9858-c22cbb4177da {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:21.759453 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e1fd6b90-5eb1-4d2b-b5fe-f71e5953f53f tempest-ServerBootFromVolumeStableRescueTest-1976367979 tempest-ServerBootFromVolumeStableRescueTest-1976367979-project-member] Lock "9847a45d-ad45-4b2b-85eb-664604911991" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.989s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:22.062444 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<ca2e5c3f-b9be-4bfb-9858-c22cbb4177da> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:03:22.081014 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1395902965',display_name='tempest-ServerRescueNegativeTestJSON-server-1395902965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverrescuenegativetestjson-server-1395902965',id=31,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzS05hQU82r7289dzCq091Kq0hKDY8vlIghFsejL46c9qOyIGwMDUj2tsi4gbzjp70mEziyTz5NLouHNw4zIeC77WZdjsM5xeXJ8F2FHPRHi+ROTn7Bnw2TX4fYLvq7NA==',key_name='tempest-keypair-363341517',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:02:25Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39cbbdb9012c4992865d4f89678ef9ac',ramdisk_id='',reservation_id='r-7zpndcla',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-62027498',owner_user_name='tempest-ServerRescueNegativeTestJSON-62027498-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:02:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b438796ed5e44f629535db767fe2b756',uuid=ca2e5c3f-b9be-4bfb-9858-c22cbb4177da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1133d110-d517-4b72-bbce-faf3064e5946", "address": "fa:16:3e:d9:1c:3f", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.67", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "vif_mac": "fa:16:3e:d9:1c:3f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1133d110-d5", "ovs_interfaceid": "1133d110-d517-4b72-bbce-faf3064e5946", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:03:22.081266 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converting VIF {"id": "1133d110-d517-4b72-bbce-faf3064e5946", "address": "fa:16:3e:d9:1c:3f", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.67", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "vif_mac": "fa:16:3e:d9:1c:3f"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1133d110-d5", "ovs_interfaceid": "1133d110-d517-4b72-bbce-faf3064e5946", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:03:22.081862 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:1c:3f,bridge_name='br-int',has_traffic_filtering=True,id=1133d110-d517-4b72-bbce-faf3064e5946,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1133d110-d5') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:03:22.082397 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'pci_devices' on Instance uuid ca2e5c3f-b9be-4bfb-9858-c22cbb4177da {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:22.225340 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Starting migrate_disk_and_power_off {{(pid=98471) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 27 03:03:22.273910 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:22.285850 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:22.310843 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:22.493478 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:22.505556 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:22.505556 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:22.505735 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] No VIF found with MAC fa:16:3e:ea:f3:4f, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:03:22.506185 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Using config drive
May 27 03:03:22.515243 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:22.586017 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:03:22.586017 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:03:22.587413 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<ca2e5c3f-b9be-4bfb-9858-c22cbb4177da> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:03:22.587970 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] End _get_guest_xml xml=<domain type="qemu">
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:   <uuid>ca2e5c3f-b9be-4bfb-9858-c22cbb4177da</uuid>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:   <name>instance-0000001f</name>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1395902965</nova:name>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:03:21</nova:creationTime>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:         <nova:user uuid="b438796ed5e44f629535db767fe2b756">tempest-ServerRescueNegativeTestJSON-62027498-project-member</nova:user>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:         <nova:project uuid="39cbbdb9012c4992865d4f89678ef9ac">tempest-ServerRescueNegativeTestJSON-62027498</nova:project>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:         <nova:port uuid="1133d110-d517-4b72-bbce-faf3064e5946">
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     <system>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <entry name="serial">ca2e5c3f-b9be-4bfb-9858-c22cbb4177da</entry>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <entry name="uuid">ca2e5c3f-b9be-4bfb-9858-c22cbb4177da</entry>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     </system>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:   <os>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:   </os>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:   <features>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:   </features>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:   <devices>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk.rescue"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     </disk>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <target dev="vdb" bus="virtio"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     </disk>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk.config.rescue"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     </disk>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:d9:1c:3f"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <target dev="tap1133d110-d5"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     </interface>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/console.log" append="off"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     </serial>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     <video>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     </video>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     </rng>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:   </devices>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]: </domain>
May 27 03:03:22.587970 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:03:22.594957 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999664422000023 future=<Future at 0x7557044915b0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:22.601210 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Instance destroyed successfully.
May 27 03:03:22.603325 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='multiattach-server-0',id=30,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7X60AtOl0SsfuAMV1LtNGpvh0yvi8THxioUm4x62ykVhuM7q4sXRNe3S5fa56OsOiAX0ZbtOowRZ4+AKeGhch21Oc/NUN3hQGbbFxrwclVqtJHRu4HOLbwt9JgM8J0mA==',key_name='tempest-keypair-1333870124',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:02:21Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-7nyxrr7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:03:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092604511a8a467ba4ecb56261cb531f',uuid=c2a5e735-d573-4ac4-bff0-d4a12648718e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "vif_mac": "fa:16:3e:5c:30:71"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:03:22.603764 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "vif_mac": "fa:16:3e:5c:30:71"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:03:22.604541 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a2498912-5a39-4f70-a141-dae495d11b2a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2498912-5a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:03:22.605054 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a2498912-5a39-4f70-a141-dae495d11b2a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2498912-5a') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:03:22.607598 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Instance destroyed successfully.
May 27 03:03:22.609389 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:22.609634 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2498912-5a, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:22.616559 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:03:22.630465 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:22.632198 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:22.632645 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71697198-9000-4cd3-aa14-1fcd30418875) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:22.635089 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:22.638967 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:03:22.640989 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4944abd8-9a13-40df-9412-07b322ea0793 req-e187b945-0345-4457-ad84-5f9809e98260 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received event network-vif-unplugged-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:22.641282 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4944abd8-9a13-40df-9412-07b322ea0793 req-e187b945-0345-4457-ad84-5f9809e98260 service nova] Acquiring lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:22.641537 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4944abd8-9a13-40df-9412-07b322ea0793 req-e187b945-0345-4457-ad84-5f9809e98260 service nova] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:22.641717 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4944abd8-9a13-40df-9412-07b322ea0793 req-e187b945-0345-4457-ad84-5f9809e98260 service nova] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:22.641901 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4944abd8-9a13-40df-9412-07b322ea0793 req-e187b945-0345-4457-ad84-5f9809e98260 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] No waiting events found dispatching network-vif-unplugged-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:22.642063 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-4944abd8-9a13-40df-9412-07b322ea0793 req-e187b945-0345-4457-ad84-5f9809e98260 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received unexpected event network-vif-unplugged-a2498912-5a39-4f70-a141-dae495d11b2a for instance with vm_state active and task_state resize_migrating.
May 27 03:03:22.648879 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:22.653055 np0000001475 nova-compute[98471]: INFO os_vif [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a2498912-5a39-4f70-a141-dae495d11b2a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2498912-5a')
May 27 03:03:23.012532 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:23.089393 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:03:23.147417 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Creating config drive at /opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd/disk.config
May 27 03:03:23.152824 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz7_fhzix {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:23.199807 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Detected multiple connections on this host for volume: 8cd7c930-2109-4c04-85a8-31ac0ce9341e, skipping target disconnect.
May 27 03:03:23.203977 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:23.226734 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz7_fhzix" returned: 0 in 0.073s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:23.322304 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:23.322828 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:23.381098 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:23.418972 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:23.419345 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:03:23.420020 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e_resize/disk /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:23.522859 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "cp -r /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e_resize/disk /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk" returned: 0 in 0.102s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:23.523327 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e_resize/disk.config /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk.config {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:23.568281 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "cp -r /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e_resize/disk.config /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk.config" returned: 0 in 0.045s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:23.568761 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e_resize/disk.info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk.info {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:23.605539 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.917s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:23.608700 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:03:23.615666 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "cp -r /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e_resize/disk.info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk.info" returned: 0 in 0.047s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:23.831123 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:23.877078 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:23.989481 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d4691743-223d-492f-8a93-ac1b59040b40 req-1a2903c8-edd7-428e-83d9-ab62681614a3 service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Received event network-vif-plugged-c87aaa49-f608-4ea5-ae24-f72634311e87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:23.989612 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d4691743-223d-492f-8a93-ac1b59040b40 req-1a2903c8-edd7-428e-83d9-ab62681614a3 service nova] Acquiring lock "de33390e-64b1-4034-a1f1-dcc935cf25fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:23.989800 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d4691743-223d-492f-8a93-ac1b59040b40 req-1a2903c8-edd7-428e-83d9-ab62681614a3 service nova] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:23.989963 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d4691743-223d-492f-8a93-ac1b59040b40 req-1a2903c8-edd7-428e-83d9-ab62681614a3 service nova] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:23.990095 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d4691743-223d-492f-8a93-ac1b59040b40 req-1a2903c8-edd7-428e-83d9-ab62681614a3 service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Processing event network-vif-plugged-c87aaa49-f608-4ea5-ae24-f72634311e87 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:03:24.117614 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:03:24.118005 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:03:24.118039 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:24.118829 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:24.139660 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:24.140513 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:24.140648 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:24.140726 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] No VIF found with MAC fa:16:3e:d9:1c:3f, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:03:24.141717 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Using config drive
May 27 03:03:24.143635 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:24.153650 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:24.177903 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:24.183875 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:24.216586 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6dd385bbf9c3482aa593c41ce7795e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a54fd7b39b4a968af6ad453070ea4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:03:24.621504 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:03:24.646885 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'ec2_ids' on Instance uuid ca2e5c3f-b9be-4bfb-9858-c22cbb4177da {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:24.684835 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851004.6840665, de33390e-64b1-4034-a1f1-dcc935cf25fd => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:24.684976 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] VM Started (Lifecycle Event)
May 27 03:03:24.686235 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:03:24.689368 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:03:24.692200 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Instance spawned successfully.
May 27 03:03:24.692519 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:03:24.736527 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3ffa42cf-64e8-419b-ac10-d2ed6343b29a req-e0f8802c-abc5-4ccb-a70d-7c655d67c206 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received event network-vif-unplugged-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:24.736779 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3ffa42cf-64e8-419b-ac10-d2ed6343b29a req-e0f8802c-abc5-4ccb-a70d-7c655d67c206 service nova] Acquiring lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:24.737101 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3ffa42cf-64e8-419b-ac10-d2ed6343b29a req-e0f8802c-abc5-4ccb-a70d-7c655d67c206 service nova] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:24.737132 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3ffa42cf-64e8-419b-ac10-d2ed6343b29a req-e0f8802c-abc5-4ccb-a70d-7c655d67c206 service nova] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:24.737322 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3ffa42cf-64e8-419b-ac10-d2ed6343b29a req-e0f8802c-abc5-4ccb-a70d-7c655d67c206 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] No waiting events found dispatching network-vif-unplugged-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:24.737486 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-3ffa42cf-64e8-419b-ac10-d2ed6343b29a req-e0f8802c-abc5-4ccb-a70d-7c655d67c206 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received unexpected event network-vif-unplugged-a2498912-5a39-4f70-a141-dae495d11b2a for instance with vm_state active and task_state resize_migrating.
May 27 03:03:24.820067 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Successfully created port: 32222a99-3c66-4869-88f8-33b8a752ec5b {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:03:24.934455 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:24.935041 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:25.021191 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Port a2498912-5a39-4f70-a141-dae495d11b2a binding to destination host np0000001475 is already ACTIVE {{(pid=98471) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 27 03:03:25.125154 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:03:25.150811 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<ca2e5c3f-b9be-4bfb-9858-c22cbb4177da> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:03:25.150969 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'keypairs' on Instance uuid ca2e5c3f-b9be-4bfb-9858-c22cbb4177da {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:25.192566 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:25.197951 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:03:25.198518 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:25.198774 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:25.199132 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:25.199329 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:25.199561 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:25.201842 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:25.438989 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Successfully updated port: 32222a99-3c66-4869-88f8-33b8a752ec5b {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:03:25.653634 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<ca2e5c3f-b9be-4bfb-9858-c22cbb4177da> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:03:25.657126 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:25.684053 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.00047098899995035026 future=<Future at 0x755704729f10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:25.685210 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Emitting event <LifecycleEvent: 1779850990.683439, 9847a45d-ad45-4b2b-85eb-664604911991 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:25.685455 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:25.685715 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] VM Stopped (Lifecycle Event)
May 27 03:03:25.687259 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=8.646837621000032 future=<Future at 0x75572c13bfe0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:25.687543 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=8.64670559399974 future=<Future at 0x75572c13bfe0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:25.704497 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:03:25.704792 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851005.7045999, de33390e-64b1-4034-a1f1-dcc935cf25fd => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:25.704908 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] VM Paused (Lifecycle Event)
May 27 03:03:25.707365 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Took 7.60 seconds to spawn the instance on the hypervisor.
May 27 03:03:25.707514 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:25.811484 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Creating config drive at /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk.config.rescue
May 27 03:03:25.818640 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo9i7iodv {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:25.875951 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo9i7iodv" returned: 0 in 0.057s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:25.942021 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "refresh_cache-e17e8031-6811-4553-b8ce-7150f690a4ba" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:25.942226 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquired lock "refresh_cache-e17e8031-6811-4553-b8ce-7150f690a4ba" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:25.942479 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:03:26.037842 np0000001475 nova-compute[98471]: DEBUG nova.compute.rpcapi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98471) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 03:03:26.046329 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:26.046540 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:26.046724 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:26.074649 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9bb56971-4480-4e52-aa70-cc945624519d req-d5bfdaed-5613-4a1d-a743-e58a61e0ec8c service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Received event network-vif-plugged-c87aaa49-f608-4ea5-ae24-f72634311e87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:26.074899 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9bb56971-4480-4e52-aa70-cc945624519d req-d5bfdaed-5613-4a1d-a743-e58a61e0ec8c service nova] Acquiring lock "de33390e-64b1-4034-a1f1-dcc935cf25fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:26.075344 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9bb56971-4480-4e52-aa70-cc945624519d req-d5bfdaed-5613-4a1d-a743-e58a61e0ec8c service nova] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:26.075456 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9bb56971-4480-4e52-aa70-cc945624519d req-d5bfdaed-5613-4a1d-a743-e58a61e0ec8c service nova] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:26.075609 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9bb56971-4480-4e52-aa70-cc945624519d req-d5bfdaed-5613-4a1d-a743-e58a61e0ec8c service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] No waiting events found dispatching network-vif-plugged-c87aaa49-f608-4ea5-ae24-f72634311e87 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:26.075765 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-9bb56971-4480-4e52-aa70-cc945624519d req-d5bfdaed-5613-4a1d-a743-e58a61e0ec8c service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Received unexpected event network-vif-plugged-c87aaa49-f608-4ea5-ae24-f72634311e87 for instance with vm_state active and task_state None.
May 27 03:03:26.094461 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:26.135413 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:03:26.136613 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:03:26.136845 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Creating image(s)
May 27 03:03:26.137274 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "/opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:26.137456 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "/opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:26.138178 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "/opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:26.138825 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:03:26.141477 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:03:26.144038 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:26.189634 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: 9847a45d-ad45-4b2b-85eb-664604911991] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:26.208799 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:26.210857 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851006.2104251, de33390e-64b1-4034-a1f1-dcc935cf25fd => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:26.211366 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] VM Resumed (Lifecycle Event)
May 27 03:03:26.223762 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Took 17.76 seconds to build instance.
May 27 03:03:26.258277 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.114s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:26.258761 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:26.259198 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:26.259568 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:03:26.262083 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:03:26.262389 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:26.354942 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:26.374916 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.110s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:26.374916 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:26.395382 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:26.434294 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba/disk 1073741824" returned: 0 in 0.060s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:26.434726 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:26.435130 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:26.526226 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:26.547846 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:03:26.567023 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.131s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:26.568502 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:03:26.568502 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:26.598555 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:26.689695 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:26.690571 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Cannot resize image /opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:03:26.691680 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:03:26.691680 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Ensure instance console log exists: /opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:03:26.692291 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:26.692291 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:26.692575 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:26.723329 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:26.727243 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:03:26.733734 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.311s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:26.740536 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:26.824401 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1e560712-524a-4457-85b3-af4b1af0de50 req-db8ce59d-1574-4e2a-8db4-449afc6f1485 service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Received event network-changed-32222a99-3c66-4869-88f8-33b8a752ec5b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:26.824401 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1e560712-524a-4457-85b3-af4b1af0de50 req-db8ce59d-1574-4e2a-8db4-449afc6f1485 service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Refreshing instance network info cache due to event network-changed-32222a99-3c66-4869-88f8-33b8a752ec5b. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:03:26.824401 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1e560712-524a-4457-85b3-af4b1af0de50 req-db8ce59d-1574-4e2a-8db4-449afc6f1485 service nova] Acquiring lock "refresh_cache-e17e8031-6811-4553-b8ce-7150f690a4ba" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:26.873873 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Updating instance_info_cache with network_info: [{"id": "32222a99-3c66-4869-88f8-33b8a752ec5b", "address": "fa:16:3e:a2:a0:80", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32222a99-3c", "ovs_interfaceid": "32222a99-3c66-4869-88f8-33b8a752ec5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:27.063988 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:27.170601 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:27.170985 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquired lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:27.170985 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:03:27.375664 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Releasing lock "refresh_cache-e17e8031-6811-4553-b8ce-7150f690a4ba" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:27.375943 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Instance network_info: |[{"id": "32222a99-3c66-4869-88f8-33b8a752ec5b", "address": "fa:16:3e:a2:a0:80", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32222a99-3c", "ovs_interfaceid": "32222a99-3c66-4869-88f8-33b8a752ec5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:03:27.376420 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1e560712-524a-4457-85b3-af4b1af0de50 req-db8ce59d-1574-4e2a-8db4-449afc6f1485 service nova] Acquired lock "refresh_cache-e17e8031-6811-4553-b8ce-7150f690a4ba" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:27.378373 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-1e560712-524a-4457-85b3-af4b1af0de50 req-db8ce59d-1574-4e2a-8db4-449afc6f1485 service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Refreshing network info cache for port 32222a99-3c66-4869-88f8-33b8a752ec5b {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:03:27.380053 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Start _get_guest_xml network_info=[{"id": "32222a99-3c66-4869-88f8-33b8a752ec5b", "address": "fa:16:3e:a2:a0:80", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32222a99-3c", "ovs_interfaceid": "32222a99-3c66-4869-88f8-33b8a752ec5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:03:27.386125 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:03:27.387611 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-376034161', uuid='e17e8031-6811-4553-b8ce-7150f690a4ba'), owner=OwnerMeta(userid='6dd385bbf9c3482aa593c41ce7795e8e', username='tempest-TestEncryptedCinderVolumes-727613157-project-member', projectid='51a54fd7b39b4a968af6ad453070ea4d', projectname='tempest-TestEncryptedCinderVolumes-727613157'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "32222a99-3c66-4869-88f8-33b8a752ec5b", "address": "fa:16:3e:a2:a0:80", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32222a99-3c", "ovs_interfaceid": "32222a99-3c66-4869-88f8-33b8a752ec5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851007.3871858) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:03:27.391327 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:03:27.393078 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:03:27.396872 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:03:27.397116 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:03:27.398515 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:03:27.398980 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:03:27.399181 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:03:27.399322 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:03:27.399497 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:03:27.399651 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:03:27.399804 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:03:27.400023 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:03:27.400142 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:03:27.400283 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:03:27.400437 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:03:27.400616 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:03:27.419897 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-376034161',display_name='tempest-TestEncryptedCinderVolumes-server-376034161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testencryptedcindervolumes-server-376034161',id=37,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBs7D+K7XXYy9ndCZLoXBly8+dvyoGBAnPmW3+clxKdIHl0K/S6h2vXSVB/WB4qA4L1mStHC0pIXGd2CaDAQNDOtBe7C6VcCJBdkgQXWhOdedVxIvdXRLgTqSarMjRBzQQ==',key_name='tempest-keypair-245298165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51a54fd7b39b4a968af6ad453070ea4d',ramdisk_id='',reservation_id='r-vyed7wv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-727613157',owner_user_name='tempest-TestEncryptedCinderVolumes-727613157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:03:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6dd385bbf9c3482aa593c41ce7795e8e',uuid=e17e8031-6811-4553-b8ce-7150f690a4ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32222a99-3c66-4869-88f8-33b8a752ec5b", "address": "fa:16:3e:a2:a0:80", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32222a99-3c", "ovs_interfaceid": "32222a99-3c66-4869-88f8-33b8a752ec5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:03:27.420209 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Converting VIF {"id": "32222a99-3c66-4869-88f8-33b8a752ec5b", "address": "fa:16:3e:a2:a0:80", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32222a99-3c", "ovs_interfaceid": "32222a99-3c66-4869-88f8-33b8a752ec5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:03:27.422030 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a0:80,bridge_name='br-int',has_traffic_filtering=True,id=32222a99-3c66-4869-88f8-33b8a752ec5b,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32222a99-3c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:03:27.422699 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lazy-loading 'pci_devices' on Instance uuid e17e8031-6811-4553-b8ce-7150f690a4ba {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:27.447032 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Removed pending STOPPED event for ca2e5c3f-b9be-4bfb-9858-c22cbb4177da due to new event <LifecycleEvent: 1779851007.445795, ca2e5c3f-b9be-4bfb-9858-c22cbb4177da => Resumed> {{(pid=98471) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 03:03:27.447032 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851007.445795, ca2e5c3f-b9be-4bfb-9858-c22cbb4177da => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:27.447884 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] VM Resumed (Lifecycle Event)
May 27 03:03:27.453985 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e3323899-f388-4b47-a3af-b466ed65fece tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:27.635477 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:27.673334 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:27.882457 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-1e560712-524a-4457-85b3-af4b1af0de50 req-db8ce59d-1574-4e2a-8db4-449afc6f1485 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:27.927000 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] End _get_guest_xml xml=<domain type="qemu">
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:   <uuid>e17e8031-6811-4553-b8ce-7150f690a4ba</uuid>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:   <name>instance-00000025</name>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-376034161</nova:name>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:03:27</nova:creationTime>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:         <nova:user uuid="6dd385bbf9c3482aa593c41ce7795e8e">tempest-TestEncryptedCinderVolumes-727613157-project-member</nova:user>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:         <nova:project uuid="51a54fd7b39b4a968af6ad453070ea4d">tempest-TestEncryptedCinderVolumes-727613157</nova:project>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:         <nova:port uuid="32222a99-3c66-4869-88f8-33b8a752ec5b">
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     <system>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <entry name="serial">e17e8031-6811-4553-b8ce-7150f690a4ba</entry>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <entry name="uuid">e17e8031-6811-4553-b8ce-7150f690a4ba</entry>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     </system>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:   <os>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:   </os>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:   <features>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:   </features>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:   <devices>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba/disk"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     </disk>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba/disk.config"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     </disk>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:a2:a0:80"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <target dev="tap32222a99-3c"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     </interface>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba/console.log" append="off"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     </serial>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     <video>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     </video>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     </rng>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:   </devices>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]: </domain>
May 27 03:03:27.927000 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:03:27.929465 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Preparing to wait for external event network-vif-plugged-32222a99-3c66-4869-88f8-33b8a752ec5b {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:03:27.929465 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "e17e8031-6811-4553-b8ce-7150f690a4ba-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:27.929465 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:27.929465 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:27.929465 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-376034161',display_name='tempest-TestEncryptedCinderVolumes-server-376034161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testencryptedcindervolumes-server-376034161',id=37,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBs7D+K7XXYy9ndCZLoXBly8+dvyoGBAnPmW3+clxKdIHl0K/S6h2vXSVB/WB4qA4L1mStHC0pIXGd2CaDAQNDOtBe7C6VcCJBdkgQXWhOdedVxIvdXRLgTqSarMjRBzQQ==',key_name='tempest-keypair-245298165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51a54fd7b39b4a968af6ad453070ea4d',ramdisk_id='',reservation_id='r-vyed7wv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-727613157',owner_user_name='tempest-TestEncryptedCinderVolumes-727613157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:03:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6dd385bbf9c3482aa593c41ce7795e8e',uuid=e17e8031-6811-4553-b8ce-7150f690a4ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32222a99-3c66-4869-88f8-33b8a752ec5b", "address": "fa:16:3e:a2:a0:80", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32222a99-3c", "ovs_interfaceid": "32222a99-3c66-4869-88f8-33b8a752ec5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:03:27.929465 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Converting VIF {"id": "32222a99-3c66-4869-88f8-33b8a752ec5b", "address": "fa:16:3e:a2:a0:80", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32222a99-3c", "ovs_interfaceid": "32222a99-3c66-4869-88f8-33b8a752ec5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:03:27.929465 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a0:80,bridge_name='br-int',has_traffic_filtering=True,id=32222a99-3c66-4869-88f8-33b8a752ec5b,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32222a99-3c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:03:27.929972 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a0:80,bridge_name='br-int',has_traffic_filtering=True,id=32222a99-3c66-4869-88f8-33b8a752ec5b,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32222a99-3c') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:03:27.930809 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:27.931111 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:27.931402 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:03:27.932886 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:27.933805 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80689649-7ec6-56fb-86ee-fefa4ea2a7ba', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:27.935138 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:27.935138 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:03:27.939431 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:27.943212 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:27.943212 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32222a99-3c, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:27.943212 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32222a99-3c, col_values=(('qos', UUID('42db8b57-6d71-4c46-b61b-ada03e63bd1c')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:27.943212 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32222a99-3c, col_values=(('external_ids', {'iface-id': '32222a99-3c66-4869-88f8-33b8a752ec5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:a0:80', 'vm-uuid': 'e17e8031-6811-4553-b8ce-7150f690a4ba'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:27.945111 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:27.945111 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:03:27.951733 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:27.952235 np0000001475 nova-compute[98471]: INFO os_vif [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a0:80,bridge_name='br-int',has_traffic_filtering=True,id=32222a99-3c66-4869-88f8-33b8a752ec5b,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32222a99-3c')
May 27 03:03:27.957643 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:27.960224 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:03:28.075031 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:28.283645 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Updating instance_info_cache with network_info: [{"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:28.304958 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-1e560712-524a-4457-85b3-af4b1af0de50 req-db8ce59d-1574-4e2a-8db4-449afc6f1485 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:28.465188 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851008.4635603, ca2e5c3f-b9be-4bfb-9858-c22cbb4177da => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:28.465188 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] VM Started (Lifecycle Event)
May 27 03:03:28.480883 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-1e560712-524a-4457-85b3-af4b1af0de50 req-db8ce59d-1574-4e2a-8db4-449afc6f1485 service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Updated VIF entry in instance network info cache for port 32222a99-3c66-4869-88f8-33b8a752ec5b. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:03:28.482343 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-1e560712-524a-4457-85b3-af4b1af0de50 req-db8ce59d-1574-4e2a-8db4-449afc6f1485 service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Updating instance_info_cache with network_info: [{"id": "32222a99-3c66-4869-88f8-33b8a752ec5b", "address": "fa:16:3e:a2:a0:80", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32222a99-3c", "ovs_interfaceid": "32222a99-3c66-4869-88f8-33b8a752ec5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:28.770182 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-9db3dd82-436a-4100-b2a5-88c3c236a0de tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Unrescuing
May 27 03:03:28.770484 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9db3dd82-436a-4100-b2a5-88c3c236a0de tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:28.770692 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9db3dd82-436a-4100-b2a5-88c3c236a0de tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquired lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:28.770934 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-9db3dd82-436a-4100-b2a5-88c3c236a0de tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:03:28.787245 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Releasing lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:28.903254 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ac5e32e2-14e3-4cc9-93c3-8baa9dc42acc req-506ec5ec-7efd-4c2c-9c7a-fa8032271078 service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received event network-vif-plugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:28.903598 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ac5e32e2-14e3-4cc9-93c3-8baa9dc42acc req-506ec5ec-7efd-4c2c-9c7a-fa8032271078 service nova] Acquiring lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:28.904184 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ac5e32e2-14e3-4cc9-93c3-8baa9dc42acc req-506ec5ec-7efd-4c2c-9c7a-fa8032271078 service nova] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:28.904344 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ac5e32e2-14e3-4cc9-93c3-8baa9dc42acc req-506ec5ec-7efd-4c2c-9c7a-fa8032271078 service nova] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:28.904537 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ac5e32e2-14e3-4cc9-93c3-8baa9dc42acc req-506ec5ec-7efd-4c2c-9c7a-fa8032271078 service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] No waiting events found dispatching network-vif-plugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:28.904750 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-ac5e32e2-14e3-4cc9-93c3-8baa9dc42acc req-506ec5ec-7efd-4c2c-9c7a-fa8032271078 service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received unexpected event network-vif-plugged-1133d110-d517-4b72-bbce-faf3064e5946 for instance with vm_state rescued and task_state unrescuing.
May 27 03:03:28.904920 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ac5e32e2-14e3-4cc9-93c3-8baa9dc42acc req-506ec5ec-7efd-4c2c-9c7a-fa8032271078 service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Received event network-changed-c87aaa49-f608-4ea5-ae24-f72634311e87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:28.905088 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ac5e32e2-14e3-4cc9-93c3-8baa9dc42acc req-506ec5ec-7efd-4c2c-9c7a-fa8032271078 service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Refreshing instance network info cache due to event network-changed-c87aaa49-f608-4ea5-ae24-f72634311e87. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:03:28.905356 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ac5e32e2-14e3-4cc9-93c3-8baa9dc42acc req-506ec5ec-7efd-4c2c-9c7a-fa8032271078 service nova] Acquiring lock "refresh_cache-de33390e-64b1-4034-a1f1-dcc935cf25fd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:28.905487 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ac5e32e2-14e3-4cc9-93c3-8baa9dc42acc req-506ec5ec-7efd-4c2c-9c7a-fa8032271078 service nova] Acquired lock "refresh_cache-de33390e-64b1-4034-a1f1-dcc935cf25fd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:28.905750 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ac5e32e2-14e3-4cc9-93c3-8baa9dc42acc req-506ec5ec-7efd-4c2c-9c7a-fa8032271078 service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Refreshing network info cache for port c87aaa49-f608-4ea5-ae24-f72634311e87 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:03:28.969905 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:28.972062 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:03:28.984684 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1e560712-524a-4457-85b3-af4b1af0de50 req-db8ce59d-1574-4e2a-8db4-449afc6f1485 service nova] Releasing lock "refresh_cache-e17e8031-6811-4553-b8ce-7150f690a4ba" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:28.984852 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1e560712-524a-4457-85b3-af4b1af0de50 req-db8ce59d-1574-4e2a-8db4-449afc6f1485 service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received event network-vif-plugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:28.985001 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1e560712-524a-4457-85b3-af4b1af0de50 req-db8ce59d-1574-4e2a-8db4-449afc6f1485 service nova] Acquiring lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:28.985139 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1e560712-524a-4457-85b3-af4b1af0de50 req-db8ce59d-1574-4e2a-8db4-449afc6f1485 service nova] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:28.985239 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1e560712-524a-4457-85b3-af4b1af0de50 req-db8ce59d-1574-4e2a-8db4-449afc6f1485 service nova] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:28.985338 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1e560712-524a-4457-85b3-af4b1af0de50 req-db8ce59d-1574-4e2a-8db4-449afc6f1485 service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] No waiting events found dispatching network-vif-plugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:28.985443 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-1e560712-524a-4457-85b3-af4b1af0de50 req-db8ce59d-1574-4e2a-8db4-449afc6f1485 service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received unexpected event network-vif-plugged-1133d110-d517-4b72-bbce-faf3064e5946 for instance with vm_state active and task_state rescuing.
May 27 03:03:29.274941 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-9db3dd82-436a-4100-b2a5-88c3c236a0de tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:29.296842 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:03:29.313764 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:03:29.338695 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:29.391284 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:03:29.391499 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:03:29.400722 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:03:29.403158 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe9d:6d1f', 'fe80::542f:34ff:fe9d:e5b', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::c805:4ff:fe3b:2374', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:feb2:aa32', 'fe80::fc16:3eff:fe01:3d37', 'fe80::fc16:3eff:fe88:48d5', 'fe80::fc16:3eff:fe75:cb49', 'fe80::fc16:3eff:fe58:79ce', 'fe80::8cdc:9fff:fe79:9907', 'fe80::fc16:3eff:fe2d:76bb', 'fe80::787c:50ff:fed5:a1fc', 'fe80::fc16:3eff:feea:f34f', 'fe80::a407:7bff:fed1:e35a', 'fe80::fc16:3eff:fed9:1c3f'] 
May 27 03:03:29.403290 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:03:29.403354 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:03:29.403573 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:03:29.409190 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-ac5e32e2-14e3-4cc9-93c3-8baa9dc42acc req-506ec5ec-7efd-4c2c-9c7a-fa8032271078 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:29.475013 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 27 03:03:29.477838 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:29.478017 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:29.478216 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No VIF found with MAC fa:16:3e:a2:a0:80, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:03:29.479015 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Using config drive
May 27 03:03:29.759450 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-9db3dd82-436a-4100-b2a5-88c3c236a0de tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:29.876795 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-ac5e32e2-14e3-4cc9-93c3-8baa9dc42acc req-506ec5ec-7efd-4c2c-9c7a-fa8032271078 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:29.951317 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-9db3dd82-436a-4100-b2a5-88c3c236a0de tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Updating instance_info_cache with network_info: [{"id": "1133d110-d517-4b72-bbce-faf3064e5946", "address": "fa:16:3e:d9:1c:3f", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1133d110-d5", "ovs_interfaceid": "1133d110-d517-4b72-bbce-faf3064e5946", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:29.988959 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:30.042545 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ac5e32e2-14e3-4cc9-93c3-8baa9dc42acc req-506ec5ec-7efd-4c2c-9c7a-fa8032271078 service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Updated VIF entry in instance network info cache for port c87aaa49-f608-4ea5-ae24-f72634311e87. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:03:30.042995 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ac5e32e2-14e3-4cc9-93c3-8baa9dc42acc req-506ec5ec-7efd-4c2c-9c7a-fa8032271078 service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Updating instance_info_cache with network_info: [{"id": "c87aaa49-f608-4ea5-ae24-f72634311e87", "address": "fa:16:3e:ea:f3:4f", "network": {"id": "9248ef89-2536-49ef-91a8-4cc5e166006b", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1769250526-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23965b01217144d29b9cc5ef0d064a47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87aaa49-f6", "ovs_interfaceid": "c87aaa49-f608-4ea5-ae24-f72634311e87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:30.143030 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Creating config drive at /opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba/disk.config
May 27 03:03:30.148150 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppuq1_t2b {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:30.233528 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppuq1_t2b" returned: 0 in 0.085s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:30.457230 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9db3dd82-436a-4100-b2a5-88c3c236a0de tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Releasing lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:30.458081 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-9db3dd82-436a-4100-b2a5-88c3c236a0de tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'flavor' on Instance uuid ca2e5c3f-b9be-4bfb-9858-c22cbb4177da {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:30.546469 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ac5e32e2-14e3-4cc9-93c3-8baa9dc42acc req-506ec5ec-7efd-4c2c-9c7a-fa8032271078 service nova] Releasing lock "refresh_cache-de33390e-64b1-4034-a1f1-dcc935cf25fd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:30.567505 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Starting finish_migration {{(pid=98471) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 27 03:03:30.568911 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Instance directory exists: not creating {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 03:03:30.568999 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Creating image(s)
May 27 03:03:30.569980 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:30.665795 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.096s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:30.666269 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:03:30.666547 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:30.735774 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:30.778169 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:30.778357 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:30.781172 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Cannot resize image /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:03:30.781939 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:30.894218 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:31.005864 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:31.012113 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:31.016150 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-295c6ba7-39d8-49fe-a8b4-d235d36ea80f req-034bc893-bc95-4fe0-8ad8-f1563588ba5e service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Received event network-vif-plugged-32222a99-3c66-4869-88f8-33b8a752ec5b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:31.016447 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-295c6ba7-39d8-49fe-a8b4-d235d36ea80f req-034bc893-bc95-4fe0-8ad8-f1563588ba5e service nova] Acquiring lock "e17e8031-6811-4553-b8ce-7150f690a4ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:31.016650 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-295c6ba7-39d8-49fe-a8b4-d235d36ea80f req-034bc893-bc95-4fe0-8ad8-f1563588ba5e service nova] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:31.016920 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-295c6ba7-39d8-49fe-a8b4-d235d36ea80f req-034bc893-bc95-4fe0-8ad8-f1563588ba5e service nova] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:31.017068 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-295c6ba7-39d8-49fe-a8b4-d235d36ea80f req-034bc893-bc95-4fe0-8ad8-f1563588ba5e service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Processing event network-vif-plugged-32222a99-3c66-4869-88f8-33b8a752ec5b {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:03:31.045975 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:31.097026 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:31.153348 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:31.166221 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:31.168121 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:31.200908 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:31.207821 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:31.285764 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:03:31.285988 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Ensure instance console log exists: /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:03:31.287406 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:31.287888 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:31.288115 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:31.292549 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Start _get_guest_xml network_info=[{"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "vif_mac": "fa:16:3e:5c:30:71"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'c2a5e735-d573-4ac4-bff0-d4a12648718e', 'attached_at': '2026-05-27T03:03:29.000000', 'detached_at': '', 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'multiattach': True, 'serial': '8cd7c930-2109-4c04-85a8-31ac0ce9341e'}, 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '74a145e5-42bb-49c7-a1bd-64b619a9d25c', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:03:31.296357 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:03:31.298159 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='c2a5e735-d573-4ac4-bff0-d4a12648718e'), owner=OwnerMeta(userid='092604511a8a467ba4ecb56261cb531f', username='tempest-AttachVolumeMultiAttachTest-774919822-project-member', projectid='a9c48d6919e8435f876f3324616521ea', projectname='tempest-AttachVolumeMultiAttachTest-774919822'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "vif_mac": "fa:16:3e:5c:30:71"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851011.2976801) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:03:31.301686 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:03:31.302209 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:03:31.304930 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:03:31.305294 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:03:31.306587 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:03:31.307065 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:03:31.307267 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:03:31.307432 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:03:31.307575 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:03:31.307732 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:03:31.307956 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:03:31.308098 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:03:31.308246 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:03:31.308394 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:03:31.308551 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:03:31.308725 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:03:31.332173 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk.config --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:31.380962 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.998645785000008 future=<Future at 0x755704401550 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:31.382011 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Instance destroyed successfully.
May 27 03:03:31.382760 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-9db3dd82-436a-4100-b2a5-88c3c236a0de tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'numa_topology' on Instance uuid ca2e5c3f-b9be-4bfb-9858-c22cbb4177da {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:31.458713 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk.config --force-share --output=json" returned: 0 in 0.128s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:03:31.459222 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:31.459551 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "/opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:31.460248 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "/opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:31.460611 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:03:31.461082 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:03:31.461175 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:03:31.461918 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:03:31.462129 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:03:31.477027 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:03:31.478597 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:03:31.480844 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:03:31.480844 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:03:31.480844 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:03:31.480844 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.startup = automatic
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.scan = manual
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:03:31.495787 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:03:31.495787 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.startup = automatic
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.scan = manual
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:03:31.506843 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:03:31.506843 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:31.515933 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:31.528257 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:31.541099 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:31.541099 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:31.541099 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:31.541099 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:31.541099 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:31.541099 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:31.541099 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:31.541099 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:31.541099 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:03:31.542412 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:31.542412 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:31.542412 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:31.542412 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:31.542412 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:31.542412 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:31.542412 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:31.542412 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:31.542412 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:03:31.543408 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.063s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:03:31.543408 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:03:31.546329 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] HCTL ('13', '0', '0', 0) found on session 61 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:03:31.546553 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:03:31.548537 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:31.548537 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:31.548537 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:31.548537 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:31.548537 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:31.548537 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:31.548537 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:31.548537 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:31.548537 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:03:31.548838 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:31.548838 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:31.548838 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:31.548838 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:31.548838 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:31.548838 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:31.548838 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:31.548838 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:31.548838 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:03:31.549023 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.070s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:03:31.549104 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:03:31.550712 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] HCTL ('14', '0', '0', 0) found on session 62 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:03:31.550712 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:03:31.555235 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:31.563350 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching for a device in session 61 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:03:31.563350 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:03:31.563535 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:31.564816 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching for a device in session 62 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:03:31.565006 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:03:31.791940 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851011.791517, e17e8031-6811-4553-b8ce-7150f690a4ba => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:31.792728 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:03:31.794230 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] VM Started (Lifecycle Event)
May 27 03:03:31.795488 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:03:31.799585 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Instance spawned successfully.
May 27 03:03:31.800135 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:03:31.891646 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-9db3dd82-436a-4100-b2a5-88c3c236a0de tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Object Instance<ca2e5c3f-b9be-4bfb-9858-c22cbb4177da> lazy-loaded attributes: flavor,numa_topology {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:03:32.295989 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:32.301550 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:03:32.309115 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:32.309333 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:32.309722 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:32.310105 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:32.310568 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:32.311069 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:03:32.373077 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:32.418038 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:32.424029 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:32.481970 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:03:32.507111 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:32.603465 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:32.806240 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:03:32.807128 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851012.8067071, e17e8031-6811-4553-b8ce-7150f690a4ba => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:32.807128 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] VM Paused (Lifecycle Event)
May 27 03:03:32.819245 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Took 6.68 seconds to spawn the instance on the hypervisor.
May 27 03:03:32.819245 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:32.944401 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:33.118291 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Received event network-vif-plugged-32222a99-3c66-4869-88f8-33b8a752ec5b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:33.119149 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] Acquiring lock "e17e8031-6811-4553-b8ce-7150f690a4ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:33.119149 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:33.119149 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:33.119149 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] No waiting events found dispatching network-vif-plugged-32222a99-3c66-4869-88f8-33b8a752ec5b {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:33.119409 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Received unexpected event network-vif-plugged-32222a99-3c66-4869-88f8-33b8a752ec5b for instance with vm_state active and task_state None.
May 27 03:03:33.119409 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received event network-vif-unplugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:33.119487 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] Acquiring lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:33.119706 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:33.119706 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:33.120210 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] No waiting events found dispatching network-vif-unplugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:33.120341 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received unexpected event network-vif-unplugged-1133d110-d517-4b72-bbce-faf3064e5946 for instance with vm_state rescued and task_state unrescuing.
May 27 03:03:33.120458 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received event network-vif-unplugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:33.120589 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] Acquiring lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:33.120756 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:33.120879 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:33.121015 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] No waiting events found dispatching network-vif-unplugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:33.121303 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received unexpected event network-vif-unplugged-1133d110-d517-4b72-bbce-faf3064e5946 for instance with vm_state rescued and task_state unrescuing.
May 27 03:03:33.121303 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received event network-vif-plugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:33.121497 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] Acquiring lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:33.121794 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:33.121936 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:33.122033 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] No waiting events found dispatching network-vif-plugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:33.122166 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received unexpected event network-vif-plugged-1133d110-d517-4b72-bbce-faf3064e5946 for instance with vm_state rescued and task_state unrescuing.
May 27 03:03:33.122266 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received event network-vif-plugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:33.122427 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] Acquiring lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:33.122586 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:33.122586 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:33.122972 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] No waiting events found dispatching network-vif-plugged-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:33.122972 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-856cde30-abe3-4ea5-a9c5-19d64a11a106 req-b38ccc83-aec8-470f-9ef5-f4eef507efac service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received unexpected event network-vif-plugged-1133d110-d517-4b72-bbce-faf3064e5946 for instance with vm_state rescued and task_state unrescuing.
May 27 03:03:33.262518 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-9db3dd82-436a-4100-b2a5-88c3c236a0de tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:33.310075 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:33.312358 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851013.3121068, e17e8031-6811-4553-b8ce-7150f690a4ba => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:33.312595 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] VM Resumed (Lifecycle Event)
May 27 03:03:33.330816 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Took 16.08 seconds to build instance.
May 27 03:03:33.499568 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Found WWN 3300000007d606cb0 for multipath device dm-6 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:03:33.500137 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.038s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:03:33.500137 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] <== connect_volume: return (2038ms) {'type': 'block', 'scsi_wwn': '3300000007d606cb0', 'path': '/dev/dm-6', 'multipath_id': '3300000007d606cb0'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:03:33.500246 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007d606cb0', 'path': '/dev/dm-6', 'multipath_id': '3300000007d606cb0'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:03:33.815106 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:33.820109 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:03:33.832379 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.592s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:34.006838 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001475',hostname='multiattach-server-0',id=30,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7X60AtOl0SsfuAMV1LtNGpvh0yvi8THxioUm4x62ykVhuM7q4sXRNe3S5fa56OsOiAX0ZbtOowRZ4+AKeGhch21Oc/NUN3hQGbbFxrwclVqtJHRu4HOLbwt9JgM8J0mA==',key_name='tempest-keypair-1333870124',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:02:21Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001475',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-7nyxrr7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:03:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092604511a8a467ba4ecb56261cb531f',uuid=c2a5e735-d573-4ac4-bff0-d4a12648718e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "vif_mac": "fa:16:3e:5c:30:71"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:03:34.006838 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "vif_mac": "fa:16:3e:5c:30:71"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:03:34.006838 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a2498912-5a39-4f70-a141-dae495d11b2a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2498912-5a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:03:34.008766 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] End _get_guest_xml xml=<domain type="qemu">
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:   <uuid>c2a5e735-d573-4ac4-bff0-d4a12648718e</uuid>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:   <name>instance-0000001e</name>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:   <memory>262144</memory>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <nova:name>multiattach-server-0</nova:name>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:03:31</nova:creationTime>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.micro" id="84">
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:         <nova:memory>256</nova:memory>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:         <nova:user uuid="092604511a8a467ba4ecb56261cb531f">tempest-AttachVolumeMultiAttachTest-774919822-project-member</nova:user>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:         <nova:project uuid="a9c48d6919e8435f876f3324616521ea">tempest-AttachVolumeMultiAttachTest-774919822</nova:project>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:         <nova:port uuid="a2498912-5a39-4f70-a141-dae495d11b2a">
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     <system>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <entry name="serial">c2a5e735-d573-4ac4-bff0-d4a12648718e</entry>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <entry name="uuid">c2a5e735-d573-4ac4-bff0-d4a12648718e</entry>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     </system>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:   <os>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:   </os>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:   <features>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:   </features>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:   <devices>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     </disk>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk.config"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     </disk>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <alias name="ua-8cd7c930-2109-4c04-85a8-31ac0ce9341e"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-6"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <target dev="vdb" bus="virtio"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <serial>8cd7c930-2109-4c04-85a8-31ac0ce9341e</serial>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <shareable/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     </disk>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:5c:30:71"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <target dev="tapa2498912-5a"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     </interface>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/console.log" append="off"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     </serial>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     <video>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     </video>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     </rng>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:   </devices>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]: </domain>
May 27 03:03:34.008766 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:03:34.010916 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001475',hostname='multiattach-server-0',id=30,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7X60AtOl0SsfuAMV1LtNGpvh0yvi8THxioUm4x62ykVhuM7q4sXRNe3S5fa56OsOiAX0ZbtOowRZ4+AKeGhch21Oc/NUN3hQGbbFxrwclVqtJHRu4HOLbwt9JgM8J0mA==',key_name='tempest-keypair-1333870124',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:02:21Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001475',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-7nyxrr7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:03:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092604511a8a467ba4ecb56261cb531f',uuid=c2a5e735-d573-4ac4-bff0-d4a12648718e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "vif_mac": "fa:16:3e:5c:30:71"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:03:34.010916 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "vif_mac": "fa:16:3e:5c:30:71"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:03:34.010916 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a2498912-5a39-4f70-a141-dae495d11b2a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2498912-5a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:03:34.010916 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a2498912-5a39-4f70-a141-dae495d11b2a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2498912-5a') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:03:34.017565 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:34.017565 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:34.017565 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:03:34.017565 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:34.017565 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e734878d-b3ef-53c0-9e90-dec8818783f0', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:34.017565 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:34.017565 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:03:34.020222 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:34.024171 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:34.024411 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2498912-5a, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:34.025090 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2498912-5a, col_values=(('qos', UUID('d4f3a0f8-7d2a-4e32-b48a-805e5e8243e6')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:34.025090 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2498912-5a, col_values=(('external_ids', {'iface-id': 'a2498912-5a39-4f70-a141-dae495d11b2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:30:71', 'vm-uuid': 'c2a5e735-d573-4ac4-bff0-d4a12648718e'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:34.025997 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:34.027468 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:03:34.035542 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:34.037517 np0000001475 nova-compute[98471]: INFO os_vif [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a2498912-5a39-4f70-a141-dae495d11b2a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2498912-5a')
May 27 03:03:34.324262 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Removed pending STOPPED event for ca2e5c3f-b9be-4bfb-9858-c22cbb4177da due to new event <LifecycleEvent: 1779851014.3238885, ca2e5c3f-b9be-4bfb-9858-c22cbb4177da => Resumed> {{(pid=98471) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 03:03:34.324402 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851014.3238885, ca2e5c3f-b9be-4bfb-9858-c22cbb4177da => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:34.324494 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] VM Resumed (Lifecycle Event)
May 27 03:03:34.334844 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.000710559000253852 future=<Future at 0x75572c13bfe0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:34.336279 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:34.336279 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=3.257943165999677 future=<Future at 0x7557044915b0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:34.336279 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=3.2578027429999565 future=<Future at 0x7557044915b0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:34.822762 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4227b4a8-3409-45ef-baeb-ce87a46fa824 req-9fcfc5bb-cf66-4503-9308-67acdf68891a service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received event network-changed-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:34.823256 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4227b4a8-3409-45ef-baeb-ce87a46fa824 req-9fcfc5bb-cf66-4503-9308-67acdf68891a service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Refreshing instance network info cache due to event network-changed-1133d110-d517-4b72-bbce-faf3064e5946. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:03:34.823256 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4227b4a8-3409-45ef-baeb-ce87a46fa824 req-9fcfc5bb-cf66-4503-9308-67acdf68891a service nova] Acquiring lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:34.823256 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4227b4a8-3409-45ef-baeb-ce87a46fa824 req-9fcfc5bb-cf66-4503-9308-67acdf68891a service nova] Acquired lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:34.823506 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4227b4a8-3409-45ef-baeb-ce87a46fa824 req-9fcfc5bb-cf66-4503-9308-67acdf68891a service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Refreshing network info cache for port 1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:03:34.828166 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:34.835811 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:03:35.172915 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-bea35109-8ab6-4c68-9fed-e7ac675035f6 req-21460439-ffa8-46ef-b91e-df6953b95b9d service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Received event network-changed-32222a99-3c66-4869-88f8-33b8a752ec5b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:35.172915 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-bea35109-8ab6-4c68-9fed-e7ac675035f6 req-21460439-ffa8-46ef-b91e-df6953b95b9d service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Refreshing instance network info cache due to event network-changed-32222a99-3c66-4869-88f8-33b8a752ec5b. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:03:35.172915 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bea35109-8ab6-4c68-9fed-e7ac675035f6 req-21460439-ffa8-46ef-b91e-df6953b95b9d service nova] Acquiring lock "refresh_cache-e17e8031-6811-4553-b8ce-7150f690a4ba" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:35.172915 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bea35109-8ab6-4c68-9fed-e7ac675035f6 req-21460439-ffa8-46ef-b91e-df6953b95b9d service nova] Acquired lock "refresh_cache-e17e8031-6811-4553-b8ce-7150f690a4ba" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:35.172915 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-bea35109-8ab6-4c68-9fed-e7ac675035f6 req-21460439-ffa8-46ef-b91e-df6953b95b9d service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Refreshing network info cache for port 32222a99-3c66-4869-88f8-33b8a752ec5b {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:03:35.326869 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-4227b4a8-3409-45ef-baeb-ce87a46fa824 req-9fcfc5bb-cf66-4503-9308-67acdf68891a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:35.344077 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851015.3436034, ca2e5c3f-b9be-4bfb-9858-c22cbb4177da => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:35.345413 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] VM Started (Lifecycle Event)
May 27 03:03:35.563226 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:35.563457 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:35.563585 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:35.563721 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No VIF found with MAC fa:16:3e:5c:30:71, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:03:35.564241 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Using config drive
May 27 03:03:35.679529 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-bea35109-8ab6-4c68-9fed-e7ac675035f6 req-21460439-ffa8-46ef-b91e-df6953b95b9d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:35.776877 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-4227b4a8-3409-45ef-baeb-ce87a46fa824 req-9fcfc5bb-cf66-4503-9308-67acdf68891a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:35.847926 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:35.854068 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:03:36.013976 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4227b4a8-3409-45ef-baeb-ce87a46fa824 req-9fcfc5bb-cf66-4503-9308-67acdf68891a service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Updated VIF entry in instance network info cache for port 1133d110-d517-4b72-bbce-faf3064e5946. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:03:36.014280 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4227b4a8-3409-45ef-baeb-ce87a46fa824 req-9fcfc5bb-cf66-4503-9308-67acdf68891a service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Updating instance_info_cache with network_info: [{"id": "1133d110-d517-4b72-bbce-faf3064e5946", "address": "fa:16:3e:d9:1c:3f", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1133d110-d5", "ovs_interfaceid": "1133d110-d517-4b72-bbce-faf3064e5946", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:36.104276 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:36.114836 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:36.145864 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-bea35109-8ab6-4c68-9fed-e7ac675035f6 req-21460439-ffa8-46ef-b91e-df6953b95b9d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:36.151900 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:36.155586 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:36.269025 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:36.332867 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:36.391955 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a3207147-c9bb-459e-8d20-3d7bde754378 req-2d935703-8fd6-4cbc-9691-fb1c2220740b service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received event network-vif-plugged-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:36.392587 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a3207147-c9bb-459e-8d20-3d7bde754378 req-2d935703-8fd6-4cbc-9691-fb1c2220740b service nova] Acquiring lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:36.393536 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a3207147-c9bb-459e-8d20-3d7bde754378 req-2d935703-8fd6-4cbc-9691-fb1c2220740b service nova] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:36.393536 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a3207147-c9bb-459e-8d20-3d7bde754378 req-2d935703-8fd6-4cbc-9691-fb1c2220740b service nova] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:36.393536 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a3207147-c9bb-459e-8d20-3d7bde754378 req-2d935703-8fd6-4cbc-9691-fb1c2220740b service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] No waiting events found dispatching network-vif-plugged-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:36.393536 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-a3207147-c9bb-459e-8d20-3d7bde754378 req-2d935703-8fd6-4cbc-9691-fb1c2220740b service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received unexpected event network-vif-plugged-a2498912-5a39-4f70-a141-dae495d11b2a for instance with vm_state active and task_state resize_finish.
May 27 03:03:36.410135 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-bea35109-8ab6-4c68-9fed-e7ac675035f6 req-21460439-ffa8-46ef-b91e-df6953b95b9d service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Updated VIF entry in instance network info cache for port 32222a99-3c66-4869-88f8-33b8a752ec5b. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:03:36.410494 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-bea35109-8ab6-4c68-9fed-e7ac675035f6 req-21460439-ffa8-46ef-b91e-df6953b95b9d service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Updating instance_info_cache with network_info: [{"id": "32222a99-3c66-4869-88f8-33b8a752ec5b", "address": "fa:16:3e:a2:a0:80", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32222a99-3c", "ovs_interfaceid": "32222a99-3c66-4869-88f8-33b8a752ec5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:36.517539 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4227b4a8-3409-45ef-baeb-ce87a46fa824 req-9fcfc5bb-cf66-4503-9308-67acdf68891a service nova] Releasing lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:36.892525 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-60f2efe7-47b0-41f1-98e7-5fb7d3162b8f req-d5fc1f2d-4461-438a-88ff-d78b0b238618 service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received event network-changed-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:36.892525 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-60f2efe7-47b0-41f1-98e7-5fb7d3162b8f req-d5fc1f2d-4461-438a-88ff-d78b0b238618 service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Refreshing instance network info cache due to event network-changed-1133d110-d517-4b72-bbce-faf3064e5946. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:03:36.892525 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-60f2efe7-47b0-41f1-98e7-5fb7d3162b8f req-d5fc1f2d-4461-438a-88ff-d78b0b238618 service nova] Acquiring lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:36.892525 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-60f2efe7-47b0-41f1-98e7-5fb7d3162b8f req-d5fc1f2d-4461-438a-88ff-d78b0b238618 service nova] Acquired lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:36.892525 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-60f2efe7-47b0-41f1-98e7-5fb7d3162b8f req-d5fc1f2d-4461-438a-88ff-d78b0b238618 service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Refreshing network info cache for port 1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:03:36.914095 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bea35109-8ab6-4c68-9fed-e7ac675035f6 req-21460439-ffa8-46ef-b91e-df6953b95b9d service nova] Releasing lock "refresh_cache-e17e8031-6811-4553-b8ce-7150f690a4ba" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:37.193733 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Instance event wait completed in 0 seconds for  {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:03:37.195358 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Removed pending STOPPED event for c2a5e735-d573-4ac4-bff0-d4a12648718e due to new event <LifecycleEvent: 1779851017.1950383, c2a5e735-d573-4ac4-bff0-d4a12648718e => Resumed> {{(pid=98471) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 03:03:37.195516 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851017.1950383, c2a5e735-d573-4ac4-bff0-d4a12648718e => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:37.195648 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] VM Resumed (Lifecycle Event)
May 27 03:03:37.198685 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Instance running successfully.
May 27 03:03:37.201640 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Failed to set time: agent not configured {{(pid=98471) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 27 03:03:37.205136 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5897f619-4b6e-4dc5-b64d-b08f02b34a78 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] finish_migration finished successfully. {{(pid=98471) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 27 03:03:37.394299 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-60f2efe7-47b0-41f1-98e7-5fb7d3162b8f req-d5fc1f2d-4461-438a-88ff-d78b0b238618 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:37.566929 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "fcb1a3e2-e470-4773-a370-f122a79de2e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:37.567269 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:37.567400 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:37.567474 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:37.567654 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:37.570175 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Terminating instance
May 27 03:03:37.594628 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0005961800002296513 future=<Future at 0x7557044915b0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:37.595099 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:37.595099 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=8.784605885000019 future=<Future at 0x755704401550 state=cancelled>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:37.595099 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=8.784450043000106 future=<Future at 0x755704401550 state=cancelled>) was cancelled while queued, skipping {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:37.595234 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:37.698428 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:37.700701 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:03:37.810212 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-60f2efe7-47b0-41f1-98e7-5fb7d3162b8f req-d5fc1f2d-4461-438a-88ff-d78b0b238618 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:38.019042 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-60f2efe7-47b0-41f1-98e7-5fb7d3162b8f req-d5fc1f2d-4461-438a-88ff-d78b0b238618 service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Updated VIF entry in instance network info cache for port 1133d110-d517-4b72-bbce-faf3064e5946. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:03:38.021420 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-60f2efe7-47b0-41f1-98e7-5fb7d3162b8f req-d5fc1f2d-4461-438a-88ff-d78b0b238618 service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Updating instance_info_cache with network_info: [{"id": "1133d110-d517-4b72-bbce-faf3064e5946", "address": "fa:16:3e:d9:1c:3f", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1133d110-d5", "ovs_interfaceid": "1133d110-d517-4b72-bbce-faf3064e5946", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:38.074945 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:03:38.107647 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:38.109151 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:38.135931 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:38.203324 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 27 03:03:38.203597 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851018.2034004, c2a5e735-d573-4ac4-bff0-d4a12648718e => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:38.203728 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] VM Started (Lifecycle Event)
May 27 03:03:38.285520 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-84fb3676-33a0-4445-b3ee-02137c98ec8a req-7e69b03b-a64b-44dc-9d11-b26d2d3c9bdf service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Received event network-vif-unplugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:38.285722 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-84fb3676-33a0-4445-b3ee-02137c98ec8a req-7e69b03b-a64b-44dc-9d11-b26d2d3c9bdf service nova] Acquiring lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:38.286015 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-84fb3676-33a0-4445-b3ee-02137c98ec8a req-7e69b03b-a64b-44dc-9d11-b26d2d3c9bdf service nova] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:38.286079 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-84fb3676-33a0-4445-b3ee-02137c98ec8a req-7e69b03b-a64b-44dc-9d11-b26d2d3c9bdf service nova] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:38.286244 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-84fb3676-33a0-4445-b3ee-02137c98ec8a req-7e69b03b-a64b-44dc-9d11-b26d2d3c9bdf service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] No waiting events found dispatching network-vif-unplugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:38.286306 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-84fb3676-33a0-4445-b3ee-02137c98ec8a req-7e69b03b-a64b-44dc-9d11-b26d2d3c9bdf service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Received event network-vif-unplugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:03:38.292776 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:38.295982 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:38.389887 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:38.403822 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:38.429905 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Instance destroyed successfully.
May 27 03:03:38.430434 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lazy-loading 'resources' on Instance uuid fcb1a3e2-e470-4773-a370-f122a79de2e6 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:38.508501 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ac166e20-6fe6-4516-99eb-aab9fb096522 req-d66202f1-0b47-43d2-8d37-00cf07115699 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received event network-vif-plugged-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:38.510245 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ac166e20-6fe6-4516-99eb-aab9fb096522 req-d66202f1-0b47-43d2-8d37-00cf07115699 service nova] Acquiring lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:38.510245 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ac166e20-6fe6-4516-99eb-aab9fb096522 req-d66202f1-0b47-43d2-8d37-00cf07115699 service nova] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:38.510590 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ac166e20-6fe6-4516-99eb-aab9fb096522 req-d66202f1-0b47-43d2-8d37-00cf07115699 service nova] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:38.510590 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ac166e20-6fe6-4516-99eb-aab9fb096522 req-d66202f1-0b47-43d2-8d37-00cf07115699 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] No waiting events found dispatching network-vif-plugged-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:38.510733 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-ac166e20-6fe6-4516-99eb-aab9fb096522 req-d66202f1-0b47-43d2-8d37-00cf07115699 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received unexpected event network-vif-plugged-a2498912-5a39-4f70-a141-dae495d11b2a for instance with vm_state resized and task_state None.
May 27 03:03:38.523979 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-60f2efe7-47b0-41f1-98e7-5fb7d3162b8f req-d5fc1f2d-4461-438a-88ff-d78b0b238618 service nova] Releasing lock "refresh_cache-ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:38.708463 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:38.710555 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:03:38.935638 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1319467240',display_name='tempest-ServerActionsTestOtherA-server-1319467240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001475',hostname='tempest-serveractionstestothera-server-1319467240',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVtCwqB5huD2R7WzeA2srtQrNLcY+5mh0PDFl9uXrLaNb8RbC2WmzNWR2uyfN3usptF21zcnp9tnWTIUBUOIX7SXlA+BK0+YEfHYyX09pbtKTE7qcopOd9351hytyFXVA==',key_name='tempest-keypair-2100360487',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:03:02Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='233d191c03874150880aca259ffd3e21',ramdisk_id='',reservation_id='r-xaz3c7w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-569974590',owner_user_name='tempest-ServerActionsTestOtherA-569974590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a93dfe76ab455d8aa6e691b1fa34c5',uuid=fcb1a3e2-e470-4773-a370-f122a79de2e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:03:38.935899 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converting VIF {"id": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "address": "fa:16:3e:75:cb:49", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e1172-e0", "ovs_interfaceid": "ee0e1172-e06e-46db-bda6-c793c47ec9a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:03:38.936524 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=ee0e1172-e06e-46db-bda6-c793c47ec9a9,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e1172-e0') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:03:38.936860 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=ee0e1172-e06e-46db-bda6-c793c47ec9a9,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e1172-e0') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:03:38.938206 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:38.938366 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee0e1172-e0, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:38.939551 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:38.943333 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:03:38.944312 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:38.944508 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58a4d926-0626-4922-b539-2db621f33bdd) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:38.945119 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:38.945541 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:03:38.947452 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:38.949349 np0000001475 nova-compute[98471]: INFO os_vif [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=ee0e1172-e06e-46db-bda6-c793c47ec9a9,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e1172-e0')
May 27 03:03:38.950888 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:03:38.951215 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:03:38.951344 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:03:38.951657 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:03:38.952002 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4f6a6a1f-0542-4c3d-b318-52f71fb19705', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:03:38.952140 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:03:38.981199 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:38.981199 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:38.981199 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:38.981199 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:38.981199 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:38.981199 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:38.981199 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:38.981199 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:38.981199 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:03:38.981679 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:38.981679 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:38.981679 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:38.981679 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:38.981679 np0000001475 nova-compute[98471]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:38.981679 np0000001475 nova-compute[98471]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705 (non-flash)
May 27 03:03:38.981679 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:38.981679 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:38.981679 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:03:38.981679 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907', '66')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:03:38.981679 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', '64')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:03:38.982821 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705', '63')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:03:38.983587 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c3f8720>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705'): ({'sdj'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:03:38.984054 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Removing multipathed devices sdj, sdk {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:03:38.984306 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Flush multipath device 3300000005ccab551 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:03:39.044753 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:03:39.089549 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:03:39.134559 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:03:39.134763 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:03:39.136027 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:03:39.152973 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:03:39.152973 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:03:39.172019 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:39.205292 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 64, target: iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705, portal: 192.168.40.100,3260]
May 27 03:03:39.205292 np0000001475 nova-compute[98471]: Logout of [sid: 64, target: iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705, portal: 192.168.40.100,3260] successful.
May 27 03:03:39.205292 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:39.214430 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999704146000113 future=<Future at 0x75570444cbf0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:39.214689 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999370022000221 future=<Future at 0x75570444cbf0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:39.214851 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99918400300021 future=<Future at 0x75570444cbf0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:39.228096 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:39.241501 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:39.285025 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705, portal: 192.168.50.100,3260]
May 27 03:03:39.285025 np0000001475 nova-compute[98471]: Logout of [sid: 63, target: iqn.2023-03.storpool.com:os--volume-4f6a6a1f-0542-4c3d-b318-52f71fb19705, portal: 192.168.50.100,3260] successful.
May 27 03:03:39.285025 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:39.301061 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:39.301247 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:03:39.301355 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] <== disconnect_volume: return (349ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:03:39.301458 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:03:39.301685 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Deleting instance files /opt/stack/data/nova/instances/fcb1a3e2-e470-4773-a370-f122a79de2e6_del
May 27 03:03:39.302356 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Deletion of /opt/stack/data/nova/instances/fcb1a3e2-e470-4773-a370-f122a79de2e6_del complete
May 27 03:03:39.810919 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Took 1.74 seconds to destroy the instance on the hypervisor.
May 27 03:03:39.811546 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:03:39.814805 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:03:39.814805 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:03:39.814805 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:39.921323 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:39.921500 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:39.921606 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Going to confirm migration 3 {{(pid=98471) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 27 03:03:39.933006 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:40.396637 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7c515fee-8b50-4b00-a099-0d7ee801bcb6 req-4eb19940-22d0-4514-85ff-ce97ce0df7ff service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Received event network-vif-unplugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:40.397071 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7c515fee-8b50-4b00-a099-0d7ee801bcb6 req-4eb19940-22d0-4514-85ff-ce97ce0df7ff service nova] Acquiring lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:40.397201 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7c515fee-8b50-4b00-a099-0d7ee801bcb6 req-4eb19940-22d0-4514-85ff-ce97ce0df7ff service nova] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:40.400200 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7c515fee-8b50-4b00-a099-0d7ee801bcb6 req-4eb19940-22d0-4514-85ff-ce97ce0df7ff service nova] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:40.400200 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7c515fee-8b50-4b00-a099-0d7ee801bcb6 req-4eb19940-22d0-4514-85ff-ce97ce0df7ff service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] No waiting events found dispatching network-vif-unplugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:40.400200 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7c515fee-8b50-4b00-a099-0d7ee801bcb6 req-4eb19940-22d0-4514-85ff-ce97ce0df7ff service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Received event network-vif-unplugged-ee0e1172-e06e-46db-bda6-c793c47ec9a9 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:03:40.427705 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:40.508056 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:40.511371 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:40.511371 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquired lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:40.511371 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:03:40.511371 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'info_cache' on Instance uuid c2a5e735-d573-4ac4-bff0-d4a12648718e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:40.593343 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-55927a60-77ee-451b-8739-9e75330303e0 req-1cf07619-f8d3-4dd6-9e31-444cdc1021e2 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Received event network-vif-deleted-ee0e1172-e06e-46db-bda6-c793c47ec9a9 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:40.593579 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-55927a60-77ee-451b-8739-9e75330303e0 req-1cf07619-f8d3-4dd6-9e31-444cdc1021e2 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Neutron deleted interface ee0e1172-e06e-46db-bda6-c793c47ec9a9; detaching it from the instance and deleting it from the info cache
May 27 03:03:40.593763 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-55927a60-77ee-451b-8739-9e75330303e0 req-1cf07619-f8d3-4dd6-9e31-444cdc1021e2 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:40.928334 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:41.099543 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-55927a60-77ee-451b-8739-9e75330303e0 req-1cf07619-f8d3-4dd6-9e31-444cdc1021e2 service nova] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Detach interface failed, port_id=ee0e1172-e06e-46db-bda6-c793c47ec9a9, reason: Instance fcb1a3e2-e470-4773-a370-f122a79de2e6 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:03:41.112179 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:41.432304 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Took 1.62 seconds to deallocate network for instance.
May 27 03:03:41.516884 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:41.944903 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:42.017919 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Took 0.59 seconds to detach 1 volumes for instance.
May 27 03:03:42.023251 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Deleting volume: 4f6a6a1f-0542-4c3d-b318-52f71fb19705 {{(pid=98471) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 27 03:03:42.180459 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Updating instance_info_cache with network_info: [{"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:42.593258 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:42.593791 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:42.596082 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:42.672971 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Deleted allocations for instance fcb1a3e2-e470-4773-a370-f122a79de2e6
May 27 03:03:42.682678 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Releasing lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:42.683697 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'migration_context' on Instance uuid c2a5e735-d573-4ac4-bff0-d4a12648718e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:43.188071 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Object Instance<c2a5e735-d573-4ac4-bff0-d4a12648718e> lazy-loaded attributes: info_cache,migration_context {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:03:43.196044 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:43.196407 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:43.690992 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-185fe72b-be85-40a1-ab92-d9c465550133 tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "fcb1a3e2-e470-4773-a370-f122a79de2e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.123s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:43.945766 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:44.489733 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:03:44.490090 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:03:44.992796 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:03:46.003937 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.808s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:46.077443 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "8d762a67-82b6-40d3-b625-0731ea01c45b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:46.077649 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "8d762a67-82b6-40d3-b625-0731ea01c45b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:46.077825 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "8d762a67-82b6-40d3-b625-0731ea01c45b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:46.077975 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "8d762a67-82b6-40d3-b625-0731ea01c45b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:46.078095 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "8d762a67-82b6-40d3-b625-0731ea01c45b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:46.080295 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Terminating instance
May 27 03:03:46.115655 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:46.584091 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:03:46.621693 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:46.631266 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:46.648522 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:46.653398 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:46.669676 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Deleted allocation for migration 62d6dcad-c244-4aae-bee1-3d2f426e2db7
May 27 03:03:46.679469 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:46.821816 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8ba2b6b2-efc3-4443-acd7-d94180966396 req-9a7b3daf-85b7-47eb-a6ce-d607d61bdaec service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Received event network-vif-unplugged-2104125d-e30e-4450-8186-54d776011dcd {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:46.821816 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8ba2b6b2-efc3-4443-acd7-d94180966396 req-9a7b3daf-85b7-47eb-a6ce-d607d61bdaec service nova] Acquiring lock "8d762a67-82b6-40d3-b625-0731ea01c45b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:46.821816 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8ba2b6b2-efc3-4443-acd7-d94180966396 req-9a7b3daf-85b7-47eb-a6ce-d607d61bdaec service nova] Lock "8d762a67-82b6-40d3-b625-0731ea01c45b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:46.821816 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8ba2b6b2-efc3-4443-acd7-d94180966396 req-9a7b3daf-85b7-47eb-a6ce-d607d61bdaec service nova] Lock "8d762a67-82b6-40d3-b625-0731ea01c45b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:46.821816 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8ba2b6b2-efc3-4443-acd7-d94180966396 req-9a7b3daf-85b7-47eb-a6ce-d607d61bdaec service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] No waiting events found dispatching network-vif-unplugged-2104125d-e30e-4450-8186-54d776011dcd {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:46.821816 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8ba2b6b2-efc3-4443-acd7-d94180966396 req-9a7b3daf-85b7-47eb-a6ce-d607d61bdaec service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Received event network-vif-unplugged-2104125d-e30e-4450-8186-54d776011dcd for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:03:46.932263 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999675123000088 future=<Future at 0x75572c1283e0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:46.933226 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Instance destroyed successfully.
May 27 03:03:46.933683 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lazy-loading 'resources' on Instance uuid 8d762a67-82b6-40d3-b625-0731ea01c45b {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:47.181310 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-368fe824-2c7d-4a41-b62c-b81d9a231fe5 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.260s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:47.439318 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T02:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-519260389',display_name='tempest-ServerActionsTestOtherA-server-519260389',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serveractionstestothera-server-519260389',id=11,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVtCwqB5huD2R7WzeA2srtQrNLcY+5mh0PDFl9uXrLaNb8RbC2WmzNWR2uyfN3usptF21zcnp9tnWTIUBUOIX7SXlA+BK0+YEfHYyX09pbtKTE7qcopOd9351hytyFXVA==',key_name='tempest-keypair-2100360487',keypairs=<?>,launch_index=0,launched_at=2026-05-27T02:58:47Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='233d191c03874150880aca259ffd3e21',ramdisk_id='',reservation_id='r-9nyx1hox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-569974590',owner_user_name='tempest-ServerActionsTestOtherA-569974590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T02:58:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a93dfe76ab455d8aa6e691b1fa34c5',uuid=8d762a67-82b6-40d3-b625-0731ea01c45b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2104125d-e30e-4450-8186-54d776011dcd", "address": "fa:16:3e:9d:6d:1f", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2104125d-e3", "ovs_interfaceid": "2104125d-e30e-4450-8186-54d776011dcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:03:47.440621 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converting VIF {"id": "2104125d-e30e-4450-8186-54d776011dcd", "address": "fa:16:3e:9d:6d:1f", "network": {"id": "147b3a32-2669-4665-8d0a-51cc2d396634", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-926404961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "233d191c03874150880aca259ffd3e21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2104125d-e3", "ovs_interfaceid": "2104125d-e30e-4450-8186-54d776011dcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:03:47.440969 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:6d:1f,bridge_name='br-int',has_traffic_filtering=True,id=2104125d-e30e-4450-8186-54d776011dcd,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2104125d-e3') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:03:47.441601 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:6d:1f,bridge_name='br-int',has_traffic_filtering=True,id=2104125d-e30e-4450-8186-54d776011dcd,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2104125d-e3') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:03:47.442680 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:47.443016 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2104125d-e3, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:47.444288 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:47.445757 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:03:47.445757 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:47.446814 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:47.446983 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8422aec0-1198-4926-80e5-7cb061735ed2) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:03:47.447535 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:47.448145 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:03:47.448766 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:47.451826 np0000001475 nova-compute[98471]: INFO os_vif [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:6d:1f,bridge_name='br-int',has_traffic_filtering=True,id=2104125d-e30e-4450-8186-54d776011dcd,network=Network(147b3a32-2669-4665-8d0a-51cc2d396634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2104125d-e3')
May 27 03:03:47.452919 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Deleting instance files /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b_del
May 27 03:03:47.453968 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Deletion of /opt/stack/data/nova/instances/8d762a67-82b6-40d3-b625-0731ea01c45b_del complete
May 27 03:03:47.963401 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Took 1.38 seconds to destroy the instance on the hypervisor.
May 27 03:03:47.964678 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:03:47.964865 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:03:47.964949 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:03:47.965162 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:48.092803 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:48.093766 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:48.108447 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:48.501716 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f7ccfb9a-8b42-4742-836c-930aa7219333 req-e7c20b17-e97f-4fd4-8947-7859dcdd2ab4 service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Received event network-vif-deleted-2104125d-e30e-4450-8186-54d776011dcd {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:48.502253 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-f7ccfb9a-8b42-4742-836c-930aa7219333 req-e7c20b17-e97f-4fd4-8947-7859dcdd2ab4 service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Neutron deleted interface 2104125d-e30e-4450-8186-54d776011dcd; detaching it from the instance and deleting it from the info cache
May 27 03:03:48.502367 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f7ccfb9a-8b42-4742-836c-930aa7219333 req-e7c20b17-e97f-4fd4-8947-7859dcdd2ab4 service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:48.598150 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'flavor' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:48.923062 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Received event network-vif-unplugged-2104125d-e30e-4450-8186-54d776011dcd {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:48.923062 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] Acquiring lock "8d762a67-82b6-40d3-b625-0731ea01c45b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:48.923062 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] Lock "8d762a67-82b6-40d3-b625-0731ea01c45b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:48.923062 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] Lock "8d762a67-82b6-40d3-b625-0731ea01c45b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:48.923062 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] No waiting events found dispatching network-vif-unplugged-2104125d-e30e-4450-8186-54d776011dcd {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:48.923062 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Received event network-vif-unplugged-2104125d-e30e-4450-8186-54d776011dcd for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:03:48.923062 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Received event network-changed-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:48.923062 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Refreshing instance network info cache due to event network-changed-57af91c5-42f3-4f9f-ac26-aad2418fdfe3. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:03:48.923062 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] Acquiring lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:48.923062 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] Acquired lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:48.923062 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Refreshing network info cache for port 57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:03:48.938175 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:49.007886 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f7ccfb9a-8b42-4742-836c-930aa7219333 req-e7c20b17-e97f-4fd4-8947-7859dcdd2ab4 service nova] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Detach interface failed, port_id=2104125d-e30e-4450-8186-54d776011dcd, reason: Instance 8d762a67-82b6-40d3-b625-0731ea01c45b could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:03:49.427713 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:49.440584 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Took 1.48 seconds to deallocate network for instance.
May 27 03:03:49.607770 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:49.797864 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:49.946888 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:49.947138 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:49.949852 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Updated VIF entry in instance network info cache for port 57af91c5-42f3-4f9f-ac26-aad2418fdfe3. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:03:49.953117 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Updating instance_info_cache with network_info: [{"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:50.456239 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] Releasing lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:50.456656 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received event network-changed-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:50.456901 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Refreshing instance network info cache due to event network-changed-a2498912-5a39-4f70-a141-dae495d11b2a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:03:50.457082 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] Acquiring lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:03:50.457180 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] Acquired lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:03:50.457299 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Refreshing network info cache for port a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:03:50.678885 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:03:50.679251 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:03:50.772106 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:50.772288 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:50.772515 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Attaching volume dddfcc30-7d36-4150-b1d9-fab003b610b2 to /dev/vdb
May 27 03:03:50.818865 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:03:50.830519 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:03:50.853331 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:50.896492 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:03:50.896797 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:03:50.905598 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:03:50.907947 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::c805:4ff:fe3b:2374', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:feb2:aa32', 'fe80::fc16:3eff:fe01:3d37', 'fe80::fc16:3eff:fe88:48d5', 'fe80::fc16:3eff:fe58:79ce', 'fe80::8cdc:9fff:fe79:9907', 'fe80::fc16:3eff:fe2d:76bb', 'fe80::787c:50ff:fed5:a1fc', 'fe80::fc16:3eff:feea:f34f', 'fe80::a407:7bff:fed1:e35a', 'fe80::fc16:3eff:fea2:a080', 'fe80::88ab:28ff:fedb:6e99', 'fe80::fc16:3eff:fed9:1c3f', 'fe80::fc16:3eff:fe5c:3071'] 
May 27 03:03:50.908106 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:03:50.908227 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:03:50.908487 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:03:50.908774 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Updating existing volume attachment record: 008ba87f-bacb-4db7-804b-da149d4e294f {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:03:50.961554 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:51.117093 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:51.181879 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:03:51.346990 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:03:51.464186 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:03:51.464527 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dddfcc30-7d36-4150-b1d9-fab003b610b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:03:51.464710 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:03:51.465337 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:03:51.465567 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dddfcc30-7d36-4150-b1d9-fab003b610b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:03:51.480191 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:03:51.481712 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:03:51.481995 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:03:51.482486 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:03:51.483212 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:03:51.483430 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:03:51.501359 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:03:51.501359 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:51.512479 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:03:51.512479 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:51.523176 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Updated VIF entry in instance network info cache for port a2498912-5a39-4f70-a141-dae495d11b2a. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:03:51.524117 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2] added
May 27 03:03:51.524117 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:03:51.524117 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:03:51.524117 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:03:51.524117 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:03:51.524117 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:03:51.524117 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:51.524632 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Updating instance_info_cache with network_info: [{"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:03:51.525665 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:03:51.525961 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0439(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:03:51.526136 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:03:51.529899 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2] added
May 27 03:03:51.529899 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:03:51.529899 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:03:51.529899 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:03:51.529899 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:03:51.529899 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:03:51.529899 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:51.530110 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:03:51.530211 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0468(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:03:51.530367 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:03:51.694242 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.747s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:51.768245 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Deleted allocations for instance 8d762a67-82b6-40d3-b625-0731ea01c45b
May 27 03:03:52.027738 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7ab1b786-b066-4c29-bd67-d4f401a47fd5 req-92a70864-8210-47e9-81ed-679cdf7e7d88 service nova] Releasing lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:03:52.448730 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:52.526664 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:03:52.530929 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:03:52.542956 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:03:52.542956 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:03:52.550532 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:03:52.550532 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:52.560262 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:52.565996 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:52.576638 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:52.576638 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:52.576638 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:52.576638 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:52.576638 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:52.576638 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:52.576638 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:03:52.576945 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:52.576945 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:52.576945 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:52.576945 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:52.576945 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:52.576945 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:52.576945 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:03:52.584201 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:52.584201 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:52.584201 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:52.584201 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:52.584201 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:52.584201 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:52.584201 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:03:52.584201 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:52.584201 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:52.584201 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:52.584201 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:52.584201 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:52.584201 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:52.584201 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:03:52.620825 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2, portal: 192.168.40.100,3260]
May 27 03:03:52.620825 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2, portal: 192.168.40.100,3260] successful.
May 27 03:03:52.620825 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:52.630959 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2, portal: 192.168.50.100,3260]
May 27 03:03:52.630959 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2, portal: 192.168.50.100,3260] successful.
May 27 03:03:52.630959 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:52.637188 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:52.645903 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:52.660423 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:52.660423 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:52.660423 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:52.660423 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:52.660423 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:52.660423 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:52.660423 np0000001475 nova-compute[98471]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:52.660423 np0000001475 nova-compute[98471]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:52.660423 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:03:52.660725 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:52.660725 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:52.660725 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:52.660725 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:52.660725 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:52.660725 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:52.660725 np0000001475 nova-compute[98471]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:52.660725 np0000001475 nova-compute[98471]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:52.660725 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:03:52.660981 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:03:52.661183 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:03:52.663465 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] HCTL ('11', '-', '-', 0) found on session 67 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:03:52.663600 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:03:52.665406 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:52.665406 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:52.665406 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:52.665406 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:52.665406 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:52.665406 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:52.665406 np0000001475 nova-compute[98471]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:52.665406 np0000001475 nova-compute[98471]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:52.665406 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:03:52.665873 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:52.665873 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:52.665873 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:52.665873 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:52.665873 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:52.665873 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:52.665873 np0000001475 nova-compute[98471]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:52.665873 np0000001475 nova-compute[98471]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:52.665873 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:03:52.665873 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:03:52.666210 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:03:52.666787 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] HCTL ('12', '-', '-', 0) found on session 68 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:03:52.666929 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:03:52.689672 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Searching for a device in session 67 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:03:52.689672 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dddfcc30-7d36-4150-b1d9-fab003b610b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:03:52.689672 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Searching for a device in session 68 and hctl ['12', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:03:52.776951 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58e30740-14b6-4719-90fb-926ad2fce98a tempest-ServerActionsTestOtherA-569974590 tempest-ServerActionsTestOtherA-569974590-project-member] Lock "8d762a67-82b6-40d3-b625-0731ea01c45b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.699s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:53.689632 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Searching for a device in session 68 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:03:53.690463 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dddfcc30-7d36-4150-b1d9-fab003b610b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:03:54.214629 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.000492699000005814 future=<Future at 0x75570444cbf0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:54.215714 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] Emitting event <LifecycleEvent: 1779851019.2139368, fcb1a3e2-e470-4773-a370-f122a79de2e6 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:03:54.216093 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:54.216393 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] VM Stopped (Lifecycle Event)
May 27 03:03:54.217676 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=7.714053146999959 future=<Future at 0x75572c1283e0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:54.219423 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=7.713854235999861 future=<Future at 0x75572c1283e0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:54.503079 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Found WWN 330000000e87099c0 for multipath device dm-4 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:03:54.503411 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:03:54.503618 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000e87099c0', 'path': '/dev/dm-4', 'multipath_id': '330000000e87099c0'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:03:54.503813 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e87099c0', 'path': '/dev/dm-4', 'multipath_id': '330000000e87099c0'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:03:54.507540 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'flavor' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:54.648965 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "1efec6a6-a26c-46fa-9370-60859f41c1a5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:54.648965 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:54.720804 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] [instance: fcb1a3e2-e470-4773-a370-f122a79de2e6] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:55.011701 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Attempting to attach volume dddfcc30-7d36-4150-b1d9-fab003b610b2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:03:55.013567 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:03:55.013567 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:03:55.013567 np0000001475 nova-compute[98471]:   <alias name="ua-dddfcc30-7d36-4150-b1d9-fab003b610b2"/>
May 27 03:03:55.013567 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-4"/>
May 27 03:03:55.013567 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:03:55.013567 np0000001475 nova-compute[98471]:   <serial>dddfcc30-7d36-4150-b1d9-fab003b610b2</serial>
May 27 03:03:55.013567 np0000001475 nova-compute[98471]: </disk>
May 27 03:03:55.013567 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:03:55.153806 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lazy-loading 'flavor' on Instance uuid 1efec6a6-a26c-46fa-9370-60859f41c1a5 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:55.252393 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:55.418234 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:56.119012 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:56.158028 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:56.698350 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:56.698793 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:56.698793 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:03:56.698793 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No VIF found with MAC fa:16:3e:58:79:ce, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:03:57.391722 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "1efec6a6-a26c-46fa-9370-60859f41c1a5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:57.392004 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:57.392234 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Attaching volume 4eba01c4-5fa0-4932-aedd-b9f70b262c6d to /dev/vdb
May 27 03:03:57.448555 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:03:57.453026 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:57.460097 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:03:57.485345 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:03:57.544310 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:03:57.544642 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:03:57.553948 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:03:57.556408 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::c805:4ff:fe3b:2374', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:feb2:aa32', 'fe80::fc16:3eff:fe01:3d37', 'fe80::fc16:3eff:fe88:48d5', 'fe80::fc16:3eff:fe58:79ce', 'fe80::8cdc:9fff:fe79:9907', 'fe80::fc16:3eff:fe2d:76bb', 'fe80::787c:50ff:fed5:a1fc', 'fe80::fc16:3eff:feea:f34f', 'fe80::a407:7bff:fed1:e35a', 'fe80::fc16:3eff:fea2:a080', 'fe80::88ab:28ff:fedb:6e99', 'fe80::fc16:3eff:fed9:1c3f', 'fe80::fc16:3eff:fe5c:3071'] 
May 27 03:03:57.556605 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:03:57.556928 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:03:57.557292 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:03:57.557622 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Updating existing volume attachment record: f0f2921a-67b4-4003-93be-94037c553380 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:03:58.133812 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:03:58.134235 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4eba01c4-5fa0-4932-aedd-b9f70b262c6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:03:58.134322 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:03:58.134985 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:03:58.135428 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4eba01c4-5fa0-4932-aedd-b9f70b262c6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:03:58.150358 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:03:58.150811 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:03:58.151028 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:03:58.151844 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:03:58.152462 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:03:58.152679 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:03:58.162391 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:03:58.162391 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:58.167961 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:03:58.167961 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:58.177630 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d] added
May 27 03:03:58.177630 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:03:58.177630 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:03:58.177630 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:03:58.177630 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:03:58.177630 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:03:58.177630 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:58.177977 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:03:58.177977 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:03:58.178141 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:03:58.178857 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d] added
May 27 03:03:58.178857 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:03:58.178857 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:03:58.178857 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:03:58.178857 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:03:58.178857 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:03:58.178857 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:58.179137 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:03:58.179320 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0265(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:03:58.179429 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:03:58.270248 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-67d456b1-b0e2-4d15-8bd9-b12945864d47 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.498s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:58.575064 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5a99eb41-d408-4c0d-a121-3978a84491ae tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:58.575770 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5a99eb41-d408-4c0d-a121-3978a84491ae tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:58.575770 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-5a99eb41-d408-4c0d-a121-3978a84491ae tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:03:58.577658 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-5a99eb41-d408-4c0d-a121-3978a84491ae tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98471) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 27 03:03:58.578191 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-5a99eb41-d408-4c0d-a121-3978a84491ae tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'flavor' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:03:59.179073 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:03:59.180312 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:03:59.196273 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:03:59.196273 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:03:59.204573 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:03:59.204573 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:59.213530 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:59.229764 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:59.238817 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:59.238817 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:59.238817 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:59.238817 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:59.238817 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:59.238817 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:59.238817 np0000001475 nova-compute[98471]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:59.238817 np0000001475 nova-compute[98471]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:59.238817 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:03:59.238817 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:59.238817 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:59.238817 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:59.238817 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:59.238817 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:59.238817 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:59.238817 np0000001475 nova-compute[98471]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:59.238817 np0000001475 nova-compute[98471]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:59.238817 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:03:59.249223 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:59.249223 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:59.249223 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:59.249223 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:59.249223 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:59.249223 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:59.249223 np0000001475 nova-compute[98471]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:59.249223 np0000001475 nova-compute[98471]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:59.249223 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:03:59.249716 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:59.249716 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:59.249716 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:59.249716 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:59.249716 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:59.249716 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:59.249716 np0000001475 nova-compute[98471]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:59.249716 np0000001475 nova-compute[98471]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:59.249716 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:03:59.283786 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d, portal: 192.168.40.100,3260]
May 27 03:03:59.283786 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d, portal: 192.168.40.100,3260] successful.
May 27 03:03:59.283786 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:59.299186 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:59.307123 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d, portal: 192.168.50.100,3260]
May 27 03:03:59.307123 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d, portal: 192.168.50.100,3260] successful.
May 27 03:03:59.307123 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:03:59.320063 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:03:59.320063 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] HCTL ('15', '-', '-', 0) found on session 69 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:03:59.320063 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:03:59.326138 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:03:59.339567 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Searching for a device in session 69 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:03:59.339567 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4eba01c4-5fa0-4932-aedd-b9f70b262c6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:03:59.346983 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:59.346983 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:59.346983 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:59.346983 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:59.346983 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:59.346983 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:59.346983 np0000001475 nova-compute[98471]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:59.346983 np0000001475 nova-compute[98471]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:59.346983 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:03:59.346983 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:03:59.346983 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:03:59.347331 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:59.347331 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:03:59.347331 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:59.347331 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:03:59.347331 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:59.347331 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:03:59.347331 np0000001475 nova-compute[98471]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:59.347331 np0000001475 nova-compute[98471]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:03:59.347331 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:03:59.347331 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:03:59.347331 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:03:59.347645 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:03:59.347645 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:03:59.348991 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] HCTL ('16', '-', '-', 0) found on session 70 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:03:59.349151 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:03:59.371192 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Searching for a device in session 70 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:03:59.371192 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4eba01c4-5fa0-4932-aedd-b9f70b262c6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:03:59.611047 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:59.618518 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:59.645537 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:59.648354 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:59.678467 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:03:59.785210 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c1740574-4a87-4469-936d-9902edae74c6 req-e0dd5a2b-81f4-456f-95ec-7855b2374142 service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received event network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:03:59.785432 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c1740574-4a87-4469-936d-9902edae74c6 req-e0dd5a2b-81f4-456f-95ec-7855b2374142 service nova] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:03:59.785568 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c1740574-4a87-4469-936d-9902edae74c6 req-e0dd5a2b-81f4-456f-95ec-7855b2374142 service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:03:59.785689 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c1740574-4a87-4469-936d-9902edae74c6 req-e0dd5a2b-81f4-456f-95ec-7855b2374142 service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:03:59.785819 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c1740574-4a87-4469-936d-9902edae74c6 req-e0dd5a2b-81f4-456f-95ec-7855b2374142 service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] No waiting events found dispatching network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:03:59.785940 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c1740574-4a87-4469-936d-9902edae74c6 req-e0dd5a2b-81f4-456f-95ec-7855b2374142 service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received unexpected event network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 for instance with vm_state active and task_state powering-off.
May 27 03:03:59.922400 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999654022999948 future=<Future at 0x7557043be150 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:03:59.924049 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Instance destroyed successfully.
May 27 03:03:59.924460 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-5a99eb41-d408-4c0d-a121-3978a84491ae tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'numa_topology' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:00.155003 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:04:00.429487 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-5a99eb41-d408-4c0d-a121-3978a84491ae tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Object Instance<bb06d928-2b8c-46f2-b61d-fdb19af4017e> lazy-loaded attributes: flavor,numa_topology {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:04:00.429487 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-5a99eb41-d408-4c0d-a121-3978a84491ae tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:00.942178 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5a99eb41-d408-4c0d-a121-3978a84491ae tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.367s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:01.138157 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:01.173968 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Found WWN 33000000082418c7a for multipath device dm-5 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:04:01.174261 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:01.174406 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '33000000082418c7a', 'path': '/dev/dm-5', 'multipath_id': '33000000082418c7a'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:04:01.174527 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000082418c7a', 'path': '/dev/dm-5', 'multipath_id': '33000000082418c7a'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:04:01.177283 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lazy-loading 'flavor' on Instance uuid 1efec6a6-a26c-46fa-9370-60859f41c1a5 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:01.463807 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'flavor' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:01.679872 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Attempting to attach volume 4eba01c4-5fa0-4932-aedd-b9f70b262c6d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:04:01.680996 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:04:01.680996 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:04:01.680996 np0000001475 nova-compute[98471]:   <alias name="ua-4eba01c4-5fa0-4932-aedd-b9f70b262c6d"/>
May 27 03:04:01.680996 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:04:01.680996 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:04:01.680996 np0000001475 nova-compute[98471]:   <serial>4eba01c4-5fa0-4932-aedd-b9f70b262c6d</serial>
May 27 03:04:01.680996 np0000001475 nova-compute[98471]: </disk>
May 27 03:04:01.680996 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:04:01.843431 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:04:01.843431 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:04:01.843431 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:04:01.843431 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:04:01.843431 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:04:01.843706 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:04:01.843706 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:04:01.843869 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:04:01.844073 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:04:01.876803 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d65d2c8b-9897-4f7f-b0c8-7f465a522eef req-4b72c479-1462-4695-8f97-39f341595b9d service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received event network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:01.877314 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d65d2c8b-9897-4f7f-b0c8-7f465a522eef req-4b72c479-1462-4695-8f97-39f341595b9d service nova] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:01.877314 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d65d2c8b-9897-4f7f-b0c8-7f465a522eef req-4b72c479-1462-4695-8f97-39f341595b9d service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:01.877511 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d65d2c8b-9897-4f7f-b0c8-7f465a522eef req-4b72c479-1462-4695-8f97-39f341595b9d service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:01.877561 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d65d2c8b-9897-4f7f-b0c8-7f465a522eef req-4b72c479-1462-4695-8f97-39f341595b9d service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] No waiting events found dispatching network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:01.877700 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-d65d2c8b-9897-4f7f-b0c8-7f465a522eef req-4b72c479-1462-4695-8f97-39f341595b9d service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received unexpected event network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 for instance with vm_state stopped and task_state powering-on.
May 27 03:04:01.934694 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0005354599998099729 future=<Future at 0x75572c1283e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:01.934694 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Emitting event <LifecycleEvent: 1779851026.9316287, 8d762a67-82b6-40d3-b625-0731ea01c45b => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:04:01.934694 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] VM Stopped (Lifecycle Event)
May 27 03:04:01.934978 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:01.934978 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=12.987037956999757 future=<Future at 0x7557043be150 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:01.935162 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=12.986923122000007 future=<Future at 0x7557043be150 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:01.970118 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "refresh_cache-bb06d928-2b8c-46f2-b61d-fdb19af4017e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:04:01.970279 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquired lock "refresh_cache-bb06d928-2b8c-46f2-b61d-fdb19af4017e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:04:01.970462 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:04:01.970653 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'info_cache' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:02.355539 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:02.355765 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:02.355907 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:02.356240 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:04:02.436736 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d2fdfbfb-7754-4f99-b6f9-16b522e1ea22 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 8d762a67-82b6-40d3-b625-0731ea01c45b] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:02.454973 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:02.474028 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Object Instance<bb06d928-2b8c-46f2-b61d-fdb19af4017e> lazy-loaded attributes: flavor,info_cache {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:04:02.977597 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:03.365251 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:03.367482 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:03.367482 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:03.367482 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No VIF found with MAC fa:16:3e:2d:76:bb, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:04:03.371608 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:03.415768 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:03.504296 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:03.505051 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:03.532709 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Updating instance_info_cache with network_info: [{"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:03.598837 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:03.603217 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:03.679904 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Acquiring lock "de33390e-64b1-4034-a1f1-dcc935cf25fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:03.682588 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:03.703476 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:03.704120 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:03.802874 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:03.803395 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:04:03.807466 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:03.898202 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:03.898654 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:03.992235 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:03.992758 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:04:03.996554 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:04.040906 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Releasing lock "refresh_cache-bb06d928-2b8c-46f2-b61d-fdb19af4017e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:04:04.102003 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:04.102503 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:04.186764 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lazy-loading 'flavor' on Instance uuid de33390e-64b1-4034-a1f1-dcc935cf25fd {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:04.198271 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:04.198755 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:04:04.202517 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:04.291492 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:04.292029 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:04.375400 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:04.376161 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:04:04.384214 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:04.469916 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:04.470447 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:04.554284 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:04.557954 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:04.671823 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:04.672954 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:04.698442 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Ignoring supplied device name: /dev/vdb
May 27 03:04:04.787568 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:04.792210 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:04:04.795393 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.rescue --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:04.897506 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.rescue --force-share --output=json" returned: 0 in 0.102s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:04.898175 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.rescue --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:04.953797 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9769da85-b3fe-4396-97a5-71487b18e3b6 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.561s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:04.995920 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk.rescue --force-share --output=json" returned: 0 in 0.098s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:04.996593 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:05.060986 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Instance destroyed successfully.
May 27 03:04:05.061825 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'numa_topology' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:05.097506 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:05.099469 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:05.207252 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.525s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:05.213222 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:05.218431 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:05.308032 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:05.308825 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:05.406138 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:05.407182 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:04:05.413222 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:05.510401 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:05.511281 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:05.567596 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Object Instance<bb06d928-2b8c-46f2-b61d-fdb19af4017e> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:04:05.568592 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'resources' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:05.608427 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:05.613147 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:05.711080 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:05.712807 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:05.797422 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:05.801254 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:04:05.803770 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:05.848536 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:05.849375 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=10385MB free_disk=72.94640350341797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:04:05.849768 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:05.849923 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:06.072209 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Object Instance<bb06d928-2b8c-46f2-b61d-fdb19af4017e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:04:06.073250 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1752019004',display_name='tempest-AttachVolumeTestJSON-server-1752019004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumetestjson-server-1752019004',id=34,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnCyl+g1Ye4tCJK/b/EmMSENQNCevd73XcwcJq7MM0QjAHn7OQTuI/rqxlNGXTk7F/U6HedbzcDuONEX5G9MqYrebfqRT8YlVYqtYPepNOx2xjMDNgKF5JW2yc7DR5vwA==',key_name='tempest-keypair-224254834',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:03:08Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ca3c6a3942eb41e8b6aefddc5faca789',ramdisk_id='',reservation_id='r-b5nd7f2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1635503347',owner_user_name='tempest-AttachVolumeTestJSON-1635503347-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0d83ca7002c41e0897c39e7b8d91bff',uuid=bb06d928-2b8c-46f2-b61d-fdb19af4017e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:04:06.073528 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converting VIF {"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:04:06.074317 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:04:06.074649 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:04:06.076439 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:06.076787 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4f71bc7-6b, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:06.078042 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:06.080854 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:06.080854 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:06.081650 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:06.081806 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea4d7afb-ffc6-4ee0-b83b-8e1699011ade) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:06.083682 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:06.083682 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:06.084919 np0000001475 nova-compute[98471]: INFO os_vif [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b')
May 27 03:04:06.086199 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:04:06.086548 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dddfcc30-7d36-4150-b1d9-fab003b610b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:04:06.086708 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:06.087141 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:06.087528 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dddfcc30-7d36-4150-b1d9-fab003b610b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:04:06.087755 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:04:06.117123 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:06.117123 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:06.117123 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:06.117123 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:06.117123 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:06.117123 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:06.117123 np0000001475 nova-compute[98471]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:06.117123 np0000001475 nova-compute[98471]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:06.117123 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:06.117123 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:06.117123 np0000001475 nova-compute[98471]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:06.117123 np0000001475 nova-compute[98471]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:06.117123 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:06.117532 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:06.117532 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:06.117532 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:06.117532 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:06.117532 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:06.117532 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:06.117532 np0000001475 nova-compute[98471]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:06.117532 np0000001475 nova-compute[98471]: tcp: [68] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:06.117532 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:06.117532 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:06.117532 np0000001475 nova-compute[98471]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:06.117532 np0000001475 nova-compute[98471]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:06.117532 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:06.117532 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', '67'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', '68'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', '71'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', '72')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:04:06.117995 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', '67')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:04:06.119842 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', '68')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:04:06.119842 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7557046f1da0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2'): ({'sdg'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:04:06.120121 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Removing multipathed devices sdf, sdg {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:04:06.120346 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Flush multipath device 330000000e87099c0 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:04:06.142212 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:06.158348 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:04:06.203978 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:04:06.256291 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:04:06.256503 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:04:06.257836 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:04:06.271662 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:04:06.271662 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:04:06.281885 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:06.320089 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2, portal: 192.168.40.100,3260]
May 27 03:04:06.320089 np0000001475 nova-compute[98471]: Logout of [sid: 67, target: iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2, portal: 192.168.40.100,3260] successful.
May 27 03:04:06.320089 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:06.344365 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:06.358568 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:06.395099 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Acquiring lock "de33390e-64b1-4034-a1f1-dcc935cf25fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:06.395290 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:06.395467 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Attaching volume 4169e733-5260-4341-8234-51936e880c3c to /dev/vdb
May 27 03:04:06.409916 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2, portal: 192.168.50.100,3260]
May 27 03:04:06.409916 np0000001475 nova-compute[98471]: Logout of [sid: 68, target: iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2, portal: 192.168.50.100,3260] successful.
May 27 03:04:06.409916 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:06.434648 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:06.434856 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:06.435005 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] <== disconnect_volume: return (348ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:04:06.435092 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:04:06.439786 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Start _get_guest_xml network_info=[{"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dddfcc30-7d36-4150-b1d9-fab003b610b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, 'status': 'reserved', 'instance': 'bb06d928-2b8c-46f2-b61d-fdb19af4017e', 'attached_at': '', 'detached_at': '', 'volume_id': 'dddfcc30-7d36-4150-b1d9-fab003b610b2', 'serial': 'dddfcc30-7d36-4150-b1d9-fab003b610b2'}, 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '008ba87f-bacb-4db7-804b-da149d4e294f', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:04:06.442775 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:04:06.443717 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1752019004', uuid='bb06d928-2b8c-46f2-b61d-fdb19af4017e'), owner=OwnerMeta(userid='f0d83ca7002c41e0897c39e7b8d91bff', username='tempest-AttachVolumeTestJSON-1635503347-project-member', projectid='ca3c6a3942eb41e8b6aefddc5faca789', projectname='tempest-AttachVolumeTestJSON-1635503347'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851046.443051) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:04:06.444172 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:04:06.444480 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:04:06.446151 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:04:06.446151 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:04:06.446264 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:04:06.446534 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:04:06.446674 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:04:06.446791 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:04:06.446936 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:04:06.447018 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:04:06.447597 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:04:06.447597 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:04:06.447597 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:04:06.447597 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:04:06.447597 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:04:06.448119 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:04:06.448119 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'vcpu_model' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:06.458561 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:04:06.470589 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:04:06.496830 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:06.544235 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:04:06.544549 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:04:06.554755 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:04:06.556877 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::c805:4ff:fe3b:2374', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:feb2:aa32', 'fe80::fc16:3eff:fe01:3d37', 'fe80::fc16:3eff:fe88:48d5', 'fe80::fc16:3eff:fe2d:76bb', 'fe80::787c:50ff:fed5:a1fc', 'fe80::fc16:3eff:feea:f34f', 'fe80::a407:7bff:fed1:e35a', 'fe80::fc16:3eff:fea2:a080', 'fe80::88ab:28ff:fedb:6e99', 'fe80::fc16:3eff:fed9:1c3f', 'fe80::fc16:3eff:fe5c:3071'] 
May 27 03:04:06.557104 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:04:06.557246 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:04:06.557544 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:04:06.557864 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Updating existing volume attachment record: 7a222d55-b11e-4798-a3d0-bcf284be36f2 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:04:06.929496 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance f5d36573-c0e7-43a0-a7cc-66678f093375 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:06.930084 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 71af628e-b06d-446d-8c2e-dcfbb232df33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:06.930278 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 4e583b08-e323-4681-9e95-01767f510590 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:06.930473 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 66b799ed-716a-4b29-8125-bac73213f2cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:06.930664 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:06.930867 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance ca2e5c3f-b9be-4bfb-9858-c22cbb4177da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:06.931070 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance d7f71824-f631-423e-a5ea-8ae72642a95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:06.931239 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance bb06d928-2b8c-46f2-b61d-fdb19af4017e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:06.931399 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 1efec6a6-a26c-46fa-9370-60859f41c1a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:06.931559 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance de33390e-64b1-4034-a1f1-dcc935cf25fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:06.931706 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance c2a5e735-d573-4ac4-bff0-d4a12648718e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:06.931927 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance e17e8031-6811-4553-b8ce-7150f690a4ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:06.950185 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Object Instance<bb06d928-2b8c-46f2-b61d-fdb19af4017e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:04:06.965302 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk.config --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:07.047031 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk.config --force-share --output=json" returned: 0 in 0.081s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:07.047565 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:07.047860 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "/opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:07.048430 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "/opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:07.048971 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:04:07.049352 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dddfcc30-7d36-4150-b1d9-fab003b610b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:04:07.049510 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:07.050519 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:07.050519 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dddfcc30-7d36-4150-b1d9-fab003b610b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:04:07.066036 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:07.066728 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:07.067914 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:07.068265 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:04:07.068829 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:07.069073 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:04:07.082113 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:04:07.082113 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:07.088799 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:04:07.088799 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:07.097943 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2] added
May 27 03:04:07.097943 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:04:07.097943 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:04:07.097943 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:04:07.097943 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:04:07.097943 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:04:07.097943 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:07.097943 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:04:07.097943 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0301(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:04:07.097943 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:04:07.103273 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2] added
May 27 03:04:07.103273 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:04:07.103273 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:04:07.103273 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:04:07.103273 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:04:07.103273 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:04:07.103273 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:07.104613 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:04:07.104613 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0348(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:04:07.104613 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:04:07.142934 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:04:07.143500 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4169e733-5260-4341-8234-51936e880c3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:04:07.143713 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:07.232985 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:07.232985 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:07.435218 np0000001475 nova-compute[98471]: INFO nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 4ac08a8b-4572-4b1f-8ba0-457c80d58b46 has allocations against this compute host but is not found in the database.
May 27 03:04:07.435789 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:04:07.436171 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=2880MB phys_disk=95GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:04:05 up 35 min,  2 users,  load average: 10.27, 8.54, 4.44\n', 'num_instances': '12', 'num_vm_active': '10', 'num_task_None': '11', 'num_os_type_None': '12', 'num_proj_a9c48d6919e8435f876f3324616521ea': '5', 'io_workload': '0', 'num_proj_39cbbdb9012c4992865d4f89678ef9ac': '3', 'num_vm_rescued': '1', 'num_vm_stopped': '1', 'num_task_powering-on': '1', 'num_proj_ca3c6a3942eb41e8b6aefddc5faca789': '1', 'num_proj_5f1801e95925498cac899f1414f2b202': '1', 'num_proj_23965b01217144d29b9cc5ef0d064a47': '1', 'num_proj_51a54fd7b39b4a968af6ad453070ea4d': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:04:07.737461 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:04:08.098571 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:04:08.104556 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:04:08.116136 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:04:08.116136 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:04:08.121640 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:04:08.121640 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:08.134265 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:08.140713 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:08.155094 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:08.155094 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:08.155094 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:08.155094 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:08.155094 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:08.155094 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:08.155094 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:08.155094 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:08.155094 np0000001475 nova-compute[98471]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:08.155094 np0000001475 nova-compute[98471]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:08.155094 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:08.155954 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:08.155954 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:08.155954 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:08.155954 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:08.155954 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:08.155954 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:08.155954 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:08.155954 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:08.155954 np0000001475 nova-compute[98471]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:08.155954 np0000001475 nova-compute[98471]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:08.155954 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:08.160810 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:08.160810 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:08.160810 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:08.160810 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:08.160810 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:08.160810 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:08.160810 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:08.160810 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:08.160810 np0000001475 nova-compute[98471]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:08.160810 np0000001475 nova-compute[98471]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:08.160810 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:08.161614 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:08.161614 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:08.161614 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:08.161614 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:08.161614 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:08.161614 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:08.161614 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:08.161614 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:08.161614 np0000001475 nova-compute[98471]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:08.161614 np0000001475 nova-compute[98471]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:08.161614 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:08.219026 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2, portal: 192.168.40.100,3260]
May 27 03:04:08.219026 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2, portal: 192.168.40.100,3260] successful.
May 27 03:04:08.219026 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:08.232095 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2, portal: 192.168.50.100,3260]
May 27 03:04:08.232095 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2, portal: 192.168.50.100,3260] successful.
May 27 03:04:08.232095 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:08.238156 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:08.252489 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:08.268777 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:08.268777 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:08.268777 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:08.268777 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:08.268777 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:08.268777 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:08.268777 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:08.268777 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:08.268777 np0000001475 nova-compute[98471]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:08.268777 np0000001475 nova-compute[98471]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:08.268777 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:08.268777 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:08.268777 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:08.269093 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:08.269093 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:08.269093 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:08.269093 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:08.269093 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:08.269093 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:08.269093 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:08.269093 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:08.269093 np0000001475 nova-compute[98471]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:08.269093 np0000001475 nova-compute[98471]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:08.269093 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:08.269093 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:08.269093 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:08.269358 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:08.269466 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:04:08.271192 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] HCTL ('11', '-', '-', 0) found on session 73 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:04:08.271349 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:08.286192 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:08.287041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.218s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:08.287041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:04:08.289877 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:04:08.290150 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:04:08.297389 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] HCTL ('12', '-', '-', 0) found on session 74 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:04:08.297389 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:04:08.297389 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Searching for a device in session 73 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:04:08.297389 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dddfcc30-7d36-4150-b1d9-fab003b610b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:04:08.322929 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:08.325319 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Searching for a device in session 74 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:04:08.325319 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dddfcc30-7d36-4150-b1d9-fab003b610b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:04:08.794699 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:04:09.069797 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:04:09.302841 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:04:09.303506 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.454s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:09.304106 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.981s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:09.304435 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 25.90 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:04:09.307888 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:04:09.308075 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Claim successful on node np0000001475
May 27 03:04:09.846516 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Stashing vm_state: active {{(pid=98471) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 27 03:04:10.083834 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Found WWN 330000000e87099c0 for multipath device dm-4 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:04:10.084121 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:10.084292 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000e87099c0', 'path': '/dev/dm-4', 'multipath_id': '330000000e87099c0'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:04:10.084422 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e87099c0', 'path': '/dev/dm-4', 'multipath_id': '330000000e87099c0'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:04:10.085251 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.941s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:10.086174 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4169e733-5260-4341-8234-51936e880c3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:04:10.102633 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:10.103443 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:10.104173 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:10.104401 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:04:10.104854 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:10.105129 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:04:10.119203 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:04:10.119203 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:10.128524 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:04:10.128524 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:10.133269 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c] added
May 27 03:04:10.133269 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:04:10.133269 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:04:10.133269 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:04:10.133269 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:04:10.133269 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:04:10.133269 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:10.133483 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:04:10.133664 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0286(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:04:10.133871 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:04:10.141357 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c] added
May 27 03:04:10.141357 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:04:10.141357 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:04:10.141357 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:04:10.141357 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:04:10.141357 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:04:10.141357 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:10.141609 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:04:10.141640 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0373(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:04:10.142129 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:04:10.422378 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:10.590936 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1752019004',display_name='tempest-AttachVolumeTestJSON-server-1752019004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumetestjson-server-1752019004',id=34,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnCyl+g1Ye4tCJK/b/EmMSENQNCevd73XcwcJq7MM0QjAHn7OQTuI/rqxlNGXTk7F/U6HedbzcDuONEX5G9MqYrebfqRT8YlVYqtYPepNOx2xjMDNgKF5JW2yc7DR5vwA==',key_name='tempest-keypair-224254834',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:03:08Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ca3c6a3942eb41e8b6aefddc5faca789',ramdisk_id='',reservation_id='r-b5nd7f2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1635503347',owner_user_name='tempest-AttachVolumeTestJSON-1635503347-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0d83ca7002c41e0897c39e7b8d91bff',uuid=bb06d928-2b8c-46f2-b61d-fdb19af4017e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:04:10.591345 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converting VIF {"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:04:10.592158 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:04:10.593309 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'pci_devices' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:11.090144 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:11.095457 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Object Instance<bb06d928-2b8c-46f2-b61d-fdb19af4017e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:04:11.098778 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] End _get_guest_xml xml=<domain type="qemu">
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:   <uuid>bb06d928-2b8c-46f2-b61d-fdb19af4017e</uuid>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:   <name>instance-00000022</name>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <nova:name>tempest-AttachVolumeTestJSON-server-1752019004</nova:name>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:04:06</nova:creationTime>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:         <nova:user uuid="f0d83ca7002c41e0897c39e7b8d91bff">tempest-AttachVolumeTestJSON-1635503347-project-member</nova:user>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:         <nova:project uuid="ca3c6a3942eb41e8b6aefddc5faca789">tempest-AttachVolumeTestJSON-1635503347</nova:project>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:         <nova:port uuid="f4f71bc7-6b31-42c9-8f6c-2bc91e87a157">
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     <system>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <entry name="serial">bb06d928-2b8c-46f2-b61d-fdb19af4017e</entry>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <entry name="uuid">bb06d928-2b8c-46f2-b61d-fdb19af4017e</entry>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     </system>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:   <os>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:   </os>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:   <features>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:   </features>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:   <devices>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     </disk>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk.config"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     </disk>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <alias name="ua-dddfcc30-7d36-4150-b1d9-fab003b610b2"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-4"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <target dev="vdb" bus="virtio"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <serial>dddfcc30-7d36-4150-b1d9-fab003b610b2</serial>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     </disk>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:58:79:ce"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <target dev="tapf4f71bc7-6b"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     </interface>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/console.log" append="off"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     </serial>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     <video>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     </video>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     </rng>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:   </devices>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]: </domain>
May 27 03:04:11.098778 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:04:11.098778 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:11.136460 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:04:11.142604 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:04:11.144423 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:04:11.156520 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:04:11.156520 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:04:11.166085 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:04:11.166085 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:11.175780 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:11.185454 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:11.202963 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:11.202963 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:11.202963 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:11.202963 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:11.202963 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:11.202963 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:11.202963 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:11.202963 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:11.202963 np0000001475 nova-compute[98471]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:11.202963 np0000001475 nova-compute[98471]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:11.202963 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:11.202963 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:11.202963 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:11.203385 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:11.203385 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:11.203385 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:11.203385 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:11.203385 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:11.203385 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:11.203385 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:11.203385 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:11.203385 np0000001475 nova-compute[98471]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:11.203385 np0000001475 nova-compute[98471]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:11.203385 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:11.203385 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:11.203385 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:11.212118 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:11.212118 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:11.212118 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:11.212118 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:11.212118 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:11.212118 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:11.212118 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:11.212118 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:11.212118 np0000001475 nova-compute[98471]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:11.212118 np0000001475 nova-compute[98471]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:11.212118 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:11.212118 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:11.212118 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:11.212582 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:11.212582 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:11.212582 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:11.212582 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:11.212582 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:11.212582 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:11.212582 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:11.212582 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:11.212582 np0000001475 nova-compute[98471]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:11.212582 np0000001475 nova-compute[98471]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:11.212582 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:11.212582 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:11.212582 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:11.218424 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:11.218424 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:11.241404 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:04:11.241971 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:04:11.264332 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c, portal: 192.168.50.100,3260]
May 27 03:04:11.264332 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c, portal: 192.168.50.100,3260] successful.
May 27 03:04:11.264332 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:11.275249 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c, portal: 192.168.40.100,3260]
May 27 03:04:11.275249 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c, portal: 192.168.40.100,3260] successful.
May 27 03:04:11.275249 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:11.275821 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:11.288044 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:11.297790 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:11.297790 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:11.297790 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:11.297790 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:11.297790 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:11.297790 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:11.297790 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:11.297790 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:11.297790 np0000001475 nova-compute[98471]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:11.297790 np0000001475 nova-compute[98471]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:11.297790 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:11.297790 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:11.297790 np0000001475 nova-compute[98471]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:11.297790 np0000001475 nova-compute[98471]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:11.297790 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:11.298427 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:11.298427 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:11.298427 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:11.298427 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:11.298427 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:11.298427 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:11.298427 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:11.298427 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:11.298427 np0000001475 nova-compute[98471]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:11.298427 np0000001475 nova-compute[98471]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:11.298427 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:11.298427 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:11.298427 np0000001475 nova-compute[98471]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:11.298427 np0000001475 nova-compute[98471]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:11.298427 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:11.298886 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:11.298886 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:04:11.300669 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] HCTL ('19', '-', '-', 0) found on session 75 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:04:11.301138 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:04:11.309813 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:11.309813 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:11.309813 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:11.309813 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:11.309813 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:11.309813 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:11.309813 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:11.309813 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:11.309813 np0000001475 nova-compute[98471]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:11.309813 np0000001475 nova-compute[98471]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:11.309813 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:11.309813 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:11.309813 np0000001475 nova-compute[98471]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:11.309813 np0000001475 nova-compute[98471]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:11.309813 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:11.310295 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:11.310961 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:11.310961 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:11.310961 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:11.310961 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:11.310961 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:11.310961 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:11.310961 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:11.310961 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:11.310961 np0000001475 nova-compute[98471]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:11.310961 np0000001475 nova-compute[98471]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:11.310961 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:11.310961 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:11.310961 np0000001475 nova-compute[98471]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:11.310961 np0000001475 nova-compute[98471]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:11.310961 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:11.311249 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:11.311249 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:04:11.311547 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:04:11.312290 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'trusted_certs' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:11.317305 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] HCTL ('20', '-', '-', 0) found on session 76 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:04:11.317305 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:04:11.317305 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Searching for a device in session 75 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:04:11.317305 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4169e733-5260-4341-8234-51936e880c3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:04:11.329478 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Searching for a device in session 76 and hctl ['20', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:04:11.429229 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:11.430203 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:11.747278 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:04:11.814863 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Object Instance<bb06d928-2b8c-46f2-b61d-fdb19af4017e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:04:11.815243 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:11.902654 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "e17e8031-6811-4553-b8ce-7150f690a4ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:11.902875 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:11.925579 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.110s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:11.925901 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:04:11.926159 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:11.940279 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Detaching volume 0717598c-54dc-4dab-9fc9-882e4b55c907
May 27 03:04:11.996771 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Attempting to driver detach volume 0717598c-54dc-4dab-9fc9-882e4b55c907 from mountpoint /dev/vdb
May 27 03:04:12.003016 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Found disk vdb by alias ua-0717598c-54dc-4dab-9fc9-882e4b55c907 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:04:12.004303 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Found disk vdb by alias ua-0717598c-54dc-4dab-9fc9-882e4b55c907 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:04:12.004443 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Attempting to detach device vdb from instance ca2e5c3f-b9be-4bfb-9858-c22cbb4177da from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:04:12.004721 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:04:12.004721 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:04:12.004721 np0000001475 nova-compute[98471]:   <alias name="ua-0717598c-54dc-4dab-9fc9-882e4b55c907"/>
May 27 03:04:12.004721 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-0"/>
May 27 03:04:12.004721 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:04:12.004721 np0000001475 nova-compute[98471]:   <serial>0717598c-54dc-4dab-9fc9-882e4b55c907</serial>
May 27 03:04:12.004721 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:04:12.004721 np0000001475 nova-compute[98471]: </disk>
May 27 03:04:12.004721 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:04:12.010649 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Successfully detached device vdb from instance ca2e5c3f-b9be-4bfb-9858-c22cbb4177da from the persistent domain config.
May 27 03:04:12.010961 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] (1/8): Attempting to detach device vdb with device alias ua-0717598c-54dc-4dab-9fc9-882e4b55c907 from instance ca2e5c3f-b9be-4bfb-9858-c22cbb4177da from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:04:12.011296 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:04:12.011296 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:04:12.011296 np0000001475 nova-compute[98471]:   <alias name="ua-0717598c-54dc-4dab-9fc9-882e4b55c907"/>
May 27 03:04:12.011296 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-0"/>
May 27 03:04:12.011296 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:04:12.011296 np0000001475 nova-compute[98471]:   <serial>0717598c-54dc-4dab-9fc9-882e4b55c907</serial>
May 27 03:04:12.011296 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:04:12.011296 np0000001475 nova-compute[98471]: </disk>
May 27 03:04:12.011296 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:04:12.012381 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:12.012947 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Cannot resize image /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:04:12.013314 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'migration_context' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:12.256790 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.953s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:12.257459 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:04:12.262772 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 1.839s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:12.329690 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Searching for a device in session 76 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:04:12.329867 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4169e733-5260-4341-8234-51936e880c3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:04:12.410401 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lazy-loading 'flavor' on Instance uuid e17e8031-6811-4553-b8ce-7150f690a4ba {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:12.516037 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Object Instance<bb06d928-2b8c-46f2-b61d-fdb19af4017e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:04:12.517206 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1752019004',display_name='tempest-AttachVolumeTestJSON-server-1752019004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumetestjson-server-1752019004',id=34,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnCyl+g1Ye4tCJK/b/EmMSENQNCevd73XcwcJq7MM0QjAHn7OQTuI/rqxlNGXTk7F/U6HedbzcDuONEX5G9MqYrebfqRT8YlVYqtYPepNOx2xjMDNgKF5JW2yc7DR5vwA==',key_name='tempest-keypair-224254834',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:03:08Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ca3c6a3942eb41e8b6aefddc5faca789',ramdisk_id='',reservation_id='r-b5nd7f2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1635503347',owner_user_name='tempest-AttachVolumeTestJSON-1635503347-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0d83ca7002c41e0897c39e7b8d91bff',uuid=bb06d928-2b8c-46f2-b61d-fdb19af4017e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:04:12.517395 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converting VIF {"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:04:12.518073 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:04:12.518341 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:04:12.521691 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:12.521691 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:12.521832 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:04:12.523157 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:12.523324 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5c2e64e-bf8d-5466-bd31-3b3c07150ed3', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:12.524208 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:12.525070 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:12.527967 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:12.531396 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:12.531582 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4f71bc7-6b, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:12.531988 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4f71bc7-6b, col_values=(('qos', UUID('82cd491a-9823-46b2-8056-4e5489005869')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:12.532147 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4f71bc7-6b, col_values=(('external_ids', {'iface-id': 'f4f71bc7-6b31-42c9-8f6c-2bc91e87a157', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:79:ce', 'vm-uuid': 'bb06d928-2b8c-46f2-b61d-fdb19af4017e'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:12.535047 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:12.535461 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:12.541514 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:12.542079 np0000001475 nova-compute[98471]: INFO os_vif [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b')
May 27 03:04:12.603354 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851052.6028972, ca2e5c3f-b9be-4bfb-9858-c22cbb4177da => ua-0717598c-54dc-4dab-9fc9-882e4b55c907> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:04:12.605114 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0717598c-54dc-4dab-9fc9-882e4b55c907 for instance ca2e5c3f-b9be-4bfb-9858-c22cbb4177da {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:04:12.608142 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Successfully detached device vdb from instance ca2e5c3f-b9be-4bfb-9858-c22cbb4177da from the live domain config.
May 27 03:04:12.609616 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:04:12.610078 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907', 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0717598c-54dc-4dab-9fc9-882e4b55c907', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:04:12.610262 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:12.766624 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:04:12.768306 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:04:12.768306 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:12.768306 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:12.779324 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:04:12.779502 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Claim successful on node np0000001475
May 27 03:04:12.839140 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca42144366ef44eb81e5c4a23624d281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1801e95925498cac899f1414f2b202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:04:12.994511 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:13.060528 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:13.091617 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:13.138917 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Found WWN 3300000001ff038f0 for multipath device dm-8 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:04:13.139607 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.054s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:13.139699 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] <== connect_volume: return (5995ms) {'type': 'block', 'scsi_wwn': '3300000001ff038f0', 'path': '/dev/dm-8', 'multipath_id': '3300000001ff038f0'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:04:13.139839 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001ff038f0', 'path': '/dev/dm-8', 'multipath_id': '3300000001ff038f0'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:04:13.140616 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.530s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:13.141122 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907', 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0717598c-54dc-4dab-9fc9-882e4b55c907', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:04:13.141337 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:04:13.147957 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lazy-loading 'flavor' on Instance uuid de33390e-64b1-4034-a1f1-dcc935cf25fd {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:13.178291 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:13.178291 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:13.178291 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:13.178291 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:13.178291 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:13.178291 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:13.178291 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:13.178291 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:13.178291 np0000001475 nova-compute[98471]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:13.178291 np0000001475 nova-compute[98471]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:13.178291 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:13.178291 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:13.178291 np0000001475 nova-compute[98471]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:13.178291 np0000001475 nova-compute[98471]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:13.178291 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:13.179131 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:13.179131 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:13.179131 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:13.179131 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:13.179131 np0000001475 nova-compute[98471]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:13.179131 np0000001475 nova-compute[98471]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907 (non-flash)
May 27 03:04:13.179131 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:13.179131 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:13.179131 np0000001475 nova-compute[98471]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:13.179131 np0000001475 nova-compute[98471]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:13.179131 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:13.179131 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:13.179131 np0000001475 nova-compute[98471]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:13.179131 np0000001475 nova-compute[98471]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:13.179131 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:13.179131 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', '71'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', '72'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', '73'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', '76')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:04:13.179131 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907', '66')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:04:13.180159 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907', '65')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:04:13.182308 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572473c0e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907'): ({'sdb'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:04:13.182484 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Removing multipathed devices sdc, sdb {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:04:13.184473 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Flush multipath device 330000000bd2d2572 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:04:13.189778 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:13.217618 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:04:13.269090 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:04:13.270286 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:04:13.287096 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0a3273e3-568d-44c5-ab18-fcd05b585e67 req-6f34c781-e10d-423f-b6d4-d7d8e5010847 service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received event network-vif-plugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:13.287334 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0a3273e3-568d-44c5-ab18-fcd05b585e67 req-6f34c781-e10d-423f-b6d4-d7d8e5010847 service nova] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:13.287524 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0a3273e3-568d-44c5-ab18-fcd05b585e67 req-6f34c781-e10d-423f-b6d4-d7d8e5010847 service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:13.287682 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0a3273e3-568d-44c5-ab18-fcd05b585e67 req-6f34c781-e10d-423f-b6d4-d7d8e5010847 service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:13.287848 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0a3273e3-568d-44c5-ab18-fcd05b585e67 req-6f34c781-e10d-423f-b6d4-d7d8e5010847 service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] No waiting events found dispatching network-vif-plugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:13.288046 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-0a3273e3-568d-44c5-ab18-fcd05b585e67 req-6f34c781-e10d-423f-b6d4-d7d8e5010847 service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received unexpected event network-vif-plugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 for instance with vm_state stopped and task_state powering-on.
May 27 03:04:13.294649 np0000001475 nova-compute[98471]: INFO nova.compute.resource_tracker [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Updating resource usage from migration c0c0f473-89b5-47a7-b402-784848288bbc
May 27 03:04:13.325192 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:04:13.325430 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:04:13.328419 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:04:13.348831 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:04:13.348831 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:04:13.365563 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:13.411231 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907, portal: 192.168.40.100,3260]
May 27 03:04:13.411231 np0000001475 nova-compute[98471]: Logout of [sid: 66, target: iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907, portal: 192.168.40.100,3260] successful.
May 27 03:04:13.411231 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:13.416530 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:13.440302 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:13.455267 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:13.489725 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:13.493730 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:13.505527 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 65, target: iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907, portal: 192.168.50.100,3260]
May 27 03:04:13.505527 np0000001475 nova-compute[98471]: Logout of [sid: 65, target: iqn.2023-03.storpool.com:os--volume-0717598c-54dc-4dab-9fc9-882e4b55c907, portal: 192.168.50.100,3260] successful.
May 27 03:04:13.505527 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:13.517274 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Successfully created port: 7221e6d5-c2ed-469e-bffd-acfd7b6cb950 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:04:13.520340 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:13.531609 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:13.532959 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:13.533169 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] <== disconnect_volume: return (922ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:04:13.533421 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:04:13.651558 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Attempting to attach volume 4169e733-5260-4341-8234-51936e880c3c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:04:13.655356 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:04:13.655356 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:04:13.655356 np0000001475 nova-compute[98471]:   <alias name="ua-4169e733-5260-4341-8234-51936e880c3c"/>
May 27 03:04:13.655356 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-8"/>
May 27 03:04:13.655356 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:04:13.655356 np0000001475 nova-compute[98471]:   <serial>4169e733-5260-4341-8234-51936e880c3c</serial>
May 27 03:04:13.655356 np0000001475 nova-compute[98471]: </disk>
May 27 03:04:13.655356 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:04:13.774196 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:04:14.117222 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'flavor' on Instance uuid ca2e5c3f-b9be-4bfb-9858-c22cbb4177da {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:14.195737 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Removed pending STOPPED event for bb06d928-2b8c-46f2-b61d-fdb19af4017e due to new event <LifecycleEvent: 1779851054.195395, bb06d928-2b8c-46f2-b61d-fdb19af4017e => Resumed> {{(pid=98471) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 03:04:14.195923 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851054.195395, bb06d928-2b8c-46f2-b61d-fdb19af4017e => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:04:14.196064 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] VM Resumed (Lifecycle Event)
May 27 03:04:14.199420 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Instance event wait completed in 0 seconds for  {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:04:14.205321 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Instance rebooted successfully.
May 27 03:04:14.296489 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Successfully updated port: 7221e6d5-c2ed-469e-bffd-acfd7b6cb950 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:04:14.319094 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:04:14.319432 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:04:14.550676 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "e17e8031-6811-4553-b8ce-7150f690a4ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:14.551280 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:14.551280 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Attaching volume c98f3ccd-980f-4f76-a069-2cc558e818c2 to /dev/vdb
May 27 03:04:14.613477 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:04:14.628199 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:04:14.650622 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:14.694580 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:04:14.694997 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:04:14.699793 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:14.704097 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:04:14.707227 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:04:14.710002 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::c805:4ff:fe3b:2374', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:feb2:aa32', 'fe80::fc16:3eff:fe01:3d37', 'fe80::fc16:3eff:fe88:48d5', 'fe80::fc16:3eff:fe2d:76bb', 'fe80::787c:50ff:fed5:a1fc', 'fe80::fc16:3eff:feea:f34f', 'fe80::a407:7bff:fed1:e35a', 'fe80::fc16:3eff:fea2:a080', 'fe80::88ab:28ff:fedb:6e99', 'fe80::fc16:3eff:fed9:1c3f', 'fe80::fc16:3eff:fe5c:3071', 'fe80::fc16:3eff:fe58:79ce', 'fe80::8cdc:9fff:fe79:9907'] 
May 27 03:04:14.710002 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:04:14.710002 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:04:14.710002 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:04:14.710002 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Updating existing volume attachment record: 2a06486f-ff37-420d-ae13-867814ec5e9e {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:04:14.796240 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:04:14.797312 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:04:14.797493 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Creating image(s)
May 27 03:04:14.799385 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:14.799523 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "/opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:14.800256 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "refresh_cache-4ac08a8b-4572-4b1f-8ba0-457c80d58b46" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:04:14.800386 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquired lock "refresh_cache-4ac08a8b-4572-4b1f-8ba0-457c80d58b46" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:04:14.800654 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:04:14.801582 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "/opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:14.802850 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:04:14.806996 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:04:14.808122 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:14.831527 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:04:14.922483 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0004083329999957641 future=<Future at 0x7557043be150 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:14.922642 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:14.925214 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.117s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:14.925643 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:14.926086 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:14.926979 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:04:14.929439 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:04:14.929784 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:15.034759 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.105s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:15.035291 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:15.088078 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46/disk 1073741824" returned: 0 in 0.052s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:15.088648 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.162s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:15.089161 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:15.125855 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1350d296-1e32-4948-86a5-e6cde634b848 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.694s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:15.190496 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.101s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:15.191022 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:04:15.191366 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:15.214962 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] During sync_power_state the instance has a pending task (powering-on). Skip.
May 27 03:04:15.215643 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851055.2153277, bb06d928-2b8c-46f2-b61d-fdb19af4017e => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:04:15.215807 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] VM Started (Lifecycle Event)
May 27 03:04:15.297779 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:15.299924 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Cannot resize image /opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:04:15.299924 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:04:15.299924 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Ensure instance console log exists: /opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:04:15.299924 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:15.299924 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:15.299924 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:15.319437 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c98f3ccd-980f-4f76-a069-2cc558e818c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e17e8031-6811-4553-b8ce-7150f690a4ba', 'attached_at': '', 'detached_at': '', 'volume_id': 'c98f3ccd-980f-4f76-a069-2cc558e818c2', 'serial': 'c98f3ccd-980f-4f76-a069-2cc558e818c2'} {{(pid=98471) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 03:04:15.323206 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:04:15.323206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c98f3ccd-980f-4f76-a069-2cc558e818c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:04:15.323206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:15.323206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:15.323206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c98f3ccd-980f-4f76-a069-2cc558e818c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:04:15.337502 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:15.338279 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:15.339442 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:15.339845 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:04:15.340717 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:15.341005 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:04:15.350781 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 3.088s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:15.350781 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Migrating
May 27 03:04:15.350781 np0000001475 nova-compute[98471]: DEBUG nova.compute.rpcapi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98471) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 03:04:15.364080 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:04:15.364080 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:15.371843 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:04:15.371843 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:15.383148 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:15.383401 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:15.383781 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:15.383781 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] No VIF found with MAC fa:16:3e:ea:f3:4f, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:04:15.384429 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2] added
May 27 03:04:15.384429 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:04:15.384429 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:04:15.384429 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:04:15.384429 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:04:15.384429 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:04:15.384429 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:15.384775 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:04:15.385016 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0451(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:04:15.385271 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:04:15.390362 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-238d907b-ed76-4298-9845-a05fcf28aed8 req-3c029a10-f84f-4d19-8841-36a3aade536d service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received event network-vif-plugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:15.393497 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-238d907b-ed76-4298-9845-a05fcf28aed8 req-3c029a10-f84f-4d19-8841-36a3aade536d service nova] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:15.393699 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-238d907b-ed76-4298-9845-a05fcf28aed8 req-3c029a10-f84f-4d19-8841-36a3aade536d service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:15.393837 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-238d907b-ed76-4298-9845-a05fcf28aed8 req-3c029a10-f84f-4d19-8841-36a3aade536d service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:15.394007 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-238d907b-ed76-4298-9845-a05fcf28aed8 req-3c029a10-f84f-4d19-8841-36a3aade536d service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] No waiting events found dispatching network-vif-plugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:15.394117 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-238d907b-ed76-4298-9845-a05fcf28aed8 req-3c029a10-f84f-4d19-8841-36a3aade536d service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received unexpected event network-vif-plugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 for instance with vm_state stopped and task_state powering-on.
May 27 03:04:15.394204 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-238d907b-ed76-4298-9845-a05fcf28aed8 req-3c029a10-f84f-4d19-8841-36a3aade536d service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Received event network-changed-7221e6d5-c2ed-469e-bffd-acfd7b6cb950 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:15.394794 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-238d907b-ed76-4298-9845-a05fcf28aed8 req-3c029a10-f84f-4d19-8841-36a3aade536d service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Refreshing instance network info cache due to event network-changed-7221e6d5-c2ed-469e-bffd-acfd7b6cb950. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:04:15.394794 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-238d907b-ed76-4298-9845-a05fcf28aed8 req-3c029a10-f84f-4d19-8841-36a3aade536d service nova] Acquiring lock "refresh_cache-4ac08a8b-4572-4b1f-8ba0-457c80d58b46" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:04:15.395880 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2] added
May 27 03:04:15.395880 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:04:15.395880 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:04:15.395880 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:04:15.395880 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:04:15.395880 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:04:15.395880 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:15.395880 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:04:15.395880 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0549(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:04:15.400021 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:04:15.417307 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:04:15.609913 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:15.732787 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:15.735841 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:04:15.738123 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:15.738276 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:15.738401 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:15.738524 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No VIF found with MAC fa:16:3e:58:79:ce, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:04:15.743324 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-92105d05-ada4-4c0a-8b52-302795946b17 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:15.774831 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Updating instance_info_cache with network_info: [{"id": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "address": "fa:16:3e:4d:21:a6", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221e6d5-c2", "ovs_interfaceid": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:15.811857 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:15.812843 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:15.812843 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:15.812843 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:15.812843 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:15.815848 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Terminating instance
May 27 03:04:15.908428 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:04:15.908428 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquired lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:04:15.908428 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:04:16.148490 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:16.224997 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Acquiring lock "895c7b70-89af-409a-97e5-27733dbea534" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:16.225246 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "895c7b70-89af-409a-97e5-27733dbea534" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:16.239442 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] During sync_power_state the instance has a pending task (powering-on). Skip.
May 27 03:04:16.276459 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Releasing lock "refresh_cache-4ac08a8b-4572-4b1f-8ba0-457c80d58b46" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:04:16.276710 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Instance network_info: |[{"id": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "address": "fa:16:3e:4d:21:a6", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221e6d5-c2", "ovs_interfaceid": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:04:16.278402 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-238d907b-ed76-4298-9845-a05fcf28aed8 req-3c029a10-f84f-4d19-8841-36a3aade536d service nova] Acquired lock "refresh_cache-4ac08a8b-4572-4b1f-8ba0-457c80d58b46" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:04:16.278402 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-238d907b-ed76-4298-9845-a05fcf28aed8 req-3c029a10-f84f-4d19-8841-36a3aade536d service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Refreshing network info cache for port 7221e6d5-c2ed-469e-bffd-acfd7b6cb950 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:04:16.281307 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Start _get_guest_xml network_info=[{"id": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "address": "fa:16:3e:4d:21:a6", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221e6d5-c2", "ovs_interfaceid": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:04:16.287556 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:04:16.289219 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1974489567', uuid='4ac08a8b-4572-4b1f-8ba0-457c80d58b46'), owner=OwnerMeta(userid='ca42144366ef44eb81e5c4a23624d281', username='tempest-AttachVolumeNegativeTest-1854580419-project-member', projectid='5f1801e95925498cac899f1414f2b202', projectname='tempest-AttachVolumeNegativeTest-1854580419'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "address": "fa:16:3e:4d:21:a6", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221e6d5-c2", "ovs_interfaceid": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851056.2886953) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:04:16.291917 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:04:16.293346 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:04:16.294293 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:04:16.294483 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:04:16.295638 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:04:16.296028 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:04:16.296238 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:04:16.296477 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:04:16.296662 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:04:16.297365 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:04:16.297702 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:04:16.297996 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:04:16.298137 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:04:16.298258 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:04:16.298355 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:04:16.298472 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:04:16.308873 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1974489567',display_name='tempest-AttachVolumeNegativeTest-server-1974489567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumenegativetest-server-1974489567',id=38,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHka1t6x4M+86kCahgInMOS/cABU8yQFVS3REP7EGviVCuSjIufXw5tE5GCDq+PUDr25r1yv/c0XKE2YgnSbUpuLM+PMyRjC2aISGQQDSC7EbVV0LcbgCjD2DJZYtBPTHA==',key_name='tempest-keypair-635272299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1801e95925498cac899f1414f2b202',ramdisk_id='',reservation_id='r-0byjkrw8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1854580419',owner_user_name='tempest-AttachVolumeNegativeTest-1854580419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca42144366ef44eb81e5c4a23624d281',uuid=4ac08a8b-4572-4b1f-8ba0-457c80d58b46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "address": "fa:16:3e:4d:21:a6", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221e6d5-c2", "ovs_interfaceid": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:04:16.309147 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converting VIF {"id": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "address": "fa:16:3e:4d:21:a6", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221e6d5-c2", "ovs_interfaceid": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:04:16.309839 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:21:a6,bridge_name='br-int',has_traffic_filtering=True,id=7221e6d5-c2ed-469e-bffd-acfd7b6cb950,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7221e6d5-c2') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:04:16.310325 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ac08a8b-4572-4b1f-8ba0-457c80d58b46 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:16.322395 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:04:16.350379 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:16.356488 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:16.378895 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:16.385770 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:04:16.396790 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:04:16.402567 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:04:16.402567 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:16.411671 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:04:16.415669 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:04:16.415669 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:16.427555 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:16.439334 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:16.450714 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:16.450714 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:16.450714 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:16.450714 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:16.450714 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:16.450714 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:16.450714 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:16.450714 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:16.450714 np0000001475 nova-compute[98471]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:16.450714 np0000001475 nova-compute[98471]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:16.450714 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:16.451687 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:16.451687 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:16.451687 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:16.451687 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:16.451687 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:16.451687 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:16.451687 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:16.451687 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:16.451687 np0000001475 nova-compute[98471]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:16.451687 np0000001475 nova-compute[98471]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:16.451687 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:16.463505 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:16.463505 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:16.463505 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:16.463505 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:16.463505 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:16.463505 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:16.463505 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:16.463505 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:16.463505 np0000001475 nova-compute[98471]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:16.463505 np0000001475 nova-compute[98471]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:16.463505 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:16.463905 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:16.463905 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:16.463905 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:16.463905 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:16.463905 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:16.463905 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:16.463905 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:16.463905 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:16.463905 np0000001475 nova-compute[98471]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:16.463905 np0000001475 nova-compute[98471]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:16.463905 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:16.517189 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2, portal: 192.168.40.100,3260]
May 27 03:04:16.517189 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2, portal: 192.168.40.100,3260] successful.
May 27 03:04:16.517189 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:16.532391 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:16.549615 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:16.549615 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:16.549615 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:16.549615 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:16.549615 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:16.549615 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:16.549615 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:16.549615 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:16.549615 np0000001475 nova-compute[98471]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:16.549615 np0000001475 nova-compute[98471]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:16.549615 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:16.549615 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:16.550078 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:16.550078 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:16.550078 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:16.550078 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:16.550078 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:16.550078 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:16.550078 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:16.550078 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:16.550078 np0000001475 nova-compute[98471]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:16.550078 np0000001475 nova-compute[98471]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:16.550078 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:16.550078 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:16.550358 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.211s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:16.550358 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:04:16.551409 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] HCTL ('7', '-', '-', 0) found on session 77 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:04:16.551535 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:04:16.560296 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:16.572763 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:16.572763 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Searching for a device in session 77 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:04:16.572763 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c98f3ccd-980f-4f76-a069-2cc558e818c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:04:16.661934 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:16.686495 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99954634200003 future=<Future at 0x7557046d12b0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:16.686854 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999161443000048 future=<Future at 0x7557046d12b0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:16.687218 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.998904863999996 future=<Future at 0x7557046d12b0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:16.689293 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Instance destroyed successfully.
May 27 03:04:16.690425 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'resources' on Instance uuid ca2e5c3f-b9be-4bfb-9858-c22cbb4177da {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:16.727576 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:04:16.784347 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-238d907b-ed76-4298-9845-a05fcf28aed8 req-3c029a10-f84f-4d19-8841-36a3aade536d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:16.813434 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] End _get_guest_xml xml=<domain type="qemu">
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:   <uuid>4ac08a8b-4572-4b1f-8ba0-457c80d58b46</uuid>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:   <name>instance-00000026</name>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1974489567</nova:name>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:04:16</nova:creationTime>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:         <nova:user uuid="ca42144366ef44eb81e5c4a23624d281">tempest-AttachVolumeNegativeTest-1854580419-project-member</nova:user>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:         <nova:project uuid="5f1801e95925498cac899f1414f2b202">tempest-AttachVolumeNegativeTest-1854580419</nova:project>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:         <nova:port uuid="7221e6d5-c2ed-469e-bffd-acfd7b6cb950">
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     <system>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <entry name="serial">4ac08a8b-4572-4b1f-8ba0-457c80d58b46</entry>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <entry name="uuid">4ac08a8b-4572-4b1f-8ba0-457c80d58b46</entry>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     </system>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:   <os>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:   </os>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:   <features>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:   </features>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:   <devices>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46/disk"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     </disk>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46/disk.config"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     </disk>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:4d:21:a6"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <target dev="tap7221e6d5-c2"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     </interface>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46/console.log" append="off"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     </serial>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     <video>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     </video>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     </rng>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:   </devices>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]: </domain>
May 27 03:04:16.813434 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:04:16.820551 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Preparing to wait for external event network-vif-plugged-7221e6d5-c2ed-469e-bffd-acfd7b6cb950 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:04:16.820551 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:16.820551 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:16.820551 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:16.820551 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1974489567',display_name='tempest-AttachVolumeNegativeTest-server-1974489567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumenegativetest-server-1974489567',id=38,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHka1t6x4M+86kCahgInMOS/cABU8yQFVS3REP7EGviVCuSjIufXw5tE5GCDq+PUDr25r1yv/c0XKE2YgnSbUpuLM+PMyRjC2aISGQQDSC7EbVV0LcbgCjD2DJZYtBPTHA==',key_name='tempest-keypair-635272299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1801e95925498cac899f1414f2b202',ramdisk_id='',reservation_id='r-0byjkrw8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1854580419',owner_user_name='tempest-AttachVolumeNegativeTest-1854580419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca42144366ef44eb81e5c4a23624d281',uuid=4ac08a8b-4572-4b1f-8ba0-457c80d58b46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "address": "fa:16:3e:4d:21:a6", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221e6d5-c2", "ovs_interfaceid": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:04:16.820551 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converting VIF {"id": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "address": "fa:16:3e:4d:21:a6", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221e6d5-c2", "ovs_interfaceid": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:04:16.820551 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:21:a6,bridge_name='br-int',has_traffic_filtering=True,id=7221e6d5-c2ed-469e-bffd-acfd7b6cb950,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7221e6d5-c2') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:04:16.820551 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:21:a6,bridge_name='br-int',has_traffic_filtering=True,id=7221e6d5-c2ed-469e-bffd-acfd7b6cb950,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7221e6d5-c2') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:04:16.820551 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:16.820551 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:16.820551 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:04:16.822972 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:16.822972 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '927f8a13-a78f-5196-bbb1-9fd8c3293688', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:16.827077 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:16.827921 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:16.835766 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:16.839356 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:16.839609 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7221e6d5-c2, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:16.840106 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7221e6d5-c2, col_values=(('qos', UUID('ab90cf7e-4b86-4db1-b1bc-547e6a5d44fc')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:16.840325 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7221e6d5-c2, col_values=(('external_ids', {'iface-id': '7221e6d5-c2ed-469e-bffd-acfd7b6cb950', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:21:a6', 'vm-uuid': '4ac08a8b-4572-4b1f-8ba0-457c80d58b46'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:16.842892 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:16.844520 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:16.856043 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:16.856866 np0000001475 nova-compute[98471]: INFO os_vif [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:21:a6,bridge_name='br-int',has_traffic_filtering=True,id=7221e6d5-c2ed-469e-bffd-acfd7b6cb950,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7221e6d5-c2')
May 27 03:04:16.860856 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:16.981224 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1b7b23c2-e279-440c-89b6-391d15f8687d tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.586s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:17.069029 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Updating instance_info_cache with network_info: [{"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:17.186966 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-238d907b-ed76-4298-9845-a05fcf28aed8 req-3c029a10-f84f-4d19-8841-36a3aade536d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:17.189069 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:17.195750 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1395902965',display_name='tempest-ServerRescueNegativeTestJSON-server-1395902965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverrescuenegativetestjson-server-1395902965',id=31,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzS05hQU82r7289dzCq091Kq0hKDY8vlIghFsejL46c9qOyIGwMDUj2tsi4gbzjp70mEziyTz5NLouHNw4zIeC77WZdjsM5xeXJ8F2FHPRHi+ROTn7Bnw2TX4fYLvq7NA==',key_name='tempest-keypair-363341517',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:03:27Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39cbbdb9012c4992865d4f89678ef9ac',ramdisk_id='',reservation_id='r-7zpndcla',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-62027498',owner_user_name='tempest-ServerRescueNegativeTestJSON-62027498-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:03:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b438796ed5e44f629535db767fe2b756',uuid=ca2e5c3f-b9be-4bfb-9858-c22cbb4177da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1133d110-d517-4b72-bbce-faf3064e5946", "address": "fa:16:3e:d9:1c:3f", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1133d110-d5", "ovs_interfaceid": "1133d110-d517-4b72-bbce-faf3064e5946", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:04:17.195750 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converting VIF {"id": "1133d110-d517-4b72-bbce-faf3064e5946", "address": "fa:16:3e:d9:1c:3f", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1133d110-d5", "ovs_interfaceid": "1133d110-d517-4b72-bbce-faf3064e5946", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:04:17.195750 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:1c:3f,bridge_name='br-int',has_traffic_filtering=True,id=1133d110-d517-4b72-bbce-faf3064e5946,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1133d110-d5') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:04:17.195750 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:1c:3f,bridge_name='br-int',has_traffic_filtering=True,id=1133d110-d517-4b72-bbce-faf3064e5946,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1133d110-d5') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:04:17.196118 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:17.196221 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1133d110-d5, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:17.198334 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:17.198488 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:17.204821 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:17.205879 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:17.206114 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7e81eee-2143-4ed5-a019-68a1e1349d5c) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:17.206702 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:17.208093 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:17.214800 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:17.219763 np0000001475 nova-compute[98471]: INFO os_vif [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:1c:3f,bridge_name='br-int',has_traffic_filtering=True,id=1133d110-d517-4b72-bbce-faf3064e5946,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1133d110-d5')
May 27 03:04:17.219763 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Deleting instance files /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da_del
May 27 03:04:17.219763 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Deletion of /opt/stack/data/nova/instances/ca2e5c3f-b9be-4bfb-9858-c22cbb4177da_del complete
May 27 03:04:17.293338 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:17.293656 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:17.298104 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:04:17.298470 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Claim successful on node np0000001475
May 27 03:04:17.319519 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Received event volume-extended-4169e733-5260-4341-8234-51936e880c3c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:17.377631 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-238d907b-ed76-4298-9845-a05fcf28aed8 req-3c029a10-f84f-4d19-8841-36a3aade536d service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Updated VIF entry in instance network info cache for port 7221e6d5-c2ed-469e-bffd-acfd7b6cb950. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:04:17.377990 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-238d907b-ed76-4298-9845-a05fcf28aed8 req-3c029a10-f84f-4d19-8841-36a3aade536d service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Updating instance_info_cache with network_info: [{"id": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "address": "fa:16:3e:4d:21:a6", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221e6d5-c2", "ovs_interfaceid": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:17.526306 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2, portal: 192.168.50.100,3260]
May 27 03:04:17.526306 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2, portal: 192.168.50.100,3260] successful.
May 27 03:04:17.526306 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:17.540675 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:17.562236 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:17.562236 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:17.562236 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:17.562236 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:17.562236 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:17.562236 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:17.562236 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:17.562236 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:17.562236 np0000001475 nova-compute[98471]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:17.562236 np0000001475 nova-compute[98471]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:17.562236 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:17.562236 np0000001475 nova-compute[98471]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:17.562236 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:17.562713 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:17.562713 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:17.562713 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:17.562713 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:17.562713 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:17.562713 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:17.562713 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:17.562713 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:17.562713 np0000001475 nova-compute[98471]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:17.562713 np0000001475 nova-compute[98471]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:17.562713 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:17.562713 np0000001475 nova-compute[98471]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:17.562713 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:17.563168 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.222s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:17.563168 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:04:17.564340 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] HCTL ('8', '-', '-', 0) found on session 78 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:04:17.564340 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:04:17.571523 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Releasing lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:04:17.586768 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Searching for a device in session 78 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:04:17.586768 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c98f3ccd-980f-4f76-a069-2cc558e818c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:04:17.725523 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Took 1.40 seconds to destroy the instance on the hypervisor.
May 27 03:04:17.726292 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:04:17.726760 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:04:17.726955 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:04:17.727211 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:17.811169 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:17.825243 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Handling volume-extended event for volume 4169e733-5260-4341-8234-51936e880c3c {{(pid=98471) extend_volume /opt/stack/nova/nova/compute/manager.py:11834}}
May 27 03:04:17.881189 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-238d907b-ed76-4298-9845-a05fcf28aed8 req-3c029a10-f84f-4d19-8841-36a3aade536d service nova] Releasing lock "refresh_cache-4ac08a8b-4572-4b1f-8ba0-457c80d58b46" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:04:18.315828 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-41ccc892-e530-4e07-a2f1-5d37a14ceb4f req-071415eb-334d-43f1-8bf8-8f92bde1e35d service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Received event network-vif-deleted-1133d110-d517-4b72-bbce-faf3064e5946 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:18.316109 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-41ccc892-e530-4e07-a2f1-5d37a14ceb4f req-071415eb-334d-43f1-8bf8-8f92bde1e35d service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Neutron deleted interface 1133d110-d517-4b72-bbce-faf3064e5946; detaching it from the instance and deleting it from the info cache
May 27 03:04:18.316109 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-41ccc892-e530-4e07-a2f1-5d37a14ceb4f req-071415eb-334d-43f1-8bf8-8f92bde1e35d service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:18.327482 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Cinder extended volume 4169e733-5260-4341-8234-51936e880c3c; extending it to detect new size
May 27 03:04:18.375696 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:04:18.385163 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:18.385284 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:18.385408 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No VIF found with MAC fa:16:3e:4d:21:a6, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:04:18.385834 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Using config drive
May 27 03:04:18.760589 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:18.821797 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-41ccc892-e530-4e07-a2f1-5d37a14ceb4f req-071415eb-334d-43f1-8bf8-8f92bde1e35d service nova] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Detach interface failed, port_id=1133d110-d517-4b72-bbce-faf3064e5946, reason: Instance ca2e5c3f-b9be-4bfb-9858-c22cbb4177da could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:04:18.872274 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] calling os-brick to extend iSCSI Volume {{(pid=98471) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:88}}
May 27 03:04:18.872675 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] ==> extend_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4169e733-5260-4341-8234-51936e880c3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}), 'kwargs': {}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:04:18.872930 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] Acquiring lock "extend_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:18.873406 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] Lock "extend_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:18.873819 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] Extend volume for {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4169e733-5260-4341-8234-51936e880c3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}
May 27 03:04:18.874019 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] Multipath discovery for iSCSI enabled
May 27 03:04:18.874278 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] Found paths for volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c-lun-0']
May 27 03:04:18.874483 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] Checking paths are valid ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c-lun-0'] {{(pid=98471) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:711}}
May 27 03:04:18.892146 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:18.902337 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] extend volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c-lun-0'] {{(pid=98471) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:718}}
May 27 03:04:18.902639 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] Running cmd (subprocess): lsscsi {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:18.952327 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] CMD "lsscsi" returned: 0 in 0.049s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:18.952888 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c-lun-0', 'host': '20', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98471) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 27 03:04:18.953158 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c-lun-0', 'host': '20', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98471) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 27 03:04:18.965583 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] Starting size: 1073741824 {{(pid=98471) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 27 03:04:19.000865 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] volume size after scsi device rescan 2147483648 {{(pid=98471) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 27 03:04:19.001245 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] Running cmd (subprocess): lsscsi {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:19.058466 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] CMD "lsscsi" returned: 0 in 0.057s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:19.059250 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c-lun-0', 'host': '19', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98471) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 27 03:04:19.061091 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c-lun-0', 'host': '19', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98471) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 27 03:04:19.077387 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] Starting size: 1073741824 {{(pid=98471) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 27 03:04:19.094595 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Starting migrate_disk_and_power_off {{(pid=98471) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 27 03:04:19.136897 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] volume size after scsi device rescan 2147483648 {{(pid=98471) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 27 03:04:19.140358 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:19.146345 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Creating config drive at /opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46/disk.config
May 27 03:04:19.154259 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpesiiw3kc {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:19.179529 np0000001475 nova-compute[98471]: INFO os_brick.initiator.linuxscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] Find Multipath device file for volume WWN 3300000001ff038f0
May 27 03:04:19.179529 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] Checking to see if /dev/disk/by-id/dm-uuid-mpath-3300000001ff038f0 exists yet. {{(pid=98471) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:482}}
May 27 03:04:19.179529 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] /dev/disk/by-id/dm-uuid-mpath-3300000001ff038f0 has shown up. {{(pid=98471) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:489}}
May 27 03:04:19.182985 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:19.217042 np0000001475 nova-compute[98471]: INFO os_brick.initiator.linuxscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-3300000001ff038f0) current size 1073741824
May 27 03:04:19.238312 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpesiiw3kc" returned: 0 in 0.084s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:19.263659 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Took 1.54 seconds to deallocate network for instance.
May 27 03:04:19.311134 np0000001475 nova-compute[98471]: INFO os_brick.initiator.linuxscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-3300000001ff038f0) new size 2147483648
May 27 03:04:19.311853 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] Lock "extend_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: held 0.438s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:19.313580 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] <== extend_volume: return (440ms) 2147483648 {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:04:19.313580 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Extend iSCSI Volume: new_size=2147483648 {{(pid=98471) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:90}}
May 27 03:04:19.320368 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [req-57c2d77f-ec41-485a-91c1-9cf4c02d15a8 req-3e79df72-7591-4a5f-8fe8-5b7356987302 service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Resizing target device /dev/dm-8 to 2147483648 {{(pid=98471) _resize_attached_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2945}}
May 27 03:04:19.322768 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:04:19.322768 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:04:19.381898 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:19.397284 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Found WWN SStorPool_iSCSI_DISK_1034578903445798972 for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:04:19.397807 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.075s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:19.399413 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] <== connect_volume: return (4076ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798972', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445798972'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:04:19.399627 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798972', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445798972'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:04:19.402001 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:19.406276 np0000001475 nova-compute[98471]: WARNING stevedore.named [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 03:04:19.406635 np0000001475 nova-compute[98471]: WARNING castellan.key_manager [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:04:19.407015 np0000001475 nova-compute[98471]: WARNING nova.keymgr.conf_key_mgr [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:04:19.434047 np0000001475 nova-compute[98471]: WARNING os_brick.encryptors.luks [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 27 03:04:19.434543 np0000001475 nova-compute[98471]: WARNING stevedore.named [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 03:04:19.434824 np0000001475 nova-compute[98471]: WARNING castellan.key_manager [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:04:19.434884 np0000001475 nova-compute[98471]: WARNING nova.keymgr.conf_key_mgr [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:04:19.435488 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7557246697f0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c98f3ccd-980f-4f76-a069-2cc558e818c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'e17e8031-6811-4553-b8ce-7150f690a4ba', 'attached_at': '', 'detached_at': '', 'volume_id': 'c98f3ccd-980f-4f76-a069-2cc558e818c2', 'serial': 'c98f3ccd-980f-4f76-a069-2cc558e818c2'} {{(pid=98471) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 27 03:04:19.435629 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors.luks [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] formatting encrypted volume /dev/dm-0 {{(pid=98471) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 27 03:04:19.510603 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:19.531007 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:19.664522 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999637983000412 future=<Future at 0x755724739760 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:19.676538 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Instance destroyed successfully.
May 27 03:04:19.677861 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='multiattach-server-1',id=33,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7X60AtOl0SsfuAMV1LtNGpvh0yvi8THxioUm4x62ykVhuM7q4sXRNe3S5fa56OsOiAX0ZbtOowRZ4+AKeGhch21Oc/NUN3hQGbbFxrwclVqtJHRu4HOLbwt9JgM8J0mA==',key_name='tempest-keypair-1333870124',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:02:42Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-ki851fh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:04:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092604511a8a467ba4ecb56261cb531f',uuid=d7f71824-f631-423e-a5ea-8ae72642a95e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "vif_mac": "fa:16:3e:88:48:d5"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:04:19.678183 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "vif_mac": "fa:16:3e:88:48:d5"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:04:19.679432 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:48:d5,bridge_name='br-int',has_traffic_filtering=True,id=57af91c5-42f3-4f9f-ac26-aad2418fdfe3,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57af91c5-42') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:04:19.679634 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:48:d5,bridge_name='br-int',has_traffic_filtering=True,id=57af91c5-42f3-4f9f-ac26-aad2418fdfe3,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57af91c5-42') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:04:19.683372 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:19.683814 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57af91c5-42, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:19.688712 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:19.693650 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:19.696814 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:19.697037 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1f94e43-c58b-448f-b0e9-e5fd6333769e) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:19.703504 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:19.703504 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:19.707472 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:19.711836 np0000001475 nova-compute[98471]: INFO os_vif [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:48:d5,bridge_name='br-int',has_traffic_filtering=True,id=57af91c5-42f3-4f9f-ac26-aad2418fdfe3,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57af91c5-42')
May 27 03:04:19.774757 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:19.830776 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:04:19.927962 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:19.956947 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:19.960574 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:20.078887 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:20.124012 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:20.126395 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:20.285733 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Detected multiple connections on this host for volume: 8cd7c930-2109-4c04-85a8-31ac0ce9341e, skipping target disconnect.
May 27 03:04:20.298514 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:20.343169 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.048s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:20.344459 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:04:20.349395 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.570s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:20.449564 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:20.449564 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:20.509488 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-da7fa1d6-0b69-4c1d-8d9b-863c988a1215 req-136e1590-1fc6-4064-8602-e0e1e7da5ca8 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Received event network-vif-unplugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:20.510123 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-da7fa1d6-0b69-4c1d-8d9b-863c988a1215 req-136e1590-1fc6-4064-8602-e0e1e7da5ca8 service nova] Acquiring lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:20.510657 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-da7fa1d6-0b69-4c1d-8d9b-863c988a1215 req-136e1590-1fc6-4064-8602-e0e1e7da5ca8 service nova] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:20.511349 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-da7fa1d6-0b69-4c1d-8d9b-863c988a1215 req-136e1590-1fc6-4064-8602-e0e1e7da5ca8 service nova] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:20.512559 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-da7fa1d6-0b69-4c1d-8d9b-863c988a1215 req-136e1590-1fc6-4064-8602-e0e1e7da5ca8 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] No waiting events found dispatching network-vif-unplugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:20.513031 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-da7fa1d6-0b69-4c1d-8d9b-863c988a1215 req-136e1590-1fc6-4064-8602-e0e1e7da5ca8 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Received unexpected event network-vif-unplugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 for instance with vm_state active and task_state resize_migrating.
May 27 03:04:20.513031 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-da7fa1d6-0b69-4c1d-8d9b-863c988a1215 req-136e1590-1fc6-4064-8602-e0e1e7da5ca8 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Received event network-vif-unplugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:20.513146 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-da7fa1d6-0b69-4c1d-8d9b-863c988a1215 req-136e1590-1fc6-4064-8602-e0e1e7da5ca8 service nova] Acquiring lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:20.513307 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-da7fa1d6-0b69-4c1d-8d9b-863c988a1215 req-136e1590-1fc6-4064-8602-e0e1e7da5ca8 service nova] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:20.513434 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-da7fa1d6-0b69-4c1d-8d9b-863c988a1215 req-136e1590-1fc6-4064-8602-e0e1e7da5ca8 service nova] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:20.513583 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-da7fa1d6-0b69-4c1d-8d9b-863c988a1215 req-136e1590-1fc6-4064-8602-e0e1e7da5ca8 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] No waiting events found dispatching network-vif-unplugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:20.513711 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-da7fa1d6-0b69-4c1d-8d9b-863c988a1215 req-136e1590-1fc6-4064-8602-e0e1e7da5ca8 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Received unexpected event network-vif-unplugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 for instance with vm_state active and task_state resize_migrating.
May 27 03:04:20.589185 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:20.589466 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:04:20.590124 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e_resize/disk /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:20.729195 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "cp -r /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e_resize/disk /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk" returned: 0 in 0.136s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:20.729195 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e_resize/disk.config /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk.config {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:20.787928 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "cp -r /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e_resize/disk.config /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk.config" returned: 0 in 0.059s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:20.788646 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e_resize/disk.info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk.info {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:20.845759 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "cp -r /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e_resize/disk.info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk.info" returned: 0 in 0.057s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:20.865189 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:04:20.865597 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:04:20.867714 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:20.868060 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:21.083995 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ac80020082f4833a8dc4ee0ce583bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b83450809f534782948c02b2c2eb4a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:04:21.152834 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:21.195398 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Acquiring lock "de33390e-64b1-4034-a1f1-dcc935cf25fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:21.195713 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:21.231571 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851061.2310872, 4ac08a8b-4572-4b1f-8ba0-457c80d58b46 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:04:21.231896 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] VM Started (Lifecycle Event)
May 27 03:04:21.369135 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:04:21.485379 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:21.636373 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:04:21.637179 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:04:21.700123 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Detaching volume 4169e733-5260-4341-8234-51936e880c3c
May 27 03:04:21.736879 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:21.740776 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851061.7383718, 4ac08a8b-4572-4b1f-8ba0-457c80d58b46 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:04:21.740776 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] VM Paused (Lifecycle Event)
May 27 03:04:21.757883 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Attempting to driver detach volume 4169e733-5260-4341-8234-51936e880c3c from mountpoint /dev/vdb
May 27 03:04:21.771354 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Found disk vdb by alias ua-4169e733-5260-4341-8234-51936e880c3c {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:04:21.772738 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Found disk vdb by alias ua-4169e733-5260-4341-8234-51936e880c3c {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:04:21.772908 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Attempting to detach device vdb from instance de33390e-64b1-4034-a1f1-dcc935cf25fd from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:04:21.773222 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:04:21.773222 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:04:21.773222 np0000001475 nova-compute[98471]:   <alias name="ua-4169e733-5260-4341-8234-51936e880c3c"/>
May 27 03:04:21.773222 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-8"/>
May 27 03:04:21.773222 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:04:21.773222 np0000001475 nova-compute[98471]:   <serial>4169e733-5260-4341-8234-51936e880c3c</serial>
May 27 03:04:21.773222 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:04:21.773222 np0000001475 nova-compute[98471]: </disk>
May 27 03:04:21.773222 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:04:21.790847 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Successfully detached device vdb from instance de33390e-64b1-4034-a1f1-dcc935cf25fd from the persistent domain config.
May 27 03:04:21.791346 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] (1/8): Attempting to detach device vdb with device alias ua-4169e733-5260-4341-8234-51936e880c3c from instance de33390e-64b1-4034-a1f1-dcc935cf25fd from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:04:21.793099 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:04:21.793099 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:04:21.793099 np0000001475 nova-compute[98471]:   <alias name="ua-4169e733-5260-4341-8234-51936e880c3c"/>
May 27 03:04:21.793099 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-8"/>
May 27 03:04:21.793099 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:04:21.793099 np0000001475 nova-compute[98471]:   <serial>4169e733-5260-4341-8234-51936e880c3c</serial>
May 27 03:04:21.793099 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:04:21.793099 np0000001475 nova-compute[98471]: </disk>
May 27 03:04:21.793099 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:04:21.873313 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:04:21.923483 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Successfully created port: 01da9f96-a1a2-44ca-939d-56c191f2da2b {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:04:22.055765 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:22.055765 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:22.140204 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:04:22.151016 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Port 57af91c5-42f3-4f9f-ac26-aad2418fdfe3 binding to destination host np0000001475 is already ACTIVE {{(pid=98471) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 27 03:04:22.241574 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:22.244344 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:04:22.379303 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Booting with volume 592d255c-9372-44f5-94d1-e53bae7920d5 at /dev/vda
May 27 03:04:22.410443 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4169e733-5260-4341-8234-51936e880c3c for instance de33390e-64b1-4034-a1f1-dcc935cf25fd {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:04:22.440186 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:04:22.459767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:04:22.489952 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:22.534495 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1666c2fd-626d-42d0-a0b5-61f1c063234c req-e3b697ce-d8f1-456f-b715-3fc3f7e3119d service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Received event network-vif-plugged-7221e6d5-c2ed-469e-bffd-acfd7b6cb950 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:22.535963 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1666c2fd-626d-42d0-a0b5-61f1c063234c req-e3b697ce-d8f1-456f-b715-3fc3f7e3119d service nova] Acquiring lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:22.535963 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1666c2fd-626d-42d0-a0b5-61f1c063234c req-e3b697ce-d8f1-456f-b715-3fc3f7e3119d service nova] Lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:22.535963 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1666c2fd-626d-42d0-a0b5-61f1c063234c req-e3b697ce-d8f1-456f-b715-3fc3f7e3119d service nova] Lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:22.536132 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1666c2fd-626d-42d0-a0b5-61f1c063234c req-e3b697ce-d8f1-456f-b715-3fc3f7e3119d service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Processing event network-vif-plugged-7221e6d5-c2ed-469e-bffd-acfd7b6cb950 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:04:22.537713 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:04:22.549449 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:04:22.553734 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Instance spawned successfully.
May 27 03:04:22.554616 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:04:22.574160 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:04:22.574160 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:04:22.586956 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:04:22.588823 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::c805:4ff:fe3b:2374', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:feb2:aa32', 'fe80::fc16:3eff:fe01:3d37', 'fe80::fc16:3eff:fe2d:76bb', 'fe80::787c:50ff:fed5:a1fc', 'fe80::fc16:3eff:feea:f34f', 'fe80::a407:7bff:fed1:e35a', 'fe80::fc16:3eff:fea2:a080', 'fe80::88ab:28ff:fedb:6e99', 'fe80::fc16:3eff:fe5c:3071', 'fe80::fc16:3eff:fe58:79ce', 'fe80::8cdc:9fff:fe79:9907', 'fe80::fc16:3eff:fe4d:21a6'] 
May 27 03:04:22.588998 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:04:22.589165 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:04:22.589481 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:04:22.589700 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Updating existing volume attachment record: 02b160fe-e632-44dc-beaf-dfd52bada752 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:04:22.652558 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.308s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:22.745014 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Deleted allocations for instance ca2e5c3f-b9be-4bfb-9858-c22cbb4177da
May 27 03:04:22.756147 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:04:22.756954 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851062.756606, de33390e-64b1-4034-a1f1-dcc935cf25fd => ua-4169e733-5260-4341-8234-51936e880c3c> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:04:22.757494 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851062.7572258, 4ac08a8b-4572-4b1f-8ba0-457c80d58b46 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:04:22.757728 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] VM Resumed (Lifecycle Event)
May 27 03:04:22.763395 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Successfully detached device vdb from instance de33390e-64b1-4034-a1f1-dcc935cf25fd from the live domain config.
May 27 03:04:22.765198 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:04:22.765331 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4169e733-5260-4341-8234-51936e880c3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:04:22.765607 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:22.766782 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:22.766782 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4169e733-5260-4341-8234-51936e880c3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:04:22.766782 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:04:22.816058 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:22.816058 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:22.816058 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:22.816058 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:22.816058 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:22.816058 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:22.816058 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:22.816058 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:22.816058 np0000001475 nova-compute[98471]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:22.816058 np0000001475 nova-compute[98471]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:22.816058 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:22.816058 np0000001475 nova-compute[98471]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:22.816058 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:22.816779 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:22.816779 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:22.816779 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:22.816779 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:22.816779 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:22.816779 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:22.816779 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:22.816779 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:22.816779 np0000001475 nova-compute[98471]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:22.816779 np0000001475 nova-compute[98471]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c (non-flash)
May 27 03:04:22.816779 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:22.816779 np0000001475 nova-compute[98471]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:22.816779 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:22.816779 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', '73'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', '75'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', '78')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:04:22.816779 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', '76')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:04:22.818291 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', '75')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:04:22.819170 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c29fe20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c'): ({'sdn'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:04:22.819400 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Removing multipathed devices sdn, sdo {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:04:22.822888 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Flush multipath device 3300000001ff038f0 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:04:22.863721 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:04:22.917309 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:04:22.968829 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:04:22.969256 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:04:22.970927 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:04:22.987134 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:04:22.987430 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:04:23.005347 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:23.052033 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 76, target: iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c, portal: 192.168.40.100,3260]
May 27 03:04:23.052033 np0000001475 nova-compute[98471]: Logout of [sid: 76, target: iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c, portal: 192.168.40.100,3260] successful.
May 27 03:04:23.052033 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:23.069896 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:04:23.070072 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:04:23.070611 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:04:23.070831 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:04:23.071174 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:04:23.071543 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:04:23.086833 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:23.105593 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:23.148886 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 75, target: iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c, portal: 192.168.50.100,3260]
May 27 03:04:23.148886 np0000001475 nova-compute[98471]: Logout of [sid: 75, target: iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c, portal: 192.168.50.100,3260] successful.
May 27 03:04:23.148886 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:23.165216 np0000001475 nova-compute[98471]: DEBUG nova.compute.rpcapi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98471) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 27 03:04:23.180449 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:23.182061 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:23.184404 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:23.184527 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:23.186007 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:23.187370 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] <== disconnect_volume: return (420ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:04:23.187370 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:04:23.221398 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Successfully updated port: 01da9f96-a1a2-44ca-939d-56c191f2da2b {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:04:23.261708 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:23.265534 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:04:23.304021 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f505cf04-d1bb-4c1f-a524-a78c9a17c1a1 req-f6aa2357-a49e-452b-bdaa-d72b5b66589f service nova] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Received event network-changed-01da9f96-a1a2-44ca-939d-56c191f2da2b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:23.304227 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f505cf04-d1bb-4c1f-a524-a78c9a17c1a1 req-f6aa2357-a49e-452b-bdaa-d72b5b66589f service nova] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Refreshing instance network info cache due to event network-changed-01da9f96-a1a2-44ca-939d-56c191f2da2b. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:04:23.304360 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f505cf04-d1bb-4c1f-a524-a78c9a17c1a1 req-f6aa2357-a49e-452b-bdaa-d72b5b66589f service nova] Acquiring lock "refresh_cache-895c7b70-89af-409a-97e5-27733dbea534" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:04:23.304474 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f505cf04-d1bb-4c1f-a524-a78c9a17c1a1 req-f6aa2357-a49e-452b-bdaa-d72b5b66589f service nova] Acquired lock "refresh_cache-895c7b70-89af-409a-97e5-27733dbea534" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:04:23.304587 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f505cf04-d1bb-4c1f-a524-a78c9a17c1a1 req-f6aa2357-a49e-452b-bdaa-d72b5b66589f service nova] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Refreshing network info cache for port 01da9f96-a1a2-44ca-939d-56c191f2da2b {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:04:23.577310 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Took 8.78 seconds to spawn the instance on the hypervisor.
May 27 03:04:23.578935 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:23.725389 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Acquiring lock "refresh_cache-895c7b70-89af-409a-97e5-27733dbea534" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:04:23.763506 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lazy-loading 'flavor' on Instance uuid de33390e-64b1-4034-a1f1-dcc935cf25fd {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:23.767920 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e2a94e03-0422-474f-8343-ac3959d13935 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "ca2e5c3f-b9be-4bfb-9858-c22cbb4177da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.956s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:23.768466 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:04:23.807814 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f505cf04-d1bb-4c1f-a524-a78c9a17c1a1 req-f6aa2357-a49e-452b-bdaa-d72b5b66589f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:23.859408 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:23.870080 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Secret XML: <secret ephemeral="no" private="no">
May 27 03:04:23.870080 np0000001475 nova-compute[98471]:   <usage type="volume">
May 27 03:04:23.870080 np0000001475 nova-compute[98471]:     <volume>c98f3ccd-980f-4f76-a069-2cc558e818c2</volume>
May 27 03:04:23.870080 np0000001475 nova-compute[98471]:   </usage>
May 27 03:04:23.870080 np0000001475 nova-compute[98471]: </secret>
May 27 03:04:23.870080 np0000001475 nova-compute[98471]:  {{(pid=98471) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 27 03:04:23.883306 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lazy-loading 'flavor' on Instance uuid e17e8031-6811-4553-b8ce-7150f690a4ba {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:23.919139 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f505cf04-d1bb-4c1f-a524-a78c9a17c1a1 req-f6aa2357-a49e-452b-bdaa-d72b5b66589f service nova] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:04:24.082345 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f505cf04-d1bb-4c1f-a524-a78c9a17c1a1 req-f6aa2357-a49e-452b-bdaa-d72b5b66589f service nova] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:24.094400 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Took 15.85 seconds to build instance.
May 27 03:04:24.204288 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:24.328316 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:04:24.328852 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquired lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:04:24.330052 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:04:24.389889 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Attempting to attach volume c98f3ccd-980f-4f76-a069-2cc558e818c2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:04:24.391882 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:04:24.391882 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:04:24.391882 np0000001475 nova-compute[98471]:   <alias name="ua-c98f3ccd-980f-4f76-a069-2cc558e818c2"/>
May 27 03:04:24.391882 np0000001475 nova-compute[98471]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 27 03:04:24.391882 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:04:24.391882 np0000001475 nova-compute[98471]:   <serial>c98f3ccd-980f-4f76-a069-2cc558e818c2</serial>
May 27 03:04:24.391882 np0000001475 nova-compute[98471]:   <encryption format="luks">
May 27 03:04:24.391882 np0000001475 nova-compute[98471]:     <secret type="passphrase" uuid="1f71b548-d23b-4b32-93f3-61afe1e034b3"/>
May 27 03:04:24.391882 np0000001475 nova-compute[98471]:   </encryption>
May 27 03:04:24.391882 np0000001475 nova-compute[98471]: </disk>
May 27 03:04:24.391882 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:04:24.526246 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Acquiring lock "de33390e-64b1-4034-a1f1-dcc935cf25fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:24.584538 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f505cf04-d1bb-4c1f-a524-a78c9a17c1a1 req-f6aa2357-a49e-452b-bdaa-d72b5b66589f service nova] Releasing lock "refresh_cache-895c7b70-89af-409a-97e5-27733dbea534" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:04:24.584887 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Acquired lock "refresh_cache-895c7b70-89af-409a-97e5-27733dbea534" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:04:24.585222 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:04:24.596556 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4e3e989-e2e7-4548-87d5-2502d8031bcd tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.365s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:24.607394 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e49c1f98-9a0c-4568-9ad3-8c4121bb63d2 req-804094ec-b3dc-4eb0-9709-5f4e319004d7 service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Received event network-vif-plugged-7221e6d5-c2ed-469e-bffd-acfd7b6cb950 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:24.607646 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e49c1f98-9a0c-4568-9ad3-8c4121bb63d2 req-804094ec-b3dc-4eb0-9709-5f4e319004d7 service nova] Acquiring lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:24.607883 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e49c1f98-9a0c-4568-9ad3-8c4121bb63d2 req-804094ec-b3dc-4eb0-9709-5f4e319004d7 service nova] Lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:24.608069 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e49c1f98-9a0c-4568-9ad3-8c4121bb63d2 req-804094ec-b3dc-4eb0-9709-5f4e319004d7 service nova] Lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:24.609254 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e49c1f98-9a0c-4568-9ad3-8c4121bb63d2 req-804094ec-b3dc-4eb0-9709-5f4e319004d7 service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] No waiting events found dispatching network-vif-plugged-7221e6d5-c2ed-469e-bffd-acfd7b6cb950 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:24.609612 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-e49c1f98-9a0c-4568-9ad3-8c4121bb63d2 req-804094ec-b3dc-4eb0-9709-5f4e319004d7 service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Received unexpected event network-vif-plugged-7221e6d5-c2ed-469e-bffd-acfd7b6cb950 for instance with vm_state active and task_state None.
May 27 03:04:24.697776 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:24.749617 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:04:24.750612 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:04:24.750893 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Creating image(s)
May 27 03:04:24.751384 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:04:24.751598 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Ensure instance console log exists: /opt/stack/data/nova/instances/895c7b70-89af-409a-97e5-27733dbea534/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:04:24.751977 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:24.752047 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:24.752267 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:24.778685 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ea18f525-bc53-4a8f-b093-ca34a28a94b6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.583s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:24.779906 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.253s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:24.780173 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Acquiring lock "de33390e-64b1-4034-a1f1-dcc935cf25fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:24.780358 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:24.780498 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:24.784348 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Terminating instance
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c1fc669f-3763-446a-9462-adbc830cb3ca req-203d1c0e-64d1-4ac8-be3a-8d95400e93c3 service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Received event network-changed-7221e6d5-c2ed-469e-bffd-acfd7b6cb950 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c1fc669f-3763-446a-9462-adbc830cb3ca req-203d1c0e-64d1-4ac8-be3a-8d95400e93c3 service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Refreshing instance network info cache due to event network-changed-7221e6d5-c2ed-469e-bffd-acfd7b6cb950. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c1fc669f-3763-446a-9462-adbc830cb3ca req-203d1c0e-64d1-4ac8-be3a-8d95400e93c3 service nova] Acquiring lock "refresh_cache-4ac08a8b-4572-4b1f-8ba0-457c80d58b46" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c1fc669f-3763-446a-9462-adbc830cb3ca req-203d1c0e-64d1-4ac8-be3a-8d95400e93c3 service nova] Acquired lock "refresh_cache-4ac08a8b-4572-4b1f-8ba0-457c80d58b46" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c1fc669f-3763-446a-9462-adbc830cb3ca req-203d1c0e-64d1-4ac8-be3a-8d95400e93c3 service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Refreshing network info cache for port 7221e6d5-c2ed-469e-bffd-acfd7b6cb950 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Updating instance_info_cache with network_info: [{"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Updating instance_info_cache with network_info: [{"id": "01da9f96-a1a2-44ca-939d-56c191f2da2b", "address": "fa:16:3e:2c:94:b4", "network": {"id": "c3e308a2-5e87-43a2-ab60-37f9737a84ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba717c80697f454cbbe062e8cd8e5989", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01da9f96-a1", "ovs_interfaceid": "01da9f96-a1a2-44ca-939d-56c191f2da2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c1fc669f-3763-446a-9462-adbc830cb3ca req-203d1c0e-64d1-4ac8-be3a-8d95400e93c3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999730537000232 future=<Future at 0x7557046ab7a0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Instance destroyed successfully.
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lazy-loading 'resources' on Instance uuid de33390e-64b1-4034-a1f1-dcc935cf25fd {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1d52935b-97a7-4ac2-8a09-2a421a940be7 req-0f6e5437-346f-4e6e-95e5-bf678a43985d service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Received event network-vif-unplugged-c87aaa49-f608-4ea5-ae24-f72634311e87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1d52935b-97a7-4ac2-8a09-2a421a940be7 req-0f6e5437-346f-4e6e-95e5-bf678a43985d service nova] Acquiring lock "de33390e-64b1-4034-a1f1-dcc935cf25fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1d52935b-97a7-4ac2-8a09-2a421a940be7 req-0f6e5437-346f-4e6e-95e5-bf678a43985d service nova] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1d52935b-97a7-4ac2-8a09-2a421a940be7 req-0f6e5437-346f-4e6e-95e5-bf678a43985d service nova] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1d52935b-97a7-4ac2-8a09-2a421a940be7 req-0f6e5437-346f-4e6e-95e5-bf678a43985d service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] No waiting events found dispatching network-vif-unplugged-c87aaa49-f608-4ea5-ae24-f72634311e87 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:25.826804 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1d52935b-97a7-4ac2-8a09-2a421a940be7 req-0f6e5437-346f-4e6e-95e5-bf678a43985d service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Received event network-vif-unplugged-c87aaa49-f608-4ea5-ae24-f72634311e87 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:04:26.062068 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Releasing lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:04:26.146145 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c1fc669f-3763-446a-9462-adbc830cb3ca req-203d1c0e-64d1-4ac8-be3a-8d95400e93c3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:26.155984 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:26.167103 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Releasing lock "refresh_cache-895c7b70-89af-409a-97e5-27733dbea534" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:04:26.167424 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Instance network_info: |[{"id": "01da9f96-a1a2-44ca-939d-56c191f2da2b", "address": "fa:16:3e:2c:94:b4", "network": {"id": "c3e308a2-5e87-43a2-ab60-37f9737a84ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba717c80697f454cbbe062e8cd8e5989", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01da9f96-a1", "ovs_interfaceid": "01da9f96-a1a2-44ca-939d-56c191f2da2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:04:26.168129 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Start _get_guest_xml network_info=[{"id": "01da9f96-a1a2-44ca-939d-56c191f2da2b", "address": "fa:16:3e:2c:94:b4", "network": {"id": "c3e308a2-5e87-43a2-ab60-37f9737a84ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba717c80697f454cbbe062e8cd8e5989", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01da9f96-a1", "ovs_interfaceid": "01da9f96-a1a2-44ca-939d-56c191f2da2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '592d255c-9372-44f5-94d1-e53bae7920d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '895c7b70-89af-409a-97e5-27733dbea534', 'attached_at': '', 'detached_at': '', 'volume_id': '592d255c-9372-44f5-94d1-e53bae7920d5', 'serial': '592d255c-9372-44f5-94d1-e53bae7920d5'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '02b160fe-e632-44dc-beaf-dfd52bada752', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:04:26.171888 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:04:26.172963 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='instance-depend-image', uuid='895c7b70-89af-409a-97e5-27733dbea534'), owner=OwnerMeta(userid='7ac80020082f4833a8dc4ee0ce583bd0', username='tempest-ImageDependencyTests-212220980-project-member', projectid='b83450809f534782948c02b2c2eb4a75', projectname='tempest-ImageDependencyTests-212220980'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "01da9f96-a1a2-44ca-939d-56c191f2da2b", "address": "fa:16:3e:2c:94:b4", "network": {"id": "c3e308a2-5e87-43a2-ab60-37f9737a84ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba717c80697f454cbbe062e8cd8e5989", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01da9f96-a1", "ovs_interfaceid": "01da9f96-a1a2-44ca-939d-56c191f2da2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851066.1726096) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:04:26.174008 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:04:26.174405 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:04:26.176081 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:04:26.176338 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:04:26.177318 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:04:26.177701 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:04:26.177830 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:04:26.177830 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:04:26.177956 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:04:26.179859 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:04:26.179859 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:04:26.179859 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:04:26.179859 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:04:26.179859 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:04:26.179859 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:04:26.179859 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:04:26.191720 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:04:26.191720 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '592d255c-9372-44f5-94d1-e53bae7920d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:04:26.191720 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:26.191720 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:26.191720 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '592d255c-9372-44f5-94d1-e53bae7920d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:04:26.191720 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1508426012',display_name='tempest-VolumesExtendAttachedTest-instance-1508426012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesextendattachedtest-instance-1508426012',id=36,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6KN9Rj63+8v0EzE3wHaWCV/BPqAOZ7k4+62hMSd1VVnupfGRHRL7/1Luk0K8JHLVcfEwK3/KakPNxxoJM2eNQ3ZacOej9n2nyf05wkTrACHzq0SPPCM6kyaYPdSSu5zA==',key_name='tempest-keypair-975408864',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:03:25Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23965b01217144d29b9cc5ef0d064a47',ramdisk_id='',reservation_id='r-diocpn6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesExtendAttachedTest-1858923834',owner_user_name='tempest-VolumesExtendAttachedTest-1858923834-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:03:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e79920811e0436ab5cc75631e778110',uuid=de33390e-64b1-4034-a1f1-dcc935cf25fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c87aaa49-f608-4ea5-ae24-f72634311e87", "address": "fa:16:3e:ea:f3:4f", "network": {"id": "9248ef89-2536-49ef-91a8-4cc5e166006b", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1769250526-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23965b01217144d29b9cc5ef0d064a47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87aaa49-f6", "ovs_interfaceid": "c87aaa49-f608-4ea5-ae24-f72634311e87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:04:26.191720 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Converting VIF {"id": "c87aaa49-f608-4ea5-ae24-f72634311e87", "address": "fa:16:3e:ea:f3:4f", "network": {"id": "9248ef89-2536-49ef-91a8-4cc5e166006b", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1769250526-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23965b01217144d29b9cc5ef0d064a47", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc87aaa49-f6", "ovs_interfaceid": "c87aaa49-f608-4ea5-ae24-f72634311e87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:04:26.191720 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:f3:4f,bridge_name='br-int',has_traffic_filtering=True,id=c87aaa49-f608-4ea5-ae24-f72634311e87,network=Network(9248ef89-2536-49ef-91a8-4cc5e166006b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc87aaa49-f6') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:04:26.191720 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:f3:4f,bridge_name='br-int',has_traffic_filtering=True,id=c87aaa49-f608-4ea5-ae24-f72634311e87,network=Network(9248ef89-2536-49ef-91a8-4cc5e166006b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc87aaa49-f6') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:04:26.195363 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:26.195621 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc87aaa49-f6, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:26.200533 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:26.202092 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:26.202285 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0685b132-8a7f-4570-b6c4-63a533d02412) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:26.203634 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:26.204498 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:26.208586 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:26.209083 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:26.209458 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:04:26.209837 np0000001475 nova-compute[98471]: INFO os_vif [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:f3:4f,bridge_name='br-int',has_traffic_filtering=True,id=c87aaa49-f608-4ea5-ae24-f72634311e87,network=Network(9248ef89-2536-49ef-91a8-4cc5e166006b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc87aaa49-f6')
May 27 03:04:26.210878 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:26.211646 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:26.212129 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:04:26.212438 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:04:26.212757 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4169e733-5260-4341-8234-51936e880c3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:04:26.212879 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:26.224066 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:04:26.224066 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:26.233563 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:04:26.233563 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:26.250606 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5] added
May 27 03:04:26.250606 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:04:26.250606 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:04:26.250606 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:04:26.250606 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:04:26.250606 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:04:26.250606 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:26.250854 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:04:26.251359 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.042(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:04:26.251532 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:04:26.252308 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5] added
May 27 03:04:26.252308 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:04:26.252308 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:04:26.252308 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:04:26.252308 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:04:26.252308 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:04:26.252308 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:26.252520 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:04:26.252818 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0409(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:04:26.253045 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:04:26.330698 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c1fc669f-3763-446a-9462-adbc830cb3ca req-203d1c0e-64d1-4ac8-be3a-8d95400e93c3 service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Updated VIF entry in instance network info cache for port 7221e6d5-c2ed-469e-bffd-acfd7b6cb950. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:04:26.331043 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c1fc669f-3763-446a-9462-adbc830cb3ca req-203d1c0e-64d1-4ac8-be3a-8d95400e93c3 service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Updating instance_info_cache with network_info: [{"id": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "address": "fa:16:3e:4d:21:a6", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221e6d5-c2", "ovs_interfaceid": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:26.576573 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:04:26.590944 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:04:26.622229 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:26.677307 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:04:26.677307 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:04:26.691205 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:04:26.695063 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::c805:4ff:fe3b:2374', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:feb2:aa32', 'fe80::fc16:3eff:fe01:3d37', 'fe80::fc16:3eff:fe2d:76bb', 'fe80::787c:50ff:fed5:a1fc', 'fe80::fc16:3eff:fea2:a080', 'fe80::88ab:28ff:fedb:6e99', 'fe80::fc16:3eff:fe5c:3071', 'fe80::fc16:3eff:fe58:79ce', 'fe80::8cdc:9fff:fe79:9907', 'fe80::fc16:3eff:fe4d:21a6'] 
May 27 03:04:26.695275 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:04:26.695649 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:04:26.695649 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:04:26.836761 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c1fc669f-3763-446a-9462-adbc830cb3ca req-203d1c0e-64d1-4ac8-be3a-8d95400e93c3 service nova] Releasing lock "refresh_cache-4ac08a8b-4572-4b1f-8ba0-457c80d58b46" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:04:26.871247 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:26.871440 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:26.871606 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:26.871787 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No VIF found with MAC fa:16:3e:a2:a0:80, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:04:27.252158 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:04:27.255548 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:04:27.267657 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:04:27.267657 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:04:27.278571 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:04:27.278571 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:27.283511 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:27.290734 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:27.308822 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:27.308822 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:27.308822 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:27.308822 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:27.308822 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:27.308822 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:27.308822 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:27.308822 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:27.308822 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:27.308822 np0000001475 nova-compute[98471]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:27.308822 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:27.310322 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:27.310322 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:27.310322 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:27.310322 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:27.310322 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:27.310322 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:27.310322 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:27.310322 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:27.310322 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:27.310322 np0000001475 nova-compute[98471]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:27.310322 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:27.320732 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:27.320732 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:27.320732 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:27.320732 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:27.320732 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:27.320732 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:27.320732 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:27.320732 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:27.320732 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:27.320732 np0000001475 nova-compute[98471]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:27.320732 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:27.321191 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:27.321191 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:27.321191 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:27.321191 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:27.321191 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:27.321191 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:27.321191 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:27.321191 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:27.321191 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:27.321191 np0000001475 nova-compute[98471]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:27.321191 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:27.368307 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5, portal: 192.168.40.100,3260]
May 27 03:04:27.368307 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5, portal: 192.168.40.100,3260] successful.
May 27 03:04:27.368307 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:27.386593 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:27.393577 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5, portal: 192.168.50.100,3260]
May 27 03:04:27.393577 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5, portal: 192.168.50.100,3260] successful.
May 27 03:04:27.393577 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:27.407689 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:27.416197 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:27.416197 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:27.416197 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:27.416197 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:27.416197 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:27.416197 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:27.416197 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:27.416197 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:27.416197 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:27.416197 np0000001475 nova-compute[98471]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:27.416197 np0000001475 nova-compute[98471]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:27.416197 np0000001475 nova-compute[98471]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:27.416197 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:27.416646 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:27.416646 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:27.416646 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:27.416646 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:27.416646 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:27.416646 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:27.416646 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:27.416646 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:27.416646 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:27.416646 np0000001475 nova-compute[98471]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:27.416646 np0000001475 nova-compute[98471]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:27.416646 np0000001475 nova-compute[98471]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:27.416646 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:27.417034 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.208s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:27.417114 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:04:27.418934 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] HCTL ('17', '-', '-', 0) found on session 79 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:04:27.419087 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:04:27.430861 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:27.430861 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:27.430861 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:27.430861 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:27.430861 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:27.430861 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:27.430861 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:27.430861 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:27.430861 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:27.430861 np0000001475 nova-compute[98471]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:27.430861 np0000001475 nova-compute[98471]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:27.430861 np0000001475 nova-compute[98471]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:27.430861 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:27.431233 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:27.431233 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:27.431233 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:27.431233 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:27.431233 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:27.431233 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:27.431233 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:27.431233 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:27.431233 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:27.431233 np0000001475 nova-compute[98471]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:27.431233 np0000001475 nova-compute[98471]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:27.431233 np0000001475 nova-compute[98471]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:27.431233 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:27.431621 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.220s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:27.431816 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:04:27.438041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] HCTL ('18', '-', '-', 0) found on session 80 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:04:27.438041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:04:27.443666 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Searching for a device in session 79 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:04:27.444613 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '592d255c-9372-44f5-94d1-e53bae7920d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:04:27.457929 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Searching for a device in session 80 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:04:27.457929 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '592d255c-9372-44f5-94d1-e53bae7920d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:04:27.675604 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "66b799ed-716a-4b29-8125-bac73213f2cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:27.676072 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "66b799ed-716a-4b29-8125-bac73213f2cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:27.676247 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:27.676300 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:27.676444 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:27.680402 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Terminating instance
May 27 03:04:27.799460 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-49086cac-7d3a-404f-8c67-6e7c62e61c75 req-ae789f1d-98b9-4159-8051-a6faee96ec6c service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Received event network-vif-unplugged-c87aaa49-f608-4ea5-ae24-f72634311e87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:27.799460 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-49086cac-7d3a-404f-8c67-6e7c62e61c75 req-ae789f1d-98b9-4159-8051-a6faee96ec6c service nova] Acquiring lock "de33390e-64b1-4034-a1f1-dcc935cf25fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:27.801579 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-49086cac-7d3a-404f-8c67-6e7c62e61c75 req-ae789f1d-98b9-4159-8051-a6faee96ec6c service nova] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:27.801579 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-49086cac-7d3a-404f-8c67-6e7c62e61c75 req-ae789f1d-98b9-4159-8051-a6faee96ec6c service nova] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:27.801579 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-49086cac-7d3a-404f-8c67-6e7c62e61c75 req-ae789f1d-98b9-4159-8051-a6faee96ec6c service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] No waiting events found dispatching network-vif-unplugged-c87aaa49-f608-4ea5-ae24-f72634311e87 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:27.802816 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-49086cac-7d3a-404f-8c67-6e7c62e61c75 req-ae789f1d-98b9-4159-8051-a6faee96ec6c service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Received event network-vif-unplugged-c87aaa49-f608-4ea5-ae24-f72634311e87 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:04:27.912294 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Starting finish_migration {{(pid=98471) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 27 03:04:27.914548 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Instance directory exists: not creating {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 27 03:04:27.914548 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Creating image(s)
May 27 03:04:27.915971 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:28.018619 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.102s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:28.019174 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:04:28.019603 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:28.129613 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:28.131016 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Cannot resize image /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:04:28.184015 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:04:28.212372 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:04:28.213083 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:28.216511 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:28.241762 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:28.447281 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:28.453529 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:28.461234 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-35ac054b-18d9-40f3-8c6f-7ff9cad145f9 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.910s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:28.581647 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999467415000254 future=<Future at 0x75572471cb30 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:28.584420 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Instance destroyed successfully.
May 27 03:04:28.585215 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'resources' on Instance uuid 66b799ed-716a-4b29-8125-bac73213f2cf {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:28.635174 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:04:28.635441 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Ensure instance console log exists: /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:04:28.636041 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:28.636041 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:28.636213 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:28.640021 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Start _get_guest_xml network_info=[{"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "vif_mac": "fa:16:3e:88:48:d5"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'd7f71824-f631-423e-a5ea-8ae72642a95e', 'attached_at': '2026-05-27T03:04:27.000000', 'detached_at': '', 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'multiattach': True, 'serial': '8cd7c930-2109-4c04-85a8-31ac0ce9341e'}, 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '56883b09-f2ba-4a56-9240-c1be92ae16bf', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:04:28.644647 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:04:28.646997 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='d7f71824-f631-423e-a5ea-8ae72642a95e'), owner=OwnerMeta(userid='092604511a8a467ba4ecb56261cb531f', username='tempest-AttachVolumeMultiAttachTest-774919822-project-member', projectid='a9c48d6919e8435f876f3324616521ea', projectname='tempest-AttachVolumeMultiAttachTest-774919822'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "vif_mac": "fa:16:3e:88:48:d5"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851068.6460505) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:04:28.649836 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:04:28.650362 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:04:28.652390 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:04:28.652624 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:04:28.654176 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:04:28.655006 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:04:28.655171 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:04:28.655624 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:04:28.655725 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:04:28.656067 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:04:28.656067 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:04:28.656293 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:04:28.656448 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:04:28.656615 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:04:28.656785 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:04:28.656969 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:04:28.681033 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk.config --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:28.789997 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk.config --force-share --output=json" returned: 0 in 0.108s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:28.790661 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:28.791052 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "/opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:28.791958 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "/opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:28.792484 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:04:28.793031 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:04:28.793366 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:28.940684 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "e17e8031-6811-4553-b8ce-7150f690a4ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:28.941163 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:29.088613 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:00:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-804870695',display_name='tempest-ServerRescueNegativeTestJSON-server-804870695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverrescuenegativetestjson-server-804870695',id=21,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:01:31Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39cbbdb9012c4992865d4f89678ef9ac',ramdisk_id='',reservation_id='r-9du7vlyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-62027498',owner_user_name='tempest-ServerRescueNegativeTestJSON-62027498-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:01:32Z,user_data=None,user_id='b438796ed5e44f629535db767fe2b756',uuid=66b799ed-716a-4b29-8125-bac73213f2cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "address": "fa:16:3e:b2:aa:32", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6bdedc-0c", "ovs_interfaceid": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:04:29.088884 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converting VIF {"id": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "address": "fa:16:3e:b2:aa:32", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe6bdedc-0c", "ovs_interfaceid": "fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:04:29.090076 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:aa:32,bridge_name='br-int',has_traffic_filtering=True,id=fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6bdedc-0c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:04:29.090353 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:aa:32,bridge_name='br-int',has_traffic_filtering=True,id=fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6bdedc-0c') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:04:29.091977 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:29.092373 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe6bdedc-0c, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:29.094862 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:29.096086 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:29.096566 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:29.099721 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:29.099922 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19a2af4a-b8b2-4a87-bd13-fceb44077825) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:29.100632 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:29.101288 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:29.102085 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:29.104548 np0000001475 nova-compute[98471]: INFO os_vif [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:aa:32,bridge_name='br-int',has_traffic_filtering=True,id=fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe6bdedc-0c')
May 27 03:04:29.104989 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Deleting instance files /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf_del
May 27 03:04:29.106397 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Deletion of /opt/stack/data/nova/instances/66b799ed-716a-4b29-8125-bac73213f2cf_del complete
May 27 03:04:29.214853 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-dd8bcdc9-ac01-45c7-a2fe-22ef389cb626 req-3f4fdd73-76c6-4aaf-92e5-0c27d0245fb4 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received event network-vif-unplugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:29.214853 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-dd8bcdc9-ac01-45c7-a2fe-22ef389cb626 req-3f4fdd73-76c6-4aaf-92e5-0c27d0245fb4 service nova] Acquiring lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:29.214992 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-dd8bcdc9-ac01-45c7-a2fe-22ef389cb626 req-3f4fdd73-76c6-4aaf-92e5-0c27d0245fb4 service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:29.215055 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-dd8bcdc9-ac01-45c7-a2fe-22ef389cb626 req-3f4fdd73-76c6-4aaf-92e5-0c27d0245fb4 service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:29.217408 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-dd8bcdc9-ac01-45c7-a2fe-22ef389cb626 req-3f4fdd73-76c6-4aaf-92e5-0c27d0245fb4 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] No waiting events found dispatching network-vif-unplugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:29.217543 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-dd8bcdc9-ac01-45c7-a2fe-22ef389cb626 req-3f4fdd73-76c6-4aaf-92e5-0c27d0245fb4 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received event network-vif-unplugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:04:29.232482 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Found WWN 3300000007068074f for multipath device dm-7 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:04:29.232881 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:29.233071 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '3300000007068074f', 'path': '/dev/dm-7', 'multipath_id': '3300000007068074f'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:04:29.233211 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007068074f', 'path': '/dev/dm-7', 'multipath_id': '3300000007068074f'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:04:29.234715 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.022s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:29.235234 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4169e733-5260-4341-8234-51936e880c3c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:04:29.237110 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:29.276467 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:29.277310 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', '73'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', '74'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', '80')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:04:29.277310 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c, 0): [] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:04:29.277310 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c') {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 03:04:29.277310 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c, 0): [] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:04:29.277310 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4169e733-5260-4341-8234-51936e880c3c') {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 03:04:29.277310 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572473fce0>, {}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:04:29.277310 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Disconnecting from: [] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:04:29.277638 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.043s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:29.277638 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] <== disconnect_volume: return (3064ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:04:29.277708 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:04:29.278127 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Deleting instance files /opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd_del
May 27 03:04:29.278684 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.485s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:29.279114 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:04:29.281991 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Deletion of /opt/stack/data/nova/instances/de33390e-64b1-4034-a1f1-dcc935cf25fd_del complete
May 27 03:04:29.300281 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:29.301390 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:29.303893 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:29.304274 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:04:29.304916 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:29.305655 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.startup = automatic
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.scan = manual
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:04:29.326060 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:04:29.326060 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.startup = automatic
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.scan = manual
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:04:29.328047 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:04:29.328047 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:29.343008 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:29.354374 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:29.370555 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:29.370555 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:29.370555 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:29.370555 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:29.370555 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:29.370555 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:29.370555 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:29.370555 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:29.370555 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:29.370555 np0000001475 nova-compute[98471]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:29.370555 np0000001475 nova-compute[98471]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:29.370555 np0000001475 nova-compute[98471]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:29.370555 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:29.371012 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:29.371012 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:29.371012 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:29.371012 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:29.371012 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:29.371012 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:29.371012 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:29.371012 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:29.371012 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:29.371012 np0000001475 nova-compute[98471]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:29.371012 np0000001475 nova-compute[98471]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:29.371012 np0000001475 nova-compute[98471]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:29.371012 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:29.371012 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.067s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:29.371516 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:04:29.372680 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] HCTL ('13', '0', '0', 0) found on session 61 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:04:29.372680 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:04:29.382680 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching for a device in session 61 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:29.384193 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:29.385330 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.080s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:29.385330 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:04:29.385399 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] HCTL ('14', '0', '0', 0) found on session 62 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:04:29.385960 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:04:29.404048 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching for a device in session 62 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:04:29.404447 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:04:29.444873 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Detaching volume c98f3ccd-980f-4f76-a069-2cc558e818c2
May 27 03:04:29.513514 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Attempting to driver detach volume c98f3ccd-980f-4f76-a069-2cc558e818c2 from mountpoint /dev/vdb
May 27 03:04:29.563814 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c98f3ccd-980f-4f76-a069-2cc558e818c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'e17e8031-6811-4553-b8ce-7150f690a4ba', 'attached_at': '', 'detached_at': '', 'volume_id': 'c98f3ccd-980f-4f76-a069-2cc558e818c2', 'serial': 'c98f3ccd-980f-4f76-a069-2cc558e818c2'} {{(pid=98471) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 03:04:29.568677 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Found disk vdb by alias ua-c98f3ccd-980f-4f76-a069-2cc558e818c2 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:04:29.571064 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Found disk vdb by alias ua-c98f3ccd-980f-4f76-a069-2cc558e818c2 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:04:29.571245 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Attempting to detach device vdb from instance e17e8031-6811-4553-b8ce-7150f690a4ba from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:04:29.572262 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:04:29.572262 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:04:29.572262 np0000001475 nova-compute[98471]:   <alias name="ua-c98f3ccd-980f-4f76-a069-2cc558e818c2"/>
May 27 03:04:29.572262 np0000001475 nova-compute[98471]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 27 03:04:29.572262 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:04:29.572262 np0000001475 nova-compute[98471]:   <serial>c98f3ccd-980f-4f76-a069-2cc558e818c2</serial>
May 27 03:04:29.572262 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:04:29.572262 np0000001475 nova-compute[98471]:   <encryption format="luks">
May 27 03:04:29.572262 np0000001475 nova-compute[98471]:     <secret type="passphrase" uuid="1f71b548-d23b-4b32-93f3-61afe1e034b3"/>
May 27 03:04:29.572262 np0000001475 nova-compute[98471]:   </encryption>
May 27 03:04:29.572262 np0000001475 nova-compute[98471]: </disk>
May 27 03:04:29.572262 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:04:29.582102 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Successfully detached device vdb from instance e17e8031-6811-4553-b8ce-7150f690a4ba from the persistent domain config.
May 27 03:04:29.582666 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] (1/8): Attempting to detach device vdb with device alias ua-c98f3ccd-980f-4f76-a069-2cc558e818c2 from instance e17e8031-6811-4553-b8ce-7150f690a4ba from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:04:29.583006 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:04:29.583006 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:04:29.583006 np0000001475 nova-compute[98471]:   <alias name="ua-c98f3ccd-980f-4f76-a069-2cc558e818c2"/>
May 27 03:04:29.583006 np0000001475 nova-compute[98471]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 27 03:04:29.583006 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:04:29.583006 np0000001475 nova-compute[98471]:   <serial>c98f3ccd-980f-4f76-a069-2cc558e818c2</serial>
May 27 03:04:29.583006 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:04:29.583006 np0000001475 nova-compute[98471]:   <encryption format="luks">
May 27 03:04:29.583006 np0000001475 nova-compute[98471]:     <secret type="passphrase" uuid="1f71b548-d23b-4b32-93f3-61afe1e034b3"/>
May 27 03:04:29.583006 np0000001475 nova-compute[98471]:   </encryption>
May 27 03:04:29.583006 np0000001475 nova-compute[98471]: </disk>
May 27 03:04:29.583006 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:04:29.619575 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Took 1.44 seconds to destroy the instance on the hypervisor.
May 27 03:04:29.620613 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:04:29.623768 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:04:29.623768 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:04:29.623768 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:29.742669 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='instance-depend-image',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b83450809f534782948c02b2c2eb4a75',ramdisk_id='',reservation_id='r-9gd1zekv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-212220980',owner_user_name='tempest-ImageDependencyTests-212220980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:04:22Z,user_data=None,user_id='7ac80020082f4833a8dc4ee0ce583bd0',uuid=895c7b70-89af-409a-97e5-27733dbea534,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01da9f96-a1a2-44ca-939d-56c191f2da2b", "address": "fa:16:3e:2c:94:b4", "network": {"id": "c3e308a2-5e87-43a2-ab60-37f9737a84ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba717c80697f454cbbe062e8cd8e5989", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01da9f96-a1", "ovs_interfaceid": "01da9f96-a1a2-44ca-939d-56c191f2da2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:04:29.742865 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Converting VIF {"id": "01da9f96-a1a2-44ca-939d-56c191f2da2b", "address": "fa:16:3e:2c:94:b4", "network": {"id": "c3e308a2-5e87-43a2-ab60-37f9737a84ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba717c80697f454cbbe062e8cd8e5989", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01da9f96-a1", "ovs_interfaceid": "01da9f96-a1a2-44ca-939d-56c191f2da2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:04:29.743572 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:94:b4,bridge_name='br-int',has_traffic_filtering=True,id=01da9f96-a1a2-44ca-939d-56c191f2da2b,network=Network(c3e308a2-5e87-43a2-ab60-37f9737a84ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01da9f96-a1') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:04:29.744797 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lazy-loading 'pci_devices' on Instance uuid 895c7b70-89af-409a-97e5-27733dbea534 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:29.753039 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:29.795295 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Took 4.50 seconds to destroy the instance on the hypervisor.
May 27 03:04:29.796467 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:04:29.796980 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:04:29.796980 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:04:29.797361 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:29.938568 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:30.122390 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fb067de8-a528-4861-a8b8-a18e9777212e req-f6423361-87fc-4778-be17-1e71cd6f2330 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received event network-vif-deleted-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:30.123041 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-fb067de8-a528-4861-a8b8-a18e9777212e req-f6423361-87fc-4778-be17-1e71cd6f2330 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Neutron deleted interface fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2; detaching it from the instance and deleting it from the info cache
May 27 03:04:30.123041 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-fb067de8-a528-4861-a8b8-a18e9777212e req-f6423361-87fc-4778-be17-1e71cd6f2330 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:30.242472 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851070.2420108, e17e8031-6811-4553-b8ce-7150f690a4ba => ua-c98f3ccd-980f-4f76-a069-2cc558e818c2> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:04:30.244061 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c98f3ccd-980f-4f76-a069-2cc558e818c2 for instance e17e8031-6811-4553-b8ce-7150f690a4ba {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:04:30.246710 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Successfully detached device vdb from instance e17e8031-6811-4553-b8ce-7150f690a4ba from the live domain config.
May 27 03:04:30.247977 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] End _get_guest_xml xml=<domain type="qemu">
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:   <uuid>895c7b70-89af-409a-97e5-27733dbea534</uuid>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:   <name>instance-00000027</name>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <nova:name>instance-depend-image</nova:name>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:04:26</nova:creationTime>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:         <nova:properties/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:         <nova:user uuid="7ac80020082f4833a8dc4ee0ce583bd0">tempest-ImageDependencyTests-212220980-project-member</nova:user>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:         <nova:project uuid="b83450809f534782948c02b2c2eb4a75">tempest-ImageDependencyTests-212220980</nova:project>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:         <nova:port uuid="01da9f96-a1a2-44ca-939d-56c191f2da2b">
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="192.168.233.197" ipVersion="4"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     <system>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <entry name="serial">895c7b70-89af-409a-97e5-27733dbea534</entry>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <entry name="uuid">895c7b70-89af-409a-97e5-27733dbea534</entry>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     </system>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:   <os>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:   </os>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:   <features>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:   </features>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:   <devices>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/895c7b70-89af-409a-97e5-27733dbea534/disk.config"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     </disk>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <alias name="ua-592d255c-9372-44f5-94d1-e53bae7920d5"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-7"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <serial>592d255c-9372-44f5-94d1-e53bae7920d5</serial>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     </disk>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:2c:94:b4"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <target dev="tap01da9f96-a1"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     </interface>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/895c7b70-89af-409a-97e5-27733dbea534/console.log" append="off"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     </serial>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     <video>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     </video>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     </rng>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:   </devices>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]: </domain>
May 27 03:04:30.247977 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:04:30.250544 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Preparing to wait for external event network-vif-plugged-01da9f96-a1a2-44ca-939d-56c191f2da2b {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:04:30.250544 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Acquiring lock "895c7b70-89af-409a-97e5-27733dbea534-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:30.250544 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "895c7b70-89af-409a-97e5-27733dbea534-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:30.250544 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "895c7b70-89af-409a-97e5-27733dbea534-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:30.250544 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='instance-depend-image',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b83450809f534782948c02b2c2eb4a75',ramdisk_id='',reservation_id='r-9gd1zekv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-212220980',owner_user_name='tempest-ImageDependencyTests-212220980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:04:22Z,user_data=None,user_id='7ac80020082f4833a8dc4ee0ce583bd0',uuid=895c7b70-89af-409a-97e5-27733dbea534,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01da9f96-a1a2-44ca-939d-56c191f2da2b", "address": "fa:16:3e:2c:94:b4", "network": {"id": "c3e308a2-5e87-43a2-ab60-37f9737a84ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba717c80697f454cbbe062e8cd8e5989", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01da9f96-a1", "ovs_interfaceid": "01da9f96-a1a2-44ca-939d-56c191f2da2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:04:30.250544 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Converting VIF {"id": "01da9f96-a1a2-44ca-939d-56c191f2da2b", "address": "fa:16:3e:2c:94:b4", "network": {"id": "c3e308a2-5e87-43a2-ab60-37f9737a84ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba717c80697f454cbbe062e8cd8e5989", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01da9f96-a1", "ovs_interfaceid": "01da9f96-a1a2-44ca-939d-56c191f2da2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:04:30.250544 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:94:b4,bridge_name='br-int',has_traffic_filtering=True,id=01da9f96-a1a2-44ca-939d-56c191f2da2b,network=Network(c3e308a2-5e87-43a2-ab60-37f9737a84ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01da9f96-a1') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:04:30.250544 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:94:b4,bridge_name='br-int',has_traffic_filtering=True,id=01da9f96-a1a2-44ca-939d-56c191f2da2b,network=Network(c3e308a2-5e87-43a2-ab60-37f9737a84ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01da9f96-a1') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:04:30.250544 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:30.251047 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:30.251592 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:04:30.252898 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:30.253650 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94c9601b-84d0-5266-960f-6e198cc270d1', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:30.255292 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:04:30.255292 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c98f3ccd-980f-4f76-a069-2cc558e818c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:04:30.255292 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:30.257879 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:30.260279 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:30.260835 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01da9f96-a1, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:30.261809 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01da9f96-a1, col_values=(('qos', UUID('7228b989-aae4-484d-ae96-1ddbd7b12f03')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:30.262703 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01da9f96-a1, col_values=(('external_ids', {'iface-id': '01da9f96-a1a2-44ca-939d-56c191f2da2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:94:b4', 'vm-uuid': '895c7b70-89af-409a-97e5-27733dbea534'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:30.264815 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:30.267034 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:30.271701 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:30.273808 np0000001475 nova-compute[98471]: INFO os_vif [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:94:b4,bridge_name='br-int',has_traffic_filtering=True,id=01da9f96-a1a2-44ca-939d-56c191f2da2b,network=Network(c3e308a2-5e87-43a2-ab60-37f9737a84ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01da9f96-a1')
May 27 03:04:30.307822 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:04:30.557339 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:30.566785 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9db88f85-2d14-43f6-91f3-6bf10f9775b6 req-ec4f4a6f-fc87-4cdf-ae14-d84700d49dac service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Received event network-vif-deleted-c87aaa49-f608-4ea5-ae24-f72634311e87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:30.566785 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-9db88f85-2d14-43f6-91f3-6bf10f9775b6 req-ec4f4a6f-fc87-4cdf-ae14-d84700d49dac service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Neutron deleted interface c87aaa49-f608-4ea5-ae24-f72634311e87; detaching it from the instance and deleting it from the info cache
May 27 03:04:30.567025 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-9db88f85-2d14-43f6-91f3-6bf10f9775b6 req-ec4f4a6f-fc87-4cdf-ae14-d84700d49dac service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:30.628311 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fb067de8-a528-4861-a8b8-a18e9777212e req-f6423361-87fc-4778-be17-1e71cd6f2330 service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Detach interface failed, port_id=fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2, reason: Instance 66b799ed-716a-4b29-8125-bac73213f2cf could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:04:31.005707 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:31.059885 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Took 1.44 seconds to deallocate network for instance.
May 27 03:04:31.075239 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9db88f85-2d14-43f6-91f3-6bf10f9775b6 req-ec4f4a6f-fc87-4cdf-ae14-d84700d49dac service nova] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Detach interface failed, port_id=c87aaa49-f608-4ea5-ae24-f72634311e87, reason: Instance de33390e-64b1-4034-a1f1-dcc935cf25fd could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:04:31.163296 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:31.273297 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-bc432b90-28c0-43d4-a3af-5efdff060b24 req-be92dff6-e05a-4237-8b86-60d699c972ce service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received event network-vif-unplugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:31.273588 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bc432b90-28c0-43d4-a3af-5efdff060b24 req-be92dff6-e05a-4237-8b86-60d699c972ce service nova] Acquiring lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:31.273903 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bc432b90-28c0-43d4-a3af-5efdff060b24 req-be92dff6-e05a-4237-8b86-60d699c972ce service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:31.274119 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bc432b90-28c0-43d4-a3af-5efdff060b24 req-be92dff6-e05a-4237-8b86-60d699c972ce service nova] Lock "66b799ed-716a-4b29-8125-bac73213f2cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:31.274643 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-bc432b90-28c0-43d4-a3af-5efdff060b24 req-be92dff6-e05a-4237-8b86-60d699c972ce service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] No waiting events found dispatching network-vif-unplugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:31.274643 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-bc432b90-28c0-43d4-a3af-5efdff060b24 req-be92dff6-e05a-4237-8b86-60d699c972ce service nova] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Received unexpected event network-vif-unplugged-fe6bdedc-0c26-4e55-a0c2-6c94d466b4d2 for instance with vm_state deleted and task_state None.
May 27 03:04:31.330690 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Found WWN 3300000007d606cb0 for multipath device dm-6 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:04:31.331024 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.052s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:31.331281 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] <== connect_volume: return (2537ms) {'type': 'block', 'scsi_wwn': '3300000007d606cb0', 'path': '/dev/dm-6', 'multipath_id': '3300000007d606cb0'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:04:31.331446 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007d606cb0', 'path': '/dev/dm-6', 'multipath_id': '3300000007d606cb0'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:04:31.332391 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.077s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:31.332715 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c98f3ccd-980f-4f76-a069-2cc558e818c2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:04:31.332853 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:04:31.369925 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:31.369925 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:31.369925 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:31.369925 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:31.369925 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:31.369925 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:31.369925 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:31.369925 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:31.369925 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:31.369925 np0000001475 nova-compute[98471]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:31.369925 np0000001475 nova-compute[98471]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:31.369925 np0000001475 nova-compute[98471]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:31.369925 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:31.370572 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:31.370572 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:31.370572 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:31.370572 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:31.370572 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:31.370572 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:31.370572 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:31.370572 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:31.370572 np0000001475 nova-compute[98471]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:31.370572 np0000001475 nova-compute[98471]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2 (non-flash)
May 27 03:04:31.370572 np0000001475 nova-compute[98471]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:31.370572 np0000001475 nova-compute[98471]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:31.370572 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:31.370572 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', '73'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', '74'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', '80')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:04:31.370572 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', '77')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:04:31.371930 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2', '78')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:04:31.373232 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75570462dd00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2'): ({'sdc'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:04:31.373711 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Removing multipathed devices sdb, sdc {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:04:31.374075 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Flush multipath device 330000000be1682f3 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:04:31.406622 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:04:31.459526 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:04:31.508486 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Took 1.71 seconds to deallocate network for instance.
May 27 03:04:31.511629 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:04:31.511991 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:04:31.514080 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:04:31.531987 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:04:31.532204 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:04:31.533696 np0000001475 nova-compute[98471]: WARNING nova.volume.cinder [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Attachment 7a222d55-b11e-4798-a3d0-bcf284be36f2 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7a222d55-b11e-4798-a3d0-bcf284be36f2. (HTTP 404) (Request-ID: req-88602621-6867-4574-aa1a-e3b8bedf5b9b)
May 27 03:04:31.534017 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Took 0.03 seconds to detach 1 volumes for instance.
May 27 03:04:31.546095 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:31.567048 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:31.567310 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:31.585308 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 77, target: iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2, portal: 192.168.40.100,3260]
May 27 03:04:31.585308 np0000001475 nova-compute[98471]: Logout of [sid: 77, target: iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2, portal: 192.168.40.100,3260] successful.
May 27 03:04:31.585308 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:31.609142 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:31.621556 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:31.657516 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 78, target: iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2, portal: 192.168.50.100,3260]
May 27 03:04:31.657516 np0000001475 nova-compute[98471]: Logout of [sid: 78, target: iqn.2023-03.storpool.com:os--volume-c98f3ccd-980f-4f76-a069-2cc558e818c2, portal: 192.168.50.100,3260] successful.
May 27 03:04:31.657516 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:31.683038 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:31.684641 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:31.684827 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] <== disconnect_volume: return (1430ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:04:31.684993 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:04:31.687368 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0010700249999899825 future=<Future at 0x7557046d12b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:31.687368 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:31.687368 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=2.976824554000359 future=<Future at 0x755724739760 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:31.687368 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=2.976740307 future=<Future at 0x755724739760 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:31.687940 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] Emitting event <LifecycleEvent: 1779851056.6858695, ca2e5c3f-b9be-4bfb-9858-c22cbb4177da => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:04:31.688176 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] VM Stopped (Lifecycle Event)
May 27 03:04:31.798016 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:31.798199 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:31.798322 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] No VIF found with MAC fa:16:3e:2c:94:b4, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:04:31.798792 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Using config drive
May 27 03:04:31.844694 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001475',hostname='multiattach-server-1',id=33,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7X60AtOl0SsfuAMV1LtNGpvh0yvi8THxioUm4x62ykVhuM7q4sXRNe3S5fa56OsOiAX0ZbtOowRZ4+AKeGhch21Oc/NUN3hQGbbFxrwclVqtJHRu4HOLbwt9JgM8J0mA==',key_name='tempest-keypair-1333870124',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:02:42Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001475',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-ki851fh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:04:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092604511a8a467ba4ecb56261cb531f',uuid=d7f71824-f631-423e-a5ea-8ae72642a95e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "vif_mac": "fa:16:3e:88:48:d5"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:04:31.844974 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "vif_mac": "fa:16:3e:88:48:d5"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:04:31.845424 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:48:d5,bridge_name='br-int',has_traffic_filtering=True,id=57af91c5-42f3-4f9f-ac26-aad2418fdfe3,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57af91c5-42') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:04:31.849773 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] End _get_guest_xml xml=<domain type="qemu">
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:   <uuid>d7f71824-f631-423e-a5ea-8ae72642a95e</uuid>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:   <name>instance-00000021</name>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:   <memory>262144</memory>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <nova:name>multiattach-server-1</nova:name>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:04:28</nova:creationTime>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.micro" id="84">
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:         <nova:memory>256</nova:memory>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:         <nova:user uuid="092604511a8a467ba4ecb56261cb531f">tempest-AttachVolumeMultiAttachTest-774919822-project-member</nova:user>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:         <nova:project uuid="a9c48d6919e8435f876f3324616521ea">tempest-AttachVolumeMultiAttachTest-774919822</nova:project>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:         <nova:port uuid="57af91c5-42f3-4f9f-ac26-aad2418fdfe3">
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     <system>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <entry name="serial">d7f71824-f631-423e-a5ea-8ae72642a95e</entry>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <entry name="uuid">d7f71824-f631-423e-a5ea-8ae72642a95e</entry>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     </system>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:   <os>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:   </os>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:   <features>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:   </features>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:   <devices>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     </disk>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk.config"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     </disk>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <alias name="ua-8cd7c930-2109-4c04-85a8-31ac0ce9341e"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-6"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <target dev="vdb" bus="virtio"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <serial>8cd7c930-2109-4c04-85a8-31ac0ce9341e</serial>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <shareable/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     </disk>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:88:48:d5"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <target dev="tap57af91c5-42"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     </interface>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/console.log" append="off"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     </serial>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     <video>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     </video>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     </rng>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:   </devices>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]: </domain>
May 27 03:04:31.849773 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:04:31.849773 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001475',hostname='multiattach-server-1',id=33,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7X60AtOl0SsfuAMV1LtNGpvh0yvi8THxioUm4x62ykVhuM7q4sXRNe3S5fa56OsOiAX0ZbtOowRZ4+AKeGhch21Oc/NUN3hQGbbFxrwclVqtJHRu4HOLbwt9JgM8J0mA==',key_name='tempest-keypair-1333870124',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:02:42Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001475',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-ki851fh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:04:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092604511a8a467ba4ecb56261cb531f',uuid=d7f71824-f631-423e-a5ea-8ae72642a95e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "vif_mac": "fa:16:3e:88:48:d5"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:04:31.849773 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "vif_mac": "fa:16:3e:88:48:d5"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:04:31.849773 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:48:d5,bridge_name='br-int',has_traffic_filtering=True,id=57af91c5-42f3-4f9f-ac26-aad2418fdfe3,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57af91c5-42') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:04:31.849773 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:48:d5,bridge_name='br-int',has_traffic_filtering=True,id=57af91c5-42f3-4f9f-ac26-aad2418fdfe3,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57af91c5-42') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:04:31.858091 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:31.858091 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:31.858091 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:04:31.858091 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:31.858091 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08fc82db-545e-5228-ba83-fe7855350b56', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:31.858091 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:31.858091 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:31.861809 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:31.865263 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:31.866333 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57af91c5-42, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:31.866678 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57af91c5-42, col_values=(('qos', UUID('3183317c-2624-4aa0-9886-cbecff6e0218')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:31.866830 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57af91c5-42, col_values=(('external_ids', {'iface-id': '57af91c5-42f3-4f9f-ac26-aad2418fdfe3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:48:d5', 'vm-uuid': 'd7f71824-f631-423e-a5ea-8ae72642a95e'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:31.868310 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:31.870452 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:31.881048 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:31.882459 np0000001475 nova-compute[98471]: INFO os_vif [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:48:d5,bridge_name='br-int',has_traffic_filtering=True,id=57af91c5-42f3-4f9f-ac26-aad2418fdfe3,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57af91c5-42')
May 27 03:04:32.041170 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:32.190879 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] [instance: ca2e5c3f-b9be-4bfb-9858-c22cbb4177da] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:32.238839 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lazy-loading 'flavor' on Instance uuid e17e8031-6811-4553-b8ce-7150f690a4ba {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:32.307869 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:32.499808 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:04:32.500081 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:04:32.513619 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Creating config drive at /opt/stack/data/nova/instances/895c7b70-89af-409a-97e5-27733dbea534/disk.config
May 27 03:04:32.517720 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/895c7b70-89af-409a-97e5-27733dbea534/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfbsuf0ma {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:32.571978 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/895c7b70-89af-409a-97e5-27733dbea534/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfbsuf0ma" returned: 0 in 0.054s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:33.004632 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:04:33.068193 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:33.146762 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:33.160133 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:33.205798 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:33.248418 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8574a4e6-0795-414a-874e-bba9c2c38d83 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.307s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:33.385092 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7f034720-2a7a-474d-a3ab-15e58477b1ec req-45efe41a-e12a-4be3-9922-51ac596a1a25 service nova] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Received event network-vif-plugged-01da9f96-a1a2-44ca-939d-56c191f2da2b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:33.385600 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7f034720-2a7a-474d-a3ab-15e58477b1ec req-45efe41a-e12a-4be3-9922-51ac596a1a25 service nova] Acquiring lock "895c7b70-89af-409a-97e5-27733dbea534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:33.385600 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7f034720-2a7a-474d-a3ab-15e58477b1ec req-45efe41a-e12a-4be3-9922-51ac596a1a25 service nova] Lock "895c7b70-89af-409a-97e5-27733dbea534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:33.385600 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7f034720-2a7a-474d-a3ab-15e58477b1ec req-45efe41a-e12a-4be3-9922-51ac596a1a25 service nova] Lock "895c7b70-89af-409a-97e5-27733dbea534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:33.385941 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7f034720-2a7a-474d-a3ab-15e58477b1ec req-45efe41a-e12a-4be3-9922-51ac596a1a25 service nova] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Processing event network-vif-plugged-01da9f96-a1a2-44ca-939d-56c191f2da2b {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:04:33.407661 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:33.407885 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:33.408058 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:33.408237 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No VIF found with MAC fa:16:3e:88:48:d5, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:04:33.409014 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Using config drive
May 27 03:04:33.463623 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:33.470890 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:33.476062 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:33.499689 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:33.504463 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:33.524046 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.957s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:33.535297 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.494s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:33.627559 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Deleted allocations for instance 66b799ed-716a-4b29-8125-bac73213f2cf
May 27 03:04:33.934817 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:33.966818 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:34.088374 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:34.127783 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:34.128723 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:34.183979 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:04:34.186117 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851074.185547, 895c7b70-89af-409a-97e5-27733dbea534 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:04:34.186465 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 895c7b70-89af-409a-97e5-27733dbea534] VM Started (Lifecycle Event)
May 27 03:04:34.193418 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fc0b4efb-fa60-4858-a15e-73491c9e0767 req-62783074-41a6-40cd-94ff-06e0352a764e service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Received event network-vif-plugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:34.195676 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fc0b4efb-fa60-4858-a15e-73491c9e0767 req-62783074-41a6-40cd-94ff-06e0352a764e service nova] Acquiring lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:34.197844 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:04:34.201984 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fc0b4efb-fa60-4858-a15e-73491c9e0767 req-62783074-41a6-40cd-94ff-06e0352a764e service nova] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:34.202332 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fc0b4efb-fa60-4858-a15e-73491c9e0767 req-62783074-41a6-40cd-94ff-06e0352a764e service nova] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:34.202833 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fc0b4efb-fa60-4858-a15e-73491c9e0767 req-62783074-41a6-40cd-94ff-06e0352a764e service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] No waiting events found dispatching network-vif-plugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:34.202833 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-fc0b4efb-fa60-4858-a15e-73491c9e0767 req-62783074-41a6-40cd-94ff-06e0352a764e service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Received unexpected event network-vif-plugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 for instance with vm_state active and task_state resize_finish.
May 27 03:04:34.209247 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Instance spawned successfully.
May 27 03:04:34.209898 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:04:34.401804 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "e17e8031-6811-4553-b8ce-7150f690a4ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:34.401804 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:34.401804 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "e17e8031-6811-4553-b8ce-7150f690a4ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:34.401804 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:34.402164 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:34.407426 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Terminating instance
May 27 03:04:34.447278 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:04:34.447278 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:04:34.641867 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-717799fc-aca2-42cd-bd2b-e1bf43793cd8 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "66b799ed-716a-4b29-8125-bac73213f2cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.966s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:34.664641 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.00043083199989268905 future=<Future at 0x755724739760 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:34.665211 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Emitting event <LifecycleEvent: 1779851059.664024, d7f71824-f631-423e-a5ea-8ae72642a95e => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:04:34.665393 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:34.665565 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=6.013759154000127 future=<Future at 0x7557046ab7a0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:34.665660 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=6.013628931000312 future=<Future at 0x7557046ab7a0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:34.665861 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] VM Stopped (Lifecycle Event)
May 27 03:04:34.698611 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:34.710837 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:04:34.724211 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:04:34.724337 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:04:34.725211 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:04:34.725629 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:04:34.726020 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:04:34.726547 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:04:34.914461 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:04:34.940302 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:34.945836 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:34.949911 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:04:34.973308 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:34.983556 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:34.984300 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Instance event wait completed in 0 seconds for  {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:04:34.989471 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Instance running successfully.
May 27 03:04:34.990391 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Failed to set time: agent not configured {{(pid=98471) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 27 03:04:34.990594 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba684b1b-0325-407d-8b5d-bbc458896060 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] finish_migration finished successfully. {{(pid=98471) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 27 03:04:35.011526 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:35.148704 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fde08a2c-483f-4066-99dc-a324f739db42 req-5ebbfc22-c5d9-4655-a9fa-2d7fdbb17946 service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Received event network-vif-unplugged-32222a99-3c66-4869-88f8-33b8a752ec5b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:35.149343 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fde08a2c-483f-4066-99dc-a324f739db42 req-5ebbfc22-c5d9-4655-a9fa-2d7fdbb17946 service nova] Acquiring lock "e17e8031-6811-4553-b8ce-7150f690a4ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:35.150452 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fde08a2c-483f-4066-99dc-a324f739db42 req-5ebbfc22-c5d9-4655-a9fa-2d7fdbb17946 service nova] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:35.150591 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fde08a2c-483f-4066-99dc-a324f739db42 req-5ebbfc22-c5d9-4655-a9fa-2d7fdbb17946 service nova] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:35.150737 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fde08a2c-483f-4066-99dc-a324f739db42 req-5ebbfc22-c5d9-4655-a9fa-2d7fdbb17946 service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] No waiting events found dispatching network-vif-unplugged-32222a99-3c66-4869-88f8-33b8a752ec5b {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:35.150901 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fde08a2c-483f-4066-99dc-a324f739db42 req-5ebbfc22-c5d9-4655-a9fa-2d7fdbb17946 service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Received event network-vif-unplugged-32222a99-3c66-4869-88f8-33b8a752ec5b for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:04:35.168646 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:35.188715 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "4e583b08-e323-4681-9e95-01767f510590" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:35.188715 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "4e583b08-e323-4681-9e95-01767f510590" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:35.188715 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "4e583b08-e323-4681-9e95-01767f510590-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:35.189687 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "4e583b08-e323-4681-9e95-01767f510590-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:35.189687 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "4e583b08-e323-4681-9e95-01767f510590-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:35.191904 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Terminating instance
May 27 03:04:35.200842 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:04:35.201212 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98471) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 27 03:04:35.213701 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 895c7b70-89af-409a-97e5-27733dbea534] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:04:35.215506 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851075.2152193, 895c7b70-89af-409a-97e5-27733dbea534 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:04:35.215677 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 895c7b70-89af-409a-97e5-27733dbea534] VM Paused (Lifecycle Event)
May 27 03:04:35.237375 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Took 10.49 seconds to spawn the instance on the hypervisor.
May 27 03:04:35.237528 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:35.256713 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Instance destroyed successfully.
May 27 03:04:35.257380 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lazy-loading 'resources' on Instance uuid e17e8031-6811-4553-b8ce-7150f690a4ba {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:35.458443 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.923s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:35.467166 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f70a83d3-aa3c-4406-b212-3a0de683e8d2 req-b19a7c4f-f2ac-4265-b37d-13f9a9f58120 service nova] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Received event network-vif-plugged-01da9f96-a1a2-44ca-939d-56c191f2da2b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:35.467896 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f70a83d3-aa3c-4406-b212-3a0de683e8d2 req-b19a7c4f-f2ac-4265-b37d-13f9a9f58120 service nova] Acquiring lock "895c7b70-89af-409a-97e5-27733dbea534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:35.468111 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f70a83d3-aa3c-4406-b212-3a0de683e8d2 req-b19a7c4f-f2ac-4265-b37d-13f9a9f58120 service nova] Lock "895c7b70-89af-409a-97e5-27733dbea534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:35.468288 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f70a83d3-aa3c-4406-b212-3a0de683e8d2 req-b19a7c4f-f2ac-4265-b37d-13f9a9f58120 service nova] Lock "895c7b70-89af-409a-97e5-27733dbea534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:35.468533 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f70a83d3-aa3c-4406-b212-3a0de683e8d2 req-b19a7c4f-f2ac-4265-b37d-13f9a9f58120 service nova] [instance: 895c7b70-89af-409a-97e5-27733dbea534] No waiting events found dispatching network-vif-plugged-01da9f96-a1a2-44ca-939d-56c191f2da2b {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:35.468688 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-f70a83d3-aa3c-4406-b212-3a0de683e8d2 req-b19a7c4f-f2ac-4265-b37d-13f9a9f58120 service nova] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Received unexpected event network-vif-plugged-01da9f96-a1a2-44ca-939d-56c191f2da2b for instance with vm_state active and task_state None.
May 27 03:04:35.526557 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Deleted allocations for instance de33390e-64b1-4034-a1f1-dcc935cf25fd
May 27 03:04:35.696390 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:04:35.706735 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:04:35.721823 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:35.727150 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:35.728769 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851075.7284734, 895c7b70-89af-409a-97e5-27733dbea534 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:04:35.728984 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 895c7b70-89af-409a-97e5-27733dbea534] VM Resumed (Lifecycle Event)
May 27 03:04:35.730848 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:35.755992 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Took 18.52 seconds to build instance.
May 27 03:04:35.759917 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:35.766142 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-376034161',display_name='tempest-TestEncryptedCinderVolumes-server-376034161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testencryptedcindervolumes-server-376034161',id=37,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBs7D+K7XXYy9ndCZLoXBly8+dvyoGBAnPmW3+clxKdIHl0K/S6h2vXSVB/WB4qA4L1mStHC0pIXGd2CaDAQNDOtBe7C6VcCJBdkgQXWhOdedVxIvdXRLgTqSarMjRBzQQ==',key_name='tempest-keypair-245298165',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:03:32Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51a54fd7b39b4a968af6ad453070ea4d',ramdisk_id='',reservation_id='r-vyed7wv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-727613157',owner_user_name='tempest-TestEncryptedCinderVolumes-727613157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:03:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6dd385bbf9c3482aa593c41ce7795e8e',uuid=e17e8031-6811-4553-b8ce-7150f690a4ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32222a99-3c66-4869-88f8-33b8a752ec5b", "address": "fa:16:3e:a2:a0:80", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32222a99-3c", "ovs_interfaceid": "32222a99-3c66-4869-88f8-33b8a752ec5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:04:35.766142 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Converting VIF {"id": "32222a99-3c66-4869-88f8-33b8a752ec5b", "address": "fa:16:3e:a2:a0:80", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32222a99-3c", "ovs_interfaceid": "32222a99-3c66-4869-88f8-33b8a752ec5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:04:35.766142 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:a0:80,bridge_name='br-int',has_traffic_filtering=True,id=32222a99-3c66-4869-88f8-33b8a752ec5b,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32222a99-3c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:04:35.767425 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:a0:80,bridge_name='br-int',has_traffic_filtering=True,id=32222a99-3c66-4869-88f8-33b8a752ec5b,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32222a99-3c') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:04:35.770166 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:35.770465 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32222a99-3c, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:35.774916 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:35.793087 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:35.798519 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:35.799493 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:35.799712 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42db8b57-6d71-4c46-b61b-ada03e63bd1c) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:35.801585 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:35.815228 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:35.820010 np0000001475 nova-compute[98471]: INFO os_vif [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:a0:80,bridge_name='br-int',has_traffic_filtering=True,id=32222a99-3c66-4869-88f8-33b8a752ec5b,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32222a99-3c')
May 27 03:04:35.820271 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Deleting instance files /opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba_del
May 27 03:04:35.820993 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Deletion of /opt/stack/data/nova/instances/e17e8031-6811-4553-b8ce-7150f690a4ba_del complete
May 27 03:04:36.044611 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 4e583b08-e323-4681-9e95-01767f510590] Instance destroyed successfully.
May 27 03:04:36.045265 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lazy-loading 'resources' on Instance uuid 4e583b08-e323-4681-9e95-01767f510590 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:36.168893 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:36.201937 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:04:36.232838 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:36.235090 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:04:36.267209 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "895c7b70-89af-409a-97e5-27733dbea534" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.042s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:36.285406 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f6b50813-112c-4d3a-b3a3-de38a55cfab6 req-b923b8cd-3f75-4e08-8f68-54ee530a76b6 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Received event network-vif-plugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:36.285599 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6b50813-112c-4d3a-b3a3-de38a55cfab6 req-b923b8cd-3f75-4e08-8f68-54ee530a76b6 service nova] Acquiring lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:36.285793 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6b50813-112c-4d3a-b3a3-de38a55cfab6 req-b923b8cd-3f75-4e08-8f68-54ee530a76b6 service nova] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:36.285929 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f6b50813-112c-4d3a-b3a3-de38a55cfab6 req-b923b8cd-3f75-4e08-8f68-54ee530a76b6 service nova] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:36.286048 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f6b50813-112c-4d3a-b3a3-de38a55cfab6 req-b923b8cd-3f75-4e08-8f68-54ee530a76b6 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] No waiting events found dispatching network-vif-plugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:36.286325 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-f6b50813-112c-4d3a-b3a3-de38a55cfab6 req-b923b8cd-3f75-4e08-8f68-54ee530a76b6 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Received unexpected event network-vif-plugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 for instance with vm_state resized and task_state None.
May 27 03:04:36.329814 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Took 1.41 seconds to destroy the instance on the hypervisor.
May 27 03:04:36.329814 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:04:36.329814 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:04:36.329814 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:04:36.329814 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:36.463018 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:36.539797 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-228b2149-2c7d-491b-bdb8-fb0fad196ec6 tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Lock "de33390e-64b1-4034-a1f1-dcc935cf25fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.761s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:36.549206 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1569279092',display_name='tempest-ServerRescueNegativeTestJSON-server-1569279092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-serverrescuenegativetestjson-server-1569279092',id=20,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:01:49Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39cbbdb9012c4992865d4f89678ef9ac',ramdisk_id='',reservation_id='r-noabdp10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-62027498',owner_user_name='tempest-ServerRescueNegativeTestJSON-62027498-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:01:56Z,user_data=None,user_id='b438796ed5e44f629535db767fe2b756',uuid=4e583b08-e323-4681-9e95-01767f510590,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "address": "fa:16:3e:01:3d:37", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e0fddb-8c", "ovs_interfaceid": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:04:36.549722 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converting VIF {"id": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "address": "fa:16:3e:01:3d:37", "network": {"id": "4637e17f-cc65-49e5-9acf-9ad3c975c394", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-116385272-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39cbbdb9012c4992865d4f89678ef9ac", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e0fddb-8c", "ovs_interfaceid": "40e0fddb-8cd7-4dee-81b1-860e4ca7040c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:04:36.550346 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=40e0fddb-8cd7-4dee-81b1-860e4ca7040c,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e0fddb-8c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:04:36.550554 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=40e0fddb-8cd7-4dee-81b1-860e4ca7040c,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e0fddb-8c') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:04:36.556627 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:36.558119 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40e0fddb-8c, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:36.562129 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:36.563558 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:36.564299 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:36.564491 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67dfa4fe-b63a-40eb-82bb-ae911696e8cb) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:36.568910 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:36.571612 np0000001475 nova-compute[98471]: INFO os_vif [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=40e0fddb-8cd7-4dee-81b1-860e4ca7040c,network=Network(4637e17f-cc65-49e5-9acf-9ad3c975c394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e0fddb-8c')
May 27 03:04:36.572014 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Deleting instance files /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590_del
May 27 03:04:36.572818 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Deletion of /opt/stack/data/nova/instances/4e583b08-e323-4681-9e95-01767f510590_del complete
May 27 03:04:36.595939 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "d7f71824-f631-423e-a5ea-8ae72642a95e" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:36.595939 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:36.595939 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Going to confirm migration 4 {{(pid=98471) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 27 03:04:36.707868 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:04:36.741781 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851076.7408721, d7f71824-f631-423e-a5ea-8ae72642a95e => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:04:36.741781 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] VM Resumed (Lifecycle Event)
May 27 03:04:37.080410 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] [instance: 4e583b08-e323-4681-9e95-01767f510590] Took 1.38 seconds to destroy the instance on the hypervisor.
May 27 03:04:37.081881 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:04:37.082229 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 4e583b08-e323-4681-9e95-01767f510590] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:04:37.082337 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 4e583b08-e323-4681-9e95-01767f510590] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:04:37.083041 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:37.102405 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:37.204585 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:37.216091 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:37.216330 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:04:37.216515 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquired lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:04:37.216639 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:04:37.216858 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'info_cache' on Instance uuid d7f71824-f631-423e-a5ea-8ae72642a95e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:37.246040 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:37.248588 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Received event network-vif-unplugged-32222a99-3c66-4869-88f8-33b8a752ec5b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:37.248830 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] Acquiring lock "e17e8031-6811-4553-b8ce-7150f690a4ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:37.249076 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:37.249706 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:37.250149 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] No waiting events found dispatching network-vif-unplugged-32222a99-3c66-4869-88f8-33b8a752ec5b {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:37.250365 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Received event network-vif-unplugged-32222a99-3c66-4869-88f8-33b8a752ec5b for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:04:37.250520 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received event network-vif-unplugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:37.250688 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] Acquiring lock "4e583b08-e323-4681-9e95-01767f510590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:37.250887 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:37.251034 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:37.251174 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] No waiting events found dispatching network-vif-unplugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:37.251320 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received event network-vif-unplugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:04:37.251460 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received event network-vif-unplugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:37.251639 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] Acquiring lock "4e583b08-e323-4681-9e95-01767f510590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:37.251795 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:37.251932 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] Lock "4e583b08-e323-4681-9e95-01767f510590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:37.252266 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] No waiting events found dispatching network-vif-unplugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:37.252533 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received event network-vif-unplugged-40e0fddb-8cd7-4dee-81b1-860e4ca7040c for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:04:37.252707 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Received event network-vif-deleted-32222a99-3c66-4869-88f8-33b8a752ec5b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:37.253215 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Neutron deleted interface 32222a99-3c66-4869-88f8-33b8a752ec5b; detaching it from the instance and deleting it from the info cache
May 27 03:04:37.253383 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:37.257136 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:04:37.546056 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:37.760813 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5504a1b2-4d44-4ea7-acc3-f908d4a7081a req-8720ce4b-3358-48b2-9755-38ff16030656 service nova] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Detach interface failed, port_id=32222a99-3c66-4869-88f8-33b8a752ec5b, reason: Instance e17e8031-6811-4553-b8ce-7150f690a4ba could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:04:37.764078 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851077.7637758, d7f71824-f631-423e-a5ea-8ae72642a95e => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:04:37.764297 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] VM Started (Lifecycle Event)
May 27 03:04:38.049583 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Took 1.72 seconds to deallocate network for instance.
May 27 03:04:38.066248 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 4e583b08-e323-4681-9e95-01767f510590] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:38.225675 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:38.268446 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:38.271256 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:04:38.557801 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:38.558002 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:38.568349 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 4e583b08-e323-4681-9e95-01767f510590] Took 1.49 seconds to deallocate network for instance.
May 27 03:04:38.599998 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:38.782238 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999772114999814 future=<Future at 0x75572c58af90 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:38.782421 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999895223999829 future=<Future at 0x755704744800 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:38.798758 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Updating instance_info_cache with network_info: [{"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:39.080298 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:39.304605 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Releasing lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:04:39.304965 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'migration_context' on Instance uuid d7f71824-f631-423e-a5ea-8ae72642a95e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:39.323923 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e3aa52dc-0d0a-4af3-8b82-02c2d041da91 req-045a766d-059e-4636-81da-959825fa8358 service nova] [instance: 4e583b08-e323-4681-9e95-01767f510590] Received event network-vif-deleted-40e0fddb-8cd7-4dee-81b1-860e4ca7040c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:39.340358 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:04:39.340564 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:04:39.807332 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Object Instance<d7f71824-f631-423e-a5ea-8ae72642a95e> lazy-loaded attributes: info_cache,migration_context {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:04:39.814174 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:39.844139 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:04:40.116847 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:40.354158 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.796s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:40.359396 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.279s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:40.473144 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Deleted allocations for instance e17e8031-6811-4553-b8ce-7150f690a4ba
May 27 03:04:40.679761 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0004098429999430664 future=<Future at 0x7557046ab7a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:40.682194 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Emitting event <LifecycleEvent: 1779851065.6792083, de33390e-64b1-4034-a1f1-dcc935cf25fd => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:04:40.682412 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] VM Stopped (Lifecycle Event)
May 27 03:04:40.683627 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:40.683882 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=2.897217633999844 future=<Future at 0x75572471cb30 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:40.684415 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=2.8967310550001457 future=<Future at 0x75572471cb30 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:40.705839 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:04:40.706008 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:04:40.706406 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:04:40.902458 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "70ca77a6-2f29-4558-abf0-07292a6200cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:40.902760 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:41.136823 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:04:41.137064 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:04:41.168107 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:41.185957 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-73a46fb5-928b-4a6e-84f8-2d0a96f85fc1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: de33390e-64b1-4034-a1f1-dcc935cf25fd] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:41.199958 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:04:41.201650 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:04:41.201650 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:04:41.201824 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Cleaning up deleted instances {{(pid=98471) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 27 03:04:41.405133 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:04:41.471185 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Acquiring lock "895c7b70-89af-409a-97e5-27733dbea534" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:41.471617 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "895c7b70-89af-409a-97e5-27733dbea534" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:41.471866 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Acquiring lock "895c7b70-89af-409a-97e5-27733dbea534-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:41.472054 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "895c7b70-89af-409a-97e5-27733dbea534-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:41.475810 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "895c7b70-89af-409a-97e5-27733dbea534-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:41.475810 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Terminating instance
May 27 03:04:41.489758 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba6706dc-d799-4d00-8893-01b111c7e7ff tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "e17e8031-6811-4553-b8ce-7150f690a4ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.088s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:41.565559 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:41.640911 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:04:41.704879 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] There are 0 instances to clean {{(pid=98471) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 27 03:04:41.705149 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:04:41.976299 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:41.978896 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:04:42.001316 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:42.003851 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:42.028419 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:42.042304 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:42.072107 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:42.076310 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:42.150190 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.791s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:42.154591 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 2.340s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:42.217175 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Deleted allocations for instance 4e583b08-e323-4681-9e95-01767f510590
May 27 03:04:42.313876 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999698417000218 future=<Future at 0x7557242158b0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:42.315397 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Instance destroyed successfully.
May 27 03:04:42.316624 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lazy-loading 'resources' on Instance uuid 895c7b70-89af-409a-97e5-27733dbea534 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:42.353557 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9de3caf7-6bd3-43ed-bf24-90d877a7afda req-3465b268-bf33-4400-8e53-f7c6909ef78a service nova] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Received event network-vif-unplugged-01da9f96-a1a2-44ca-939d-56c191f2da2b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:42.353752 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9de3caf7-6bd3-43ed-bf24-90d877a7afda req-3465b268-bf33-4400-8e53-f7c6909ef78a service nova] Acquiring lock "895c7b70-89af-409a-97e5-27733dbea534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:42.353947 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9de3caf7-6bd3-43ed-bf24-90d877a7afda req-3465b268-bf33-4400-8e53-f7c6909ef78a service nova] Lock "895c7b70-89af-409a-97e5-27733dbea534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:42.354247 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9de3caf7-6bd3-43ed-bf24-90d877a7afda req-3465b268-bf33-4400-8e53-f7c6909ef78a service nova] Lock "895c7b70-89af-409a-97e5-27733dbea534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:42.354313 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9de3caf7-6bd3-43ed-bf24-90d877a7afda req-3465b268-bf33-4400-8e53-f7c6909ef78a service nova] [instance: 895c7b70-89af-409a-97e5-27733dbea534] No waiting events found dispatching network-vif-unplugged-01da9f96-a1a2-44ca-939d-56c191f2da2b {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:42.354443 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9de3caf7-6bd3-43ed-bf24-90d877a7afda req-3465b268-bf33-4400-8e53-f7c6909ef78a service nova] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Received event network-vif-unplugged-01da9f96-a1a2-44ca-939d-56c191f2da2b for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:04:42.676036 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:42.705966 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:04:42.705966 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.49 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:04:42.819354 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='instance-depend-image',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:04:35Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b83450809f534782948c02b2c2eb4a75',ramdisk_id='',reservation_id='r-9gd1zekv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-ImageDependencyTests-212220980',owner_user_name='tempest-ImageDependencyTests-212220980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:04:35Z,user_data=None,user_id='7ac80020082f4833a8dc4ee0ce583bd0',uuid=895c7b70-89af-409a-97e5-27733dbea534,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01da9f96-a1a2-44ca-939d-56c191f2da2b", "address": "fa:16:3e:2c:94:b4", "network": {"id": "c3e308a2-5e87-43a2-ab60-37f9737a84ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba717c80697f454cbbe062e8cd8e5989", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01da9f96-a1", "ovs_interfaceid": "01da9f96-a1a2-44ca-939d-56c191f2da2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:04:42.819962 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Converting VIF {"id": "01da9f96-a1a2-44ca-939d-56c191f2da2b", "address": "fa:16:3e:2c:94:b4", "network": {"id": "c3e308a2-5e87-43a2-ab60-37f9737a84ff", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba717c80697f454cbbe062e8cd8e5989", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01da9f96-a1", "ovs_interfaceid": "01da9f96-a1a2-44ca-939d-56c191f2da2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:04:42.820787 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:94:b4,bridge_name='br-int',has_traffic_filtering=True,id=01da9f96-a1a2-44ca-939d-56c191f2da2b,network=Network(c3e308a2-5e87-43a2-ab60-37f9737a84ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01da9f96-a1') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:04:42.821767 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:94:b4,bridge_name='br-int',has_traffic_filtering=True,id=01da9f96-a1a2-44ca-939d-56c191f2da2b,network=Network(c3e308a2-5e87-43a2-ab60-37f9737a84ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01da9f96-a1') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:04:42.824213 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:42.824213 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01da9f96-a1, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:42.827870 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:42.827870 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:42.827870 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7228b989-aae4-484d-ae96-1ddbd7b12f03) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:42.829685 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:42.835443 np0000001475 nova-compute[98471]: INFO os_vif [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:94:b4,bridge_name='br-int',has_traffic_filtering=True,id=01da9f96-a1a2-44ca-939d-56c191f2da2b,network=Network(c3e308a2-5e87-43a2-ab60-37f9737a84ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01da9f96-a1')
May 27 03:04:42.838451 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:04:42.838898 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '592d255c-9372-44f5-94d1-e53bae7920d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:04:42.839566 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:42.840135 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:42.841008 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '592d255c-9372-44f5-94d1-e53bae7920d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:04:42.841008 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:42.882924 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5 (non-flash)
May 27 03:04:42.882924 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', '73'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', '74'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', '80')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', '79')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:04:42.882924 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5', '80')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:04:42.884521 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755724647560>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5'): ({'sdm'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:04:42.884934 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Removing multipathed devices sdm, sdl {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:04:42.885335 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Flush multipath device 3300000007068074f {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:04:42.922219 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:04:42.978568 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:04:43.020911 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:04:43.020911 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:04:43.020911 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:04:43.038849 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:04:43.039261 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:04:43.055032 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:43.100007 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 79, target: iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5, portal: 192.168.40.100,3260]
May 27 03:04:43.100007 np0000001475 nova-compute[98471]: Logout of [sid: 79, target: iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5, portal: 192.168.40.100,3260] successful.
May 27 03:04:43.100007 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:43.119865 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:43.136768 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:43.179565 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 80, target: iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5, portal: 192.168.50.100,3260]
May 27 03:04:43.179565 np0000001475 nova-compute[98471]: Logout of [sid: 80, target: iqn.2023-03.storpool.com:os--volume-592d255c-9372-44f5-94d1-e53bae7920d5, portal: 192.168.50.100,3260] successful.
May 27 03:04:43.179565 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:43.205638 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:43.205638 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:43.205638 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] <== disconnect_volume: return (362ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:04:43.205638 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:04:43.205638 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Deleting instance files /opt/stack/data/nova/instances/895c7b70-89af-409a-97e5-27733dbea534_del
May 27 03:04:43.205638 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Deletion of /opt/stack/data/nova/instances/895c7b70-89af-409a-97e5-27733dbea534_del complete
May 27 03:04:43.236018 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2785a333-7162-4701-8c98-5c6a1705e2c0 tempest-ServerRescueNegativeTestJSON-62027498 tempest-ServerRescueNegativeTestJSON-62027498-project-member] Lock "4e583b08-e323-4681-9e95-01767f510590" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.047s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:43.415752 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:04:43.416049 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:04:43.583516 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.002264790000026551 future=<Future at 0x75572471cb30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:43.589109 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:43.589109 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=10.193956916999923 future=<Future at 0x75572c58af90 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:43.589109 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=10.193835479999962 future=<Future at 0x75572c58af90 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:43.589109 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Emitting event <LifecycleEvent: 1779851068.5809848, 66b799ed-716a-4b29-8125-bac73213f2cf => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:04:43.589109 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] VM Stopped (Lifecycle Event)
May 27 03:04:43.722333 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Took 1.74 seconds to destroy the instance on the hypervisor.
May 27 03:04:43.723421 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:04:43.724931 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:04:43.724931 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 895c7b70-89af-409a-97e5-27733dbea534] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:04:43.724931 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:43.820198 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:43.919841 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:04:44.095429 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00917e82-3cfc-4456-9849-0418557648ee tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 66b799ed-716a-4b29-8125-bac73213f2cf] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:44.449414 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-03114569-7420-4c23-b3eb-331ee7ae164b req-83998497-4fbb-4a61-be15-b57b3cc78afe service nova] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Received event network-vif-unplugged-01da9f96-a1a2-44ca-939d-56c191f2da2b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:44.449414 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-03114569-7420-4c23-b3eb-331ee7ae164b req-83998497-4fbb-4a61-be15-b57b3cc78afe service nova] Acquiring lock "895c7b70-89af-409a-97e5-27733dbea534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:44.451092 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-03114569-7420-4c23-b3eb-331ee7ae164b req-83998497-4fbb-4a61-be15-b57b3cc78afe service nova] Lock "895c7b70-89af-409a-97e5-27733dbea534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:44.452444 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-03114569-7420-4c23-b3eb-331ee7ae164b req-83998497-4fbb-4a61-be15-b57b3cc78afe service nova] Lock "895c7b70-89af-409a-97e5-27733dbea534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:44.453908 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-03114569-7420-4c23-b3eb-331ee7ae164b req-83998497-4fbb-4a61-be15-b57b3cc78afe service nova] [instance: 895c7b70-89af-409a-97e5-27733dbea534] No waiting events found dispatching network-vif-unplugged-01da9f96-a1a2-44ca-939d-56c191f2da2b {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:44.456245 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-03114569-7420-4c23-b3eb-331ee7ae164b req-83998497-4fbb-4a61-be15-b57b3cc78afe service nova] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Received event network-vif-unplugged-01da9f96-a1a2-44ca-939d-56c191f2da2b for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:04:44.456245 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-03114569-7420-4c23-b3eb-331ee7ae164b req-83998497-4fbb-4a61-be15-b57b3cc78afe service nova] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Received event network-vif-deleted-01da9f96-a1a2-44ca-939d-56c191f2da2b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:44.456445 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-03114569-7420-4c23-b3eb-331ee7ae164b req-83998497-4fbb-4a61-be15-b57b3cc78afe service nova] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Neutron deleted interface 01da9f96-a1a2-44ca-939d-56c191f2da2b; detaching it from the instance and deleting it from the info cache
May 27 03:04:44.456662 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-03114569-7420-4c23-b3eb-331ee7ae164b req-83998497-4fbb-4a61-be15-b57b3cc78afe service nova] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:44.624567 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:44.944773 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.788s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:44.946038 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.967s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:44.956532 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:04:44.956532 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Claim successful on node np0000001475
May 27 03:04:44.961209 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-03114569-7420-4c23-b3eb-331ee7ae164b req-83998497-4fbb-4a61-be15-b57b3cc78afe service nova] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Detach interface failed, port_id=01da9f96-a1a2-44ca-939d-56c191f2da2b, reason: Instance 895c7b70-89af-409a-97e5-27733dbea534 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:04:45.132342 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Took 1.41 seconds to deallocate network for instance.
May 27 03:04:45.148263 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:45.196355 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:04:45.196809 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:04:45.199526 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:04:45.203065 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:04:45.203396 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:04:45.588720 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Deleted allocation for migration c0c0f473-89b5-47a7-b402-784848288bbc
May 27 03:04:45.700799 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Took 0.57 seconds to detach 1 volumes for instance.
May 27 03:04:45.702600 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Deleting volume: 592d255c-9372-44f5-94d1-e53bae7920d5 {{(pid=98471) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 27 03:04:46.096859 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21fb274e-2c62-4bb4-982a-73fe483cf8b9 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 9.502s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:46.179510 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:46.272369 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:46.529383 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:04:46.529776 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:04:46.591462 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "c3954135-0707-4b78-bfe3-f458ab39f55c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:46.591733 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:46.942953 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d35f41ad-2f87-46c8-b982-5bcd20d05b70 req-38a46496-7493-4dc2-a939-983bfc585ceb service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received event network-changed-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:46.943089 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d35f41ad-2f87-46c8-b982-5bcd20d05b70 req-38a46496-7493-4dc2-a939-983bfc585ceb service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Refreshing instance network info cache due to event network-changed-a2498912-5a39-4f70-a141-dae495d11b2a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:04:46.943257 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d35f41ad-2f87-46c8-b982-5bcd20d05b70 req-38a46496-7493-4dc2-a939-983bfc585ceb service nova] Acquiring lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:04:46.943383 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d35f41ad-2f87-46c8-b982-5bcd20d05b70 req-38a46496-7493-4dc2-a939-983bfc585ceb service nova] Acquired lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:04:46.943509 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-d35f41ad-2f87-46c8-b982-5bcd20d05b70 req-38a46496-7493-4dc2-a939-983bfc585ceb service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Refreshing network info cache for port a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:04:47.034886 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:04:47.094975 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:04:47.201513 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:04:47.201513 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:04:47.446303 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-d35f41ad-2f87-46c8-b982-5bcd20d05b70 req-38a46496-7493-4dc2-a939-983bfc585ceb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:47.542101 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.599s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:47.542695 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.270s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:47.542929 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:04:47.690306 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:47.827341 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-d35f41ad-2f87-46c8-b982-5bcd20d05b70 req-38a46496-7493-4dc2-a939-983bfc585ceb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:47.829682 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:47.928505 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:48.020043 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-d35f41ad-2f87-46c8-b982-5bcd20d05b70 req-38a46496-7493-4dc2-a939-983bfc585ceb service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Updated VIF entry in instance network info cache for port a2498912-5a39-4f70-a141-dae495d11b2a. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:04:48.020387 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-d35f41ad-2f87-46c8-b982-5bcd20d05b70 req-38a46496-7493-4dc2-a939-983bfc585ceb service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Updating instance_info_cache with network_info: [{"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:48.051630 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:04:48.051884 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:04:48.052101 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:48.052345 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:48.162641 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06881b076ff74d528c49eedf998fac83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0405565349241dd88ac22d535484e65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:04:48.300572 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:04:48.301058 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:04:48.525299 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d35f41ad-2f87-46c8-b982-5bcd20d05b70 req-38a46496-7493-4dc2-a939-983bfc585ceb service nova] Releasing lock "refresh_cache-c2a5e735-d573-4ac4-bff0-d4a12648718e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:04:48.557957 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:04:48.625851 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Successfully created port: 77f2ecc1-416d-42e8-8279-c8119022bfef {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:04:48.804580 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:04:49.025514 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-860015d9-1803-4aa1-830a-1e97f94c0a46 req-a1070582-d518-4fab-83e4-b5fb4c83d75f service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Received event network-changed-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:49.025935 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-860015d9-1803-4aa1-830a-1e97f94c0a46 req-a1070582-d518-4fab-83e4-b5fb4c83d75f service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Refreshing instance network info cache due to event network-changed-57af91c5-42f3-4f9f-ac26-aad2418fdfe3. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:04:49.026144 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-860015d9-1803-4aa1-830a-1e97f94c0a46 req-a1070582-d518-4fab-83e4-b5fb4c83d75f service nova] Acquiring lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:04:49.026330 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-860015d9-1803-4aa1-830a-1e97f94c0a46 req-a1070582-d518-4fab-83e4-b5fb4c83d75f service nova] Acquired lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:04:49.026484 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-860015d9-1803-4aa1-830a-1e97f94c0a46 req-a1070582-d518-4fab-83e4-b5fb4c83d75f service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Refreshing network info cache for port 57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:04:49.061044 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:04:49.198613 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Successfully updated port: 77f2ecc1-416d-42e8-8279-c8119022bfef {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:04:49.315728 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.773s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:49.321579 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.630s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:49.327522 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:04:49.327717 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Claim successful on node np0000001475
May 27 03:04:49.395400 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Deleted allocations for instance 895c7b70-89af-409a-97e5-27733dbea534
May 27 03:04:49.530104 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-860015d9-1803-4aa1-830a-1e97f94c0a46 req-a1070582-d518-4fab-83e4-b5fb4c83d75f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:49.567326 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Booting with volume efa3742d-ee2d-4e4e-9256-2cce7bc6724b at /dev/vda
May 27 03:04:49.608792 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:04:49.619778 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:04:49.643866 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:49.702220 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "refresh_cache-70ca77a6-2f29-4558-abf0-07292a6200cd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:04:49.702413 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquired lock "refresh_cache-70ca77a6-2f29-4558-abf0-07292a6200cd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:04:49.702984 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:04:49.703700 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:04:49.704536 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:04:49.714646 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:04:49.716146 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:fe2d:76bb', 'fe80::787c:50ff:fed5:a1fc', 'fe80::fc16:3eff:fe5c:3071', 'fe80::fc16:3eff:fe58:79ce', 'fe80::8cdc:9fff:fe79:9907', 'fe80::fc16:3eff:fe4d:21a6', 'fe80::fc16:3eff:fe88:48d5'] 
May 27 03:04:49.716304 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:04:49.716440 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:04:49.716717 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:04:49.716960 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Updating existing volume attachment record: e4b7a8d8-610d-49ba-a64f-1afdeef67e41 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:04:49.916891 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-860015d9-1803-4aa1-830a-1e97f94c0a46 req-a1070582-d518-4fab-83e4-b5fb4c83d75f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:50.090839 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-860015d9-1803-4aa1-830a-1e97f94c0a46 req-a1070582-d518-4fab-83e4-b5fb4c83d75f service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Updated VIF entry in instance network info cache for port 57af91c5-42f3-4f9f-ac26-aad2418fdfe3. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:04:50.091186 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-860015d9-1803-4aa1-830a-1e97f94c0a46 req-a1070582-d518-4fab-83e4-b5fb4c83d75f service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Updating instance_info_cache with network_info: [{"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:50.199962 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:04:50.272332 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:04:50.410640 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6695eda3-a482-46db-ae25-d69a83c71bf7 tempest-ImageDependencyTests-212220980 tempest-ImageDependencyTests-212220980-project-member] Lock "895c7b70-89af-409a-97e5-27733dbea534" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.939s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:50.497491 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:50.593671 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-860015d9-1803-4aa1-830a-1e97f94c0a46 req-a1070582-d518-4fab-83e4-b5fb4c83d75f service nova] Releasing lock "refresh_cache-d7f71824-f631-423e-a5ea-8ae72642a95e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:04:50.706476 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:50.715114 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Updating instance_info_cache with network_info: [{"id": "77f2ecc1-416d-42e8-8279-c8119022bfef", "address": "fa:16:3e:00:0b:7f", "network": {"id": "0d667c62-7603-42bb-94fe-f2a3ac9ae7d5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-544867481-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0405565349241dd88ac22d535484e65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f2ecc1-41", "ovs_interfaceid": "77f2ecc1-416d-42e8-8279-c8119022bfef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:51.055590 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:04:51.055590 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:04:51.108437 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7c36ef71-c50f-401a-8e04-f88995219ea6 req-1e2dd51c-33bc-4077-b72e-b74980d195aa service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Received event network-changed-77f2ecc1-416d-42e8-8279-c8119022bfef {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:51.108583 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7c36ef71-c50f-401a-8e04-f88995219ea6 req-1e2dd51c-33bc-4077-b72e-b74980d195aa service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Refreshing instance network info cache due to event network-changed-77f2ecc1-416d-42e8-8279-c8119022bfef. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:04:51.108728 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7c36ef71-c50f-401a-8e04-f88995219ea6 req-1e2dd51c-33bc-4077-b72e-b74980d195aa service nova] Acquiring lock "refresh_cache-70ca77a6-2f29-4558-abf0-07292a6200cd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:04:51.179397 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:51.222032 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Releasing lock "refresh_cache-70ca77a6-2f29-4558-abf0-07292a6200cd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:04:51.222269 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Instance network_info: |[{"id": "77f2ecc1-416d-42e8-8279-c8119022bfef", "address": "fa:16:3e:00:0b:7f", "network": {"id": "0d667c62-7603-42bb-94fe-f2a3ac9ae7d5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-544867481-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0405565349241dd88ac22d535484e65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f2ecc1-41", "ovs_interfaceid": "77f2ecc1-416d-42e8-8279-c8119022bfef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:04:51.222532 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7c36ef71-c50f-401a-8e04-f88995219ea6 req-1e2dd51c-33bc-4077-b72e-b74980d195aa service nova] Acquired lock "refresh_cache-70ca77a6-2f29-4558-abf0-07292a6200cd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:04:51.222677 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7c36ef71-c50f-401a-8e04-f88995219ea6 req-1e2dd51c-33bc-4077-b72e-b74980d195aa service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Refreshing network info cache for port 77f2ecc1-416d-42e8-8279-c8119022bfef {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:04:51.518199 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:51.558328 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:04:51.724799 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-7c36ef71-c50f-401a-8e04-f88995219ea6 req-1e2dd51c-33bc-4077-b72e-b74980d195aa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:51.862208 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:04:51.866216 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:04:51.866216 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Creating image(s)
May 27 03:04:51.866216 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:04:51.866216 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Ensure instance console log exists: /opt/stack/data/nova/instances/70ca77a6-2f29-4558-abf0-07292a6200cd/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:04:51.866216 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:51.866216 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:51.866216 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:51.866216 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Start _get_guest_xml network_info=[{"id": "77f2ecc1-416d-42e8-8279-c8119022bfef", "address": "fa:16:3e:00:0b:7f", "network": {"id": "0d667c62-7603-42bb-94fe-f2a3ac9ae7d5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-544867481-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0405565349241dd88ac22d535484e65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f2ecc1-41", "ovs_interfaceid": "77f2ecc1-416d-42e8-8279-c8119022bfef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '70ca77a6-2f29-4558-abf0-07292a6200cd', 'attached_at': '', 'detached_at': '', 'volume_id': 'efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 'serial': 'efa3742d-ee2d-4e4e-9256-2cce7bc6724b'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'e4b7a8d8-610d-49ba-a64f-1afdeef67e41', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:04:51.868884 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:04:51.869891 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestInstancesWithCinderVolumes-server-69520248', uuid='70ca77a6-2f29-4558-abf0-07292a6200cd'), owner=OwnerMeta(userid='06881b076ff74d528c49eedf998fac83', username='tempest-TestInstancesWithCinderVolumes-518567810-project-member', projectid='c0405565349241dd88ac22d535484e65', projectname='tempest-TestInstancesWithCinderVolumes-518567810'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "77f2ecc1-416d-42e8-8279-c8119022bfef", "address": "fa:16:3e:00:0b:7f", "network": {"id": "0d667c62-7603-42bb-94fe-f2a3ac9ae7d5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-544867481-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0405565349241dd88ac22d535484e65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f2ecc1-41", "ovs_interfaceid": "77f2ecc1-416d-42e8-8279-c8119022bfef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851091.8694477) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:04:51.872306 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:04:51.872306 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:04:51.874639 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:04:51.875808 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:04:51.876182 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:04:51.876567 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:04:51.876793 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:04:51.877961 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:04:51.878250 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:04:51.878536 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:04:51.878689 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:04:51.878923 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:04:51.879069 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:04:51.879884 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:04:51.880264 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:04:51.880458 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:04:51.896438 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:04:51.896918 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:04:51.897194 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:51.897824 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:51.898508 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:04:51.918040 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:51.918900 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:51.920358 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:51.920525 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:04:51.921242 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:51.921612 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:04:51.936971 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:04:51.936971 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:51.939484 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:04:51.939484 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:51.952735 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-32f0f914-e74f-4e61-9e08-44c82836c57f req-1699fc7c-2976-49b3-b211-b772bebfb79e service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Received event network-vif-unplugged-77f2ecc1-416d-42e8-8279-c8119022bfef {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:51.952735 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-32f0f914-e74f-4e61-9e08-44c82836c57f req-1699fc7c-2976-49b3-b211-b772bebfb79e service nova] Acquiring lock "70ca77a6-2f29-4558-abf0-07292a6200cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:51.952735 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-32f0f914-e74f-4e61-9e08-44c82836c57f req-1699fc7c-2976-49b3-b211-b772bebfb79e service nova] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:51.952735 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-32f0f914-e74f-4e61-9e08-44c82836c57f req-1699fc7c-2976-49b3-b211-b772bebfb79e service nova] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:51.952735 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-32f0f914-e74f-4e61-9e08-44c82836c57f req-1699fc7c-2976-49b3-b211-b772bebfb79e service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] No waiting events found dispatching network-vif-unplugged-77f2ecc1-416d-42e8-8279-c8119022bfef {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:51.952735 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-32f0f914-e74f-4e61-9e08-44c82836c57f req-1699fc7c-2976-49b3-b211-b772bebfb79e service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Received unexpected event network-vif-unplugged-77f2ecc1-416d-42e8-8279-c8119022bfef for instance with vm_state building and task_state spawning.
May 27 03:04:51.957161 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b] added
May 27 03:04:51.957161 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:04:51.957161 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:04:51.957161 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:04:51.957161 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:04:51.957161 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:04:51.957161 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:51.957403 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:04:51.957548 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0371(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:04:51.957783 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:04:51.961122 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b] added
May 27 03:04:51.961122 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:04:51.961122 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:04:51.961122 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:04:51.961122 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:04:51.961122 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:04:51.961122 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:51.961415 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:04:51.961506 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.04(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:04:51.961705 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:04:52.068217 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.748s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:52.069699 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:04:52.072674 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.366s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:52.073313 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:52.075122 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:04:52.250772 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-7c36ef71-c50f-401a-8e04-f88995219ea6 req-1e2dd51c-33bc-4077-b72e-b74980d195aa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:52.473977 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7c36ef71-c50f-401a-8e04-f88995219ea6 req-1e2dd51c-33bc-4077-b72e-b74980d195aa service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Updated VIF entry in instance network info cache for port 77f2ecc1-416d-42e8-8279-c8119022bfef. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:04:52.474392 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7c36ef71-c50f-401a-8e04-f88995219ea6 req-1e2dd51c-33bc-4077-b72e-b74980d195aa service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Updating instance_info_cache with network_info: [{"id": "77f2ecc1-416d-42e8-8279-c8119022bfef", "address": "fa:16:3e:00:0b:7f", "network": {"id": "0d667c62-7603-42bb-94fe-f2a3ac9ae7d5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-544867481-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0405565349241dd88ac22d535484e65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f2ecc1-41", "ovs_interfaceid": "77f2ecc1-416d-42e8-8279-c8119022bfef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:52.582952 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:04:52.583462 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:04:52.583617 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:52.583953 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:52.701127 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6dd385bbf9c3482aa593c41ce7795e8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a54fd7b39b4a968af6ad453070ea4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:04:52.831973 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:52.958258 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:04:52.963266 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:04:52.972675 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:04:52.972675 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:52.977139 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7c36ef71-c50f-401a-8e04-f88995219ea6 req-1e2dd51c-33bc-4077-b72e-b74980d195aa service nova] Releasing lock "refresh_cache-70ca77a6-2f29-4558-abf0-07292a6200cd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:04:52.980022 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:04:52.980022 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:52.989878 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:52.997194 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:53.008081 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:53.008081 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:53.008081 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:53.008081 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:53.008081 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:53.008081 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:53.008081 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:53.008081 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:53.008081 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:53.008498 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:53.008498 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:53.008498 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:53.008498 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:53.008498 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:53.008498 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:53.008498 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:53.008498 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:53.008498 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:53.018521 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:53.018521 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:53.018521 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:53.018521 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:53.018521 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:53.018521 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:53.018521 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:53.018521 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:53.018521 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:53.018770 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:53.018770 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:53.018770 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:53.018770 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:53.018770 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:53.018770 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:53.018770 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:53.018770 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:53.018770 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:53.029932 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:53.029932 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:53.054694 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b, portal: 192.168.50.100,3260]
May 27 03:04:53.054694 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b, portal: 192.168.50.100,3260] successful.
May 27 03:04:53.054694 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:53.064591 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b, portal: 192.168.40.100,3260]
May 27 03:04:53.064591 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b, portal: 192.168.40.100,3260] successful.
May 27 03:04:53.064591 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:53.073698 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:53.085021 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:53.090309 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:04:53.101402 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:53.101402 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:53.101402 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:53.101402 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:53.101402 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:53.101402 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:53.101402 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:53.101402 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:53.101402 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:04:53.101402 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:04:53.101402 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:53.101727 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:53.101727 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:53.101727 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:53.101727 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:53.101727 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:53.101727 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:53.101727 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:53.101727 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:53.101727 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:04:53.101727 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:04:53.101727 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:53.101952 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:53.102144 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:04:53.103330 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] HCTL ('7', '-', '-', 0) found on session 83 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:04:53.106195 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:04:53.117888 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:53.117888 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:53.117888 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:53.117888 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:53.117888 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:53.117888 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:53.117888 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:53.117888 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:53.117888 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:04:53.117888 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:04:53.117888 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:53.118232 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:53.118232 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:53.118232 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:53.118232 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:53.118232 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:53.118232 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:53.118232 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:53.118232 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:53.118232 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:04:53.118232 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:04:53.118232 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:53.118514 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:53.118514 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:04:53.119866 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] HCTL ('8', '-', '-', 0) found on session 84 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:04:53.120328 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:04:53.126456 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Searching for a device in session 83 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:04:53.126867 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:04:53.140333 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Searching for a device in session 84 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:04:53.140333 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:04:53.153272 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:53.271829 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:53.274846 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:53.377889 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Successfully created port: 927538e0-eed1-4097-ab6b-3e4b57e6f1cd {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:04:53.382235 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:53.387846 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:53.508618 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:53.510402 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:53.538814 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Detaching volume dddfcc30-7d36-4150-b1d9-fab003b610b2
May 27 03:04:53.593767 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:04:53.598091 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Attempting to driver detach volume dddfcc30-7d36-4150-b1d9-fab003b610b2 from mountpoint /dev/vdb
May 27 03:04:53.606372 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Found disk vdb by alias ua-dddfcc30-7d36-4150-b1d9-fab003b610b2 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:04:53.607929 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Found disk vdb by alias ua-dddfcc30-7d36-4150-b1d9-fab003b610b2 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:04:53.608112 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Attempting to detach device vdb from instance bb06d928-2b8c-46f2-b61d-fdb19af4017e from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:04:53.608474 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:04:53.608474 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:04:53.608474 np0000001475 nova-compute[98471]:   <alias name="ua-dddfcc30-7d36-4150-b1d9-fab003b610b2"/>
May 27 03:04:53.608474 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-4"/>
May 27 03:04:53.608474 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:04:53.608474 np0000001475 nova-compute[98471]:   <serial>dddfcc30-7d36-4150-b1d9-fab003b610b2</serial>
May 27 03:04:53.608474 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 03:04:53.608474 np0000001475 nova-compute[98471]: </disk>
May 27 03:04:53.608474 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:04:53.615024 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:53.615650 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:04:53.619356 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:53.633000 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Successfully detached device vdb from instance bb06d928-2b8c-46f2-b61d-fdb19af4017e from the persistent domain config.
May 27 03:04:53.641770 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] (1/8): Attempting to detach device vdb with device alias ua-dddfcc30-7d36-4150-b1d9-fab003b610b2 from instance bb06d928-2b8c-46f2-b61d-fdb19af4017e from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:04:53.641770 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:04:53.641770 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:04:53.641770 np0000001475 nova-compute[98471]:   <alias name="ua-dddfcc30-7d36-4150-b1d9-fab003b610b2"/>
May 27 03:04:53.641770 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-4"/>
May 27 03:04:53.641770 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:04:53.641770 np0000001475 nova-compute[98471]:   <serial>dddfcc30-7d36-4150-b1d9-fab003b610b2</serial>
May 27 03:04:53.641770 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 03:04:53.641770 np0000001475 nova-compute[98471]: </disk>
May 27 03:04:53.641770 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:04:53.715838 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:53.716645 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:53.784440 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0017238890000044194 future=<Future at 0x75572c58af90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:53.784440 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:53.784440 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0017127880000771256 future=<Future at 0x755704744800 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:53.784440 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0018587300000945106 future=<Future at 0x755704744800 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:53.784440 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:53.784440 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=3.529075511999963 future=<Future at 0x7557242158b0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:53.784440 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=3.528997688000345 future=<Future at 0x7557242158b0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:53.785369 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Emitting event <LifecycleEvent: 1779851078.7819154, e17e8031-6811-4553-b8ce-7150f690a4ba => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:04:53.785643 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] VM Stopped (Lifecycle Event)
May 27 03:04:53.790288 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] Emitting event <LifecycleEvent: 1779851078.7822795, 4e583b08-e323-4681-9e95-01767f510590 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:04:53.790770 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] VM Stopped (Lifecycle Event)
May 27 03:04:53.828507 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:53.829081 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:04:53.834978 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:53.922710 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:04:53.944372 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:53.945364 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:54.056680 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:54.057361 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:04:54.066418 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:54.112334 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Successfully updated port: 927538e0-eed1-4097-ab6b-3e4b57e6f1cd {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:04:54.167816 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ba635fa8-3a96-41d9-8836-6ab82cb86e07 req-c0d71579-138c-4597-9fec-afeb12883bb8 service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Received event network-changed-927538e0-eed1-4097-ab6b-3e4b57e6f1cd {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:54.168079 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ba635fa8-3a96-41d9-8836-6ab82cb86e07 req-c0d71579-138c-4597-9fec-afeb12883bb8 service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Refreshing instance network info cache due to event network-changed-927538e0-eed1-4097-ab6b-3e4b57e6f1cd. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:04:54.168365 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ba635fa8-3a96-41d9-8836-6ab82cb86e07 req-c0d71579-138c-4597-9fec-afeb12883bb8 service nova] Acquiring lock "refresh_cache-c3954135-0707-4b78-bfe3-f458ab39f55c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:04:54.168477 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ba635fa8-3a96-41d9-8836-6ab82cb86e07 req-c0d71579-138c-4597-9fec-afeb12883bb8 service nova] Acquired lock "refresh_cache-c3954135-0707-4b78-bfe3-f458ab39f55c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:04:54.168626 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ba635fa8-3a96-41d9-8836-6ab82cb86e07 req-c0d71579-138c-4597-9fec-afeb12883bb8 service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Refreshing network info cache for port 927538e0-eed1-4097-ab6b-3e4b57e6f1cd {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:04:54.185680 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:54.186660 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:54.288107 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:54.288623 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:04:54.290577 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: e17e8031-6811-4553-b8ce-7150f690a4ba] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:54.294615 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] [instance: 4e583b08-e323-4681-9e95-01767f510590] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:54.297256 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:04:54.299628 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:54.374560 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-dddfcc30-7d36-4150-b1d9-fab003b610b2 for instance bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:04:54.375254 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851094.3748386, bb06d928-2b8c-46f2-b61d-fdb19af4017e => ua-dddfcc30-7d36-4150-b1d9-fab003b610b2> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:04:54.380117 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Successfully detached device vdb from instance bb06d928-2b8c-46f2-b61d-fdb19af4017e from the live domain config.
May 27 03:04:54.380505 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:04:54.381937 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dddfcc30-7d36-4150-b1d9-fab003b610b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:04:54.381937 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:04:54.396033 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:54.396920 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:54.494438 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:54.498233 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:54.590354 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:54.591581 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:54.624251 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "refresh_cache-c3954135-0707-4b78-bfe3-f458ab39f55c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:04:54.627152 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:04:54.628925 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:04:54.629308 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Creating image(s)
May 27 03:04:54.630074 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:54.630345 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "/opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:54.630892 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "/opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:54.631928 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:04:54.635234 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:04:54.637214 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:54.675504 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-ba635fa8-3a96-41d9-8836-6ab82cb86e07 req-c0d71579-138c-4597-9fec-afeb12883bb8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:54.706117 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:54.712986 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:04:54.715136 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:54.756622 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.119s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:54.760140 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:54.760140 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:54.760581 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:04:54.765801 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:04:54.766239 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:54.786207 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.070s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:54.787169 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=11400MB free_disk=73.0071792602539GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:04:54.787995 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:54.788212 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:54.801495 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ba635fa8-3a96-41d9-8836-6ab82cb86e07 req-c0d71579-138c-4597-9fec-afeb12883bb8 service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:04:54.888731 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.122s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:54.889207 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:54.939762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Found WWN 3300000007c97f2ad for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:04:54.940353 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:54.940599 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] <== connect_volume: return (3043ms) {'type': 'block', 'scsi_wwn': '3300000007c97f2ad', 'path': '/dev/dm-0', 'multipath_id': '3300000007c97f2ad'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:04:54.940801 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007c97f2ad', 'path': '/dev/dm-0', 'multipath_id': '3300000007c97f2ad'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:04:54.942084 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.561s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:04:54.942308 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dddfcc30-7d36-4150-b1d9-fab003b610b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:04:54.942527 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:04:54.948439 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c/disk 1073741824" returned: 0 in 0.059s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:54.949035 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:54.949684 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:54.988410 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:54.988410 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:54.988410 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:54.988410 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:54.988410 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:54.988410 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:54.988410 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:54.988410 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:54.988410 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:04:54.988410 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:04:54.988410 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:04:54.988655 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:54.988655 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:04:54.988655 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:54.988655 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:04:54.988655 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:54.988655 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:04:54.988655 np0000001475 nova-compute[98471]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:54.988655 np0000001475 nova-compute[98471]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2 (non-flash)
May 27 03:04:54.988655 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:04:54.988655 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:04:54.988655 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:04:54.988907 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', '73'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', '84')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:04:54.989104 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', '73')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:04:54.990988 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2', '74')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:04:54.991992 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c0c2020>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2'): ({'sdg'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:04:54.992602 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Removing multipathed devices sdf, sdg {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:04:54.992971 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Flush multipath device 330000000e87099c0 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:04:55.020358 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ba635fa8-3a96-41d9-8836-6ab82cb86e07 req-c0d71579-138c-4597-9fec-afeb12883bb8 service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:55.027801 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:04:55.069524 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.120s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:55.072632 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:04:55.072632 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:55.083169 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:04:55.138817 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:04:55.139167 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:04:55.141643 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:04:55.154649 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:04:55.155099 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:04:55.167225 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:55.176203 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:55.178501 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Cannot resize image /opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:04:55.178501 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:04:55.178501 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Ensure instance console log exists: /opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:04:55.178501 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:55.178501 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:55.178501 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:55.205135 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 73, target: iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2, portal: 192.168.40.100,3260]
May 27 03:04:55.205135 np0000001475 nova-compute[98471]: Logout of [sid: 73, target: iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2, portal: 192.168.40.100,3260] successful.
May 27 03:04:55.205135 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:55.226779 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:55.240851 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:55.275592 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 74, target: iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2, portal: 192.168.50.100,3260]
May 27 03:04:55.275592 np0000001475 nova-compute[98471]: Logout of [sid: 74, target: iqn.2023-03.storpool.com:os--volume-dddfcc30-7d36-4150-b1d9-fab003b610b2, portal: 192.168.50.100,3260] successful.
May 27 03:04:55.275592 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:55.300316 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:04:55.300316 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:04:55.300316 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] <== disconnect_volume: return (918ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:04:55.300316 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:04:55.450328 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:04:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-69520248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testinstanceswithcindervolumes-server-69520248',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClzQ8IT5GD8T6/VYM+Nx7JuDUk8vH9bUCBPOLf7nqUJg7LhOE/B+WTxIwvxcX9OVp68/cvV8Zp4uBY0TsjTbqEpHOWdXohePGPurTX8y9H/O0E09ZR2CRZMi5VwD5h1Lw==',key_name='tempest-TestInstancesWithCinderVolumes-1254397776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0405565349241dd88ac22d535484e65',ramdisk_id='',reservation_id='r-e7ezli28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-518567810',owner_user_name='tempest-TestInstancesWithCinderVolumes-518567810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:04:49Z,user_data=None,user_id='06881b076ff74d528c49eedf998fac83',uuid=70ca77a6-2f29-4558-abf0-07292a6200cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77f2ecc1-416d-42e8-8279-c8119022bfef", "address": "fa:16:3e:00:0b:7f", "network": {"id": "0d667c62-7603-42bb-94fe-f2a3ac9ae7d5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-544867481-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0405565349241dd88ac22d535484e65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f2ecc1-41", "ovs_interfaceid": "77f2ecc1-416d-42e8-8279-c8119022bfef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:04:55.450626 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Converting VIF {"id": "77f2ecc1-416d-42e8-8279-c8119022bfef", "address": "fa:16:3e:00:0b:7f", "network": {"id": "0d667c62-7603-42bb-94fe-f2a3ac9ae7d5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-544867481-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0405565349241dd88ac22d535484e65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f2ecc1-41", "ovs_interfaceid": "77f2ecc1-416d-42e8-8279-c8119022bfef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:04:55.451492 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:0b:7f,bridge_name='br-int',has_traffic_filtering=True,id=77f2ecc1-416d-42e8-8279-c8119022bfef,network=Network(0d667c62-7603-42bb-94fe-f2a3ac9ae7d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f2ecc1-41') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:04:55.452316 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lazy-loading 'pci_devices' on Instance uuid 70ca77a6-2f29-4558-abf0-07292a6200cd {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:55.490176 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:55.523088 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ba635fa8-3a96-41d9-8836-6ab82cb86e07 req-c0d71579-138c-4597-9fec-afeb12883bb8 service nova] Releasing lock "refresh_cache-c3954135-0707-4b78-bfe3-f458ab39f55c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:04:55.523694 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquired lock "refresh_cache-c3954135-0707-4b78-bfe3-f458ab39f55c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:04:55.523896 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:04:55.868628 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance f5d36573-c0e7-43a0-a7cc-66678f093375 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:55.868976 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 71af628e-b06d-446d-8c2e-dcfbb232df33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:55.869353 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:55.869353 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance bb06d928-2b8c-46f2-b61d-fdb19af4017e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:55.869353 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 1efec6a6-a26c-46fa-9370-60859f41c1a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:55.870762 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'flavor' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:55.872380 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance c2a5e735-d573-4ac4-bff0-d4a12648718e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:55.872685 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 4ac08a8b-4572-4b1f-8ba0-457c80d58b46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:55.872920 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance d7f71824-f631-423e-a5ea-8ae72642a95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:55.873062 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 70ca77a6-2f29-4558-abf0-07292a6200cd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:55.873193 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance c3954135-0707-4b78-bfe3-f458ab39f55c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:04:55.873466 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:04:55.873647 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=2560MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:04:54 up 36 min,  2 users,  load average: 9.11, 8.50, 4.64\n', 'num_instances': '10', 'num_vm_active': '8', 'num_task_None': '8', 'num_os_type_None': '10', 'num_proj_a9c48d6919e8435f876f3324616521ea': '5', 'io_workload': '2', 'num_proj_ca3c6a3942eb41e8b6aefddc5faca789': '1', 'num_proj_5f1801e95925498cac899f1414f2b202': '2', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_c0405565349241dd88ac22d535484e65': '1', 'num_proj_51a54fd7b39b4a968af6ad453070ea4d': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:04:55.955707 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] End _get_guest_xml xml=<domain type="qemu">
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:   <uuid>70ca77a6-2f29-4558-abf0-07292a6200cd</uuid>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:   <name>instance-00000028</name>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestInstancesWithCinderVolumes-server-69520248</nova:name>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:04:51</nova:creationTime>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:         <nova:properties/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:         <nova:user uuid="06881b076ff74d528c49eedf998fac83">tempest-TestInstancesWithCinderVolumes-518567810-project-member</nova:user>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:         <nova:project uuid="c0405565349241dd88ac22d535484e65">tempest-TestInstancesWithCinderVolumes-518567810</nova:project>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:         <nova:port uuid="77f2ecc1-416d-42e8-8279-c8119022bfef">
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     <system>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <entry name="serial">70ca77a6-2f29-4558-abf0-07292a6200cd</entry>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <entry name="uuid">70ca77a6-2f29-4558-abf0-07292a6200cd</entry>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     </system>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:   <os>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:   </os>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:   <features>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:   </features>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:   <devices>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/70ca77a6-2f29-4558-abf0-07292a6200cd/disk.config"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     </disk>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <alias name="ua-efa3742d-ee2d-4e4e-9256-2cce7bc6724b"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-0"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <serial>efa3742d-ee2d-4e4e-9256-2cce7bc6724b</serial>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     </disk>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:00:0b:7f"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <target dev="tap77f2ecc1-41"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     </interface>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/70ca77a6-2f29-4558-abf0-07292a6200cd/console.log" append="off"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     </serial>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     <video>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     </video>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     </rng>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:   </devices>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]: </domain>
May 27 03:04:55.955707 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:04:55.957723 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Preparing to wait for external event network-vif-plugged-77f2ecc1-416d-42e8-8279-c8119022bfef {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:04:55.957723 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "70ca77a6-2f29-4558-abf0-07292a6200cd-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:55.957723 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:55.957723 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:55.957723 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:04:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-69520248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testinstanceswithcindervolumes-server-69520248',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClzQ8IT5GD8T6/VYM+Nx7JuDUk8vH9bUCBPOLf7nqUJg7LhOE/B+WTxIwvxcX9OVp68/cvV8Zp4uBY0TsjTbqEpHOWdXohePGPurTX8y9H/O0E09ZR2CRZMi5VwD5h1Lw==',key_name='tempest-TestInstancesWithCinderVolumes-1254397776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0405565349241dd88ac22d535484e65',ramdisk_id='',reservation_id='r-e7ezli28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-518567810',owner_user_name='tempest-TestInstancesWithCinderVolumes-518567810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:04:49Z,user_data=None,user_id='06881b076ff74d528c49eedf998fac83',uuid=70ca77a6-2f29-4558-abf0-07292a6200cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77f2ecc1-416d-42e8-8279-c8119022bfef", "address": "fa:16:3e:00:0b:7f", "network": {"id": "0d667c62-7603-42bb-94fe-f2a3ac9ae7d5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-544867481-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0405565349241dd88ac22d535484e65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f2ecc1-41", "ovs_interfaceid": "77f2ecc1-416d-42e8-8279-c8119022bfef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:04:55.957960 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Converting VIF {"id": "77f2ecc1-416d-42e8-8279-c8119022bfef", "address": "fa:16:3e:00:0b:7f", "network": {"id": "0d667c62-7603-42bb-94fe-f2a3ac9ae7d5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-544867481-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0405565349241dd88ac22d535484e65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f2ecc1-41", "ovs_interfaceid": "77f2ecc1-416d-42e8-8279-c8119022bfef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:04:55.958492 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:0b:7f,bridge_name='br-int',has_traffic_filtering=True,id=77f2ecc1-416d-42e8-8279-c8119022bfef,network=Network(0d667c62-7603-42bb-94fe-f2a3ac9ae7d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f2ecc1-41') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:04:55.958823 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:0b:7f,bridge_name='br-int',has_traffic_filtering=True,id=77f2ecc1-416d-42e8-8279-c8119022bfef,network=Network(0d667c62-7603-42bb-94fe-f2a3ac9ae7d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f2ecc1-41') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:04:55.959234 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:55.959559 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:55.959846 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:04:55.960941 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:55.961126 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7631199-1dcb-503d-aa05-e7fba7115ef7', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:55.962267 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:55.963161 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:55.963653 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:55.965968 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:55.966168 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77f2ecc1-41, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:55.966533 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77f2ecc1-41, col_values=(('qos', UUID('04ae03ca-38c2-45e4-b0f6-d72d0a2cbed2')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:55.966753 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77f2ecc1-41, col_values=(('external_ids', {'iface-id': '77f2ecc1-416d-42e8-8279-c8119022bfef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:0b:7f', 'vm-uuid': '70ca77a6-2f29-4558-abf0-07292a6200cd'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:55.967523 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:55.968676 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:55.974162 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:55.975218 np0000001475 nova-compute[98471]: INFO os_vif [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:0b:7f,bridge_name='br-int',has_traffic_filtering=True,id=77f2ecc1-416d-42e8-8279-c8119022bfef,network=Network(0d667c62-7603-42bb-94fe-f2a3ac9ae7d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f2ecc1-41')
May 27 03:04:56.101244 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:04:56.181244 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:56.281834 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:56.472583 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Updating instance_info_cache with network_info: [{"id": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "address": "fa:16:3e:6d:20:b3", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap927538e0-ee", "ovs_interfaceid": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:04:56.641883 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:04:56.642088 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:04:56.880138 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba89a167-bda3-4f16-85f0-dca5563b2dc1 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.852s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:56.975157 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Releasing lock "refresh_cache-c3954135-0707-4b78-bfe3-f458ab39f55c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:04:56.975435 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Instance network_info: |[{"id": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "address": "fa:16:3e:6d:20:b3", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap927538e0-ee", "ovs_interfaceid": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:04:56.977486 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Start _get_guest_xml network_info=[{"id": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "address": "fa:16:3e:6d:20:b3", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap927538e0-ee", "ovs_interfaceid": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:04:56.982886 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:04:56.983997 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-711734824', uuid='c3954135-0707-4b78-bfe3-f458ab39f55c'), owner=OwnerMeta(userid='6dd385bbf9c3482aa593c41ce7795e8e', username='tempest-TestEncryptedCinderVolumes-727613157-project-member', projectid='51a54fd7b39b4a968af6ad453070ea4d', projectname='tempest-TestEncryptedCinderVolumes-727613157'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "address": "fa:16:3e:6d:20:b3", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap927538e0-ee", "ovs_interfaceid": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851096.9836128) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:04:56.984882 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:04:56.985692 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:04:56.986060 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:04:56.986234 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:04:56.987080 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:04:56.987401 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:04:56.987534 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:04:56.987622 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:04:56.987735 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:04:56.987857 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:04:56.987943 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:04:56.988093 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:04:56.988204 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:04:56.988355 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:04:56.988463 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:04:56.988593 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:04:57.000166 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-711734824',display_name='tempest-TestEncryptedCinderVolumes-server-711734824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testencryptedcindervolumes-server-711734824',id=41,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9Brv+rFOzS48a7uMOJ/zQ7M7CoJM5ILJOzCS4QemsD/USpp/z6kGjlaOA0LeAyT74mFuKHRhNk1RGUPgYOb0EAP21ZG8Wb+dtDJPssiJxHiUnkx1od8+FPP+hH9qdtKg==',key_name='tempest-keypair-1239197266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51a54fd7b39b4a968af6ad453070ea4d',ramdisk_id='',reservation_id='r-ar7ql3c6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-727613157',owner_user_name='tempest-TestEncryptedCinderVolumes-727613157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:04:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6dd385bbf9c3482aa593c41ce7795e8e',uuid=c3954135-0707-4b78-bfe3-f458ab39f55c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "address": "fa:16:3e:6d:20:b3", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap927538e0-ee", "ovs_interfaceid": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:04:57.000351 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Converting VIF {"id": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "address": "fa:16:3e:6d:20:b3", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap927538e0-ee", "ovs_interfaceid": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:04:57.000996 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:20:b3,bridge_name='br-int',has_traffic_filtering=True,id=927538e0-eed1-4097-ab6b-3e4b57e6f1cd,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927538e0-ee') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:04:57.001292 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lazy-loading 'pci_devices' on Instance uuid c3954135-0707-4b78-bfe3-f458ab39f55c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:57.144882 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:04:57.313946 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.00045783499990648124 future=<Future at 0x7557242158b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:57.314460 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Emitting event <LifecycleEvent: 1779851082.313367, 895c7b70-89af-409a-97e5-27733dbea534 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:04:57.314662 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:57.314812 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] VM Stopped (Lifecycle Event)
May 27 03:04:57.351167 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4fbfb387-984d-44fb-b6ce-288aad4dba26 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:57.351431 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4fbfb387-984d-44fb-b6ce-288aad4dba26 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:57.351590 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-4fbfb387-984d-44fb-b6ce-288aad4dba26 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:57.353752 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-4fbfb387-984d-44fb-b6ce-288aad4dba26 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98471) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 27 03:04:57.354289 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-4fbfb387-984d-44fb-b6ce-288aad4dba26 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'flavor' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:57.500629 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:57.500786 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:57.500942 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] No VIF found with MAC fa:16:3e:00:0b:7f, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:04:57.501328 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Using config drive
May 27 03:04:57.505307 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] End _get_guest_xml xml=<domain type="qemu">
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:   <uuid>c3954135-0707-4b78-bfe3-f458ab39f55c</uuid>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:   <name>instance-00000029</name>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-711734824</nova:name>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:04:56</nova:creationTime>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:         <nova:user uuid="6dd385bbf9c3482aa593c41ce7795e8e">tempest-TestEncryptedCinderVolumes-727613157-project-member</nova:user>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:         <nova:project uuid="51a54fd7b39b4a968af6ad453070ea4d">tempest-TestEncryptedCinderVolumes-727613157</nova:project>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:         <nova:port uuid="927538e0-eed1-4097-ab6b-3e4b57e6f1cd">
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     <system>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <entry name="serial">c3954135-0707-4b78-bfe3-f458ab39f55c</entry>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <entry name="uuid">c3954135-0707-4b78-bfe3-f458ab39f55c</entry>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     </system>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:   <os>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:   </os>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:   <features>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:   </features>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:   <devices>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c/disk"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     </disk>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c/disk.config"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     </disk>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:6d:20:b3"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <target dev="tap927538e0-ee"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     </interface>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c/console.log" append="off"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     </serial>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     <video>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     </video>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     </rng>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:   </devices>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]: </domain>
May 27 03:04:57.505307 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:04:57.505307 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Preparing to wait for external event network-vif-plugged-927538e0-eed1-4097-ab6b-3e4b57e6f1cd {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:04:57.508340 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "c3954135-0707-4b78-bfe3-f458ab39f55c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:57.508340 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:57.508340 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:57.508340 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-711734824',display_name='tempest-TestEncryptedCinderVolumes-server-711734824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testencryptedcindervolumes-server-711734824',id=41,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9Brv+rFOzS48a7uMOJ/zQ7M7CoJM5ILJOzCS4QemsD/USpp/z6kGjlaOA0LeAyT74mFuKHRhNk1RGUPgYOb0EAP21ZG8Wb+dtDJPssiJxHiUnkx1od8+FPP+hH9qdtKg==',key_name='tempest-keypair-1239197266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51a54fd7b39b4a968af6ad453070ea4d',ramdisk_id='',reservation_id='r-ar7ql3c6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-727613157',owner_user_name='tempest-TestEncryptedCinderVolumes-727613157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:04:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6dd385bbf9c3482aa593c41ce7795e8e',uuid=c3954135-0707-4b78-bfe3-f458ab39f55c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "address": "fa:16:3e:6d:20:b3", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap927538e0-ee", "ovs_interfaceid": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:04:57.508340 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Converting VIF {"id": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "address": "fa:16:3e:6d:20:b3", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap927538e0-ee", "ovs_interfaceid": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:04:57.508340 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:20:b3,bridge_name='br-int',has_traffic_filtering=True,id=927538e0-eed1-4097-ab6b-3e4b57e6f1cd,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927538e0-ee') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:04:57.508340 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:20:b3,bridge_name='br-int',has_traffic_filtering=True,id=927538e0-eed1-4097-ab6b-3e4b57e6f1cd,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927538e0-ee') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:04:57.508340 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:57.508340 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:57.509124 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:04:57.509387 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:57.509583 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61c04b97-0cd9-5171-b604-7dbfc019c4ca', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:57.510440 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:57.511369 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:57.516371 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:57.518820 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:57.518998 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap927538e0-ee, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:57.519265 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap927538e0-ee, col_values=(('qos', UUID('813c7f42-13c5-41ed-b74c-fc78f97257ae')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:57.519469 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap927538e0-ee, col_values=(('external_ids', {'iface-id': '927538e0-eed1-4097-ab6b-3e4b57e6f1cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:20:b3', 'vm-uuid': 'c3954135-0707-4b78-bfe3-f458ab39f55c'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:04:57.520405 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:57.521900 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:04:57.532126 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:57.533116 np0000001475 nova-compute[98471]: INFO os_vif [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:20:b3,bridge_name='br-int',has_traffic_filtering=True,id=927538e0-eed1-4097-ab6b-3e4b57e6f1cd,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927538e0-ee')
May 27 03:04:57.651899 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:04:57.651899 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.864s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:57.652332 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.47 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:04:57.817796 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: 895c7b70-89af-409a-97e5-27733dbea534] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:58.006172 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:58.032985 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5637256d-eeea-4e82-aa57-036b7b361d1c req-51044592-a034-4ee1-96e2-5855e4fc312f service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Received event network-vif-unplugged-927538e0-eed1-4097-ab6b-3e4b57e6f1cd {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:58.033220 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5637256d-eeea-4e82-aa57-036b7b361d1c req-51044592-a034-4ee1-96e2-5855e4fc312f service nova] Acquiring lock "c3954135-0707-4b78-bfe3-f458ab39f55c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:58.033386 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5637256d-eeea-4e82-aa57-036b7b361d1c req-51044592-a034-4ee1-96e2-5855e4fc312f service nova] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:58.033470 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5637256d-eeea-4e82-aa57-036b7b361d1c req-51044592-a034-4ee1-96e2-5855e4fc312f service nova] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:58.033648 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5637256d-eeea-4e82-aa57-036b7b361d1c req-51044592-a034-4ee1-96e2-5855e4fc312f service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] No event matching network-vif-unplugged-927538e0-eed1-4097-ab6b-3e4b57e6f1cd in dict_keys([('network-vif-plugged', '927538e0-eed1-4097-ab6b-3e4b57e6f1cd')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 03:04:58.034404 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-5637256d-eeea-4e82-aa57-036b7b361d1c req-51044592-a034-4ee1-96e2-5855e4fc312f service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Received unexpected event network-vif-unplugged-927538e0-eed1-4097-ab6b-3e4b57e6f1cd for instance with vm_state building and task_state spawning.
May 27 03:04:58.129668 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Creating config drive at /opt/stack/data/nova/instances/70ca77a6-2f29-4558-abf0-07292a6200cd/disk.config
May 27 03:04:58.133783 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/70ca77a6-2f29-4558-abf0-07292a6200cd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkba3za8c {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:58.189980 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/70ca77a6-2f29-4558-abf0-07292a6200cd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkba3za8c" returned: 0 in 0.056s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:58.405477 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:58.408644 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:58.429508 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:58.432756 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:58.470886 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:58.573655 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6b790815-133b-4d9e-9371-c29e200c4292 req-981e8a9f-f216-4b04-b764-1399db022105 service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received event network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:04:58.574111 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6b790815-133b-4d9e-9371-c29e200c4292 req-981e8a9f-f216-4b04-b764-1399db022105 service nova] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:04:58.574845 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6b790815-133b-4d9e-9371-c29e200c4292 req-981e8a9f-f216-4b04-b764-1399db022105 service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:04:58.575118 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6b790815-133b-4d9e-9371-c29e200c4292 req-981e8a9f-f216-4b04-b764-1399db022105 service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:04:58.575233 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6b790815-133b-4d9e-9371-c29e200c4292 req-981e8a9f-f216-4b04-b764-1399db022105 service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] No waiting events found dispatching network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:04:58.575449 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-6b790815-133b-4d9e-9371-c29e200c4292 req-981e8a9f-f216-4b04-b764-1399db022105 service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received unexpected event network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 for instance with vm_state active and task_state powering-off.
May 27 03:04:58.681713 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:58.723152 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:58.922017 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999561201000233 future=<Future at 0x7557047c9e50 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:58.924986 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.996397706000153 future=<Future at 0x7557047c9e50 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:58.926337 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.996166163999987 future=<Future at 0x7557047c9e50 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:04:58.933293 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:58.936644 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Instance destroyed successfully.
May 27 03:04:58.937148 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-4fbfb387-984d-44fb-b6ce-288aad4dba26 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'numa_topology' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:04:59.060161 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:59.061871 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:04:59.061871 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No VIF found with MAC fa:16:3e:6d:20:b3, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:04:59.061974 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Using config drive
May 27 03:04:59.090467 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:59.107061 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:59.107607 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:59.142770 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:59.155819 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:04:59.439106 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-4fbfb387-984d-44fb-b6ce-288aad4dba26 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Object Instance<bb06d928-2b8c-46f2-b61d-fdb19af4017e> lazy-loaded attributes: flavor,numa_topology {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:04:59.439411 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-4fbfb387-984d-44fb-b6ce-288aad4dba26 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:04:59.569464 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:04:59.664409 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851099.6639698, 70ca77a6-2f29-4558-abf0-07292a6200cd => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:04:59.664794 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] VM Started (Lifecycle Event)
May 27 03:04:59.716604 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Creating config drive at /opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c/disk.config
May 27 03:04:59.721948 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphyjxv6_8 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:04:59.784097 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphyjxv6_8" returned: 0 in 0.062s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:04:59.953826 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4fbfb387-984d-44fb-b6ce-288aad4dba26 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.602s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:00.117774 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-816df09f-36cc-41b5-b979-fdeed532ba75 req-6b6995ff-63cd-4aa9-8680-6f84041201c5 service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Received event network-vif-plugged-77f2ecc1-416d-42e8-8279-c8119022bfef {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:00.118420 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-816df09f-36cc-41b5-b979-fdeed532ba75 req-6b6995ff-63cd-4aa9-8680-6f84041201c5 service nova] Acquiring lock "70ca77a6-2f29-4558-abf0-07292a6200cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:00.118573 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-816df09f-36cc-41b5-b979-fdeed532ba75 req-6b6995ff-63cd-4aa9-8680-6f84041201c5 service nova] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:00.118724 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-816df09f-36cc-41b5-b979-fdeed532ba75 req-6b6995ff-63cd-4aa9-8680-6f84041201c5 service nova] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:00.118940 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-816df09f-36cc-41b5-b979-fdeed532ba75 req-6b6995ff-63cd-4aa9-8680-6f84041201c5 service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Processing event network-vif-plugged-77f2ecc1-416d-42e8-8279-c8119022bfef {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:05:00.119084 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-816df09f-36cc-41b5-b979-fdeed532ba75 req-6b6995ff-63cd-4aa9-8680-6f84041201c5 service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Received event network-vif-plugged-77f2ecc1-416d-42e8-8279-c8119022bfef {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:00.119249 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-816df09f-36cc-41b5-b979-fdeed532ba75 req-6b6995ff-63cd-4aa9-8680-6f84041201c5 service nova] Acquiring lock "70ca77a6-2f29-4558-abf0-07292a6200cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:00.119409 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-816df09f-36cc-41b5-b979-fdeed532ba75 req-6b6995ff-63cd-4aa9-8680-6f84041201c5 service nova] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:00.119571 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-816df09f-36cc-41b5-b979-fdeed532ba75 req-6b6995ff-63cd-4aa9-8680-6f84041201c5 service nova] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:00.119803 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-816df09f-36cc-41b5-b979-fdeed532ba75 req-6b6995ff-63cd-4aa9-8680-6f84041201c5 service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] No waiting events found dispatching network-vif-plugged-77f2ecc1-416d-42e8-8279-c8119022bfef {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:05:00.121447 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:05:00.121709 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-816df09f-36cc-41b5-b979-fdeed532ba75 req-6b6995ff-63cd-4aa9-8680-6f84041201c5 service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Received unexpected event network-vif-plugged-77f2ecc1-416d-42e8-8279-c8119022bfef for instance with vm_state building and task_state spawning.
May 27 03:05:00.125689 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:05:00.127955 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Instance spawned successfully.
May 27 03:05:00.129513 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:05:00.168468 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:00.171013 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:05:00.227315 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:00.266697 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:00.357889 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:00.614157 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:00.624549 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:00.628457 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:00.640866 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:00.641021 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:00.641521 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:00.641657 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:00.643602 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:00.643602 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:00.648629 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-254dbd5b-8bc5-4788-8f39-7eb0fc699311 req-01b0a8c4-6822-444e-ac86-0fefdc44e14e service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received event network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:00.653080 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-254dbd5b-8bc5-4788-8f39-7eb0fc699311 req-01b0a8c4-6822-444e-ac86-0fefdc44e14e service nova] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:00.653080 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-254dbd5b-8bc5-4788-8f39-7eb0fc699311 req-01b0a8c4-6822-444e-ac86-0fefdc44e14e service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:00.653080 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-254dbd5b-8bc5-4788-8f39-7eb0fc699311 req-01b0a8c4-6822-444e-ac86-0fefdc44e14e service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:00.653080 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-254dbd5b-8bc5-4788-8f39-7eb0fc699311 req-01b0a8c4-6822-444e-ac86-0fefdc44e14e service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] No waiting events found dispatching network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:05:00.653080 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-254dbd5b-8bc5-4788-8f39-7eb0fc699311 req-01b0a8c4-6822-444e-ac86-0fefdc44e14e service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received unexpected event network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 for instance with vm_state stopped and task_state None.
May 27 03:05:00.666295 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:00.672366 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:00.675489 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:05:00.675799 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851100.675585, 70ca77a6-2f29-4558-abf0-07292a6200cd => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:05:00.676130 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] VM Paused (Lifecycle Event)
May 27 03:05:01.150522 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Took 9.29 seconds to spawn the instance on the hypervisor.
May 27 03:05:01.151032 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:01.179820 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:01.182231 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851101.1818798, 70ca77a6-2f29-4558-abf0-07292a6200cd => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:05:01.182356 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] VM Resumed (Lifecycle Event)
May 27 03:05:01.185151 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:01.202231 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:05:01.431074 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'flavor' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:01.661237 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Took 19.75 seconds to build instance.
May 27 03:05:01.691505 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:01.694276 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:05:01.937851 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "refresh_cache-bb06d928-2b8c-46f2-b61d-fdb19af4017e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:05:01.937978 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquired lock "refresh_cache-bb06d928-2b8c-46f2-b61d-fdb19af4017e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:05:01.938178 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:05:01.938408 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'info_cache' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:02.163111 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e923634f-4e8a-4207-8fc2-c69337f04eca tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.260s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:02.197942 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851102.1975665, c3954135-0707-4b78-bfe3-f458ab39f55c => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:05:02.198125 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] VM Started (Lifecycle Event)
May 27 03:05:02.201414 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:02.201717 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:02.201910 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:02.203584 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:02.203584 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:02.204718 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Terminating instance
May 27 03:05:02.214649 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-032a2333-0b93-4959-b60b-a9b3d7a61ff8 req-7076d958-70fa-47c6-8570-4d9abdb1e0b7 service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Received event network-vif-plugged-927538e0-eed1-4097-ab6b-3e4b57e6f1cd {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:02.215083 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-032a2333-0b93-4959-b60b-a9b3d7a61ff8 req-7076d958-70fa-47c6-8570-4d9abdb1e0b7 service nova] Acquiring lock "c3954135-0707-4b78-bfe3-f458ab39f55c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:02.215177 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-032a2333-0b93-4959-b60b-a9b3d7a61ff8 req-7076d958-70fa-47c6-8570-4d9abdb1e0b7 service nova] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:02.215271 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-032a2333-0b93-4959-b60b-a9b3d7a61ff8 req-7076d958-70fa-47c6-8570-4d9abdb1e0b7 service nova] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:02.215445 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-032a2333-0b93-4959-b60b-a9b3d7a61ff8 req-7076d958-70fa-47c6-8570-4d9abdb1e0b7 service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Processing event network-vif-plugged-927538e0-eed1-4097-ab6b-3e4b57e6f1cd {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:05:02.215583 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-032a2333-0b93-4959-b60b-a9b3d7a61ff8 req-7076d958-70fa-47c6-8570-4d9abdb1e0b7 service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Received event network-vif-plugged-927538e0-eed1-4097-ab6b-3e4b57e6f1cd {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:02.219260 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-032a2333-0b93-4959-b60b-a9b3d7a61ff8 req-7076d958-70fa-47c6-8570-4d9abdb1e0b7 service nova] Acquiring lock "c3954135-0707-4b78-bfe3-f458ab39f55c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:02.219515 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-032a2333-0b93-4959-b60b-a9b3d7a61ff8 req-7076d958-70fa-47c6-8570-4d9abdb1e0b7 service nova] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:02.219761 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-032a2333-0b93-4959-b60b-a9b3d7a61ff8 req-7076d958-70fa-47c6-8570-4d9abdb1e0b7 service nova] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:02.220328 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:05:02.220881 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-032a2333-0b93-4959-b60b-a9b3d7a61ff8 req-7076d958-70fa-47c6-8570-4d9abdb1e0b7 service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] No waiting events found dispatching network-vif-plugged-927538e0-eed1-4097-ab6b-3e4b57e6f1cd {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:05:02.220933 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-032a2333-0b93-4959-b60b-a9b3d7a61ff8 req-7076d958-70fa-47c6-8570-4d9abdb1e0b7 service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Received unexpected event network-vif-plugged-927538e0-eed1-4097-ab6b-3e4b57e6f1cd for instance with vm_state building and task_state spawning.
May 27 03:05:02.226162 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:05:02.231689 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Instance spawned successfully.
May 27 03:05:02.232100 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:05:02.443819 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Object Instance<bb06d928-2b8c-46f2-b61d-fdb19af4017e> lazy-loaded attributes: flavor,info_cache {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:05:02.521504 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:02.700759 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:02.702873 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:05:02.712487 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:05:02.745448 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:02.745855 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:02.746328 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:02.746609 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:02.746976 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:02.747627 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:02.761305 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:02.791793 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:02.947140 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:02.965984 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:02.971513 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ec2c20b6-7e37-4993-a29a-df9acff06886 req-4e7c9bed-21db-470e-941c-96a448f031b6 service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Received event network-vif-unplugged-7221e6d5-c2ed-469e-bffd-acfd7b6cb950 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:02.971513 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ec2c20b6-7e37-4993-a29a-df9acff06886 req-4e7c9bed-21db-470e-941c-96a448f031b6 service nova] Acquiring lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:02.971513 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ec2c20b6-7e37-4993-a29a-df9acff06886 req-4e7c9bed-21db-470e-941c-96a448f031b6 service nova] Lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:02.971513 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ec2c20b6-7e37-4993-a29a-df9acff06886 req-4e7c9bed-21db-470e-941c-96a448f031b6 service nova] Lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:02.971513 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ec2c20b6-7e37-4993-a29a-df9acff06886 req-4e7c9bed-21db-470e-941c-96a448f031b6 service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] No waiting events found dispatching network-vif-unplugged-7221e6d5-c2ed-469e-bffd-acfd7b6cb950 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:05:02.971513 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ec2c20b6-7e37-4993-a29a-df9acff06886 req-4e7c9bed-21db-470e-941c-96a448f031b6 service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Received event network-vif-unplugged-7221e6d5-c2ed-469e-bffd-acfd7b6cb950 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:05:02.978044 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:03.089497 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Instance destroyed successfully.
May 27 03:05:03.089497 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lazy-loading 'resources' on Instance uuid 4ac08a8b-4572-4b1f-8ba0-457c80d58b46 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:03.206515 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:05:03.207031 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851103.2065246, c3954135-0707-4b78-bfe3-f458ab39f55c => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:05:03.207031 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] VM Paused (Lifecycle Event)
May 27 03:05:03.269552 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Took 8.64 seconds to spawn the instance on the hypervisor.
May 27 03:05:03.269852 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:03.457714 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:03.593126 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1974489567',display_name='tempest-AttachVolumeNegativeTest-server-1974489567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumenegativetest-server-1974489567',id=38,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHka1t6x4M+86kCahgInMOS/cABU8yQFVS3REP7EGviVCuSjIufXw5tE5GCDq+PUDr25r1yv/c0XKE2YgnSbUpuLM+PMyRjC2aISGQQDSC7EbVV0LcbgCjD2DJZYtBPTHA==',key_name='tempest-keypair-635272299',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:04:23Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f1801e95925498cac899f1414f2b202',ramdisk_id='',reservation_id='r-0byjkrw8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1854580419',owner_user_name='tempest-AttachVolumeNegativeTest-1854580419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca42144366ef44eb81e5c4a23624d281',uuid=4ac08a8b-4572-4b1f-8ba0-457c80d58b46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "address": "fa:16:3e:4d:21:a6", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221e6d5-c2", "ovs_interfaceid": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:05:03.593451 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converting VIF {"id": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "address": "fa:16:3e:4d:21:a6", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7221e6d5-c2", "ovs_interfaceid": "7221e6d5-c2ed-469e-bffd-acfd7b6cb950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:05:03.594358 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:21:a6,bridge_name='br-int',has_traffic_filtering=True,id=7221e6d5-c2ed-469e-bffd-acfd7b6cb950,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7221e6d5-c2') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:05:03.594796 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:21:a6,bridge_name='br-int',has_traffic_filtering=True,id=7221e6d5-c2ed-469e-bffd-acfd7b6cb950,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7221e6d5-c2') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:05:03.596539 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:03.597230 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7221e6d5-c2, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:03.601160 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:05:03.609877 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:03.611442 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:03.611689 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab90cf7e-4b86-4db1-b1bc-547e6a5d44fc) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:03.613461 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:03.614440 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:05:03.623421 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:03.626951 np0000001475 nova-compute[98471]: INFO os_vif [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:21:a6,bridge_name='br-int',has_traffic_filtering=True,id=7221e6d5-c2ed-469e-bffd-acfd7b6cb950,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7221e6d5-c2')
May 27 03:05:03.626951 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Deleting instance files /opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46_del
May 27 03:05:03.627849 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Deletion of /opt/stack/data/nova/instances/4ac08a8b-4572-4b1f-8ba0-457c80d58b46_del complete
May 27 03:05:03.670186 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Updating instance_info_cache with network_info: [{"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:03.709814 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:03.712143 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851103.711658, c3954135-0707-4b78-bfe3-f458ab39f55c => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:05:03.712327 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] VM Resumed (Lifecycle Event)
May 27 03:05:03.787928 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Took 16.19 seconds to build instance.
May 27 03:05:04.139675 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Took 1.43 seconds to destroy the instance on the hypervisor.
May 27 03:05:04.143234 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:05:04.143634 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:05:04.143634 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:05:04.143996 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:04.173868 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Releasing lock "refresh_cache-bb06d928-2b8c-46f2-b61d-fdb19af4017e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:05:04.216557 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:04.221730 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:05:04.293494 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:04.293494 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bacba51-69cb-4e94-85b0-58c5e0f5cbb3 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.702s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:04.304897 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-62c84756-e16b-4a06-8928-cafa5cbb1ac8 req-400f6b76-6d2c-410c-8db5-0c754d08b27e service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Received event network-changed-77f2ecc1-416d-42e8-8279-c8119022bfef {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:04.305971 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-62c84756-e16b-4a06-8928-cafa5cbb1ac8 req-400f6b76-6d2c-410c-8db5-0c754d08b27e service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Refreshing instance network info cache due to event network-changed-77f2ecc1-416d-42e8-8279-c8119022bfef. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:05:04.305971 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-62c84756-e16b-4a06-8928-cafa5cbb1ac8 req-400f6b76-6d2c-410c-8db5-0c754d08b27e service nova] Acquiring lock "refresh_cache-70ca77a6-2f29-4558-abf0-07292a6200cd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:05:04.305971 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-62c84756-e16b-4a06-8928-cafa5cbb1ac8 req-400f6b76-6d2c-410c-8db5-0c754d08b27e service nova] Acquired lock "refresh_cache-70ca77a6-2f29-4558-abf0-07292a6200cd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:05:04.305971 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-62c84756-e16b-4a06-8928-cafa5cbb1ac8 req-400f6b76-6d2c-410c-8db5-0c754d08b27e service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Refreshing network info cache for port 77f2ecc1-416d-42e8-8279-c8119022bfef {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:05:04.729073 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999616734000028 future=<Future at 0x7557047cb800 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:04.815819 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-62c84756-e16b-4a06-8928-cafa5cbb1ac8 req-400f6b76-6d2c-410c-8db5-0c754d08b27e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:05.067395 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0fadbaf6-9435-4053-ab96-baba7d66748c req-1de1a240-2d87-4466-ab7f-17d202987415 service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Received event network-vif-unplugged-7221e6d5-c2ed-469e-bffd-acfd7b6cb950 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:05.067556 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0fadbaf6-9435-4053-ab96-baba7d66748c req-1de1a240-2d87-4466-ab7f-17d202987415 service nova] Acquiring lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:05.067785 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0fadbaf6-9435-4053-ab96-baba7d66748c req-1de1a240-2d87-4466-ab7f-17d202987415 service nova] Lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:05.067832 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0fadbaf6-9435-4053-ab96-baba7d66748c req-1de1a240-2d87-4466-ab7f-17d202987415 service nova] Lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:05.068001 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0fadbaf6-9435-4053-ab96-baba7d66748c req-1de1a240-2d87-4466-ab7f-17d202987415 service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] No waiting events found dispatching network-vif-unplugged-7221e6d5-c2ed-469e-bffd-acfd7b6cb950 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:05:05.068080 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0fadbaf6-9435-4053-ab96-baba7d66748c req-1de1a240-2d87-4466-ab7f-17d202987415 service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Received event network-vif-unplugged-7221e6d5-c2ed-469e-bffd-acfd7b6cb950 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:05:05.189393 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Instance destroyed successfully.
May 27 03:05:05.190602 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'numa_topology' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:05.283852 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-62c84756-e16b-4a06-8928-cafa5cbb1ac8 req-400f6b76-6d2c-410c-8db5-0c754d08b27e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:05.352869 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:05.542863 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-62c84756-e16b-4a06-8928-cafa5cbb1ac8 req-400f6b76-6d2c-410c-8db5-0c754d08b27e service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Updated VIF entry in instance network info cache for port 77f2ecc1-416d-42e8-8279-c8119022bfef. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:05:05.544094 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-62c84756-e16b-4a06-8928-cafa5cbb1ac8 req-400f6b76-6d2c-410c-8db5-0c754d08b27e service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Updating instance_info_cache with network_info: [{"id": "77f2ecc1-416d-42e8-8279-c8119022bfef", "address": "fa:16:3e:00:0b:7f", "network": {"id": "0d667c62-7603-42bb-94fe-f2a3ac9ae7d5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-544867481-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0405565349241dd88ac22d535484e65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f2ecc1-41", "ovs_interfaceid": "77f2ecc1-416d-42e8-8279-c8119022bfef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:05.693513 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Object Instance<bb06d928-2b8c-46f2-b61d-fdb19af4017e> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:05:05.693513 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'resources' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:05.856864 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Took 1.71 seconds to deallocate network for instance.
May 27 03:05:06.048472 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-62c84756-e16b-4a06-8928-cafa5cbb1ac8 req-400f6b76-6d2c-410c-8db5-0c754d08b27e service nova] Releasing lock "refresh_cache-70ca77a6-2f29-4558-abf0-07292a6200cd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:05:06.188915 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:06.197348 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Object Instance<bb06d928-2b8c-46f2-b61d-fdb19af4017e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:05:06.198606 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1752019004',display_name='tempest-AttachVolumeTestJSON-server-1752019004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumetestjson-server-1752019004',id=34,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnCyl+g1Ye4tCJK/b/EmMSENQNCevd73XcwcJq7MM0QjAHn7OQTuI/rqxlNGXTk7F/U6HedbzcDuONEX5G9MqYrebfqRT8YlVYqtYPepNOx2xjMDNgKF5JW2yc7DR5vwA==',key_name='tempest-keypair-224254834',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:03:08Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ca3c6a3942eb41e8b6aefddc5faca789',ramdisk_id='',reservation_id='r-b5nd7f2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1635503347',owner_user_name='tempest-AttachVolumeTestJSON-1635503347-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:04:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0d83ca7002c41e0897c39e7b8d91bff',uuid=bb06d928-2b8c-46f2-b61d-fdb19af4017e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:05:06.198606 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converting VIF {"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:05:06.198858 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:05:06.198934 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:05:06.199705 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:06.199898 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4f71bc7-6b, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:06.200828 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:06.201848 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:05:06.204577 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:06.205981 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:06.205981 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82cd491a-9823-46b2-8056-4e5489005869) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:06.206148 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:06.206805 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:05:06.209495 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:06.216149 np0000001475 nova-compute[98471]: INFO os_vif [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b')
May 27 03:05:06.221013 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Start _get_guest_xml network_info=[{"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:05:06.227974 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:05:06.229103 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1752019004', uuid='bb06d928-2b8c-46f2-b61d-fdb19af4017e'), owner=OwnerMeta(userid='f0d83ca7002c41e0897c39e7b8d91bff', username='tempest-AttachVolumeTestJSON-1635503347-project-member', projectid='ca3c6a3942eb41e8b6aefddc5faca789', projectname='tempest-AttachVolumeTestJSON-1635503347'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851106.2286844) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:05:06.230586 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:05:06.230925 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:05:06.233158 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:05:06.233381 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:05:06.234618 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:05:06.234910 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:05:06.235072 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:05:06.235183 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:05:06.235295 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:05:06.235398 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:05:06.235574 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:05:06.235705 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:05:06.235853 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:05:06.235966 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:05:06.236059 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:05:06.236177 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:05:06.236342 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'vcpu_model' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:06.363043 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:06.363517 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:06.396356 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-893175ac-8390-4cb1-8d7f-47c234296dcc req-d377e95e-13e4-47f6-a623-83b2595e896a service nova] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Received event network-vif-deleted-7221e6d5-c2ed-469e-bffd-acfd7b6cb950 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:06.396356 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-893175ac-8390-4cb1-8d7f-47c234296dcc req-d377e95e-13e4-47f6-a623-83b2595e896a service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Received event network-changed-77f2ecc1-416d-42e8-8279-c8119022bfef {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:06.396456 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-893175ac-8390-4cb1-8d7f-47c234296dcc req-d377e95e-13e4-47f6-a623-83b2595e896a service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Refreshing instance network info cache due to event network-changed-77f2ecc1-416d-42e8-8279-c8119022bfef. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:05:06.396603 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-893175ac-8390-4cb1-8d7f-47c234296dcc req-d377e95e-13e4-47f6-a623-83b2595e896a service nova] Acquiring lock "refresh_cache-70ca77a6-2f29-4558-abf0-07292a6200cd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:05:06.397993 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-893175ac-8390-4cb1-8d7f-47c234296dcc req-d377e95e-13e4-47f6-a623-83b2595e896a service nova] Acquired lock "refresh_cache-70ca77a6-2f29-4558-abf0-07292a6200cd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:05:06.397993 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-893175ac-8390-4cb1-8d7f-47c234296dcc req-d377e95e-13e4-47f6-a623-83b2595e896a service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Refreshing network info cache for port 77f2ecc1-416d-42e8-8279-c8119022bfef {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:05:06.437236 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Refreshing inventories for resource provider 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 27 03:05:06.517011 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Updating ProviderTree inventory for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 27 03:05:06.517478 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Updating inventory in ProviderTree for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 27 03:05:06.578814 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Refreshing aggregate associations for resource provider 379b682a-2af7-4cd6-bb46-9d0c412d430a, aggregates: None {{(pid=98471) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 27 03:05:06.651113 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Refreshing trait associations for resource provider 379b682a-2af7-4cd6-bb46-9d0c412d430a, traits: HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ARCH_X86_64,HW_CPU_X86_SSSE3,COMPUTE_ARCH_S390X,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NODE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ARCH_RISCV64,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ARCH_AARCH64,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_MIPSEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_ARCH_X86_64,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE {{(pid=98471) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 27 03:05:06.742792 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Object Instance<bb06d928-2b8c-46f2-b61d-fdb19af4017e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:05:06.772191 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1752019004',display_name='tempest-AttachVolumeTestJSON-server-1752019004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumetestjson-server-1752019004',id=34,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnCyl+g1Ye4tCJK/b/EmMSENQNCevd73XcwcJq7MM0QjAHn7OQTuI/rqxlNGXTk7F/U6HedbzcDuONEX5G9MqYrebfqRT8YlVYqtYPepNOx2xjMDNgKF5JW2yc7DR5vwA==',key_name='tempest-keypair-224254834',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:03:08Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ca3c6a3942eb41e8b6aefddc5faca789',ramdisk_id='',reservation_id='r-b5nd7f2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1635503347',owner_user_name='tempest-AttachVolumeTestJSON-1635503347-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:04:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0d83ca7002c41e0897c39e7b8d91bff',uuid=bb06d928-2b8c-46f2-b61d-fdb19af4017e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:05:06.772191 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converting VIF {"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:05:06.773087 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:05:06.774176 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'pci_devices' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:06.900407 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-893175ac-8390-4cb1-8d7f-47c234296dcc req-d377e95e-13e4-47f6-a623-83b2595e896a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:07.154191 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-12a61123-30e3-4c47-937a-c21cea59579d req-66c93b56-6df0-4d4c-9b1f-f9a5b4110d2b service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Received event network-changed-927538e0-eed1-4097-ab6b-3e4b57e6f1cd {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:07.154566 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-12a61123-30e3-4c47-937a-c21cea59579d req-66c93b56-6df0-4d4c-9b1f-f9a5b4110d2b service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Refreshing instance network info cache due to event network-changed-927538e0-eed1-4097-ab6b-3e4b57e6f1cd. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:05:07.154566 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-12a61123-30e3-4c47-937a-c21cea59579d req-66c93b56-6df0-4d4c-9b1f-f9a5b4110d2b service nova] Acquiring lock "refresh_cache-c3954135-0707-4b78-bfe3-f458ab39f55c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:05:07.154731 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-12a61123-30e3-4c47-937a-c21cea59579d req-66c93b56-6df0-4d4c-9b1f-f9a5b4110d2b service nova] Acquired lock "refresh_cache-c3954135-0707-4b78-bfe3-f458ab39f55c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:05:07.154731 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-12a61123-30e3-4c47-937a-c21cea59579d req-66c93b56-6df0-4d4c-9b1f-f9a5b4110d2b service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Refreshing network info cache for port 927538e0-eed1-4097-ab6b-3e4b57e6f1cd {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:05:07.280066 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Object Instance<bb06d928-2b8c-46f2-b61d-fdb19af4017e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:05:07.282548 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] End _get_guest_xml xml=<domain type="qemu">
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:   <uuid>bb06d928-2b8c-46f2-b61d-fdb19af4017e</uuid>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:   <name>instance-00000022</name>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <nova:name>tempest-AttachVolumeTestJSON-server-1752019004</nova:name>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:05:06</nova:creationTime>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:         <nova:user uuid="f0d83ca7002c41e0897c39e7b8d91bff">tempest-AttachVolumeTestJSON-1635503347-project-member</nova:user>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:         <nova:project uuid="ca3c6a3942eb41e8b6aefddc5faca789">tempest-AttachVolumeTestJSON-1635503347</nova:project>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:         <nova:port uuid="f4f71bc7-6b31-42c9-8f6c-2bc91e87a157">
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     <system>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <entry name="serial">bb06d928-2b8c-46f2-b61d-fdb19af4017e</entry>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <entry name="uuid">bb06d928-2b8c-46f2-b61d-fdb19af4017e</entry>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     </system>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:   <os>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:   </os>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:   <features>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:   </features>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:   <devices>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     </disk>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk.config"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     </disk>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:58:79:ce"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <target dev="tapf4f71bc7-6b"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     </interface>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/console.log" append="off"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     </serial>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     <video>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     </video>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     </rng>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:   </devices>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]: </domain>
May 27 03:05:07.282548 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:05:07.286611 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:07.349302 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0a721c85-8257-4426-b211-2d9582b620ce tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:07.349801 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0a721c85-8257-4426-b211-2d9582b620ce tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:07.357063 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:05:07.357167 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:05:07.363077 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-893175ac-8390-4cb1-8d7f-47c234296dcc req-d377e95e-13e4-47f6-a623-83b2595e896a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:07.419830 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:07.420981 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:07.552477 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:07.554589 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'trusted_certs' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:07.577708 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-893175ac-8390-4cb1-8d7f-47c234296dcc req-d377e95e-13e4-47f6-a623-83b2595e896a service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Updated VIF entry in instance network info cache for port 77f2ecc1-416d-42e8-8279-c8119022bfef. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:05:07.578341 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-893175ac-8390-4cb1-8d7f-47c234296dcc req-d377e95e-13e4-47f6-a623-83b2595e896a service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Updating instance_info_cache with network_info: [{"id": "77f2ecc1-416d-42e8-8279-c8119022bfef", "address": "fa:16:3e:00:0b:7f", "network": {"id": "0d667c62-7603-42bb-94fe-f2a3ac9ae7d5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-544867481-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0405565349241dd88ac22d535484e65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f2ecc1-41", "ovs_interfaceid": "77f2ecc1-416d-42e8-8279-c8119022bfef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:07.657555 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-12a61123-30e3-4c47-937a-c21cea59579d req-66c93b56-6df0-4d4c-9b1f-f9a5b4110d2b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:07.855122 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-0a721c85-8257-4426-b211-2d9582b620ce tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Detaching volume 8cd7c930-2109-4c04-85a8-31ac0ce9341e
May 27 03:05:07.866816 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:05:07.915481 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-0a721c85-8257-4426-b211-2d9582b620ce tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Attempting to driver detach volume 8cd7c930-2109-4c04-85a8-31ac0ce9341e from mountpoint /dev/vdb
May 27 03:05:07.929419 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0a721c85-8257-4426-b211-2d9582b620ce tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Found disk vdb by alias ua-8cd7c930-2109-4c04-85a8-31ac0ce9341e {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:05:07.933399 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0a721c85-8257-4426-b211-2d9582b620ce tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Found disk vdb by alias ua-8cd7c930-2109-4c04-85a8-31ac0ce9341e {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:05:07.933577 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0a721c85-8257-4426-b211-2d9582b620ce tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Attempting to detach device vdb from instance c2a5e735-d573-4ac4-bff0-d4a12648718e from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:05:07.933882 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-0a721c85-8257-4426-b211-2d9582b620ce tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:05:07.933882 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:05:07.933882 np0000001475 nova-compute[98471]:   <alias name="ua-8cd7c930-2109-4c04-85a8-31ac0ce9341e"/>
May 27 03:05:07.933882 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-6"/>
May 27 03:05:07.933882 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:05:07.933882 np0000001475 nova-compute[98471]:   <serial>8cd7c930-2109-4c04-85a8-31ac0ce9341e</serial>
May 27 03:05:07.933882 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:05:07.933882 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 03:05:07.933882 np0000001475 nova-compute[98471]: </disk>
May 27 03:05:07.933882 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:05:07.943233 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-0a721c85-8257-4426-b211-2d9582b620ce tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully detached device vdb from instance c2a5e735-d573-4ac4-bff0-d4a12648718e from the persistent domain config.
May 27 03:05:07.943562 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0a721c85-8257-4426-b211-2d9582b620ce tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] (1/8): Attempting to detach device vdb with device alias ua-8cd7c930-2109-4c04-85a8-31ac0ce9341e from instance c2a5e735-d573-4ac4-bff0-d4a12648718e from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:05:07.944763 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-0a721c85-8257-4426-b211-2d9582b620ce tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:05:07.944763 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:05:07.944763 np0000001475 nova-compute[98471]:   <alias name="ua-8cd7c930-2109-4c04-85a8-31ac0ce9341e"/>
May 27 03:05:07.944763 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-6"/>
May 27 03:05:07.944763 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:05:07.944763 np0000001475 nova-compute[98471]:   <serial>8cd7c930-2109-4c04-85a8-31ac0ce9341e</serial>
May 27 03:05:07.944763 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:05:07.944763 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 03:05:07.944763 np0000001475 nova-compute[98471]: </disk>
May 27 03:05:07.944763 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:05:08.060240 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Object Instance<bb06d928-2b8c-46f2-b61d-fdb19af4017e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:05:08.067145 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:08.095114 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-893175ac-8390-4cb1-8d7f-47c234296dcc req-d377e95e-13e4-47f6-a623-83b2595e896a service nova] Releasing lock "refresh_cache-70ca77a6-2f29-4558-abf0-07292a6200cd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:05:08.164320 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-12a61123-30e3-4c47-937a-c21cea59579d req-66c93b56-6df0-4d4c-9b1f-f9a5b4110d2b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:08.188549 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.121s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:08.192460 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:05:08.192768 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:08.304446 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:08.304857 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Cannot resize image /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:05:08.305178 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'migration_context' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:08.376020 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.011s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:08.381972 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-12a61123-30e3-4c47-937a-c21cea59579d req-66c93b56-6df0-4d4c-9b1f-f9a5b4110d2b service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Updated VIF entry in instance network info cache for port 927538e0-eed1-4097-ab6b-3e4b57e6f1cd. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:05:08.381972 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-12a61123-30e3-4c47-937a-c21cea59579d req-66c93b56-6df0-4d4c-9b1f-f9a5b4110d2b service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Updating instance_info_cache with network_info: [{"id": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "address": "fa:16:3e:6d:20:b3", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap927538e0-ee", "ovs_interfaceid": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:08.456807 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Deleted allocations for instance 4ac08a8b-4572-4b1f-8ba0-457c80d58b46
May 27 03:05:08.610147 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851108.6097271, c2a5e735-d573-4ac4-bff0-d4a12648718e => ua-8cd7c930-2109-4c04-85a8-31ac0ce9341e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:05:08.611117 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0a721c85-8257-4426-b211-2d9582b620ce tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8cd7c930-2109-4c04-85a8-31ac0ce9341e for instance c2a5e735-d573-4ac4-bff0-d4a12648718e {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:05:08.617757 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-0a721c85-8257-4426-b211-2d9582b620ce tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully detached device vdb from instance c2a5e735-d573-4ac4-bff0-d4a12648718e from the live domain config.
May 27 03:05:08.808534 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Object Instance<bb06d928-2b8c-46f2-b61d-fdb19af4017e> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:05:08.809975 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1752019004',display_name='tempest-AttachVolumeTestJSON-server-1752019004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumetestjson-server-1752019004',id=34,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnCyl+g1Ye4tCJK/b/EmMSENQNCevd73XcwcJq7MM0QjAHn7OQTuI/rqxlNGXTk7F/U6HedbzcDuONEX5G9MqYrebfqRT8YlVYqtYPepNOx2xjMDNgKF5JW2yc7DR5vwA==',key_name='tempest-keypair-224254834',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:03:08Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ca3c6a3942eb41e8b6aefddc5faca789',ramdisk_id='',reservation_id='r-b5nd7f2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1635503347',owner_user_name='tempest-AttachVolumeTestJSON-1635503347-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:04:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0d83ca7002c41e0897c39e7b8d91bff',uuid=bb06d928-2b8c-46f2-b61d-fdb19af4017e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:05:08.810390 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converting VIF {"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:05:08.810949 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:05:08.811279 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:05:08.811879 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:08.814363 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:08.815123 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:05:08.816830 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:08.817190 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5c2e64e-bf8d-5466-bd31-3b3c07150ed3', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:08.818184 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:08.819443 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:05:08.820318 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:08.825934 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:08.826158 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4f71bc7-6b, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:08.826609 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4f71bc7-6b, col_values=(('qos', UUID('bbfecf44-e6c0-4988-b1c8-76b1ac26214e')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:08.826830 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4f71bc7-6b, col_values=(('external_ids', {'iface-id': 'f4f71bc7-6b31-42c9-8f6c-2bc91e87a157', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:79:ce', 'vm-uuid': 'bb06d928-2b8c-46f2-b61d-fdb19af4017e'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:08.827839 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:08.829347 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:05:08.835715 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:08.838093 np0000001475 nova-compute[98471]: INFO os_vif [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b')
May 27 03:05:08.887430 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-12a61123-30e3-4c47-937a-c21cea59579d req-66c93b56-6df0-4d4c-9b1f-f9a5b4110d2b service nova] Releasing lock "refresh_cache-c3954135-0707-4b78-bfe3-f458ab39f55c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:05:09.177506 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-0a721c85-8257-4426-b211-2d9582b620ce tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Detected multiple connections on this host for volume: 8cd7c930-2109-4c04-85a8-31ac0ce9341e, skipping target disconnect.
May 27 03:05:09.344502 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:09.384992 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:09.468032 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0a7e58e1-dda5-4dd2-a11b-211ac8ca712f tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "4ac08a8b-4572-4b1f-8ba0-457c80d58b46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.266s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:09.488111 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:09.651230 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7d1d0b9d-d971-4f19-a678-a899d4a5f192 req-2e32e2f4-5934-4a1d-b793-b47ada5ff7c0 service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received event network-vif-plugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:09.652243 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7d1d0b9d-d971-4f19-a678-a899d4a5f192 req-2e32e2f4-5934-4a1d-b793-b47ada5ff7c0 service nova] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:09.652513 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7d1d0b9d-d971-4f19-a678-a899d4a5f192 req-2e32e2f4-5934-4a1d-b793-b47ada5ff7c0 service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:09.652694 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7d1d0b9d-d971-4f19-a678-a899d4a5f192 req-2e32e2f4-5934-4a1d-b793-b47ada5ff7c0 service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:09.652905 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7d1d0b9d-d971-4f19-a678-a899d4a5f192 req-2e32e2f4-5934-4a1d-b793-b47ada5ff7c0 service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] No waiting events found dispatching network-vif-plugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:05:09.653086 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-7d1d0b9d-d971-4f19-a678-a899d4a5f192 req-2e32e2f4-5934-4a1d-b793-b47ada5ff7c0 service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received unexpected event network-vif-plugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 for instance with vm_state stopped and task_state powering-on.
May 27 03:05:09.767483 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-0a721c85-8257-4426-b211-2d9582b620ce tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'flavor' on Instance uuid c2a5e735-d573-4ac4-bff0-d4a12648718e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:09.828135 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:09.828135 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:09.832620 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:09.851791 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:10.427155 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Instance event wait completed in 0 seconds for  {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:05:10.429613 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Removed pending STOPPED event for bb06d928-2b8c-46f2-b61d-fdb19af4017e due to new event <LifecycleEvent: 1779851110.4275746, bb06d928-2b8c-46f2-b61d-fdb19af4017e => Resumed> {{(pid=98471) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 03:05:10.429613 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851110.4275746, bb06d928-2b8c-46f2-b61d-fdb19af4017e => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:05:10.429613 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] VM Resumed (Lifecycle Event)
May 27 03:05:10.434347 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Instance rebooted successfully.
May 27 03:05:10.782507 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0a721c85-8257-4426-b211-2d9582b620ce tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.432s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:10.816992 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "d7f71824-f631-423e-a5ea-8ae72642a95e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:10.819281 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:10.837927 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "1efec6a6-a26c-46fa-9370-60859f41c1a5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:10.837927 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:10.931479 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:10.934026 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:05:11.188234 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:11.321625 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Detaching volume 8cd7c930-2109-4c04-85a8-31ac0ce9341e
May 27 03:05:11.343334 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Detaching volume 4eba01c4-5fa0-4932-aedd-b9f70b262c6d
May 27 03:05:11.374573 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Attempting to driver detach volume 8cd7c930-2109-4c04-85a8-31ac0ce9341e from mountpoint /dev/vdb
May 27 03:05:11.385199 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Found disk vdb by alias ua-8cd7c930-2109-4c04-85a8-31ac0ce9341e {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:05:11.386889 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Found disk vdb by alias ua-8cd7c930-2109-4c04-85a8-31ac0ce9341e {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:05:11.387061 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Attempting to detach device vdb from instance d7f71824-f631-423e-a5ea-8ae72642a95e from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:05:11.387758 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:05:11.387758 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:05:11.387758 np0000001475 nova-compute[98471]:   <alias name="ua-8cd7c930-2109-4c04-85a8-31ac0ce9341e"/>
May 27 03:05:11.387758 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-6"/>
May 27 03:05:11.387758 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:05:11.387758 np0000001475 nova-compute[98471]:   <serial>8cd7c930-2109-4c04-85a8-31ac0ce9341e</serial>
May 27 03:05:11.387758 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:05:11.387758 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 03:05:11.387758 np0000001475 nova-compute[98471]: </disk>
May 27 03:05:11.387758 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:05:11.395012 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully detached device vdb from instance d7f71824-f631-423e-a5ea-8ae72642a95e from the persistent domain config.
May 27 03:05:11.395228 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] (1/8): Attempting to detach device vdb with device alias ua-8cd7c930-2109-4c04-85a8-31ac0ce9341e from instance d7f71824-f631-423e-a5ea-8ae72642a95e from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:05:11.396668 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:05:11.396668 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:05:11.396668 np0000001475 nova-compute[98471]:   <alias name="ua-8cd7c930-2109-4c04-85a8-31ac0ce9341e"/>
May 27 03:05:11.396668 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-6"/>
May 27 03:05:11.396668 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:05:11.396668 np0000001475 nova-compute[98471]:   <serial>8cd7c930-2109-4c04-85a8-31ac0ce9341e</serial>
May 27 03:05:11.396668 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:05:11.396668 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 03:05:11.396668 np0000001475 nova-compute[98471]: </disk>
May 27 03:05:11.396668 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:05:11.420621 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Attempting to driver detach volume 4eba01c4-5fa0-4932-aedd-b9f70b262c6d from mountpoint /dev/vdb
May 27 03:05:11.425120 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Found disk vdb by alias ua-4eba01c4-5fa0-4932-aedd-b9f70b262c6d {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:05:11.427234 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Found disk vdb by alias ua-4eba01c4-5fa0-4932-aedd-b9f70b262c6d {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:05:11.427692 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Attempting to detach device vdb from instance 1efec6a6-a26c-46fa-9370-60859f41c1a5 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:05:11.427961 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:05:11.427961 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:05:11.427961 np0000001475 nova-compute[98471]:   <alias name="ua-4eba01c4-5fa0-4932-aedd-b9f70b262c6d"/>
May 27 03:05:11.427961 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:05:11.427961 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:05:11.427961 np0000001475 nova-compute[98471]:   <serial>4eba01c4-5fa0-4932-aedd-b9f70b262c6d</serial>
May 27 03:05:11.427961 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:05:11.427961 np0000001475 nova-compute[98471]: </disk>
May 27 03:05:11.427961 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:05:11.435527 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Successfully detached device vdb from instance 1efec6a6-a26c-46fa-9370-60859f41c1a5 from the persistent domain config.
May 27 03:05:11.435708 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] (1/8): Attempting to detach device vdb with device alias ua-4eba01c4-5fa0-4932-aedd-b9f70b262c6d from instance 1efec6a6-a26c-46fa-9370-60859f41c1a5 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:05:11.438413 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:05:11.438413 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:05:11.438413 np0000001475 nova-compute[98471]:   <alias name="ua-4eba01c4-5fa0-4932-aedd-b9f70b262c6d"/>
May 27 03:05:11.438413 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:05:11.438413 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:05:11.438413 np0000001475 nova-compute[98471]:   <serial>4eba01c4-5fa0-4932-aedd-b9f70b262c6d</serial>
May 27 03:05:11.438413 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:05:11.438413 np0000001475 nova-compute[98471]: </disk>
May 27 03:05:11.438413 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:05:11.438413 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] During sync_power_state the instance has a pending task (powering-on). Skip.
May 27 03:05:11.438413 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851111.4370582, bb06d928-2b8c-46f2-b61d-fdb19af4017e => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:05:11.438413 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] VM Started (Lifecycle Event)
May 27 03:05:11.717643 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-23c123c8-8ac7-497d-9d48-7abd1c2187a6 req-b4c510cc-f0d3-41ce-b9ca-db2cc08ddb1f service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received event network-vif-plugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:11.717891 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-23c123c8-8ac7-497d-9d48-7abd1c2187a6 req-b4c510cc-f0d3-41ce-b9ca-db2cc08ddb1f service nova] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:11.718077 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-23c123c8-8ac7-497d-9d48-7abd1c2187a6 req-b4c510cc-f0d3-41ce-b9ca-db2cc08ddb1f service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:11.718458 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-23c123c8-8ac7-497d-9d48-7abd1c2187a6 req-b4c510cc-f0d3-41ce-b9ca-db2cc08ddb1f service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:11.718799 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-23c123c8-8ac7-497d-9d48-7abd1c2187a6 req-b4c510cc-f0d3-41ce-b9ca-db2cc08ddb1f service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] No waiting events found dispatching network-vif-plugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:05:11.718799 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-23c123c8-8ac7-497d-9d48-7abd1c2187a6 req-b4c510cc-f0d3-41ce-b9ca-db2cc08ddb1f service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received unexpected event network-vif-plugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 for instance with vm_state stopped and task_state powering-on.
May 27 03:05:11.944707 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:11.953988 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:05:11.959289 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:05:11.959406 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:05:11.959629 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No VIF found with MAC fa:16:3e:58:79:ce, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:05:11.960320 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00c48325-f913-49d7-a5df-3dd7920e5c37 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:12.037572 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4eba01c4-5fa0-4932-aedd-b9f70b262c6d for instance 1efec6a6-a26c-46fa-9370-60859f41c1a5 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:05:12.457730 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] During sync_power_state the instance has a pending task (powering-on). Skip.
May 27 03:05:12.458573 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851112.4578197, 1efec6a6-a26c-46fa-9370-60859f41c1a5 => ua-4eba01c4-5fa0-4932-aedd-b9f70b262c6d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:05:12.461000 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Successfully detached device vdb from instance 1efec6a6-a26c-46fa-9370-60859f41c1a5 from the live domain config.
May 27 03:05:12.462770 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:05:12.462770 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4eba01c4-5fa0-4932-aedd-b9f70b262c6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:05:12.462770 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:05:12.462770 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:05:12.463259 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4eba01c4-5fa0-4932-aedd-b9f70b262c6d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:05:12.463547 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:05:12.496373 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:12.496373 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:12.496373 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:05:12.496373 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:05:12.496373 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:05:12.496373 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:05:12.496373 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:12.496373 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:12.496373 np0000001475 nova-compute[98471]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bce51d2-6c6e-4e7a-9ea0-4b99ccec18cf (non-flash)
May 27 03:05:12.496373 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:05:12.496373 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:12.496373 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:12.496373 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:05:12.496373 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:05:12.496373 np0000001475 nova-compute[98471]: tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:05:12.496373 np0000001475 nova-compute[98471]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d (non-flash)
May 27 03:05:12.496373 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:12.496373 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:12.496373 np0000001475 nova-compute[98471]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0bce51d2-6c6e-4e7a-9ea0-4b99ccec18cf (non-flash)
May 27 03:05:12.496373 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:05:12.496373 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0bce51d2-6c6e-4e7a-9ea0-4b99ccec18cf', '85')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:05:12.496373 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', '69')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:05:12.501039 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d', '70')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:05:12.501039 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755724758360>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d'): ({'sdk'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:05:12.501039 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Removing multipathed devices sdj, sdk {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:05:12.501039 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Flush multipath device 33000000082418c7a {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:05:12.536007 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:05:12.577715 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:05:12.626206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:05:12.626206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:05:12.626206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:05:12.644991 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:05:12.645497 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:05:12.658848 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:12.695491 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d, portal: 192.168.40.100,3260]
May 27 03:05:12.695491 np0000001475 nova-compute[98471]: Logout of [sid: 69, target: iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d, portal: 192.168.40.100,3260] successful.
May 27 03:05:12.695491 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:12.717453 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:12.730109 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:12.771778 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d, portal: 192.168.50.100,3260]
May 27 03:05:12.771778 np0000001475 nova-compute[98471]: Logout of [sid: 70, target: iqn.2023-03.storpool.com:os--volume-4eba01c4-5fa0-4932-aedd-b9f70b262c6d, portal: 192.168.50.100,3260] successful.
May 27 03:05:12.771778 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:12.789241 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:12.789241 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:05:12.789241 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] <== disconnect_volume: return (326ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:05:12.789241 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:05:13.362176 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lazy-loading 'flavor' on Instance uuid 1efec6a6-a26c-46fa-9370-60859f41c1a5 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:13.831176 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:13.921801 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0003882629998770426 future=<Future at 0x7557047c9e50 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:13.921948 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:13.922104 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=5.806486023000161 future=<Future at 0x7557047cb800 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:13.922196 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=5.80637729099999 future=<Future at 0x7557047cb800 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:14.366965 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e232da44-fb29-4698-8b9e-ed4247e47dc0 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.529s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:14.663515 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851114.6631627, d7f71824-f631-423e-a5ea-8ae72642a95e => ua-8cd7c930-2109-4c04-85a8-31ac0ce9341e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:05:14.667390 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8cd7c930-2109-4c04-85a8-31ac0ce9341e for instance d7f71824-f631-423e-a5ea-8ae72642a95e {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:05:14.671693 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully detached device vdb from instance d7f71824-f631-423e-a5ea-8ae72642a95e from the live domain config.
May 27 03:05:14.711729 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:05:14.712195 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:05:14.712448 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:05:14.712816 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:05:14.713053 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8cd7c930-2109-4c04-85a8-31ac0ce9341e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:05:14.713178 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:05:14.741729 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:14.741729 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:14.741729 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:05:14.741729 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:05:14.741729 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:14.741729 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:14.741729 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:05:14.742006 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:14.742006 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:14.742006 np0000001475 nova-compute[98471]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:05:14.742006 np0000001475 nova-compute[98471]: tcp: [62] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e (non-flash)
May 27 03:05:14.742006 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:14.742006 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:14.742006 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:05:14.742134 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', '84')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:05:14.742134 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '61')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:05:14.743110 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e', '62')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:05:14.743862 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c29fe20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e'): ({'sdi'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:05:14.744045 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Removing multipathed devices sdi, sdh {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:05:14.744268 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Flush multipath device 3300000007d606cb0 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:05:14.783972 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:05:14.821392 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:05:14.860381 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:05:14.860780 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:05:14.862158 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:05:14.873781 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:05:14.874128 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:05:14.890535 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:14.921515 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e, portal: 192.168.40.100,3260]
May 27 03:05:14.921515 np0000001475 nova-compute[98471]: Logout of [sid: 61, target: iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e, portal: 192.168.40.100,3260] successful.
May 27 03:05:14.921515 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:14.935876 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:14.949425 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:14.979829 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e, portal: 192.168.50.100,3260]
May 27 03:05:14.979829 np0000001475 nova-compute[98471]: Logout of [sid: 62, target: iqn.2023-03.storpool.com:os--volume-8cd7c930-2109-4c04-85a8-31ac0ce9341e, portal: 192.168.50.100,3260] successful.
May 27 03:05:14.979829 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:14.999925 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:14.999925 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:05:14.999925 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] <== disconnect_volume: return (287ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:05:15.000280 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:05:15.272606 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "1efec6a6-a26c-46fa-9370-60859f41c1a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:15.272851 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:15.273077 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:15.273282 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:15.273462 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:15.275761 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Terminating instance
May 27 03:05:15.570701 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'flavor' on Instance uuid d7f71824-f631-423e-a5ea-8ae72642a95e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:15.779932 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:05:15.806596 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:15.815350 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:15.832607 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:15.840785 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:15.856389 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:15.863020 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:16.022863 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ee8c1cdb-c8f8-4696-98d0-7d1748eb4b65 req-cd8697ab-15ed-4a69-8a36-ca9d7efb76de service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Received event network-vif-unplugged-dab9dc9d-db9a-4cd4-a59a-fe204f719f1a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:16.023099 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ee8c1cdb-c8f8-4696-98d0-7d1748eb4b65 req-cd8697ab-15ed-4a69-8a36-ca9d7efb76de service nova] Acquiring lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:16.023362 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ee8c1cdb-c8f8-4696-98d0-7d1748eb4b65 req-cd8697ab-15ed-4a69-8a36-ca9d7efb76de service nova] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:16.023550 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ee8c1cdb-c8f8-4696-98d0-7d1748eb4b65 req-cd8697ab-15ed-4a69-8a36-ca9d7efb76de service nova] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:16.023757 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ee8c1cdb-c8f8-4696-98d0-7d1748eb4b65 req-cd8697ab-15ed-4a69-8a36-ca9d7efb76de service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] No waiting events found dispatching network-vif-unplugged-dab9dc9d-db9a-4cd4-a59a-fe204f719f1a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:05:16.024016 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ee8c1cdb-c8f8-4696-98d0-7d1748eb4b65 req-cd8697ab-15ed-4a69-8a36-ca9d7efb76de service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Received event network-vif-unplugged-dab9dc9d-db9a-4cd4-a59a-fe204f719f1a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:05:16.164339 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999683169000036 future=<Future at 0x755704402510 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:16.166499 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Instance destroyed successfully.
May 27 03:05:16.167120 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lazy-loading 'resources' on Instance uuid 1efec6a6-a26c-46fa-9370-60859f41c1a5 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:16.193157 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:16.578909 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-921bc150-4221-420a-9320-c036f5412da3 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.762s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:16.675981 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1340861760',display_name='tempest-AttachVolumeNegativeTest-server-1340861760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumenegativetest-server-1340861760',id=35,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVHH0IguZBlDv00sDx71oMd2+F33DWWdUbt05w4Mu7RTsI2o6x6EPq3H8GCS+kKFv3PHXMFRuVZtOYSdMj8L+J6rV9q0Hisg0lpkL0j1Vy4T6Fgu44k6NuzSnzNv+v4Kw==',key_name='tempest-keypair-276585317',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:03:15Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f1801e95925498cac899f1414f2b202',ramdisk_id='',reservation_id='r-9ls66omb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1854580419',owner_user_name='tempest-AttachVolumeNegativeTest-1854580419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:03:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca42144366ef44eb81e5c4a23624d281',uuid=1efec6a6-a26c-46fa-9370-60859f41c1a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "address": "fa:16:3e:2d:76:bb", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab9dc9d-db", "ovs_interfaceid": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:05:16.675981 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converting VIF {"id": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "address": "fa:16:3e:2d:76:bb", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab9dc9d-db", "ovs_interfaceid": "dab9dc9d-db9a-4cd4-a59a-fe204f719f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:05:16.675981 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:76:bb,bridge_name='br-int',has_traffic_filtering=True,id=dab9dc9d-db9a-4cd4-a59a-fe204f719f1a,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab9dc9d-db') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:05:16.675981 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:76:bb,bridge_name='br-int',has_traffic_filtering=True,id=dab9dc9d-db9a-4cd4-a59a-fe204f719f1a,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab9dc9d-db') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:05:16.678158 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:16.678605 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdab9dc9d-db, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:16.681261 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:16.681486 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:05:16.683320 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:16.683634 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e388c57-9134-4bd9-b5fc-03e0a644d729) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:16.684379 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:16.686332 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:05:16.689106 np0000001475 nova-compute[98471]: INFO os_vif [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:76:bb,bridge_name='br-int',has_traffic_filtering=True,id=dab9dc9d-db9a-4cd4-a59a-fe204f719f1a,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab9dc9d-db')
May 27 03:05:16.690166 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Deleting instance files /opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5_del
May 27 03:05:16.691796 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Deletion of /opt/stack/data/nova/instances/1efec6a6-a26c-46fa-9370-60859f41c1a5_del complete
May 27 03:05:17.199654 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Took 1.42 seconds to destroy the instance on the hypervisor.
May 27 03:05:17.200321 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:05:17.200694 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:05:17.200815 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:05:17.201077 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:17.290260 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:17.953537 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1713e027-b43a-40a8-b6c7-3e5d35016056 req-86b05139-7df0-4e10-a81a-ea93466e3138 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Received event network-vif-deleted-dab9dc9d-db9a-4cd4-a59a-fe204f719f1a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:17.954801 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-1713e027-b43a-40a8-b6c7-3e5d35016056 req-86b05139-7df0-4e10-a81a-ea93466e3138 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Neutron deleted interface dab9dc9d-db9a-4cd4-a59a-fe204f719f1a; detaching it from the instance and deleting it from the info cache
May 27 03:05:17.954801 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-1713e027-b43a-40a8-b6c7-3e5d35016056 req-86b05139-7df0-4e10-a81a-ea93466e3138 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:18.106494 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ab4cd309-2d7c-43c3-bb17-cad28c698c93 req-15342432-e838-456e-ac98-1435ffb53277 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Received event network-vif-unplugged-dab9dc9d-db9a-4cd4-a59a-fe204f719f1a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:18.106784 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ab4cd309-2d7c-43c3-bb17-cad28c698c93 req-15342432-e838-456e-ac98-1435ffb53277 service nova] Acquiring lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:18.106974 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ab4cd309-2d7c-43c3-bb17-cad28c698c93 req-15342432-e838-456e-ac98-1435ffb53277 service nova] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:18.107664 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ab4cd309-2d7c-43c3-bb17-cad28c698c93 req-15342432-e838-456e-ac98-1435ffb53277 service nova] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:18.107664 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ab4cd309-2d7c-43c3-bb17-cad28c698c93 req-15342432-e838-456e-ac98-1435ffb53277 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] No waiting events found dispatching network-vif-unplugged-dab9dc9d-db9a-4cd4-a59a-fe204f719f1a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:05:18.107664 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ab4cd309-2d7c-43c3-bb17-cad28c698c93 req-15342432-e838-456e-ac98-1435ffb53277 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Received event network-vif-unplugged-dab9dc9d-db9a-4cd4-a59a-fe204f719f1a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:05:18.383504 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:18.457326 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1713e027-b43a-40a8-b6c7-3e5d35016056 req-86b05139-7df0-4e10-a81a-ea93466e3138 service nova] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Detach interface failed, port_id=dab9dc9d-db9a-4cd4-a59a-fe204f719f1a, reason: Instance 1efec6a6-a26c-46fa-9370-60859f41c1a5 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:05:18.886525 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Took 1.69 seconds to deallocate network for instance.
May 27 03:05:19.402550 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:19.403036 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:19.730246 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0016054479997364979 future=<Future at 0x7557047cb800 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:19.730605 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:19.730605 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=11.433440653999696 future=<Future at 0x755704402510 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:19.730780 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=11.433319456999925 future=<Future at 0x755704402510 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:19.732499 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Emitting event <LifecycleEvent: 1779851104.7285016, 4ac08a8b-4572-4b1f-8ba0-457c80d58b46 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:05:19.732499 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] VM Stopped (Lifecycle Event)
May 27 03:05:20.095433 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:05:20.095828 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:05:20.218156 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "cdff666e-dc56-4310-a648-6d774f27acb2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:20.218441 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "cdff666e-dc56-4310-a648-6d774f27acb2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:20.236834 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-845ed549-eda8-43ca-8012-e8f3df41a1ce tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: 4ac08a8b-4572-4b1f-8ba0-457c80d58b46] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:20.599715 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:05:20.725228 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:05:21.109601 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.707s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:21.203659 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:21.212138 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Deleted allocations for instance 1efec6a6-a26c-46fa-9370-60859f41c1a5
May 27 03:05:21.302382 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:21.302900 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:21.306674 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:05:21.306992 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Claim successful on node np0000001475
May 27 03:05:21.686230 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:22.222734 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8415af1a-faec-407a-bbbf-34926ce1f333 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "1efec6a6-a26c-46fa-9370-60859f41c1a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.950s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:22.430799 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:22.431137 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:22.935045 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:05:22.973932 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:05:22.974089 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:05:23.477303 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:05:23.505359 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:23.986936 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.684s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:23.987964 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.482s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:23.988221 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:05:23.993559 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:05:23.993986 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Claim successful on node np0000001475
May 27 03:05:24.507220 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:05:24.507220 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:05:24.507220 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:24.508314 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:24.609052 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '092604511a8a467ba4ecb56261cb531f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9c48d6919e8435f876f3324616521ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:05:25.010286 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:05:25.175427 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Successfully created port: c7fac247-8618-44e1-928a-63192f178a0a {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:05:25.457107 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "b9047e8c-855e-4623-8659-3c145e1706ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:25.457392 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "b9047e8c-855e-4623-8659-3c145e1706ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:25.516690 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:05:25.642837 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:05:25.643100 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:05:25.833171 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Successfully updated port: c7fac247-8618-44e1-928a-63192f178a0a {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:05:25.902906 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ef954e88-26fd-426f-9406-74042a3dda15 req-202217d0-c1b4-4126-9f94-41fb1365c7e8 service nova] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Received event network-changed-c7fac247-8618-44e1-928a-63192f178a0a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:25.904268 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ef954e88-26fd-426f-9406-74042a3dda15 req-202217d0-c1b4-4126-9f94-41fb1365c7e8 service nova] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Refreshing instance network info cache due to event network-changed-c7fac247-8618-44e1-928a-63192f178a0a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:05:25.904467 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ef954e88-26fd-426f-9406-74042a3dda15 req-202217d0-c1b4-4126-9f94-41fb1365c7e8 service nova] Acquiring lock "refresh_cache-cdff666e-dc56-4310-a648-6d774f27acb2" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:05:25.904560 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ef954e88-26fd-426f-9406-74042a3dda15 req-202217d0-c1b4-4126-9f94-41fb1365c7e8 service nova] Acquired lock "refresh_cache-cdff666e-dc56-4310-a648-6d774f27acb2" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:05:25.904840 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ef954e88-26fd-426f-9406-74042a3dda15 req-202217d0-c1b4-4126-9f94-41fb1365c7e8 service nova] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Refreshing network info cache for port c7fac247-8618-44e1-928a-63192f178a0a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:05:25.960709 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:05:26.029041 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Booting with volume 9263f34c-0d34-40a0-9ff5-b4510c72a6b7 at /dev/vda
May 27 03:05:26.069063 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:05:26.082839 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:05:26.105509 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:26.146587 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:05:26.153702 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:05:26.155063 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:05:26.163033 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:05:26.164389 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:fe5c:3071', 'fe80::fc16:3eff:fe88:48d5', 'fe80::fc16:3eff:fe00:b7f', 'fe80::5060:75ff:fe06:71d8', 'fe80::fc16:3eff:fe6d:20b3', 'fe80::88ab:28ff:fedb:6e99', 'fe80::fc16:3eff:fe58:79ce', 'fe80::8cdc:9fff:fe79:9907'] 
May 27 03:05:26.164538 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:05:26.164672 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:05:26.165009 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:05:26.165233 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Updating existing volume attachment record: 026b5a09-5398-4d4b-bdb4-74edcf4ee696 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:05:26.209309 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:26.335671 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "refresh_cache-cdff666e-dc56-4310-a648-6d774f27acb2" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:05:26.407840 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-ef954e88-26fd-426f-9406-74042a3dda15 req-202217d0-c1b4-4126-9f94-41fb1365c7e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:26.502727 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ef954e88-26fd-426f-9406-74042a3dda15 req-202217d0-c1b4-4126-9f94-41fb1365c7e8 service nova] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:05:26.525999 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:26.655489 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.668s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:26.656082 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:05:26.659345 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.134s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:26.665582 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:05:26.666158 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Claim successful on node np0000001475
May 27 03:05:26.687134 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:26.691460 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ef954e88-26fd-426f-9406-74042a3dda15 req-202217d0-c1b4-4126-9f94-41fb1365c7e8 service nova] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:27.162536 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:05:27.165473 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:05:27.165473 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:27.165473 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:27.193370 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ef954e88-26fd-426f-9406-74042a3dda15 req-202217d0-c1b4-4126-9f94-41fb1365c7e8 service nova] Releasing lock "refresh_cache-cdff666e-dc56-4310-a648-6d774f27acb2" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:05:27.193891 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquired lock "refresh_cache-cdff666e-dc56-4310-a648-6d774f27acb2" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:05:27.194077 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:05:27.249086 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ba707c9283c45989ff891306f972873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d79b15ea2254cd7adc804ece7e7cfae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:05:27.666266 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:05:27.773958 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Successfully created port: 8b0c44e7-f8e9-407f-b08c-e71f03b4ea30 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:05:27.804864 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:05:28.043458 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:28.170586 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:05:28.271565 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Updating instance_info_cache with network_info: [{"id": "c7fac247-8618-44e1-928a-63192f178a0a", "address": "fa:16:3e:1b:af:60", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fac247-86", "ovs_interfaceid": "c7fac247-8618-44e1-928a-63192f178a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:28.295779 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:05:28.297667 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:05:28.299120 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Creating image(s)
May 27 03:05:28.299791 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:05:28.299935 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Ensure instance console log exists: /opt/stack/data/nova/instances/cdff666e-dc56-4310-a648-6d774f27acb2/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:05:28.300204 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:28.300427 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:28.300604 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:28.407614 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Successfully updated port: 8b0c44e7-f8e9-407f-b08c-e71f03b4ea30 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:05:28.418274 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:05:28.418542 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:05:28.460844 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c5efb7fa-c960-4294-b084-13ab9ef75455 req-43183c11-7e15-42e0-be19-9608d739f08d service nova] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Received event network-changed-8b0c44e7-f8e9-407f-b08c-e71f03b4ea30 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:28.460844 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c5efb7fa-c960-4294-b084-13ab9ef75455 req-43183c11-7e15-42e0-be19-9608d739f08d service nova] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Refreshing instance network info cache due to event network-changed-8b0c44e7-f8e9-407f-b08c-e71f03b4ea30. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:05:28.460844 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c5efb7fa-c960-4294-b084-13ab9ef75455 req-43183c11-7e15-42e0-be19-9608d739f08d service nova] Acquiring lock "refresh_cache-a3cd35f5-3cbb-41fb-802e-22931d1089bd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:05:28.460844 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c5efb7fa-c960-4294-b084-13ab9ef75455 req-43183c11-7e15-42e0-be19-9608d739f08d service nova] Acquired lock "refresh_cache-a3cd35f5-3cbb-41fb-802e-22931d1089bd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:05:28.460844 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c5efb7fa-c960-4294-b084-13ab9ef75455 req-43183c11-7e15-42e0-be19-9608d739f08d service nova] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Refreshing network info cache for port 8b0c44e7-f8e9-407f-b08c-e71f03b4ea30 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:05:28.774459 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Releasing lock "refresh_cache-cdff666e-dc56-4310-a648-6d774f27acb2" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:05:28.774807 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Instance network_info: |[{"id": "c7fac247-8618-44e1-928a-63192f178a0a", "address": "fa:16:3e:1b:af:60", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fac247-86", "ovs_interfaceid": "c7fac247-8618-44e1-928a-63192f178a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:05:28.775964 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Start _get_guest_xml network_info=[{"id": "c7fac247-8618-44e1-928a-63192f178a0a", "address": "fa:16:3e:1b:af:60", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fac247-86", "ovs_interfaceid": "c7fac247-8618-44e1-928a-63192f178a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'cdff666e-dc56-4310-a648-6d774f27acb2', 'attached_at': '', 'detached_at': '', 'volume_id': '9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'serial': '9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'multiattach': True}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '026b5a09-5398-4d4b-bdb4-74edcf4ee696', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:05:28.778252 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:05:28.779879 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-366068574', uuid='cdff666e-dc56-4310-a648-6d774f27acb2'), owner=OwnerMeta(userid='092604511a8a467ba4ecb56261cb531f', username='tempest-AttachVolumeMultiAttachTest-774919822-project-member', projectid='a9c48d6919e8435f876f3324616521ea', projectname='tempest-AttachVolumeMultiAttachTest-774919822'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c7fac247-8618-44e1-928a-63192f178a0a", "address": "fa:16:3e:1b:af:60", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fac247-86", "ovs_interfaceid": "c7fac247-8618-44e1-928a-63192f178a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851128.7793124) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:05:28.781086 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:05:28.781550 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:05:28.782570 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:05:28.782716 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:05:28.783854 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:05:28.784220 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:05:28.784993 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:05:28.784993 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:05:28.784993 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:05:28.784993 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:05:28.784993 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:05:28.787935 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:05:28.787935 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:05:28.787935 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:05:28.787935 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:05:28.787935 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:05:28.801627 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:05:28.802000 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:05:28.802164 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:05:28.802588 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:05:28.802864 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:05:28.814003 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:05:28.814492 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:05:28.814665 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:05:28.815212 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:05:28.817586 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:05:28.817813 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:05:28.827725 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:05:28.827725 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:28.832469 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:05:28.832469 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:28.841189 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7] added
May 27 03:05:28.841189 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:05:28.841189 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:05:28.841189 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:05:28.841189 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:05:28.841189 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:05:28.841189 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:28.841523 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:05:28.841625 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:05:28.841782 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:05:28.843751 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7] added
May 27 03:05:28.843751 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:05:28.843751 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:05:28.843751 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:05:28.843751 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:05:28.843751 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:05:28.843751 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:28.845366 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:05:28.845366 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:05:28.845366 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:05:28.909751 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "refresh_cache-a3cd35f5-3cbb-41fb-802e-22931d1089bd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:05:28.921069 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:05:28.963808 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c5efb7fa-c960-4294-b084-13ab9ef75455 req-43183c11-7e15-42e0-be19-9608d739f08d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:29.023895 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c5efb7fa-c960-4294-b084-13ab9ef75455 req-43183c11-7e15-42e0-be19-9608d739f08d service nova] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:05:29.177061 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c5efb7fa-c960-4294-b084-13ab9ef75455 req-43183c11-7e15-42e0-be19-9608d739f08d service nova] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:29.180195 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:05:29.183115 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:05:29.183115 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Creating image(s)
May 27 03:05:29.183115 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:29.183115 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "/opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:29.183115 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "/opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:29.183115 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:05:29.187092 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:05:29.187092 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:29.284845 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.098s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:29.285458 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:29.286067 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:29.286501 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:05:29.289104 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:05:29.289442 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:29.394766 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.101s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:29.394766 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:29.429463 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.770s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:29.430206 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:05:29.454902 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd/disk 1073741824" returned: 0 in 0.063s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:29.455369 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:29.455726 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:29.548114 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.092s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:29.548616 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:05:29.548924 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:29.642674 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:29.643113 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Cannot resize image /opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:05:29.643639 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:05:29.643906 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Ensure instance console log exists: /opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:05:29.644295 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:29.644592 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:29.644790 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:29.679552 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c5efb7fa-c960-4294-b084-13ab9ef75455 req-43183c11-7e15-42e0-be19-9608d739f08d service nova] Releasing lock "refresh_cache-a3cd35f5-3cbb-41fb-802e-22931d1089bd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:05:29.680002 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquired lock "refresh_cache-a3cd35f5-3cbb-41fb-802e-22931d1089bd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:05:29.680176 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:05:29.842330 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:05:29.844807 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:05:29.856306 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:05:29.856306 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:05:29.867013 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:05:29.867013 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:29.874766 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:29.878366 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:29.886228 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:29.886228 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:29.886228 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:29.886228 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:29.886228 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:05:29.886228 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:29.886228 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:29.886228 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:29.886228 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:29.886228 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:05:29.897622 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:29.897622 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:29.897622 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:29.897622 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:29.897622 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:05:29.897622 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:29.897622 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:29.897622 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:29.897622 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:29.897622 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:05:29.918789 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7, portal: 192.168.40.100,3260]
May 27 03:05:29.918789 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7, portal: 192.168.40.100,3260] successful.
May 27 03:05:29.918789 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:29.938684 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:29.939499 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:05:29.939640 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:05:29.940075 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:29.940435 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:29.952511 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7, portal: 192.168.50.100,3260]
May 27 03:05:29.952511 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7, portal: 192.168.50.100,3260] successful.
May 27 03:05:29.952511 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:29.958133 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:29.958133 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:29.958133 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:29.958133 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:29.958133 np0000001475 nova-compute[98471]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7 (non-flash)
May 27 03:05:29.958133 np0000001475 nova-compute[98471]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7 (non-flash)
May 27 03:05:29.958133 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:05:29.958383 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:29.958383 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:29.958383 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:29.958383 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:29.958383 np0000001475 nova-compute[98471]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7 (non-flash)
May 27 03:05:29.958383 np0000001475 nova-compute[98471]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7 (non-flash)
May 27 03:05:29.958383 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:05:29.958615 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:05:29.958774 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:05:29.959686 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] HCTL ('11', '-', '-', 0) found on session 86 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:05:29.960082 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:05:29.965556 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:29.982687 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching for a device in session 86 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:05:29.983034 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:05:29.984890 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:29.984890 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:29.984890 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:29.984890 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:29.984890 np0000001475 nova-compute[98471]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7 (non-flash)
May 27 03:05:29.984890 np0000001475 nova-compute[98471]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7 (non-flash)
May 27 03:05:29.984890 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:05:29.985149 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:29.985149 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:29.985149 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:29.985149 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:29.985149 np0000001475 nova-compute[98471]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7 (non-flash)
May 27 03:05:29.985149 np0000001475 nova-compute[98471]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7 (non-flash)
May 27 03:05:29.985149 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:05:29.985529 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:05:29.985704 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:05:29.986668 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] HCTL ('12', '-', '-', 0) found on session 87 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:05:29.986833 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:05:30.008934 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Searching for a device in session 87 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:05:30.008934 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:05:30.042456 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca42144366ef44eb81e5c4a23624d281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1801e95925498cac899f1414f2b202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:05:30.249982 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:05:30.420177 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:30.443532 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:05:30.612491 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Successfully created port: 01d57c3b-325e-43f9-9d7e-f0d3e24b75a1 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:05:30.651213 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Updating instance_info_cache with network_info: [{"id": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "address": "fa:16:3e:bb:5a:83", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0c44e7-f8", "ovs_interfaceid": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:30.818459 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:05:30.949046 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:05:31.164198 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Releasing lock "refresh_cache-a3cd35f5-3cbb-41fb-802e-22931d1089bd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:05:31.164573 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Instance network_info: |[{"id": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "address": "fa:16:3e:bb:5a:83", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0c44e7-f8", "ovs_interfaceid": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:05:31.167229 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Start _get_guest_xml network_info=[{"id": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "address": "fa:16:3e:bb:5a:83", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0c44e7-f8", "ovs_interfaceid": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:05:31.168380 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.00422357000024931 future=<Future at 0x755704402510 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:31.168585 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:31.170074 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Emitting event <LifecycleEvent: 1779851116.1639087, 1efec6a6-a26c-46fa-9370-60859f41c1a5 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:05:31.170074 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] VM Stopped (Lifecycle Event)
May 27 03:05:31.175034 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:05:31.176437 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-110972352', uuid='a3cd35f5-3cbb-41fb-802e-22931d1089bd'), owner=OwnerMeta(userid='4ba707c9283c45989ff891306f972873', username='tempest-VolumesSnapshotTestJSON-189213940-project-member', projectid='4d79b15ea2254cd7adc804ece7e7cfae', projectname='tempest-VolumesSnapshotTestJSON-189213940'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "address": "fa:16:3e:bb:5a:83", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0c44e7-f8", "ovs_interfaceid": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851131.1759164) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:05:31.178535 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:05:31.178535 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:05:31.180759 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:05:31.180944 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:05:31.182677 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:05:31.182677 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:05:31.182677 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:05:31.182677 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:05:31.182677 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:05:31.182677 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:05:31.183146 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:05:31.183146 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:05:31.183226 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:05:31.183440 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:05:31.183440 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:05:31.183600 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:05:31.194291 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-110972352',display_name='tempest-VolumesSnapshotTestJSON-instance-110972352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumessnapshottestjson-instance-110972352',id=43,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNVJMYGTBNptxAkOWaVBNhPxgswjyBFHTc92D1l8+AqAnzLCEaJ5By/rNxyWhhOUuvDSAq5nOybbm58malgExGrveZhp+f0uLH+ctNvTjWH97OPvko9Ik4qRezyfncrvg==',key_name='tempest-keypair-158001254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d79b15ea2254cd7adc804ece7e7cfae',ramdisk_id='',reservation_id='r-0sloqlwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-189213940',owner_user_name='tempest-VolumesSnapshotTestJSON-189213940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:05:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ba707c9283c45989ff891306f972873',uuid=a3cd35f5-3cbb-41fb-802e-22931d1089bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "address": "fa:16:3e:bb:5a:83", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0c44e7-f8", "ovs_interfaceid": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:05:31.194477 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Converting VIF {"id": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "address": "fa:16:3e:bb:5a:83", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0c44e7-f8", "ovs_interfaceid": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:05:31.195100 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:5a:83,bridge_name='br-int',has_traffic_filtering=True,id=8b0c44e7-f8e9-407f-b08c-e71f03b4ea30,network=Network(3c97181e-8aba-4ea6-ac09-fed09f0812ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b0c44e7-f8') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:05:31.195646 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lazy-loading 'pci_devices' on Instance uuid a3cd35f5-3cbb-41fb-802e-22931d1089bd {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:31.198387 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Successfully updated port: 01d57c3b-325e-43f9-9d7e-f0d3e24b75a1 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:05:31.209570 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:31.264334 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c278918d-c1c2-4a09-991f-64697ffbb08a req-bead9c48-1c62-4cc3-89de-d260528f00f0 service nova] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Received event network-changed-01d57c3b-325e-43f9-9d7e-f0d3e24b75a1 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:31.264766 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c278918d-c1c2-4a09-991f-64697ffbb08a req-bead9c48-1c62-4cc3-89de-d260528f00f0 service nova] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Refreshing instance network info cache due to event network-changed-01d57c3b-325e-43f9-9d7e-f0d3e24b75a1. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:05:31.265287 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c278918d-c1c2-4a09-991f-64697ffbb08a req-bead9c48-1c62-4cc3-89de-d260528f00f0 service nova] Acquiring lock "refresh_cache-b9047e8c-855e-4623-8659-3c145e1706ba" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:05:31.265360 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c278918d-c1c2-4a09-991f-64697ffbb08a req-bead9c48-1c62-4cc3-89de-d260528f00f0 service nova] Acquired lock "refresh_cache-b9047e8c-855e-4623-8659-3c145e1706ba" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:05:31.266047 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c278918d-c1c2-4a09-991f-64697ffbb08a req-bead9c48-1c62-4cc3-89de-d260528f00f0 service nova] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Refreshing network info cache for port 01d57c3b-325e-43f9-9d7e-f0d3e24b75a1 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:05:31.674036 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: 1efec6a6-a26c-46fa-9370-60859f41c1a5] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:31.688484 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:31.700984 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] End _get_guest_xml xml=<domain type="qemu">
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:   <uuid>a3cd35f5-3cbb-41fb-802e-22931d1089bd</uuid>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:   <name>instance-0000002b</name>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-110972352</nova:name>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:05:31</nova:creationTime>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:         <nova:user uuid="4ba707c9283c45989ff891306f972873">tempest-VolumesSnapshotTestJSON-189213940-project-member</nova:user>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:         <nova:project uuid="4d79b15ea2254cd7adc804ece7e7cfae">tempest-VolumesSnapshotTestJSON-189213940</nova:project>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:         <nova:port uuid="8b0c44e7-f8e9-407f-b08c-e71f03b4ea30">
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     <system>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <entry name="serial">a3cd35f5-3cbb-41fb-802e-22931d1089bd</entry>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <entry name="uuid">a3cd35f5-3cbb-41fb-802e-22931d1089bd</entry>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     </system>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:   <os>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:   </os>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:   <features>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:   </features>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:   <devices>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd/disk"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     </disk>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd/disk.config"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     </disk>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:bb:5a:83"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <target dev="tap8b0c44e7-f8"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     </interface>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd/console.log" append="off"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     </serial>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     <video>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     </video>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     </rng>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:   </devices>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]: </domain>
May 27 03:05:31.700984 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:05:31.702792 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Preparing to wait for external event network-vif-plugged-8b0c44e7-f8e9-407f-b08c-e71f03b4ea30 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:05:31.702792 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:31.702792 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:31.702792 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:31.702792 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-110972352',display_name='tempest-VolumesSnapshotTestJSON-instance-110972352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumessnapshottestjson-instance-110972352',id=43,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNVJMYGTBNptxAkOWaVBNhPxgswjyBFHTc92D1l8+AqAnzLCEaJ5By/rNxyWhhOUuvDSAq5nOybbm58malgExGrveZhp+f0uLH+ctNvTjWH97OPvko9Ik4qRezyfncrvg==',key_name='tempest-keypair-158001254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d79b15ea2254cd7adc804ece7e7cfae',ramdisk_id='',reservation_id='r-0sloqlwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-189213940',owner_user_name='tempest-VolumesSnapshotTestJSON-189213940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:05:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ba707c9283c45989ff891306f972873',uuid=a3cd35f5-3cbb-41fb-802e-22931d1089bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "address": "fa:16:3e:bb:5a:83", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0c44e7-f8", "ovs_interfaceid": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:05:31.703892 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Converting VIF {"id": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "address": "fa:16:3e:bb:5a:83", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0c44e7-f8", "ovs_interfaceid": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:05:31.704428 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "refresh_cache-b9047e8c-855e-4623-8659-3c145e1706ba" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:05:31.704832 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:5a:83,bridge_name='br-int',has_traffic_filtering=True,id=8b0c44e7-f8e9-407f-b08c-e71f03b4ea30,network=Network(3c97181e-8aba-4ea6-ac09-fed09f0812ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b0c44e7-f8') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:05:31.705228 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:5a:83,bridge_name='br-int',has_traffic_filtering=True,id=8b0c44e7-f8e9-407f-b08c-e71f03b4ea30,network=Network(3c97181e-8aba-4ea6-ac09-fed09f0812ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b0c44e7-f8') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:05:31.705544 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:31.705800 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:31.706073 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:05:31.707012 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:31.707198 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4ce8175-cbff-5537-a795-c1cdd3be9afc', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:31.708024 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:31.710133 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:05:31.712561 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:31.712774 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b0c44e7-f8, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:31.713243 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b0c44e7-f8, col_values=(('qos', UUID('4d0977df-c416-4d1b-8cf2-23f592715e81')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:31.713462 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b0c44e7-f8, col_values=(('external_ids', {'iface-id': '8b0c44e7-f8e9-407f-b08c-e71f03b4ea30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:5a:83', 'vm-uuid': 'a3cd35f5-3cbb-41fb-802e-22931d1089bd'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:31.714413 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:31.717506 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:05:31.722274 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:31.723576 np0000001475 nova-compute[98471]: INFO os_vif [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:5a:83,bridge_name='br-int',has_traffic_filtering=True,id=8b0c44e7-f8e9-407f-b08c-e71f03b4ea30,network=Network(3c97181e-8aba-4ea6-ac09-fed09f0812ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b0c44e7-f8')
May 27 03:05:31.767933 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c278918d-c1c2-4a09-991f-64697ffbb08a req-bead9c48-1c62-4cc3-89de-d260528f00f0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:31.838050 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Found WWN 330000000e341234c for multipath device dm-4 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:05:31.838050 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:05:31.838050 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000e341234c', 'path': '/dev/dm-4', 'multipath_id': '330000000e341234c'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:05:31.838050 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e341234c', 'path': '/dev/dm-4', 'multipath_id': '330000000e341234c'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:05:31.860333 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c278918d-c1c2-4a09-991f-64697ffbb08a req-bead9c48-1c62-4cc3-89de-d260528f00f0 service nova] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:05:31.957815 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:05:31.958988 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:05:31.959275 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Creating image(s)
May 27 03:05:31.959841 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:31.960052 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "/opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:31.960547 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "/opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:31.961192 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:05:31.963908 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:05:31.965018 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:32.060913 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c278918d-c1c2-4a09-991f-64697ffbb08a req-bead9c48-1c62-4cc3-89de-d260528f00f0 service nova] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:32.063456 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.098s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:32.064106 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:32.064657 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:32.065230 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:05:32.070265 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:05:32.071096 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:32.188473 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.117s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:32.188958 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:32.254966 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba/disk 1073741824" returned: 0 in 0.066s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:32.255394 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:32.255751 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:32.346541 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:05:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-366068574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumemultiattachtest-server-366068574',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-y7w2j39q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:05:26Z,user_data=None,user_id='092604511a8a467ba4ecb56261cb531f',uuid=cdff666e-dc56-4310-a648-6d774f27acb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7fac247-8618-44e1-928a-63192f178a0a", "address": "fa:16:3e:1b:af:60", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fac247-86", "ovs_interfaceid": "c7fac247-8618-44e1-928a-63192f178a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:05:32.347042 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "c7fac247-8618-44e1-928a-63192f178a0a", "address": "fa:16:3e:1b:af:60", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fac247-86", "ovs_interfaceid": "c7fac247-8618-44e1-928a-63192f178a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:05:32.347473 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:af:60,bridge_name='br-int',has_traffic_filtering=True,id=c7fac247-8618-44e1-928a-63192f178a0a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fac247-86') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:05:32.348405 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'pci_devices' on Instance uuid cdff666e-dc56-4310-a648-6d774f27acb2 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:32.364657 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.109s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:32.365015 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:05:32.365245 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:32.463109 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:32.463582 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Cannot resize image /opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:05:32.464012 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:05:32.464184 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Ensure instance console log exists: /opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:05:32.464800 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:32.464800 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:32.464912 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:32.564731 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c278918d-c1c2-4a09-991f-64697ffbb08a req-bead9c48-1c62-4cc3-89de-d260528f00f0 service nova] Releasing lock "refresh_cache-b9047e8c-855e-4623-8659-3c145e1706ba" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:05:32.565278 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquired lock "refresh_cache-b9047e8c-855e-4623-8659-3c145e1706ba" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:05:32.565506 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:05:32.852194 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] End _get_guest_xml xml=<domain type="qemu">
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:   <uuid>cdff666e-dc56-4310-a648-6d774f27acb2</uuid>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:   <name>instance-0000002a</name>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-366068574</nova:name>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:05:28</nova:creationTime>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:         <nova:user uuid="092604511a8a467ba4ecb56261cb531f">tempest-AttachVolumeMultiAttachTest-774919822-project-member</nova:user>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:         <nova:project uuid="a9c48d6919e8435f876f3324616521ea">tempest-AttachVolumeMultiAttachTest-774919822</nova:project>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:         <nova:port uuid="c7fac247-8618-44e1-928a-63192f178a0a">
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     <system>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <entry name="serial">cdff666e-dc56-4310-a648-6d774f27acb2</entry>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <entry name="uuid">cdff666e-dc56-4310-a648-6d774f27acb2</entry>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     </system>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:   <os>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:   </os>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:   <features>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:   </features>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:   <devices>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/cdff666e-dc56-4310-a648-6d774f27acb2/disk.config"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     </disk>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <alias name="ua-9263f34c-0d34-40a0-9ff5-b4510c72a6b7"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-4"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <serial>9263f34c-0d34-40a0-9ff5-b4510c72a6b7</serial>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <shareable/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     </disk>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:1b:af:60"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <target dev="tapc7fac247-86"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     </interface>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/cdff666e-dc56-4310-a648-6d774f27acb2/console.log" append="off"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     </serial>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     <video>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     </video>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     </rng>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:   </devices>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]: </domain>
May 27 03:05:32.852194 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:05:32.856535 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Preparing to wait for external event network-vif-plugged-c7fac247-8618-44e1-928a-63192f178a0a {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:05:32.856535 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "cdff666e-dc56-4310-a648-6d774f27acb2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:32.856535 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "cdff666e-dc56-4310-a648-6d774f27acb2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:32.856535 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "cdff666e-dc56-4310-a648-6d774f27acb2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:32.856535 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:05:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-366068574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumemultiattachtest-server-366068574',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-y7w2j39q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:05:26Z,user_data=None,user_id='092604511a8a467ba4ecb56261cb531f',uuid=cdff666e-dc56-4310-a648-6d774f27acb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7fac247-8618-44e1-928a-63192f178a0a", "address": "fa:16:3e:1b:af:60", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fac247-86", "ovs_interfaceid": "c7fac247-8618-44e1-928a-63192f178a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:05:32.856535 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "c7fac247-8618-44e1-928a-63192f178a0a", "address": "fa:16:3e:1b:af:60", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fac247-86", "ovs_interfaceid": "c7fac247-8618-44e1-928a-63192f178a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:05:32.856535 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:af:60,bridge_name='br-int',has_traffic_filtering=True,id=c7fac247-8618-44e1-928a-63192f178a0a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fac247-86') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:05:32.856535 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:af:60,bridge_name='br-int',has_traffic_filtering=True,id=c7fac247-8618-44e1-928a-63192f178a0a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fac247-86') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:05:32.856535 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:32.856535 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:32.857267 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:05:32.859270 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:32.860880 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c09ca86-3d33-5a5f-983b-e2269f3117ed', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:32.862122 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:32.862952 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:05:32.873031 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:32.875786 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:32.876094 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7fac247-86, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:32.876689 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7fac247-86, col_values=(('qos', UUID('3779b0fe-f0b2-4718-ba66-089b359735c7')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:32.877042 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7fac247-86, col_values=(('external_ids', {'iface-id': 'c7fac247-8618-44e1-928a-63192f178a0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:af:60', 'vm-uuid': 'cdff666e-dc56-4310-a648-6d774f27acb2'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:32.878272 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:32.881549 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:05:32.890326 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:32.892163 np0000001475 nova-compute[98471]: INFO os_vif [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:af:60,bridge_name='br-int',has_traffic_filtering=True,id=c7fac247-8618-44e1-928a-63192f178a0a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fac247-86')
May 27 03:05:33.133455 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:05:33.246194 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:05:33.246426 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:05:33.246609 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] No VIF found with MAC fa:16:3e:bb:5a:83, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:05:33.247212 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Using config drive
May 27 03:05:33.290151 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:33.443705 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Updating instance_info_cache with network_info: [{"id": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "address": "fa:16:3e:21:ba:30", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01d57c3b-32", "ovs_interfaceid": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:33.756311 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:33.908004 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Creating config drive at /opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd/disk.config
May 27 03:05:33.913341 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp56y_o5bh {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:33.947813 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Releasing lock "refresh_cache-b9047e8c-855e-4623-8659-3c145e1706ba" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:05:33.948717 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Instance network_info: |[{"id": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "address": "fa:16:3e:21:ba:30", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01d57c3b-32", "ovs_interfaceid": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:05:33.951604 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Start _get_guest_xml network_info=[{"id": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "address": "fa:16:3e:21:ba:30", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01d57c3b-32", "ovs_interfaceid": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:05:33.957049 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:05:33.958971 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1228693741', uuid='b9047e8c-855e-4623-8659-3c145e1706ba'), owner=OwnerMeta(userid='ca42144366ef44eb81e5c4a23624d281', username='tempest-AttachVolumeNegativeTest-1854580419-project-member', projectid='5f1801e95925498cac899f1414f2b202', projectname='tempest-AttachVolumeNegativeTest-1854580419'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "address": "fa:16:3e:21:ba:30", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01d57c3b-32", "ovs_interfaceid": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851133.9584565) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:05:33.961276 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:05:33.961949 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:05:33.963021 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:05:33.963187 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:05:33.964214 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:05:33.964569 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:05:33.964754 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:05:33.964843 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:05:33.964972 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:05:33.965045 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:05:33.965162 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:05:33.965350 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:05:33.965465 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:05:33.965575 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:05:33.966139 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:05:33.966326 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:05:33.977543 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:05:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1228693741',display_name='tempest-AttachVolumeNegativeTest-server-1228693741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumenegativetest-server-1228693741',id=44,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMC3BwOfYRgidjTcfEpPSCBDsOBjQeOl86QoTrFjnPb/1WjtkzweasHWkmC89B7QzyDs7OG7EEYXH55L96MyfXVu2NleGH9u76DNcNy4Xv+qPtVrgczGcVGrTZLK8D4L4A==',key_name='tempest-keypair-1451786771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1801e95925498cac899f1414f2b202',ramdisk_id='',reservation_id='r-r4en49wr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1854580419',owner_user_name='tempest-AttachVolumeNegativeTest-1854580419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:05:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca42144366ef44eb81e5c4a23624d281',uuid=b9047e8c-855e-4623-8659-3c145e1706ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "address": "fa:16:3e:21:ba:30", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01d57c3b-32", "ovs_interfaceid": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:05:33.977767 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converting VIF {"id": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "address": "fa:16:3e:21:ba:30", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01d57c3b-32", "ovs_interfaceid": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:05:33.978350 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:ba:30,bridge_name='br-int',has_traffic_filtering=True,id=01d57c3b-325e-43f9-9d7e-f0d3e24b75a1,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01d57c3b-32') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:05:33.978907 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lazy-loading 'pci_devices' on Instance uuid b9047e8c-855e-4623-8659-3c145e1706ba {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:33.985609 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp56y_o5bh" returned: 0 in 0.072s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:34.419871 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:05:34.420132 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:05:34.420132 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] No VIF found with MAC fa:16:3e:1b:af:60, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:05:34.420673 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Using config drive
May 27 03:05:34.484474 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] End _get_guest_xml xml=<domain type="qemu">
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:   <uuid>b9047e8c-855e-4623-8659-3c145e1706ba</uuid>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:   <name>instance-0000002c</name>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1228693741</nova:name>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:05:33</nova:creationTime>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:         <nova:user uuid="ca42144366ef44eb81e5c4a23624d281">tempest-AttachVolumeNegativeTest-1854580419-project-member</nova:user>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:         <nova:project uuid="5f1801e95925498cac899f1414f2b202">tempest-AttachVolumeNegativeTest-1854580419</nova:project>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:         <nova:port uuid="01d57c3b-325e-43f9-9d7e-f0d3e24b75a1">
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     <system>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <entry name="serial">b9047e8c-855e-4623-8659-3c145e1706ba</entry>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <entry name="uuid">b9047e8c-855e-4623-8659-3c145e1706ba</entry>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     </system>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:   <os>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:   </os>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:   <features>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:   </features>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:   <devices>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba/disk"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     </disk>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba/disk.config"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     </disk>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:21:ba:30"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <target dev="tap01d57c3b-32"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     </interface>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba/console.log" append="off"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     </serial>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     <video>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     </video>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     </rng>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:   </devices>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]: </domain>
May 27 03:05:34.484474 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:05:34.487437 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Preparing to wait for external event network-vif-plugged-01d57c3b-325e-43f9-9d7e-f0d3e24b75a1 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:05:34.487437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "b9047e8c-855e-4623-8659-3c145e1706ba-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:34.487437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "b9047e8c-855e-4623-8659-3c145e1706ba-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:34.487437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "b9047e8c-855e-4623-8659-3c145e1706ba-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:34.487437 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:05:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1228693741',display_name='tempest-AttachVolumeNegativeTest-server-1228693741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumenegativetest-server-1228693741',id=44,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMC3BwOfYRgidjTcfEpPSCBDsOBjQeOl86QoTrFjnPb/1WjtkzweasHWkmC89B7QzyDs7OG7EEYXH55L96MyfXVu2NleGH9u76DNcNy4Xv+qPtVrgczGcVGrTZLK8D4L4A==',key_name='tempest-keypair-1451786771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1801e95925498cac899f1414f2b202',ramdisk_id='',reservation_id='r-r4en49wr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1854580419',owner_user_name='tempest-AttachVolumeNegativeTest-1854580419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:05:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca42144366ef44eb81e5c4a23624d281',uuid=b9047e8c-855e-4623-8659-3c145e1706ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "address": "fa:16:3e:21:ba:30", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01d57c3b-32", "ovs_interfaceid": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:05:34.487437 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converting VIF {"id": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "address": "fa:16:3e:21:ba:30", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01d57c3b-32", "ovs_interfaceid": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:05:34.487437 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:ba:30,bridge_name='br-int',has_traffic_filtering=True,id=01d57c3b-325e-43f9-9d7e-f0d3e24b75a1,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01d57c3b-32') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:05:34.487437 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:ba:30,bridge_name='br-int',has_traffic_filtering=True,id=01d57c3b-325e-43f9-9d7e-f0d3e24b75a1,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01d57c3b-32') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:05:34.487953 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:34.488352 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:34.488996 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:05:34.489884 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:34.490089 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1bc00f6c-0307-5018-bbc2-1eb351a45b9f', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:34.491074 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:34.491938 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:05:34.494846 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:34.540813 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:34.546486 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:34.546669 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01d57c3b-32, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:34.547106 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01d57c3b-32, col_values=(('qos', UUID('d296ceba-5f2a-4e9a-9137-d28ed280be40')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:34.547411 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01d57c3b-32, col_values=(('external_ids', {'iface-id': '01d57c3b-325e-43f9-9d7e-f0d3e24b75a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:ba:30', 'vm-uuid': 'b9047e8c-855e-4623-8659-3c145e1706ba'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:34.549456 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:34.551455 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:05:34.565552 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:34.566300 np0000001475 nova-compute[98471]: INFO os_vif [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:ba:30,bridge_name='br-int',has_traffic_filtering=True,id=01d57c3b-325e-43f9-9d7e-f0d3e24b75a1,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01d57c3b-32')
May 27 03:05:34.636393 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:34.816655 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-79caf8f3-05a1-4ccb-8426-15edc6052cda req-8d5a8e7c-2580-43f3-afda-649ddca4da7d service nova] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Received event network-vif-plugged-8b0c44e7-f8e9-407f-b08c-e71f03b4ea30 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:34.818510 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-79caf8f3-05a1-4ccb-8426-15edc6052cda req-8d5a8e7c-2580-43f3-afda-649ddca4da7d service nova] Acquiring lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:34.820000 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-79caf8f3-05a1-4ccb-8426-15edc6052cda req-8d5a8e7c-2580-43f3-afda-649ddca4da7d service nova] Lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:34.820991 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-79caf8f3-05a1-4ccb-8426-15edc6052cda req-8d5a8e7c-2580-43f3-afda-649ddca4da7d service nova] Lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:34.820991 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-79caf8f3-05a1-4ccb-8426-15edc6052cda req-8d5a8e7c-2580-43f3-afda-649ddca4da7d service nova] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Processing event network-vif-plugged-8b0c44e7-f8e9-407f-b08c-e71f03b4ea30 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:05:34.932083 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:34.970434 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:34.991263 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:34.997344 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:35.033260 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:35.049608 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:35.123479 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Creating config drive at /opt/stack/data/nova/instances/cdff666e-dc56-4310-a648-6d774f27acb2/disk.config
May 27 03:05:35.128053 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cdff666e-dc56-4310-a648-6d774f27acb2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj7gilube {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:35.195595 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cdff666e-dc56-4310-a648-6d774f27acb2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj7gilube" returned: 0 in 0.067s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:35.587227 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851135.5867045, a3cd35f5-3cbb-41fb-802e-22931d1089bd => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:05:35.587227 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] VM Started (Lifecycle Event)
May 27 03:05:35.590859 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:05:35.598799 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:05:35.602135 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Instance spawned successfully.
May 27 03:05:35.602496 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:05:35.688181 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:35.728341 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:35.810885 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:35.893354 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:35.899198 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:35.920261 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-86a31205-a4fb-4dfb-a0ae-5217d504ed72 req-f663fb6e-70ff-4ce8-be85-cdcd1fe89ff4 service nova] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Received event network-vif-plugged-c7fac247-8618-44e1-928a-63192f178a0a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:35.923882 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-86a31205-a4fb-4dfb-a0ae-5217d504ed72 req-f663fb6e-70ff-4ce8-be85-cdcd1fe89ff4 service nova] Acquiring lock "cdff666e-dc56-4310-a648-6d774f27acb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:35.923882 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-86a31205-a4fb-4dfb-a0ae-5217d504ed72 req-f663fb6e-70ff-4ce8-be85-cdcd1fe89ff4 service nova] Lock "cdff666e-dc56-4310-a648-6d774f27acb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:35.923882 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-86a31205-a4fb-4dfb-a0ae-5217d504ed72 req-f663fb6e-70ff-4ce8-be85-cdcd1fe89ff4 service nova] Lock "cdff666e-dc56-4310-a648-6d774f27acb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:35.923882 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-86a31205-a4fb-4dfb-a0ae-5217d504ed72 req-f663fb6e-70ff-4ce8-be85-cdcd1fe89ff4 service nova] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Processing event network-vif-plugged-c7fac247-8618-44e1-928a-63192f178a0a {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:05:36.090960 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:05:36.091134 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:05:36.091298 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No VIF found with MAC fa:16:3e:21:ba:30, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:05:36.091976 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Using config drive
May 27 03:05:36.094642 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:36.097736 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:05:36.113129 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:36.113309 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:36.113721 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:36.114014 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:36.114556 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:36.114556 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:36.212410 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:36.601048 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:36.604236 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:05:36.604503 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851136.6043415, a3cd35f5-3cbb-41fb-802e-22931d1089bd => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:05:36.604596 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] VM Paused (Lifecycle Event)
May 27 03:05:36.623132 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Took 7.44 seconds to spawn the instance on the hypervisor.
May 27 03:05:36.623293 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:36.694449 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:05:36.696892 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:05:36.701212 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Instance spawned successfully.
May 27 03:05:36.702082 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:05:36.783771 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Creating config drive at /opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba/disk.config
May 27 03:05:36.788458 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp95ixw2g0 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:36.860650 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp95ixw2g0" returned: 0 in 0.071s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:36.899277 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-61de8963-672b-4aee-9bd6-35e9a117849e req-76ca82e9-44bb-4ab6-913b-962055a3680e service nova] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Received event network-vif-plugged-8b0c44e7-f8e9-407f-b08c-e71f03b4ea30 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:36.900482 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-61de8963-672b-4aee-9bd6-35e9a117849e req-76ca82e9-44bb-4ab6-913b-962055a3680e service nova] Acquiring lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:36.900545 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-61de8963-672b-4aee-9bd6-35e9a117849e req-76ca82e9-44bb-4ab6-913b-962055a3680e service nova] Lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:36.900776 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-61de8963-672b-4aee-9bd6-35e9a117849e req-76ca82e9-44bb-4ab6-913b-962055a3680e service nova] Lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:36.901075 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-61de8963-672b-4aee-9bd6-35e9a117849e req-76ca82e9-44bb-4ab6-913b-962055a3680e service nova] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] No waiting events found dispatching network-vif-plugged-8b0c44e7-f8e9-407f-b08c-e71f03b4ea30 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:05:36.901273 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-61de8963-672b-4aee-9bd6-35e9a117849e req-76ca82e9-44bb-4ab6-913b-962055a3680e service nova] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Received unexpected event network-vif-plugged-8b0c44e7-f8e9-407f-b08c-e71f03b4ea30 for instance with vm_state active and task_state None.
May 27 03:05:37.110321 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:37.121639 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851137.1190448, a3cd35f5-3cbb-41fb-802e-22931d1089bd => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:05:37.121639 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] VM Resumed (Lifecycle Event)
May 27 03:05:37.142923 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Took 13.70 seconds to build instance.
May 27 03:05:37.214900 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:37.215231 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:37.215571 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:37.215872 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:37.216405 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:37.216809 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:37.400893 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:37.442571 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:37.562384 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:37.625348 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:37.637768 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:05:37.647784 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.216s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:37.723924 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Took 9.43 seconds to spawn the instance on the hypervisor.
May 27 03:05:37.725870 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:37.919000 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:37.921716 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:37.927303 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:37.963346 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:38.059961 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4e382cb9-74b4-4853-8778-8f274f8cda39 req-3357aed6-45ab-4e4b-af2b-f83ef0a723e8 service nova] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Received event network-vif-plugged-c7fac247-8618-44e1-928a-63192f178a0a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:38.060655 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4e382cb9-74b4-4853-8778-8f274f8cda39 req-3357aed6-45ab-4e4b-af2b-f83ef0a723e8 service nova] Acquiring lock "cdff666e-dc56-4310-a648-6d774f27acb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:38.060655 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4e382cb9-74b4-4853-8778-8f274f8cda39 req-3357aed6-45ab-4e4b-af2b-f83ef0a723e8 service nova] Lock "cdff666e-dc56-4310-a648-6d774f27acb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:38.060655 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4e382cb9-74b4-4853-8778-8f274f8cda39 req-3357aed6-45ab-4e4b-af2b-f83ef0a723e8 service nova] Lock "cdff666e-dc56-4310-a648-6d774f27acb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:38.060974 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4e382cb9-74b4-4853-8778-8f274f8cda39 req-3357aed6-45ab-4e4b-af2b-f83ef0a723e8 service nova] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] No waiting events found dispatching network-vif-plugged-c7fac247-8618-44e1-928a-63192f178a0a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:05:38.061079 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-4e382cb9-74b4-4853-8778-8f274f8cda39 req-3357aed6-45ab-4e4b-af2b-f83ef0a723e8 service nova] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Received unexpected event network-vif-plugged-c7fac247-8618-44e1-928a-63192f178a0a for instance with vm_state active and task_state None.
May 27 03:05:38.144126 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851138.1419804, cdff666e-dc56-4310-a648-6d774f27acb2 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:05:38.144277 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] VM Started (Lifecycle Event)
May 27 03:05:38.249476 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Took 17.01 seconds to build instance.
May 27 03:05:38.647090 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:38.658662 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:05:38.756395 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "cdff666e-dc56-4310-a648-6d774f27acb2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.538s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:38.988833 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c016e87c-ace7-46e9-b29a-9dfdeac85aaa req-e3567b76-cd4f-4c72-8372-9331a8fa705b service nova] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Received event network-vif-plugged-01d57c3b-325e-43f9-9d7e-f0d3e24b75a1 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:38.988999 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c016e87c-ace7-46e9-b29a-9dfdeac85aaa req-e3567b76-cd4f-4c72-8372-9331a8fa705b service nova] Acquiring lock "b9047e8c-855e-4623-8659-3c145e1706ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:38.989497 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c016e87c-ace7-46e9-b29a-9dfdeac85aaa req-e3567b76-cd4f-4c72-8372-9331a8fa705b service nova] Lock "b9047e8c-855e-4623-8659-3c145e1706ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:38.989497 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c016e87c-ace7-46e9-b29a-9dfdeac85aaa req-e3567b76-cd4f-4c72-8372-9331a8fa705b service nova] Lock "b9047e8c-855e-4623-8659-3c145e1706ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:38.989983 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c016e87c-ace7-46e9-b29a-9dfdeac85aaa req-e3567b76-cd4f-4c72-8372-9331a8fa705b service nova] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Processing event network-vif-plugged-01d57c3b-325e-43f9-9d7e-f0d3e24b75a1 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:05:38.989983 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c016e87c-ace7-46e9-b29a-9dfdeac85aaa req-e3567b76-cd4f-4c72-8372-9331a8fa705b service nova] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Received event network-vif-plugged-01d57c3b-325e-43f9-9d7e-f0d3e24b75a1 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:38.989983 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c016e87c-ace7-46e9-b29a-9dfdeac85aaa req-e3567b76-cd4f-4c72-8372-9331a8fa705b service nova] Acquiring lock "b9047e8c-855e-4623-8659-3c145e1706ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:38.990611 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c016e87c-ace7-46e9-b29a-9dfdeac85aaa req-e3567b76-cd4f-4c72-8372-9331a8fa705b service nova] Lock "b9047e8c-855e-4623-8659-3c145e1706ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:38.990611 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c016e87c-ace7-46e9-b29a-9dfdeac85aaa req-e3567b76-cd4f-4c72-8372-9331a8fa705b service nova] Lock "b9047e8c-855e-4623-8659-3c145e1706ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:38.990611 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c016e87c-ace7-46e9-b29a-9dfdeac85aaa req-e3567b76-cd4f-4c72-8372-9331a8fa705b service nova] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] No waiting events found dispatching network-vif-plugged-01d57c3b-325e-43f9-9d7e-f0d3e24b75a1 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:05:38.990611 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c016e87c-ace7-46e9-b29a-9dfdeac85aaa req-e3567b76-cd4f-4c72-8372-9331a8fa705b service nova] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Received unexpected event network-vif-plugged-01d57c3b-325e-43f9-9d7e-f0d3e24b75a1 for instance with vm_state building and task_state spawning.
May 27 03:05:38.993256 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:05:38.998339 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:05:39.004344 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Instance spawned successfully.
May 27 03:05:39.004674 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:05:39.163081 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851139.1626709, cdff666e-dc56-4310-a648-6d774f27acb2 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:05:39.163306 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] VM Paused (Lifecycle Event)
May 27 03:05:39.517487 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:39.517785 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:39.518394 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:39.519124 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:39.519474 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:39.520010 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:05:39.549536 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:39.668295 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:39.670926 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851139.6703885, cdff666e-dc56-4310-a648-6d774f27acb2 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:05:39.670926 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] VM Resumed (Lifecycle Event)
May 27 03:05:40.028177 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Took 8.07 seconds to spawn the instance on the hypervisor.
May 27 03:05:40.028385 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:40.157510 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-486329bd-6880-4d1e-ae49-d3d390526f61 req-10285bc8-655e-4e57-a03a-c7f36e8dc1e0 service nova] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Received event network-changed-8b0c44e7-f8e9-407f-b08c-e71f03b4ea30 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:40.157946 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-486329bd-6880-4d1e-ae49-d3d390526f61 req-10285bc8-655e-4e57-a03a-c7f36e8dc1e0 service nova] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Refreshing instance network info cache due to event network-changed-8b0c44e7-f8e9-407f-b08c-e71f03b4ea30. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:05:40.158120 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-486329bd-6880-4d1e-ae49-d3d390526f61 req-10285bc8-655e-4e57-a03a-c7f36e8dc1e0 service nova] Acquiring lock "refresh_cache-a3cd35f5-3cbb-41fb-802e-22931d1089bd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:05:40.158819 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-486329bd-6880-4d1e-ae49-d3d390526f61 req-10285bc8-655e-4e57-a03a-c7f36e8dc1e0 service nova] Acquired lock "refresh_cache-a3cd35f5-3cbb-41fb-802e-22931d1089bd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:05:40.158935 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-486329bd-6880-4d1e-ae49-d3d390526f61 req-10285bc8-655e-4e57-a03a-c7f36e8dc1e0 service nova] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Refreshing network info cache for port 8b0c44e7-f8e9-407f-b08c-e71f03b4ea30 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:05:40.174552 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:40.177465 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:05:40.537608 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Took 14.07 seconds to build instance.
May 27 03:05:40.661367 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-486329bd-6880-4d1e-ae49-d3d390526f61 req-10285bc8-655e-4e57-a03a-c7f36e8dc1e0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:40.681527 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851140.6809745, b9047e8c-855e-4623-8659-3c145e1706ba => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:05:40.681954 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] VM Started (Lifecycle Event)
May 27 03:05:41.039338 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "b9047e8c-855e-4623-8659-3c145e1706ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.582s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:41.096271 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-486329bd-6880-4d1e-ae49-d3d390526f61 req-10285bc8-655e-4e57-a03a-c7f36e8dc1e0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:41.189596 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:41.194552 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:05:41.215110 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:41.269958 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-486329bd-6880-4d1e-ae49-d3d390526f61 req-10285bc8-655e-4e57-a03a-c7f36e8dc1e0 service nova] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Updated VIF entry in instance network info cache for port 8b0c44e7-f8e9-407f-b08c-e71f03b4ea30. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:05:41.270435 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-486329bd-6880-4d1e-ae49-d3d390526f61 req-10285bc8-655e-4e57-a03a-c7f36e8dc1e0 service nova] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Updating instance_info_cache with network_info: [{"id": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "address": "fa:16:3e:bb:5a:83", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0c44e7-f8", "ovs_interfaceid": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:41.698157 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851141.6976607, b9047e8c-855e-4623-8659-3c145e1706ba => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:05:41.699956 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] VM Paused (Lifecycle Event)
May 27 03:05:41.775867 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-486329bd-6880-4d1e-ae49-d3d390526f61 req-10285bc8-655e-4e57-a03a-c7f36e8dc1e0 service nova] Releasing lock "refresh_cache-a3cd35f5-3cbb-41fb-802e-22931d1089bd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:05:41.916555 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c5380975-bca7-4a37-9373-afdb5e04e9a4 req-0a3211f9-7517-460d-bf44-bbb26ef28539 service nova] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Received event network-changed-01d57c3b-325e-43f9-9d7e-f0d3e24b75a1 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:41.916767 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c5380975-bca7-4a37-9373-afdb5e04e9a4 req-0a3211f9-7517-460d-bf44-bbb26ef28539 service nova] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Refreshing instance network info cache due to event network-changed-01d57c3b-325e-43f9-9d7e-f0d3e24b75a1. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:05:41.916975 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c5380975-bca7-4a37-9373-afdb5e04e9a4 req-0a3211f9-7517-460d-bf44-bbb26ef28539 service nova] Acquiring lock "refresh_cache-b9047e8c-855e-4623-8659-3c145e1706ba" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:05:41.917163 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c5380975-bca7-4a37-9373-afdb5e04e9a4 req-0a3211f9-7517-460d-bf44-bbb26ef28539 service nova] Acquired lock "refresh_cache-b9047e8c-855e-4623-8659-3c145e1706ba" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:05:41.917420 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c5380975-bca7-4a37-9373-afdb5e04e9a4 req-0a3211f9-7517-460d-bf44-bbb26ef28539 service nova] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Refreshing network info cache for port 01d57c3b-325e-43f9-9d7e-f0d3e24b75a1 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:05:42.073489 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "c3954135-0707-4b78-bfe3-f458ab39f55c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:42.073820 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:42.201546 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:42.204483 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851142.2041762, b9047e8c-855e-4623-8659-3c145e1706ba => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:05:42.204758 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] VM Resumed (Lifecycle Event)
May 27 03:05:42.374020 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "70ca77a6-2f29-4558-abf0-07292a6200cd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:42.374525 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:42.422766 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c5380975-bca7-4a37-9373-afdb5e04e9a4 req-0a3211f9-7517-460d-bf44-bbb26ef28539 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:42.577926 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lazy-loading 'flavor' on Instance uuid c3954135-0707-4b78-bfe3-f458ab39f55c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:42.635833 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "cdff666e-dc56-4310-a648-6d774f27acb2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:42.636082 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "cdff666e-dc56-4310-a648-6d774f27acb2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:42.636293 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "cdff666e-dc56-4310-a648-6d774f27acb2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:42.636476 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "cdff666e-dc56-4310-a648-6d774f27acb2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:42.636623 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "cdff666e-dc56-4310-a648-6d774f27acb2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:42.639033 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Terminating instance
May 27 03:05:42.710219 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:42.712814 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:05:42.816460 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c5380975-bca7-4a37-9373-afdb5e04e9a4 req-0a3211f9-7517-460d-bf44-bbb26ef28539 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:42.877953 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lazy-loading 'flavor' on Instance uuid 70ca77a6-2f29-4558-abf0-07292a6200cd {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:42.971217 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c5380975-bca7-4a37-9373-afdb5e04e9a4 req-0a3211f9-7517-460d-bf44-bbb26ef28539 service nova] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Updated VIF entry in instance network info cache for port 01d57c3b-325e-43f9-9d7e-f0d3e24b75a1. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:05:42.971468 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c5380975-bca7-4a37-9373-afdb5e04e9a4 req-0a3211f9-7517-460d-bf44-bbb26ef28539 service nova] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Updating instance_info_cache with network_info: [{"id": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "address": "fa:16:3e:21:ba:30", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01d57c3b-32", "ovs_interfaceid": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:43.143026 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:05:43.164288 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:43.167551 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:43.192947 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:43.335358 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a5405eb9-659a-4203-95da-8258e232283f req-2dae5c0c-a807-41ff-928b-15db07257471 service nova] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Received event network-vif-unplugged-c7fac247-8618-44e1-928a-63192f178a0a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:43.335808 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a5405eb9-659a-4203-95da-8258e232283f req-2dae5c0c-a807-41ff-928b-15db07257471 service nova] Acquiring lock "cdff666e-dc56-4310-a648-6d774f27acb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:43.336408 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a5405eb9-659a-4203-95da-8258e232283f req-2dae5c0c-a807-41ff-928b-15db07257471 service nova] Lock "cdff666e-dc56-4310-a648-6d774f27acb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:43.336408 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:43.337157 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a5405eb9-659a-4203-95da-8258e232283f req-2dae5c0c-a807-41ff-928b-15db07257471 service nova] Lock "cdff666e-dc56-4310-a648-6d774f27acb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:43.337157 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a5405eb9-659a-4203-95da-8258e232283f req-2dae5c0c-a807-41ff-928b-15db07257471 service nova] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] No waiting events found dispatching network-vif-unplugged-c7fac247-8618-44e1-928a-63192f178a0a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:05:43.337157 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a5405eb9-659a-4203-95da-8258e232283f req-2dae5c0c-a807-41ff-928b-15db07257471 service nova] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Received event network-vif-unplugged-c7fac247-8618-44e1-928a-63192f178a0a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:05:43.342800 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:43.445029 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:43.455298 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:43.473709 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c5380975-bca7-4a37-9373-afdb5e04e9a4 req-0a3211f9-7517-460d-bf44-bbb26ef28539 service nova] Releasing lock "refresh_cache-b9047e8c-855e-4623-8659-3c145e1706ba" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:05:43.475648 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99973221099981 future=<Future at 0x75572c2302c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:43.476099 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999283754999851 future=<Future at 0x75572c2302c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:43.477304 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.998068959999728 future=<Future at 0x75572c2302c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:43.478207 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Instance destroyed successfully.
May 27 03:05:43.478681 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'resources' on Instance uuid cdff666e-dc56-4310-a648-6d774f27acb2 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:43.585331 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:43.883286 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:43.981322 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:05:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-366068574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumemultiattachtest-server-366068574',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:05:37Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-y7w2j39q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:05:38Z,user_data=None,user_id='092604511a8a467ba4ecb56261cb531f',uuid=cdff666e-dc56-4310-a648-6d774f27acb2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7fac247-8618-44e1-928a-63192f178a0a", "address": "fa:16:3e:1b:af:60", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fac247-86", "ovs_interfaceid": "c7fac247-8618-44e1-928a-63192f178a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:05:43.981672 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "c7fac247-8618-44e1-928a-63192f178a0a", "address": "fa:16:3e:1b:af:60", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7fac247-86", "ovs_interfaceid": "c7fac247-8618-44e1-928a-63192f178a0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:05:43.982528 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:af:60,bridge_name='br-int',has_traffic_filtering=True,id=c7fac247-8618-44e1-928a-63192f178a0a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fac247-86') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:05:43.983047 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:af:60,bridge_name='br-int',has_traffic_filtering=True,id=c7fac247-8618-44e1-928a-63192f178a0a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fac247-86') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:05:43.985250 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:43.985570 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7fac247-86, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:43.986777 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:43.987643 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:05:43.988467 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:43.989580 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:43.989781 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3779b0fe-f0b2-4718-ba66-089b359735c7) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:43.990570 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:43.990960 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:05:43.991704 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:43.994418 np0000001475 nova-compute[98471]: INFO os_vif [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:af:60,bridge_name='br-int',has_traffic_filtering=True,id=c7fac247-8618-44e1-928a-63192f178a0a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7fac247-86')
May 27 03:05:44.037356 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:05:44.037716 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:05:44.037910 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:05:44.038378 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:05:44.038828 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:05:44.038979 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:05:44.065358 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:44.065358 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:44.065358 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:44.065358 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:44.065358 np0000001475 nova-compute[98471]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7 (non-flash)
May 27 03:05:44.065358 np0000001475 nova-compute[98471]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7 (non-flash)
May 27 03:05:44.065358 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:05:44.065592 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:44.065592 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:44.065592 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:44.065592 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:44.065592 np0000001475 nova-compute[98471]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7 (non-flash)
May 27 03:05:44.065592 np0000001475 nova-compute[98471]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7 (non-flash)
May 27 03:05:44.065592 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:05:44.065592 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7', '87')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:05:44.065877 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7', '86')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:05:44.066510 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7', '87')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:05:44.067208 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c27e8e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7'): ({'sdg'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:05:44.067389 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Removing multipathed devices sdf, sdg {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:05:44.067586 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Flush multipath device 330000000e341234c {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:05:44.122925 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:05:44.179408 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:05:44.232603 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:05:44.232768 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:05:44.233922 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:05:44.244592 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:05:44.244837 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:05:44.258012 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:44.289702 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 86, target: iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7, portal: 192.168.40.100,3260]
May 27 03:05:44.289702 np0000001475 nova-compute[98471]: Logout of [sid: 86, target: iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7, portal: 192.168.40.100,3260] successful.
May 27 03:05:44.289702 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:44.305312 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:44.322569 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:44.355992 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 87, target: iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7, portal: 192.168.50.100,3260]
May 27 03:05:44.355992 np0000001475 nova-compute[98471]: Logout of [sid: 87, target: iqn.2023-03.storpool.com:os--volume-9263f34c-0d34-40a0-9ff5-b4510c72a6b7, portal: 192.168.50.100,3260] successful.
May 27 03:05:44.355992 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:44.373924 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:44.374375 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:05:44.374538 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] <== disconnect_volume: return (336ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:05:44.374680 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:05:44.375072 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Deleting instance files /opt/stack/data/nova/instances/cdff666e-dc56-4310-a648-6d774f27acb2_del
May 27 03:05:44.376439 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Deletion of /opt/stack/data/nova/instances/cdff666e-dc56-4310-a648-6d774f27acb2_del complete
May 27 03:05:44.662368 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "c3954135-0707-4b78-bfe3-f458ab39f55c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:44.663103 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:44.663987 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Attaching volume b8771a8c-0e68-46bf-99ee-4ad0965beccd to /dev/vdb
May 27 03:05:44.714414 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:05:44.728992 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:05:44.754241 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:44.806485 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:05:44.806856 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:05:44.817806 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:05:44.819313 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:fe5c:3071', 'fe80::fc16:3eff:fe88:48d5', 'fe80::fc16:3eff:fe00:b7f', 'fe80::5060:75ff:fe06:71d8', 'fe80::fc16:3eff:fe6d:20b3', 'fe80::88ab:28ff:fedb:6e99', 'fe80::fc16:3eff:fe58:79ce', 'fe80::8cdc:9fff:fe79:9907', 'fe80::fc16:3eff:febb:5a83', 'fe80::492:18ff:fe4d:a46d', 'fe80::fc16:3eff:fe21:ba30', 'fe80::787c:50ff:fed5:a1fc'] 
May 27 03:05:44.819478 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:05:44.819545 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:05:44.819757 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:05:44.820003 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Updating existing volume attachment record: 5ed23ccd-1d09-4e65-af64-935272f8120b {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:05:44.890037 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Took 1.75 seconds to destroy the instance on the hypervisor.
May 27 03:05:44.891131 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:05:44.891266 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:05:44.891416 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:05:44.891876 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:44.959564 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:44.969765 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "70ca77a6-2f29-4558-abf0-07292a6200cd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:44.969765 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:44.969765 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Attaching volume fa027204-a605-4551-9c81-86ef0865bcdb to /dev/vdb
May 27 03:05:45.022863 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:05:45.035107 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:05:45.063823 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:45.128250 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:05:45.129880 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:05:45.140962 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:05:45.141924 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:fe5c:3071', 'fe80::fc16:3eff:fe88:48d5', 'fe80::fc16:3eff:fe00:b7f', 'fe80::5060:75ff:fe06:71d8', 'fe80::fc16:3eff:fe6d:20b3', 'fe80::88ab:28ff:fedb:6e99', 'fe80::fc16:3eff:fe58:79ce', 'fe80::8cdc:9fff:fe79:9907', 'fe80::fc16:3eff:febb:5a83', 'fe80::492:18ff:fe4d:a46d', 'fe80::fc16:3eff:fe21:ba30', 'fe80::787c:50ff:fed5:a1fc'] 
May 27 03:05:45.142308 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:05:45.144776 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:05:45.144776 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:05:45.144776 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Updating existing volume attachment record: 697be958-6fa8-45de-96fe-4462a6dc752c {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:05:45.269631 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a166cfb7-9974-40ec-9ece-63e1f799c688 req-22c4a86f-b4ca-4ab1-870e-63925009557c service nova] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Received event network-vif-deleted-c7fac247-8618-44e1-928a-63192f178a0a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:45.269631 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-a166cfb7-9974-40ec-9ece-63e1f799c688 req-22c4a86f-b4ca-4ab1-870e-63925009557c service nova] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Neutron deleted interface c7fac247-8618-44e1-928a-63192f178a0a; detaching it from the instance and deleting it from the info cache
May 27 03:05:45.269631 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a166cfb7-9974-40ec-9ece-63e1f799c688 req-22c4a86f-b4ca-4ab1-870e-63925009557c service nova] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:45.407353 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f7b32c57-e16f-40f4-b5c4-2e0aefde769f req-a88c9cda-8922-462b-b982-b1c8f564266f service nova] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Received event network-vif-unplugged-c7fac247-8618-44e1-928a-63192f178a0a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:45.407353 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f7b32c57-e16f-40f4-b5c4-2e0aefde769f req-a88c9cda-8922-462b-b982-b1c8f564266f service nova] Acquiring lock "cdff666e-dc56-4310-a648-6d774f27acb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:45.407353 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f7b32c57-e16f-40f4-b5c4-2e0aefde769f req-a88c9cda-8922-462b-b982-b1c8f564266f service nova] Lock "cdff666e-dc56-4310-a648-6d774f27acb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:45.407353 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f7b32c57-e16f-40f4-b5c4-2e0aefde769f req-a88c9cda-8922-462b-b982-b1c8f564266f service nova] Lock "cdff666e-dc56-4310-a648-6d774f27acb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:45.407353 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f7b32c57-e16f-40f4-b5c4-2e0aefde769f req-a88c9cda-8922-462b-b982-b1c8f564266f service nova] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] No waiting events found dispatching network-vif-unplugged-c7fac247-8618-44e1-928a-63192f178a0a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:05:45.407353 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f7b32c57-e16f-40f4-b5c4-2e0aefde769f req-a88c9cda-8922-462b-b982-b1c8f564266f service nova] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Received event network-vif-unplugged-c7fac247-8618-44e1-928a-63192f178a0a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:05:45.429025 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c3954135-0707-4b78-bfe3-f458ab39f55c', 'attached_at': '', 'detached_at': '', 'volume_id': 'b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'serial': 'b8771a8c-0e68-46bf-99ee-4ad0965beccd'} {{(pid=98471) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 03:05:45.431440 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:05:45.431440 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:05:45.431440 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:05:45.431440 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:05:45.431440 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:05:45.443168 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:05:45.444051 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:05:45.444535 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:05:45.444770 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:05:45.445408 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:05:45.445631 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:05:45.456603 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:05:45.456603 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:45.463828 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:05:45.463828 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:45.473241 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd] added
May 27 03:05:45.473241 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:05:45.473241 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:05:45.473241 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:05:45.473241 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:05:45.473241 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:05:45.473241 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:45.473241 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:05:45.473833 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:05:45.473833 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:05:45.480419 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd] added
May 27 03:05:45.480419 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:05:45.480419 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:05:45.480419 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:05:45.480419 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:05:45.480419 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:05:45.480419 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:45.480419 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:05:45.480774 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.035(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:05:45.481027 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:05:45.695975 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:45.723246 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:05:45.723246 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb', 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fa027204-a605-4551-9c81-86ef0865bcdb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:05:45.723246 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:05:45.773715 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a166cfb7-9974-40ec-9ece-63e1f799c688 req-22c4a86f-b4ca-4ab1-870e-63925009557c service nova] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Detach interface failed, port_id=c7fac247-8618-44e1-928a-63192f178a0a, reason: Instance cdff666e-dc56-4310-a648-6d774f27acb2 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:05:46.197949 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Took 1.31 seconds to deallocate network for instance.
May 27 03:05:46.218048 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:46.474134 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:05:46.481376 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:05:46.488583 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:05:46.488583 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:05:46.500558 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:05:46.500558 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:46.509235 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:46.516285 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:46.527107 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:46.527107 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:46.527107 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:46.527107 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:46.527107 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:05:46.527258 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:46.527258 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:46.527258 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:46.527258 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:46.527258 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:05:46.532209 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:46.532209 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:46.532209 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:46.532209 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:46.532209 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:05:46.532376 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:46.532376 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:46.532376 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:46.532376 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:46.532376 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:05:46.573079 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd, portal: 192.168.40.100,3260]
May 27 03:05:46.573079 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd, portal: 192.168.40.100,3260] successful.
May 27 03:05:46.573079 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:46.578379 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd, portal: 192.168.50.100,3260]
May 27 03:05:46.578379 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd, portal: 192.168.50.100,3260] successful.
May 27 03:05:46.578379 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:46.586373 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:46.594123 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:46.602403 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:46.602403 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:46.602403 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:46.602403 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:46.602403 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:46.602403 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:46.602403 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:05:46.602761 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:46.602761 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:46.602761 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:46.602761 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:46.602761 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:46.602761 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:46.602761 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:05:46.603119 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:05:46.603119 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:05:46.603928 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] HCTL ('11', '-', '-', 0) found on session 88 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:05:46.603991 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:05:46.617130 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:46.617130 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:46.617130 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:46.617130 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:46.617130 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:46.617130 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:46.617130 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:05:46.619771 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:46.619771 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:46.619771 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:46.619771 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:46.619771 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:46.619771 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:46.619771 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:05:46.619771 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:05:46.620086 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:05:46.623470 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] HCTL ('12', '-', '-', 0) found on session 89 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:05:46.623609 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:05:46.624550 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Searching for a device in session 88 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:05:46.624866 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:05:46.640817 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Searching for a device in session 89 and hctl ['12', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:05:46.778232 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Took 0.58 seconds to detach 1 volumes for instance.
May 27 03:05:47.123993 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:05:47.124315 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:05:47.124535 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:05:47.124771 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:05:47.124967 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:05:47.125212 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:05:47.287940 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:47.288448 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:47.632779 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
May 27 03:05:47.632779 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Triggering sync for uuid f5d36573-c0e7-43a0-a7cc-66678f093375 {{(pid=98471) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 03:05:47.633133 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Triggering sync for uuid 71af628e-b06d-446d-8c2e-dcfbb232df33 {{(pid=98471) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 03:05:47.633754 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "f5d36573-c0e7-43a0-a7cc-66678f093375" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:47.634374 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Triggering sync for uuid 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 {{(pid=98471) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 03:05:47.634727 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "f5d36573-c0e7-43a0-a7cc-66678f093375" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:47.635245 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "71af628e-b06d-446d-8c2e-dcfbb232df33" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:47.635936 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Triggering sync for uuid c2a5e735-d573-4ac4-bff0-d4a12648718e {{(pid=98471) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 03:05:47.636423 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:47.637567 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:47.637567 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Triggering sync for uuid d7f71824-f631-423e-a5ea-8ae72642a95e {{(pid=98471) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 03:05:47.638773 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:47.640558 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:47.641456 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Triggering sync for uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 03:05:47.641456 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:47.641456 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "d7f71824-f631-423e-a5ea-8ae72642a95e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:47.641629 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Triggering sync for uuid 70ca77a6-2f29-4558-abf0-07292a6200cd {{(pid=98471) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 03:05:47.643124 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:47.643124 np0000001475 nova-compute[98471]: WARNING nova.utils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x755724686840> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 27 03:05:47.643124 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Triggering sync for uuid c3954135-0707-4b78-bfe3-f458ab39f55c {{(pid=98471) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 03:05:47.643124 np0000001475 nova-compute[98471]: WARNING nova.utils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x755724686840> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 27 03:05:47.643124 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Triggering sync for uuid cdff666e-dc56-4310-a648-6d774f27acb2 {{(pid=98471) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 03:05:47.643124 np0000001475 nova-compute[98471]: WARNING nova.utils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x755724686840> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 27 03:05:47.643329 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Triggering sync for uuid a3cd35f5-3cbb-41fb-802e-22931d1089bd {{(pid=98471) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 03:05:47.643879 np0000001475 nova-compute[98471]: WARNING nova.utils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x755724686840> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 27 03:05:47.646073 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Triggering sync for uuid b9047e8c-855e-4623-8659-3c145e1706ba {{(pid=98471) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 03:05:47.646278 np0000001475 nova-compute[98471]: WARNING nova.utils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x755724686840> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 27 03:05:47.646774 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:05:47.647815 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:05:47.647815 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.07 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:05:47.666543 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Searching for a device in session 89 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:05:47.677086 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:05:47.722814 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:05:47.723116 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.48 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:05:47.980216 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:05:47.980452 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:05:48.141366 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "f5d36573-c0e7-43a0-a7cc-66678f093375" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.507s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:48.141588 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:48.141862 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:48.160326 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.524s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:48.160586 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "70ca77a6-2f29-4558-abf0-07292a6200cd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:48.183655 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.546s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:48.184266 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "c3954135-0707-4b78-bfe3-f458ab39f55c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:48.185299 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.545s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:48.185299 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "cdff666e-dc56-4310-a648-6d774f27acb2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:48.186111 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.544s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:48.186111 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:48.186111 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:48.464372 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Found WWN 3300000005d3ccd88 for multipath device dm-4 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:05:48.464861 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:05:48.465301 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.742s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:05:48.465526 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb', 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fa027204-a605-4551-9c81-86ef0865bcdb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:05:48.466911 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '3300000005d3ccd88', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '3300000005d3ccd88'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:05:48.466911 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005d3ccd88', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '3300000005d3ccd88'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:05:48.468969 np0000001475 nova-compute[98471]: WARNING stevedore.named [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 03:05:48.469227 np0000001475 nova-compute[98471]: WARNING castellan.key_manager [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:05:48.469409 np0000001475 nova-compute[98471]: WARNING nova.keymgr.conf_key_mgr [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:05:48.470051 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x755704645e80>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': 'c3954135-0707-4b78-bfe3-f458ab39f55c', 'attached_at': '', 'detached_at': '', 'volume_id': 'b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'serial': 'b8771a8c-0e68-46bf-99ee-4ad0965beccd'} {{(pid=98471) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 27 03:05:48.470191 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98471) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 27 03:05:48.470314 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors.luks [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] opening encrypted volume /dev/dm-4 {{(pid=98471) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 27 03:05:48.477396 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:05:48.478257 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:05:48.478875 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:05:48.479072 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:05:48.479566 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:05:48.479782 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:05:48.483661 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:05:48.497079 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:05:48.497079 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:48.500900 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:05:48.500900 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:48.521702 np0000001475 nova-compute[98471]: WARNING os_brick.encryptors.luks [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 27 03:05:48.521938 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb] added
May 27 03:05:48.521938 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:05:48.521938 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:05:48.521938 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:05:48.521938 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:05:48.521938 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:05:48.521938 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:48.522168 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb] added
May 27 03:05:48.522168 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:05:48.522168 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:05:48.522168 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:05:48.522168 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:05:48.522168 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:05:48.522168 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:48.522353 np0000001475 nova-compute[98471]: INFO os_brick.encryptors.luks [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] /dev/dm-4 is not a valid LUKS device; formatting device for first use
May 27 03:05:48.522523 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:05:48.522799 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:05:48.523012 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors.luks [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] formatting encrypted volume /dev/dm-4 {{(pid=98471) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 27 03:05:48.523178 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.043(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:05:48.523980 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0439(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:05:48.523980 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:05:48.523980 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:05:48.646190 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.504s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:48.646492 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "b9047e8c-855e-4623-8659-3c145e1706ba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:48.646643 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "b9047e8c-855e-4623-8659-3c145e1706ba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:48.690211 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.504s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:48.993629 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.705s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:49.003689 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:49.074376 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Deleted allocations for instance cdff666e-dc56-4310-a648-6d774f27acb2
May 27 03:05:49.167576 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "b9047e8c-855e-4623-8659-3c145e1706ba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.521s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:49.524252 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:05:49.525496 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:05:49.539966 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:05:49.539966 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:05:49.545293 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:05:49.545293 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:49.554466 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:49.563391 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:49.575451 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:49.575451 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:49.575451 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:49.575451 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:49.575451 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:49.575451 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:49.575451 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:05:49.575869 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:49.575869 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:49.575869 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:49.575869 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:49.575869 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:49.575869 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:49.575869 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:05:49.581617 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:49.581617 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:49.581617 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:49.581617 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:49.581617 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:49.581617 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:49.581617 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:05:49.581967 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:49.581967 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:49.581967 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:49.581967 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:49.581967 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:49.581967 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:49.581967 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:05:49.629778 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb, portal: 192.168.40.100,3260]
May 27 03:05:49.629778 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb, portal: 192.168.40.100,3260] successful.
May 27 03:05:49.629778 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:49.650852 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:49.653275 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb, portal: 192.168.50.100,3260]
May 27 03:05:49.653275 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb, portal: 192.168.50.100,3260] successful.
May 27 03:05:49.653275 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:49.670085 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:49.671634 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:49.671634 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:49.671634 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:49.671634 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:49.671634 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:49.671634 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:49.671634 np0000001475 nova-compute[98471]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:05:49.671634 np0000001475 nova-compute[98471]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:05:49.671634 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:05:49.671897 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:49.671897 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:49.671897 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:49.671897 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:49.671897 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:49.671897 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:49.671897 np0000001475 nova-compute[98471]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:05:49.671897 np0000001475 nova-compute[98471]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:05:49.671897 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:05:49.672320 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:05:49.672466 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:05:49.673457 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] HCTL ('13', '-', '-', 0) found on session 90 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:05:49.673555 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:05:49.694603 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:49.694603 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:49.694603 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:49.694603 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:49.694603 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:49.694603 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:49.694603 np0000001475 nova-compute[98471]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:05:49.694603 np0000001475 nova-compute[98471]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:05:49.694603 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:05:49.694603 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:49.694603 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:05:49.694603 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:49.694603 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:05:49.694603 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:49.694603 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:05:49.694603 np0000001475 nova-compute[98471]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:05:49.694603 np0000001475 nova-compute[98471]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:05:49.694603 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:05:49.694603 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.214s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:05:49.694603 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:05:49.695385 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] HCTL ('14', '-', '-', 0) found on session 91 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:05:49.695385 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:05:49.696280 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Searching for a device in session 90 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:05:49.696450 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fa027204-a605-4551-9c81-86ef0865bcdb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:05:49.717716 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Searching for a device in session 91 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:05:49.718227 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fa027204-a605-4551-9c81-86ef0865bcdb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:05:49.846056 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:49.846219 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:49.846432 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:49.846604 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:49.846713 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:49.850073 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Terminating instance
May 27 03:05:50.089770 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cc56b6ff-e124-4cd8-809a-749390063520 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "cdff666e-dc56-4310-a648-6d774f27acb2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.452s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:50.089770 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "cdff666e-dc56-4310-a648-6d774f27acb2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.903s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:50.357296 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:05:50.399025 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:50.400458 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:50.426276 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:50.438598 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:50.470018 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:50.479879 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:05:50.591381 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d3aefc1e-3b0f-486f-8696-aba0dba872e2 req-e54559a3-0a0e-4b04-b122-916b6527eccd service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received event network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:50.591796 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d3aefc1e-3b0f-486f-8696-aba0dba872e2 req-e54559a3-0a0e-4b04-b122-916b6527eccd service nova] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:50.595922 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d3aefc1e-3b0f-486f-8696-aba0dba872e2 req-e54559a3-0a0e-4b04-b122-916b6527eccd service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:50.595922 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d3aefc1e-3b0f-486f-8696-aba0dba872e2 req-e54559a3-0a0e-4b04-b122-916b6527eccd service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:50.595922 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d3aefc1e-3b0f-486f-8696-aba0dba872e2 req-e54559a3-0a0e-4b04-b122-916b6527eccd service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] No waiting events found dispatching network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:05:50.595922 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d3aefc1e-3b0f-486f-8696-aba0dba872e2 req-e54559a3-0a0e-4b04-b122-916b6527eccd service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received event network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:05:50.596863 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "cdff666e-dc56-4310-a648-6d774f27acb2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.507s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:50.733393 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999628077000125 future=<Future at 0x755704787200 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:50.735448 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Instance destroyed successfully.
May 27 03:05:50.736558 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'resources' on Instance uuid bb06d928-2b8c-46f2-b61d-fdb19af4017e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:51.220033 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:51.240345 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1752019004',display_name='tempest-AttachVolumeTestJSON-server-1752019004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumetestjson-server-1752019004',id=34,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnCyl+g1Ye4tCJK/b/EmMSENQNCevd73XcwcJq7MM0QjAHn7OQTuI/rqxlNGXTk7F/U6HedbzcDuONEX5G9MqYrebfqRT8YlVYqtYPepNOx2xjMDNgKF5JW2yc7DR5vwA==',key_name='tempest-keypair-224254834',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:03:08Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca3c6a3942eb41e8b6aefddc5faca789',ramdisk_id='',reservation_id='r-b5nd7f2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1635503347',owner_user_name='tempest-AttachVolumeTestJSON-1635503347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:05:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0d83ca7002c41e0897c39e7b8d91bff',uuid=bb06d928-2b8c-46f2-b61d-fdb19af4017e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:05:51.240615 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converting VIF {"id": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "address": "fa:16:3e:58:79:ce", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f71bc7-6b", "ovs_interfaceid": "f4f71bc7-6b31-42c9-8f6c-2bc91e87a157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:05:51.241530 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:05:51.241919 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:05:51.243760 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:51.243989 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4f71bc7-6b, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:51.246252 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:51.246972 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:05:51.247554 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:51.248328 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:51.248463 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bbfecf44-e6c0-4988-b1c8-76b1ac26214e) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:51.249364 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:05:51.249765 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:51.251243 np0000001475 nova-compute[98471]: INFO os_vif [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f71bc7-6b')
May 27 03:05:51.251592 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Deleting instance files /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e_del
May 27 03:05:51.252460 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Deletion of /opt/stack/data/nova/instances/bb06d928-2b8c-46f2-b61d-fdb19af4017e_del complete
May 27 03:05:51.497434 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Found WWN 3300000004b9a3f4b for multipath device dm-5 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:05:51.497838 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:05:51.498164 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] <== connect_volume: return (5775ms) {'type': 'block', 'scsi_wwn': '3300000004b9a3f4b', 'path': '/dev/dm-5', 'multipath_id': '3300000004b9a3f4b'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:05:51.498334 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004b9a3f4b', 'path': '/dev/dm-5', 'multipath_id': '3300000004b9a3f4b'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:05:51.501047 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lazy-loading 'flavor' on Instance uuid 70ca77a6-2f29-4558-abf0-07292a6200cd {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:51.762444 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Took 1.41 seconds to destroy the instance on the hypervisor.
May 27 03:05:51.763277 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:05:51.763685 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:05:51.763895 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:05:51.764658 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:51.906388 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:52.016199 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Attempting to attach volume fa027204-a605-4551-9c81-86ef0865bcdb with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:05:52.019393 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:05:52.019393 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:05:52.019393 np0000001475 nova-compute[98471]:   <alias name="ua-fa027204-a605-4551-9c81-86ef0865bcdb"/>
May 27 03:05:52.019393 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:05:52.019393 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:05:52.019393 np0000001475 nova-compute[98471]:   <serial>fa027204-a605-4551-9c81-86ef0865bcdb</serial>
May 27 03:05:52.019393 np0000001475 nova-compute[98471]: </disk>
May 27 03:05:52.019393 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:05:52.199600 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:05:52.602806 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c60165fd-b715-4d72-a299-1a882253eae9 req-01ffcc94-cf64-43b9-bbcd-c80625fe2efe service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received event network-vif-deleted-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:52.602806 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-c60165fd-b715-4d72-a299-1a882253eae9 req-01ffcc94-cf64-43b9-bbcd-c80625fe2efe service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Neutron deleted interface f4f71bc7-6b31-42c9-8f6c-2bc91e87a157; detaching it from the instance and deleting it from the info cache
May 27 03:05:52.602986 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c60165fd-b715-4d72-a299-1a882253eae9 req-01ffcc94-cf64-43b9-bbcd-c80625fe2efe service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:52.689085 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6588cd49-0450-4192-8146-59a1b1b9aafd req-b5771006-ddc1-4256-abd9-77b869295857 service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received event network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:52.692700 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6588cd49-0450-4192-8146-59a1b1b9aafd req-b5771006-ddc1-4256-abd9-77b869295857 service nova] Acquiring lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:52.692863 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6588cd49-0450-4192-8146-59a1b1b9aafd req-b5771006-ddc1-4256-abd9-77b869295857 service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:52.693135 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6588cd49-0450-4192-8146-59a1b1b9aafd req-b5771006-ddc1-4256-abd9-77b869295857 service nova] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:52.693197 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6588cd49-0450-4192-8146-59a1b1b9aafd req-b5771006-ddc1-4256-abd9-77b869295857 service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] No waiting events found dispatching network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:05:52.693364 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6588cd49-0450-4192-8146-59a1b1b9aafd req-b5771006-ddc1-4256-abd9-77b869295857 service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Received event network-vif-unplugged-f4f71bc7-6b31-42c9-8f6c-2bc91e87a157 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:05:52.722031 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:52.722279 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:52.722321 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:52.722484 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:05:53.015591 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:53.121162 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c60165fd-b715-4d72-a299-1a882253eae9 req-01ffcc94-cf64-43b9-bbcd-c80625fe2efe service nova] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Detach interface failed, port_id=f4f71bc7-6b31-42c9-8f6c-2bc91e87a157, reason: Instance bb06d928-2b8c-46f2-b61d-fdb19af4017e could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:05:53.516144 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Took 1.75 seconds to deallocate network for instance.
May 27 03:05:53.767653 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:05:53.767883 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:05:53.768135 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:05:53.768135 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] No VIF found with MAC fa:16:3e:00:0b:7f, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:05:53.779592 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:53.888918 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:53.889642 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:53.982228 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:53.992791 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:54.028310 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:54.028693 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:54.104468 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:54.105107 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:54.199353 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "d7f71824-f631-423e-a5ea-8ae72642a95e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:54.199670 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:54.199978 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:54.200192 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:54.200377 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:54.203861 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Terminating instance
May 27 03:05:54.228633 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:54.236669 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:54.348707 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:54.349804 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:54.483249 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:54.492175 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:05:54.492309 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:05:54.495162 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:54.640936 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:54.645147 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:54.711262 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:05:54.746298 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:54.759782 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:54.765882 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:54.781476 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:54.792539 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors.luks [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] opening encrypted volume /dev/dm-4 {{(pid=98471) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 27 03:05:54.884993 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:54.886800 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:54.929772 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:05:54.929772 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:05:54.974059 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9816650e-cc05-4297-b2dd-eda601630778 req-0b44fa35-73b7-4960-84e4-615fdabfc536 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Received event network-vif-unplugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:54.974213 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9816650e-cc05-4297-b2dd-eda601630778 req-0b44fa35-73b7-4960-84e4-615fdabfc536 service nova] Acquiring lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:54.974463 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9816650e-cc05-4297-b2dd-eda601630778 req-0b44fa35-73b7-4960-84e4-615fdabfc536 service nova] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:54.974667 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9816650e-cc05-4297-b2dd-eda601630778 req-0b44fa35-73b7-4960-84e4-615fdabfc536 service nova] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:54.977241 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9816650e-cc05-4297-b2dd-eda601630778 req-0b44fa35-73b7-4960-84e4-615fdabfc536 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] No waiting events found dispatching network-vif-unplugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:05:54.977608 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9816650e-cc05-4297-b2dd-eda601630778 req-0b44fa35-73b7-4960-84e4-615fdabfc536 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Received event network-vif-unplugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:05:54.982131 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:54.987167 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:55.006032 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:55.006948 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:05:55.012120 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:55.066490 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.998211185999935 future=<Future at 0x7557047a27e0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:55.077184 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Instance destroyed successfully.
May 27 03:05:55.078469 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'resources' on Instance uuid d7f71824-f631-423e-a5ea-8ae72642a95e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:55.167250 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:55.167725 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:55.258466 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:55.263563 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:55.352071 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:55.352071 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:55.378466 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-500c1ec4-8c5c-4893-bb20-94eff253f2d5 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.409s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:55.380121 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.219s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:55.440780 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:05:55.456095 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:55.461699 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:05:55.462607 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:55.522249 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.059s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:05:55.522954 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=9813MB free_disk=72.96210479736328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:05:55.523168 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:55.584808 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001475',hostname='multiattach-server-1',id=33,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7X60AtOl0SsfuAMV1LtNGpvh0yvi8THxioUm4x62ykVhuM7q4sXRNe3S5fa56OsOiAX0ZbtOowRZ4+AKeGhch21Oc/NUN3hQGbbFxrwclVqtJHRu4HOLbwt9JgM8J0mA==',key_name='tempest-keypair-1333870124',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:04:35Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-ki851fh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092604511a8a467ba4ecb56261cb531f',uuid=d7f71824-f631-423e-a5ea-8ae72642a95e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:05:55.585179 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "address": "fa:16:3e:88:48:d5", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap57af91c5-42", "ovs_interfaceid": "57af91c5-42f3-4f9f-ac26-aad2418fdfe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:05:55.587862 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:48:d5,bridge_name='br-int',has_traffic_filtering=True,id=57af91c5-42f3-4f9f-ac26-aad2418fdfe3,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57af91c5-42') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:05:55.588757 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:48:d5,bridge_name='br-int',has_traffic_filtering=True,id=57af91c5-42f3-4f9f-ac26-aad2418fdfe3,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57af91c5-42') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:05:55.591070 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:55.591501 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57af91c5-42, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:55.600178 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:55.600813 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:05:55.601190 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:55.602897 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:55.602897 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3183317c-2624-4aa0-9886-cbecff6e0218) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:05:55.603632 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:55.606558 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:05:55.606821 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:55.610429 np0000001475 nova-compute[98471]: INFO os_vif [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:48:d5,bridge_name='br-int',has_traffic_filtering=True,id=57af91c5-42f3-4f9f-ac26-aad2418fdfe3,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57af91c5-42')
May 27 03:05:55.610907 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Deleting instance files /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e_del
May 27 03:05:55.620025 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Deletion of /opt/stack/data/nova/instances/d7f71824-f631-423e-a5ea-8ae72642a95e_del complete
May 27 03:05:55.903635 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.524s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:55.956461 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.928s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:55.959259 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.436s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:56.043203 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Deleted allocations for instance bb06d928-2b8c-46f2-b61d-fdb19af4017e
May 27 03:05:56.127897 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Took 1.42 seconds to destroy the instance on the hypervisor.
May 27 03:05:56.129071 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:05:56.129242 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:05:56.129376 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:05:56.129767 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:56.226012 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:56.284889 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:05:56.628364 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "70ca77a6-2f29-4558-abf0-07292a6200cd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:56.629140 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:56.758277 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:05:56.931710 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lazy-loading 'flavor' on Instance uuid c3954135-0707-4b78-bfe3-f458ab39f55c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:56.955755 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f3fad148-a019-404e-b024-e82f34c1d632 req-fd6635a9-e7ee-45e4-a3c1-7052db121295 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Received event network-vif-deleted-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:56.956516 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-f3fad148-a019-404e-b024-e82f34c1d632 req-fd6635a9-e7ee-45e4-a3c1-7052db121295 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Neutron deleted interface 57af91c5-42f3-4f9f-ac26-aad2418fdfe3; detaching it from the instance and deleting it from the info cache
May 27 03:05:56.956516 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f3fad148-a019-404e-b024-e82f34c1d632 req-fd6635a9-e7ee-45e4-a3c1-7052db121295 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:57.044309 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-294c6913-ae81-40be-b394-314a598cc38e req-7a0f457a-6831-4850-873a-7bc93bc7abf0 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Received event network-vif-unplugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:05:57.045376 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-294c6913-ae81-40be-b394-314a598cc38e req-7a0f457a-6831-4850-873a-7bc93bc7abf0 service nova] Acquiring lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:57.045376 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-294c6913-ae81-40be-b394-314a598cc38e req-7a0f457a-6831-4850-873a-7bc93bc7abf0 service nova] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:57.045376 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-294c6913-ae81-40be-b394-314a598cc38e req-7a0f457a-6831-4850-873a-7bc93bc7abf0 service nova] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:57.045877 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-294c6913-ae81-40be-b394-314a598cc38e req-7a0f457a-6831-4850-873a-7bc93bc7abf0 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] No waiting events found dispatching network-vif-unplugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:05:57.046101 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-294c6913-ae81-40be-b394-314a598cc38e req-7a0f457a-6831-4850-873a-7bc93bc7abf0 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Received event network-vif-unplugged-57af91c5-42f3-4f9f-ac26-aad2418fdfe3 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:05:57.049673 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance f5d36573-c0e7-43a0-a7cc-66678f093375 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:05:57.049973 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 71af628e-b06d-446d-8c2e-dcfbb232df33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:05:57.050564 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:05:57.050564 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance c2a5e735-d573-4ac4-bff0-d4a12648718e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:05:57.050940 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance d7f71824-f631-423e-a5ea-8ae72642a95e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:05:57.051151 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 70ca77a6-2f29-4558-abf0-07292a6200cd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:05:57.051341 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance c3954135-0707-4b78-bfe3-f458ab39f55c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:05:57.051823 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance a3cd35f5-3cbb-41fb-802e-22931d1089bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:05:57.054541 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance b9047e8c-855e-4623-8659-3c145e1706ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:05:57.058019 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:05:57.061528 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=2368MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:05:55 up 37 min,  2 users,  load average: 8.32, 8.43, 4.86\n', 'num_instances': '9', 'num_vm_active': '9', 'num_task_None': '8', 'num_os_type_None': '9', 'num_proj_a9c48d6919e8435f876f3324616521ea': '5', 'io_workload': '0', 'num_task_deleting': '1', 'num_proj_c0405565349241dd88ac22d535484e65': '1', 'num_proj_51a54fd7b39b4a968af6ad453070ea4d': '1', 'num_proj_4d79b15ea2254cd7adc804ece7e7cfae': '1', 'num_proj_5f1801e95925498cac899f1414f2b202': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:05:57.072615 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0209b4f7-1113-42ce-b221-33c3c81b3245 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "bb06d928-2b8c-46f2-b61d-fdb19af4017e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.226s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:57.133788 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lazy-loading 'flavor' on Instance uuid 70ca77a6-2f29-4558-abf0-07292a6200cd {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:05:57.383440 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:05:57.433911 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Attempting to attach volume b8771a8c-0e68-46bf-99ee-4ad0965beccd with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:05:57.436646 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:05:57.436646 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:05:57.436646 np0000001475 nova-compute[98471]:   <alias name="ua-b8771a8c-0e68-46bf-99ee-4ad0965beccd"/>
May 27 03:05:57.436646 np0000001475 nova-compute[98471]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 27 03:05:57.436646 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:05:57.436646 np0000001475 nova-compute[98471]:   <serial>b8771a8c-0e68-46bf-99ee-4ad0965beccd</serial>
May 27 03:05:57.436646 np0000001475 nova-compute[98471]: </disk>
May 27 03:05:57.436646 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:05:57.465847 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f3fad148-a019-404e-b024-e82f34c1d632 req-fd6635a9-e7ee-45e4-a3c1-7052db121295 service nova] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Detach interface failed, port_id=57af91c5-42f3-4f9f-ac26-aad2418fdfe3, reason: Instance d7f71824-f631-423e-a5ea-8ae72642a95e could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:05:57.561679 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:05:57.561987 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:05:57.885099 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Took 1.76 seconds to deallocate network for instance.
May 27 03:05:58.064607 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:05:58.140156 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:58.392896 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:58.475876 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0004657530002987187 future=<Future at 0x75572c2302c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:58.476845 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Emitting event <LifecycleEvent: 1779851143.4752758, cdff666e-dc56-4310-a648-6d774f27acb2 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:05:58.477128 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:58.477327 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=7.255367682000269 future=<Future at 0x755704787200 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:58.477650 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] VM Stopped (Lifecycle Event)
May 27 03:05:58.478201 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=7.254486750000069 future=<Future at 0x755704787200 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:05:58.571538 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:05:58.571734 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.613s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:05:58.572119 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.179s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:58.572587 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:05:58.980281 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: cdff666e-dc56-4310-a648-6d774f27acb2] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:05:59.108907 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:05:59.111875 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:05:59.111875 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:05:59.111875 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] No VIF found with MAC fa:16:3e:6d:20:b3, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:05:59.144786 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:05:59.145205 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:05:59.254265 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "70ca77a6-2f29-4558-abf0-07292a6200cd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:05:59.254385 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:05:59.254549 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Attaching volume 84717294-7eb7-4a8e-a867-0d8ee34db75d to /dev/vdc
May 27 03:05:59.293234 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:05:59.303650 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:05:59.326763 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:05:59.367565 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:05:59.367792 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:05:59.375764 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:05:59.378416 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::fc16:3eff:fed1:eab1', 'fe80::fc16:3eff:fe5c:3071', 'fe80::fc16:3eff:fe00:b7f', 'fe80::5060:75ff:fe06:71d8', 'fe80::fc16:3eff:fe6d:20b3', 'fe80::88ab:28ff:fedb:6e99', 'fe80::fc16:3eff:febb:5a83', 'fe80::492:18ff:fe4d:a46d', 'fe80::fc16:3eff:fe21:ba30', 'fe80::787c:50ff:fed5:a1fc'] 
May 27 03:05:59.378416 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:05:59.378416 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:05:59.378642 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:05:59.378891 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Updating existing volume attachment record: a216979a-e744-4e75-8281-8aa3b722feef {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:05:59.648432 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:05:59.941362 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:05:59.941800 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d', 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '84717294-7eb7-4a8e-a867-0d8ee34db75d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:05:59.942065 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:05:59.942484 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:05:59.942937 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d', 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '84717294-7eb7-4a8e-a867-0d8ee34db75d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:05:59.954399 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:05:59.954852 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:05:59.955019 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:05:59.955378 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:05:59.958637 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:05:59.958637 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:05:59.965464 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:05:59.965464 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:59.971676 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:05:59.971676 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:59.976611 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d] added
May 27 03:05:59.976611 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:05:59.976611 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:05:59.976611 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:05:59.976611 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:05:59.976611 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:05:59.976611 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:59.976797 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:05:59.977104 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0219(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:05:59.977309 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:05:59.984784 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d] added
May 27 03:05:59.984784 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:05:59.984784 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:05:59.984784 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:05:59.984784 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:05:59.984784 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:05:59.984784 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:05:59.984953 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:05:59.985069 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.027(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:05:59.985195 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:06:00.010458 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:00.010648 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:00.156144 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.584s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:00.212004 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Deleted allocations for instance d7f71824-f631-423e-a5ea-8ae72642a95e
May 27 03:06:00.512507 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:06:00.605737 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:00.663785 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4ac25647-2043-467d-87c1-01717907c0a6 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:00.664780 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 12.480s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:00.897423 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:00.975767 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "c3954135-0707-4b78-bfe3-f458ab39f55c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:00.977652 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:06:00.985840 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:06:00.992605 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:06:00.992605 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:06:00.999714 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:06:00.999714 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:01.008103 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:01.013411 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:01.030949 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:01.030949 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:01.030949 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:01.030949 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:01.030949 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:06:01.030949 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:06:01.030949 np0000001475 nova-compute[98471]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:01.030949 np0000001475 nova-compute[98471]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:01.030949 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:01.031223 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:01.031223 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:01.031223 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:01.031223 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:01.031223 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:06:01.031223 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:06:01.031223 np0000001475 nova-compute[98471]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:01.031223 np0000001475 nova-compute[98471]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:01.031223 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:01.032266 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:01.032266 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:01.032266 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:01.032266 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:01.032266 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:06:01.032266 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:06:01.032266 np0000001475 nova-compute[98471]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:01.032266 np0000001475 nova-compute[98471]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:01.032266 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:01.032465 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:01.032465 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:01.032465 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:01.032465 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:01.032465 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:06:01.032465 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:06:01.032465 np0000001475 nova-compute[98471]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:01.032465 np0000001475 nova-compute[98471]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:01.032465 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:01.078497 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:01.078766 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:01.080865 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d, portal: 192.168.50.100,3260]
May 27 03:06:01.080865 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d, portal: 192.168.50.100,3260] successful.
May 27 03:06:01.080865 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:01.083311 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:06:01.083451 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Claim successful on node np0000001475
May 27 03:06:01.089392 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d, portal: 192.168.40.100,3260]
May 27 03:06:01.089392 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d, portal: 192.168.40.100,3260] successful.
May 27 03:06:01.089392 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:01.099574 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:01.107122 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:01.123353 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:01.123353 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:01.123353 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:01.123353 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:01.123353 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:06:01.123353 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:06:01.123353 np0000001475 nova-compute[98471]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:01.123353 np0000001475 nova-compute[98471]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:01.123353 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:01.123353 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:01.123353 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:01.123699 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:01.123699 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:01.123699 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:01.123699 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:01.123699 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:06:01.123699 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:06:01.123699 np0000001475 nova-compute[98471]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:01.123699 np0000001475 nova-compute[98471]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:01.123699 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:01.123699 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:01.123699 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:01.124035 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:01.124201 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:06:01.126272 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] HCTL ('15', '-', '-', 0) found on session 92 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:06:01.126272 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:06:01.130393 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:01.130393 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:01.130393 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:01.130393 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:01.130393 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:06:01.130393 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:06:01.130393 np0000001475 nova-compute[98471]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:01.130393 np0000001475 nova-compute[98471]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:01.130393 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:01.130393 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:01.130393 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:01.132454 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:01.132454 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:01.132454 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:01.132454 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:01.132454 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:06:01.132454 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:06:01.132454 np0000001475 nova-compute[98471]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:01.132454 np0000001475 nova-compute[98471]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:01.132454 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:01.132454 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:01.132454 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:01.132454 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:01.132454 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:06:01.133362 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] HCTL ('16', '-', '-', 0) found on session 93 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:06:01.134350 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:06:01.145963 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Searching for a device in session 92 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:06:01.146161 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '84717294-7eb7-4a8e-a867-0d8ee34db75d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:06:01.151931 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Searching for a device in session 93 and hctl ['16', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:06:01.170497 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.506s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:01.171082 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.195s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:01.223584 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-cc98372d-a13d-42aa-862b-e4253af2d6cc tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "d7f71824-f631-423e-a5ea-8ae72642a95e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.024s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:01.225942 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:01.541730 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:01.542003 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:01.542297 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:01.542452 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:01.542569 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:01.544867 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Terminating instance
May 27 03:06:01.674584 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Detaching volume b8771a8c-0e68-46bf-99ee-4ad0965beccd
May 27 03:06:01.729647 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Attempting to driver detach volume b8771a8c-0e68-46bf-99ee-4ad0965beccd from mountpoint /dev/vdb
May 27 03:06:01.775056 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': 'c3954135-0707-4b78-bfe3-f458ab39f55c', 'attached_at': '', 'detached_at': '', 'volume_id': 'b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'serial': 'b8771a8c-0e68-46bf-99ee-4ad0965beccd'} {{(pid=98471) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 03:06:01.779249 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Found disk vdb by alias ua-b8771a8c-0e68-46bf-99ee-4ad0965beccd {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:06:01.781097 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Found disk vdb by alias ua-b8771a8c-0e68-46bf-99ee-4ad0965beccd {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:06:01.781256 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Attempting to detach device vdb from instance c3954135-0707-4b78-bfe3-f458ab39f55c from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:06:01.781577 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:06:01.781577 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:06:01.781577 np0000001475 nova-compute[98471]:   <alias name="ua-b8771a8c-0e68-46bf-99ee-4ad0965beccd"/>
May 27 03:06:01.781577 np0000001475 nova-compute[98471]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 27 03:06:01.781577 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:06:01.781577 np0000001475 nova-compute[98471]:   <serial>b8771a8c-0e68-46bf-99ee-4ad0965beccd</serial>
May 27 03:06:01.781577 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:06:01.781577 np0000001475 nova-compute[98471]: </disk>
May 27 03:06:01.781577 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:06:01.789173 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Successfully detached device vdb from instance c3954135-0707-4b78-bfe3-f458ab39f55c from the persistent domain config.
May 27 03:06:01.789434 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] (1/8): Attempting to detach device vdb with device alias ua-b8771a8c-0e68-46bf-99ee-4ad0965beccd from instance c3954135-0707-4b78-bfe3-f458ab39f55c from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:06:01.789802 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:06:01.789802 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:06:01.789802 np0000001475 nova-compute[98471]:   <alias name="ua-b8771a8c-0e68-46bf-99ee-4ad0965beccd"/>
May 27 03:06:01.789802 np0000001475 nova-compute[98471]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 27 03:06:01.789802 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:06:01.789802 np0000001475 nova-compute[98471]:   <serial>b8771a8c-0e68-46bf-99ee-4ad0965beccd</serial>
May 27 03:06:01.789802 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:06:01.789802 np0000001475 nova-compute[98471]: </disk>
May 27 03:06:01.789802 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:06:02.054530 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:06:02.077217 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:02.081605 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:02.107994 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:02.151618 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Searching for a device in session 93 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:06:02.151719 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '84717294-7eb7-4a8e-a867-0d8ee34db75d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:06:02.294982 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:02.302889 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:02.313314 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851162.3098063, c3954135-0707-4b78-bfe3-f458ab39f55c => ua-b8771a8c-0e68-46bf-99ee-4ad0965beccd> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:06:02.317662 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b8771a8c-0e68-46bf-99ee-4ad0965beccd for instance c3954135-0707-4b78-bfe3-f458ab39f55c {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:06:02.322551 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Successfully detached device vdb from instance c3954135-0707-4b78-bfe3-f458ab39f55c from the live domain config.
May 27 03:06:02.325679 np0000001475 nova-compute[98471]: WARNING stevedore.named [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 03:06:02.325679 np0000001475 nova-compute[98471]: WARNING castellan.key_manager [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:06:02.325679 np0000001475 nova-compute[98471]: WARNING nova.keymgr.conf_key_mgr [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:06:02.325679 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7557046294c0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': 'c3954135-0707-4b78-bfe3-f458ab39f55c', 'attached_at': '', 'detached_at': '', 'volume_id': 'b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'serial': 'b8771a8c-0e68-46bf-99ee-4ad0965beccd'} {{(pid=98471) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 27 03:06:02.325679 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors.luks [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] closing encrypted volume /dev/dm-6 {{(pid=98471) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 27 03:06:02.338766 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-aa034406-7d57-4117-a99d-f213d156ce3c req-66c046e6-0680-49ff-bf45-532309d19c2c service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received event network-vif-unplugged-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:02.338766 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa034406-7d57-4117-a99d-f213d156ce3c req-66c046e6-0680-49ff-bf45-532309d19c2c service nova] Acquiring lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:02.338766 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa034406-7d57-4117-a99d-f213d156ce3c req-66c046e6-0680-49ff-bf45-532309d19c2c service nova] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:02.338766 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa034406-7d57-4117-a99d-f213d156ce3c req-66c046e6-0680-49ff-bf45-532309d19c2c service nova] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:02.338766 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-aa034406-7d57-4117-a99d-f213d156ce3c req-66c046e6-0680-49ff-bf45-532309d19c2c service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] No waiting events found dispatching network-vif-unplugged-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:06:02.338766 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-aa034406-7d57-4117-a99d-f213d156ce3c req-66c046e6-0680-49ff-bf45-532309d19c2c service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received event network-vif-unplugged-a2498912-5a39-4f70-a141-dae495d11b2a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:06:02.358472 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:06:02.359514 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:06:02.360759 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:06:02.448120 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.998865575999844 future=<Future at 0x755704784d70 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:02.450271 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Instance destroyed successfully.
May 27 03:06:02.451467 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'resources' on Instance uuid c2a5e735-d573-4ac4-bff0-d4a12648718e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:02.666933 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:06:02.667188 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:06:02.954624 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001475',hostname='multiattach-server-0',id=30,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7X60AtOl0SsfuAMV1LtNGpvh0yvi8THxioUm4x62ykVhuM7q4sXRNe3S5fa56OsOiAX0ZbtOowRZ4+AKeGhch21Oc/NUN3hQGbbFxrwclVqtJHRu4HOLbwt9JgM8J0mA==',key_name='tempest-keypair-1333870124',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:03:37Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-7nyxrr7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:03:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092604511a8a467ba4ecb56261cb531f',uuid=c2a5e735-d573-4ac4-bff0-d4a12648718e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:06:02.954813 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "a2498912-5a39-4f70-a141-dae495d11b2a", "address": "fa:16:3e:5c:30:71", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2498912-5a", "ovs_interfaceid": "a2498912-5a39-4f70-a141-dae495d11b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:06:02.955697 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a2498912-5a39-4f70-a141-dae495d11b2a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2498912-5a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:06:02.956093 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a2498912-5a39-4f70-a141-dae495d11b2a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2498912-5a') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:06:02.958169 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:02.958471 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2498912-5a, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:02.973206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Found WWN 330000000023c2995 for multipath device dm-9 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:06:02.973206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:02.973206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000023c2995', 'path': '/dev/dm-9', 'multipath_id': '330000000023c2995'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:06:02.973522 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000023c2995', 'path': '/dev/dm-9', 'multipath_id': '330000000023c2995'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:06:02.975573 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:02.976405 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:02.977717 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4f3a0f8-7d2a-4e32-b48a-805e5e8243e6) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:02.978276 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.618s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:06:02.978707 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b8771a8c-0e68-46bf-99ee-4ad0965beccd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:06:02.980208 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:02.980403 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:06:02.981221 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:02.982393 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lazy-loading 'flavor' on Instance uuid 70ca77a6-2f29-4558-abf0-07292a6200cd {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:02.984752 np0000001475 nova-compute[98471]: INFO os_vif [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:30:71,bridge_name='br-int',has_traffic_filtering=True,id=a2498912-5a39-4f70-a141-dae495d11b2a,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2498912-5a')
May 27 03:06:02.985101 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Deleting instance files /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e_del
May 27 03:06:03.005409 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Deletion of /opt/stack/data/nova/instances/c2a5e735-d573-4ac4-bff0-d4a12648718e_del complete
May 27 03:06:03.011857 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:03.011857 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:03.011857 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:03.011857 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:03.011857 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:06:03.011857 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:06:03.011857 np0000001475 nova-compute[98471]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:03.011857 np0000001475 nova-compute[98471]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:03.011857 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:03.011857 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:03.011857 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:03.012809 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:03.012809 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:03.012809 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:03.012809 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:03.012809 np0000001475 nova-compute[98471]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:06:03.012809 np0000001475 nova-compute[98471]: tcp: [89] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd (non-flash)
May 27 03:06:03.012809 np0000001475 nova-compute[98471]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:03.012809 np0000001475 nova-compute[98471]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:03.012809 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:03.012809 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:03.012809 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:03.012809 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', '88'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb', '91'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d', '93')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:06:03.012809 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', '88')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:06:03.015928 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd', '89')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:06:03.016918 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7557246256c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd'): ({'sdg'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:06:03.017196 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Removing multipathed devices sdf, sdg {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:06:03.017958 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Flush multipath device 3300000005d3ccd88 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:06:03.051586 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:06:03.102420 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:06:03.147259 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:06:03.147553 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:06:03.148824 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:06:03.159944 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:06:03.160424 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:06:03.172022 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:06:03.177667 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:03.216751 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 88, target: iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd, portal: 192.168.40.100,3260]
May 27 03:06:03.216751 np0000001475 nova-compute[98471]: Logout of [sid: 88, target: iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd, portal: 192.168.40.100,3260] successful.
May 27 03:06:03.216751 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:03.235526 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:03.246988 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:03.285671 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 89, target: iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd, portal: 192.168.50.100,3260]
May 27 03:06:03.285671 np0000001475 nova-compute[98471]: Logout of [sid: 89, target: iqn.2023-03.storpool.com:os--volume-b8771a8c-0e68-46bf-99ee-4ad0965beccd, portal: 192.168.50.100,3260] successful.
May 27 03:06:03.285671 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:03.302708 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:03.309855 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:03.309855 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] <== disconnect_volume: return (945ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:06:03.309855 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:06:03.487314 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Attempting to attach volume 84717294-7eb7-4a8e-a867-0d8ee34db75d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:06:03.488483 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:06:03.488483 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:06:03.488483 np0000001475 nova-compute[98471]:   <alias name="ua-84717294-7eb7-4a8e-a867-0d8ee34db75d"/>
May 27 03:06:03.488483 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-9"/>
May 27 03:06:03.488483 np0000001475 nova-compute[98471]:   <target dev="vdc" bus="virtio"/>
May 27 03:06:03.488483 np0000001475 nova-compute[98471]:   <serial>84717294-7eb7-4a8e-a867-0d8ee34db75d</serial>
May 27 03:06:03.488483 np0000001475 nova-compute[98471]: </disk>
May 27 03:06:03.488483 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:06:03.514299 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Took 1.46 seconds to destroy the instance on the hypervisor.
May 27 03:06:03.514912 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:06:03.515115 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:06:03.515227 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:06:03.515698 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:03.653051 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:03.682963 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.604s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:03.684326 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:06:03.737335 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:03.871480 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lazy-loading 'flavor' on Instance uuid c3954135-0707-4b78-bfe3-f458ab39f55c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:04.153537 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:04.196110 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:06:04.196309 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:06:04.196682 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:04.196921 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:04.264662 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0d83ca7002c41e0897c39e7b8d91bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3c6a3942eb41e8b6aefddc5faca789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:06:04.404016 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:04.420880 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-78224f45-c2a2-4cb7-bdb0-876aed95c3f1 req-14a7f049-3126-4c40-a593-ff55f546aca7 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received event network-vif-unplugged-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:04.420880 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-78224f45-c2a2-4cb7-bdb0-876aed95c3f1 req-14a7f049-3126-4c40-a593-ff55f546aca7 service nova] Acquiring lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:04.420880 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-78224f45-c2a2-4cb7-bdb0-876aed95c3f1 req-14a7f049-3126-4c40-a593-ff55f546aca7 service nova] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:04.420880 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-78224f45-c2a2-4cb7-bdb0-876aed95c3f1 req-14a7f049-3126-4c40-a593-ff55f546aca7 service nova] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:04.420880 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-78224f45-c2a2-4cb7-bdb0-876aed95c3f1 req-14a7f049-3126-4c40-a593-ff55f546aca7 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] No waiting events found dispatching network-vif-unplugged-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:06:04.420880 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-78224f45-c2a2-4cb7-bdb0-876aed95c3f1 req-14a7f049-3126-4c40-a593-ff55f546aca7 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received event network-vif-unplugged-a2498912-5a39-4f70-a141-dae495d11b2a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:06:04.420880 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-78224f45-c2a2-4cb7-bdb0-876aed95c3f1 req-14a7f049-3126-4c40-a593-ff55f546aca7 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Received event network-vif-deleted-a2498912-5a39-4f70-a141-dae495d11b2a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:04.420880 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-78224f45-c2a2-4cb7-bdb0-876aed95c3f1 req-14a7f049-3126-4c40-a593-ff55f546aca7 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Neutron deleted interface a2498912-5a39-4f70-a141-dae495d11b2a; detaching it from the instance and deleting it from the info cache
May 27 03:06:04.420880 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-78224f45-c2a2-4cb7-bdb0-876aed95c3f1 req-14a7f049-3126-4c40-a593-ff55f546aca7 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:04.700851 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:06:04.814225 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Successfully created port: 4a157cbc-e218-493d-a824-c7318f618ed3 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:06:04.877089 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f7e39ae6-603a-4988-b158-89bf56d7cdcb tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.706s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:04.909210 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Took 1.39 seconds to deallocate network for instance.
May 27 03:06:04.926276 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-78224f45-c2a2-4cb7-bdb0-876aed95c3f1 req-14a7f049-3126-4c40-a593-ff55f546aca7 service nova] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Detach interface failed, port_id=a2498912-5a39-4f70-a141-dae495d11b2a, reason: Instance c2a5e735-d573-4ac4-bff0-d4a12648718e could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:06:05.164128 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:06:05.164602 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:06:05.165068 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:06:05.165425 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:06:05.165808 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] No VIF found with MAC fa:16:3e:00:0b:7f, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:06:05.208948 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:06:05.378252 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "c3954135-0707-4b78-bfe3-f458ab39f55c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:05.378492 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:05.378712 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "c3954135-0707-4b78-bfe3-f458ab39f55c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:05.378922 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:05.379108 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:05.381543 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Terminating instance
May 27 03:06:05.423434 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:05.423434 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:05.733198 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0004780019999088836 future=<Future at 0x755704787200 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:05.733344 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:05.733522 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=4.331098187999942 future=<Future at 0x7557047a27e0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:05.733590 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=4.330981189999875 future=<Future at 0x7557047a27e0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:05.734037 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Emitting event <LifecycleEvent: 1779851150.7326007, bb06d928-2b8c-46f2-b61d-fdb19af4017e => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:05.734588 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] VM Stopped (Lifecycle Event)
May 27 03:06:05.843599 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Successfully updated port: 4a157cbc-e218-493d-a824-c7318f618ed3 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:06:05.886390 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:06:05.890133 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:05.913578 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:05.919814 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:05.926479 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b694e2af-aff5-4d15-9595-b63405597cea req-293c12c8-8ee2-498c-821c-e4c99c5c8860 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Received event network-changed-4a157cbc-e218-493d-a824-c7318f618ed3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:05.929129 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b694e2af-aff5-4d15-9595-b63405597cea req-293c12c8-8ee2-498c-821c-e4c99c5c8860 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Refreshing instance network info cache due to event network-changed-4a157cbc-e218-493d-a824-c7318f618ed3. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:06:05.929819 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b694e2af-aff5-4d15-9595-b63405597cea req-293c12c8-8ee2-498c-821c-e4c99c5c8860 service nova] Acquiring lock "refresh_cache-3593ceaa-ccfe-4242-9fcd-2582ac795dd2" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:06:05.929819 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b694e2af-aff5-4d15-9595-b63405597cea req-293c12c8-8ee2-498c-821c-e4c99c5c8860 service nova] Acquired lock "refresh_cache-3593ceaa-ccfe-4242-9fcd-2582ac795dd2" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:06:05.929819 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-b694e2af-aff5-4d15-9595-b63405597cea req-293c12c8-8ee2-498c-821c-e4c99c5c8860 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Refreshing network info cache for port 4a157cbc-e218-493d-a824-c7318f618ed3 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:06:05.940546 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:05.944279 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:05.971770 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:06.025252 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:06:06.025415 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:06:06.221112 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99971707199984 future=<Future at 0x75572c12a2a0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:06.223655 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:06:06.225626 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:06:06.226617 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Instance destroyed successfully.
May 27 03:06:06.234508 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lazy-loading 'resources' on Instance uuid c3954135-0707-4b78-bfe3-f458ab39f55c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:06.235692 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Creating image(s)
May 27 03:06:06.236588 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:06.239110 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-58a9ba55-6eb5-4b76-8c6a-c2b7a88d9bf1 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: bb06d928-2b8c-46f2-b61d-fdb19af4017e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:06.239408 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "/opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:06.239617 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "/opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:06.240439 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "/opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:06.241203 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:06:06.247086 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:06:06.252978 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:06.349175 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.095s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:06.349175 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:06.349323 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:06.351597 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:06:06.353960 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "refresh_cache-3593ceaa-ccfe-4242-9fcd-2582ac795dd2" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:06:06.357462 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:06:06.357825 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:06.432976 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-b694e2af-aff5-4d15-9595-b63405597cea req-293c12c8-8ee2-498c-821c-e4c99c5c8860 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:06.458788 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.100s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:06.459661 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:06.523072 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2/disk 1073741824" returned: 0 in 0.063s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:06.523354 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.174s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:06.523922 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:06.544642 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:06:06.557505 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-b694e2af-aff5-4d15-9595-b63405597cea req-293c12c8-8ee2-498c-821c-e4c99c5c8860 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:06:06.629440 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.104s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:06.629440 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:06:06.629440 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:06.724682 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:06.730027 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Cannot resize image /opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:06:06.730220 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:06:06.730441 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Ensure instance console log exists: /opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:06:06.730753 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:06.731021 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:06.731149 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:06.739764 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-711734824',display_name='tempest-TestEncryptedCinderVolumes-server-711734824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testencryptedcindervolumes-server-711734824',id=41,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9Brv+rFOzS48a7uMOJ/zQ7M7CoJM5ILJOzCS4QemsD/USpp/z6kGjlaOA0LeAyT74mFuKHRhNk1RGUPgYOb0EAP21ZG8Wb+dtDJPssiJxHiUnkx1od8+FPP+hH9qdtKg==',key_name='tempest-keypair-1239197266',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:05:03Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51a54fd7b39b4a968af6ad453070ea4d',ramdisk_id='',reservation_id='r-ar7ql3c6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-727613157',owner_user_name='tempest-TestEncryptedCinderVolumes-727613157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:05:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6dd385bbf9c3482aa593c41ce7795e8e',uuid=c3954135-0707-4b78-bfe3-f458ab39f55c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "address": "fa:16:3e:6d:20:b3", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap927538e0-ee", "ovs_interfaceid": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:06:06.741567 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Converting VIF {"id": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "address": "fa:16:3e:6d:20:b3", "network": {"id": "410ac6d9-fa3f-44dd-bd58-a0db6fd7c182", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-420565884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "51a54fd7b39b4a968af6ad453070ea4d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap927538e0-ee", "ovs_interfaceid": "927538e0-eed1-4097-ab6b-3e4b57e6f1cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:06:06.741567 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:20:b3,bridge_name='br-int',has_traffic_filtering=True,id=927538e0-eed1-4097-ab6b-3e4b57e6f1cd,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927538e0-ee') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:06:06.741567 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:20:b3,bridge_name='br-int',has_traffic_filtering=True,id=927538e0-eed1-4097-ab6b-3e4b57e6f1cd,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927538e0-ee') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:06:06.742383 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:06.742844 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap927538e0-ee, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:06.744225 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:06.746683 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:06.746683 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:06.747668 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:06.747911 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=813c7f42-13c5-41ed-b74c-fc78f97257ae) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:06.748561 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:06.749120 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:06.750067 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:06.752850 np0000001475 nova-compute[98471]: INFO os_vif [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:20:b3,bridge_name='br-int',has_traffic_filtering=True,id=927538e0-eed1-4097-ab6b-3e4b57e6f1cd,network=Network(410ac6d9-fa3f-44dd-bd58-a0db6fd7c182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap927538e0-ee')
May 27 03:06:06.753734 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Deleting instance files /opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c_del
May 27 03:06:06.754200 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Deletion of /opt/stack/data/nova/instances/c3954135-0707-4b78-bfe3-f458ab39f55c_del complete
May 27 03:06:06.775021 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-b694e2af-aff5-4d15-9595-b63405597cea req-293c12c8-8ee2-498c-821c-e4c99c5c8860 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:06.776110 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92aef94d-210a-4f25-a066-ef4b24494363 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.522s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:07.063439 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.641s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:07.141996 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Deleted allocations for instance c2a5e735-d573-4ac4-bff0-d4a12648718e
May 27 03:06:07.267888 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Took 1.38 seconds to destroy the instance on the hypervisor.
May 27 03:06:07.268036 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:06:07.268538 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:06:07.268538 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:06:07.268806 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:07.278974 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b694e2af-aff5-4d15-9595-b63405597cea req-293c12c8-8ee2-498c-821c-e4c99c5c8860 service nova] Releasing lock "refresh_cache-3593ceaa-ccfe-4242-9fcd-2582ac795dd2" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:06:07.279866 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquired lock "refresh_cache-3593ceaa-ccfe-4242-9fcd-2582ac795dd2" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:06:07.280121 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:06:07.407268 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:07.967887 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:06:08.007303 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fce0b839-6317-404d-b66f-8f327348df93 req-4c79150f-16a6-40b3-b8af-b17a84720691 service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Received event network-vif-deleted-927538e0-eed1-4097-ab6b-3e4b57e6f1cd {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:08.007522 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-fce0b839-6317-404d-b66f-8f327348df93 req-4c79150f-16a6-40b3-b8af-b17a84720691 service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Neutron deleted interface 927538e0-eed1-4097-ab6b-3e4b57e6f1cd; detaching it from the instance and deleting it from the info cache
May 27 03:06:08.007666 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-fce0b839-6317-404d-b66f-8f327348df93 req-4c79150f-16a6-40b3-b8af-b17a84720691 service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:08.152328 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e86f32f0-48c7-43e3-8268-df319c0e501e tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "c2a5e735-d573-4ac4-bff0-d4a12648718e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.610s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:08.162276 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:08.366450 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Updating instance_info_cache with network_info: [{"id": "4a157cbc-e218-493d-a824-c7318f618ed3", "address": "fa:16:3e:ad:d2:06", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a157cbc-e2", "ovs_interfaceid": "4a157cbc-e218-493d-a824-c7318f618ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:08.445255 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:08.513920 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fce0b839-6317-404d-b66f-8f327348df93 req-4c79150f-16a6-40b3-b8af-b17a84720691 service nova] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Detach interface failed, port_id=927538e0-eed1-4097-ab6b-3e4b57e6f1cd, reason: Instance c3954135-0707-4b78-bfe3-f458ab39f55c could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:06:08.800330 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "30e926af-236d-4544-9b8e-5fb9a3bddea6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:08.800485 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:08.869119 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Releasing lock "refresh_cache-3593ceaa-ccfe-4242-9fcd-2582ac795dd2" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:06:08.869261 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Instance network_info: |[{"id": "4a157cbc-e218-493d-a824-c7318f618ed3", "address": "fa:16:3e:ad:d2:06", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a157cbc-e2", "ovs_interfaceid": "4a157cbc-e218-493d-a824-c7318f618ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:06:08.870848 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Start _get_guest_xml network_info=[{"id": "4a157cbc-e218-493d-a824-c7318f618ed3", "address": "fa:16:3e:ad:d2:06", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a157cbc-e2", "ovs_interfaceid": "4a157cbc-e218-493d-a824-c7318f618ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:06:08.873274 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:06:08.874122 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1832726814', uuid='3593ceaa-ccfe-4242-9fcd-2582ac795dd2'), owner=OwnerMeta(userid='f0d83ca7002c41e0897c39e7b8d91bff', username='tempest-AttachVolumeTestJSON-1635503347-project-member', projectid='ca3c6a3942eb41e8b6aefddc5faca789', projectname='tempest-AttachVolumeTestJSON-1635503347'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4a157cbc-e218-493d-a824-c7318f618ed3", "address": "fa:16:3e:ad:d2:06", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a157cbc-e2", "ovs_interfaceid": "4a157cbc-e218-493d-a824-c7318f618ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851168.8738065) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:06:08.875103 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:06:08.875401 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:06:08.876380 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:06:08.877025 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:06:08.878265 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:06:08.878542 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:06:08.878671 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:06:08.878815 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:06:08.878996 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:06:08.879355 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:06:08.879563 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:06:08.879809 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:06:08.879969 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:06:08.880180 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:06:08.880351 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:06:08.880530 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:06:08.896527 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:05:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1832726814',display_name='tempest-AttachVolumeTestJSON-server-1832726814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumetestjson-server-1832726814',id=45,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgMwAk3Mc1SEYQ0aF1gRSiwHjVQMMTyaB1GQTy8x8jOeMDCicH5Z6dLT2cLieY14z6ysLiBJU/K3RNmk57bbqTiZSDPN/igldnxcZekFaYPwSvyqnQG6BSNvx6oFrTgOw==',key_name='tempest-keypair-1591828618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca3c6a3942eb41e8b6aefddc5faca789',ramdisk_id='',reservation_id='r-h40jc4a4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1635503347',owner_user_name='tempest-AttachVolumeTestJSON-1635503347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:06:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0d83ca7002c41e0897c39e7b8d91bff',uuid=3593ceaa-ccfe-4242-9fcd-2582ac795dd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a157cbc-e218-493d-a824-c7318f618ed3", "address": "fa:16:3e:ad:d2:06", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a157cbc-e2", "ovs_interfaceid": "4a157cbc-e218-493d-a824-c7318f618ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:06:08.896711 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converting VIF {"id": "4a157cbc-e218-493d-a824-c7318f618ed3", "address": "fa:16:3e:ad:d2:06", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a157cbc-e2", "ovs_interfaceid": "4a157cbc-e218-493d-a824-c7318f618ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:06:08.897639 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d2:06,bridge_name='br-int',has_traffic_filtering=True,id=4a157cbc-e218-493d-a824-c7318f618ed3,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a157cbc-e2') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:06:08.898547 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'pci_devices' on Instance uuid 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:08.949964 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Took 1.68 seconds to deallocate network for instance.
May 27 03:06:09.063120 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:09.302762 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:06:09.403855 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] End _get_guest_xml xml=<domain type="qemu">
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:   <uuid>3593ceaa-ccfe-4242-9fcd-2582ac795dd2</uuid>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:   <name>instance-0000002d</name>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <nova:name>tempest-AttachVolumeTestJSON-server-1832726814</nova:name>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:06:08</nova:creationTime>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:         <nova:user uuid="f0d83ca7002c41e0897c39e7b8d91bff">tempest-AttachVolumeTestJSON-1635503347-project-member</nova:user>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:         <nova:project uuid="ca3c6a3942eb41e8b6aefddc5faca789">tempest-AttachVolumeTestJSON-1635503347</nova:project>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:         <nova:port uuid="4a157cbc-e218-493d-a824-c7318f618ed3">
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     <system>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <entry name="serial">3593ceaa-ccfe-4242-9fcd-2582ac795dd2</entry>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <entry name="uuid">3593ceaa-ccfe-4242-9fcd-2582ac795dd2</entry>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     </system>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:   <os>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:   </os>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:   <features>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:   </features>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:   <devices>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2/disk"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     </disk>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2/disk.config"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     </disk>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:ad:d2:06"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <target dev="tap4a157cbc-e2"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     </interface>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2/console.log" append="off"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     </serial>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     <video>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     </video>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     </rng>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:   </devices>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]: </domain>
May 27 03:06:09.403855 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:06:09.403855 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Preparing to wait for external event network-vif-plugged-4a157cbc-e218-493d-a824-c7318f618ed3 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:06:09.403855 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:09.403855 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:09.403855 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:09.403855 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:05:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1832726814',display_name='tempest-AttachVolumeTestJSON-server-1832726814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumetestjson-server-1832726814',id=45,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgMwAk3Mc1SEYQ0aF1gRSiwHjVQMMTyaB1GQTy8x8jOeMDCicH5Z6dLT2cLieY14z6ysLiBJU/K3RNmk57bbqTiZSDPN/igldnxcZekFaYPwSvyqnQG6BSNvx6oFrTgOw==',key_name='tempest-keypair-1591828618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca3c6a3942eb41e8b6aefddc5faca789',ramdisk_id='',reservation_id='r-h40jc4a4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1635503347',owner_user_name='tempest-AttachVolumeTestJSON-1635503347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:06:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0d83ca7002c41e0897c39e7b8d91bff',uuid=3593ceaa-ccfe-4242-9fcd-2582ac795dd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a157cbc-e218-493d-a824-c7318f618ed3", "address": "fa:16:3e:ad:d2:06", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a157cbc-e2", "ovs_interfaceid": "4a157cbc-e218-493d-a824-c7318f618ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:06:09.403855 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converting VIF {"id": "4a157cbc-e218-493d-a824-c7318f618ed3", "address": "fa:16:3e:ad:d2:06", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a157cbc-e2", "ovs_interfaceid": "4a157cbc-e218-493d-a824-c7318f618ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:06:09.403855 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d2:06,bridge_name='br-int',has_traffic_filtering=True,id=4a157cbc-e218-493d-a824-c7318f618ed3,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a157cbc-e2') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:06:09.403855 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d2:06,bridge_name='br-int',has_traffic_filtering=True,id=4a157cbc-e218-493d-a824-c7318f618ed3,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a157cbc-e2') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:06:09.406558 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:09.406558 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:09.406558 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:06:09.408192 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:09.408551 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf0df448-1df0-54fb-a08b-5807524950f8', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:09.410698 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:09.411611 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:09.414120 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:09.414120 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a157cbc-e2, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:09.414550 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a157cbc-e2, col_values=(('qos', UUID('6846c130-c2ef-4605-971c-e8c060432f08')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:09.414814 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a157cbc-e2, col_values=(('external_ids', {'iface-id': '4a157cbc-e218-493d-a824-c7318f618ed3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:d2:06', 'vm-uuid': '3593ceaa-ccfe-4242-9fcd-2582ac795dd2'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:09.418386 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:09.419172 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:09.426896 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:09.428939 np0000001475 nova-compute[98471]: INFO os_vif [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d2:06,bridge_name='br-int',has_traffic_filtering=True,id=4a157cbc-e218-493d-a824-c7318f618ed3,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a157cbc-e2')
May 27 03:06:09.456716 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:09.456948 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:09.883661 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:10.065341 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0007246330001180468 future=<Future at 0x7557047a27e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:10.066114 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Emitting event <LifecycleEvent: 1779851155.0642767, d7f71824-f631-423e-a5ea-8ae72642a95e => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:10.068032 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:10.068465 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] VM Stopped (Lifecycle Event)
May 27 03:06:10.069829 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=7.377391392999925 future=<Future at 0x755704784d70 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:10.069962 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=7.376971329999833 future=<Future at 0x755704784d70 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:10.072705 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:06:10.072880 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:06:10.126767 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:10.127014 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:10.127269 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:10.127462 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:10.127838 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:10.131261 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Terminating instance
May 27 03:06:10.571317 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: d7f71824-f631-423e-a5ea-8ae72642a95e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:10.575413 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:06:10.588595 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-cc520a13-d7a1-4359-8d29-cb248ccb662d req-eab0ec38-4891-4588-ad0d-20fb9fe2ed51 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Received event network-vif-unplugged-4a157cbc-e218-493d-a824-c7318f618ed3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:10.589796 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cc520a13-d7a1-4359-8d29-cb248ccb662d req-eab0ec38-4891-4588-ad0d-20fb9fe2ed51 service nova] Acquiring lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:10.590027 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cc520a13-d7a1-4359-8d29-cb248ccb662d req-eab0ec38-4891-4588-ad0d-20fb9fe2ed51 service nova] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:10.590185 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cc520a13-d7a1-4359-8d29-cb248ccb662d req-eab0ec38-4891-4588-ad0d-20fb9fe2ed51 service nova] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:10.590333 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-cc520a13-d7a1-4359-8d29-cb248ccb662d req-eab0ec38-4891-4588-ad0d-20fb9fe2ed51 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] No event matching network-vif-unplugged-4a157cbc-e218-493d-a824-c7318f618ed3 in dict_keys([('network-vif-plugged', '4a157cbc-e218-493d-a824-c7318f618ed3')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 03:06:10.590503 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-cc520a13-d7a1-4359-8d29-cb248ccb662d req-eab0ec38-4891-4588-ad0d-20fb9fe2ed51 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Received unexpected event network-vif-unplugged-4a157cbc-e218-493d-a824-c7318f618ed3 for instance with vm_state building and task_state spawning.
May 27 03:06:10.635518 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:06:10.668173 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:10.678112 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:10.702663 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:10.868093 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:10.881945 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:10.963569 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:06:10.965644 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:06:10.965962 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No VIF found with MAC fa:16:3e:ad:d2:06, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:06:10.966721 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Using config drive
May 27 03:06:10.997195 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999451998999575 future=<Future at 0x75572420e2a0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:10.998162 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:11.002918 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Instance destroyed successfully.
May 27 03:06:11.004104 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'resources' on Instance uuid 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:11.086752 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.630s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:11.088415 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.205s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:11.092639 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:06:11.093064 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Claim successful on node np0000001475
May 27 03:06:11.146160 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Deleted allocations for instance c3954135-0707-4b78-bfe3-f458ab39f55c
May 27 03:06:11.238832 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:11.472782 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:11.506720 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:00:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='multiattach-server-1',id=22,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7X60AtOl0SsfuAMV1LtNGpvh0yvi8THxioUm4x62ykVhuM7q4sXRNe3S5fa56OsOiAX0ZbtOowRZ4+AKeGhch21Oc/NUN3hQGbbFxrwclVqtJHRu4HOLbwt9JgM8J0mA==',key_name='tempest-keypair-1333870124',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:01:20Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-t931x00t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:01:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092604511a8a467ba4ecb56261cb531f',uuid=3e5f7741-2c52-4242-9b37-566ff5f5a6a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "address": "fa:16:3e:d1:ea:b1", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d220c08-bd", "ovs_interfaceid": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:06:11.507047 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "address": "fa:16:3e:d1:ea:b1", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d220c08-bd", "ovs_interfaceid": "9d220c08-bd01-473f-a389-4dcbeb9ecf4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:06:11.507829 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=9d220c08-bd01-473f-a389-4dcbeb9ecf4c,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d220c08-bd') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:06:11.508169 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=9d220c08-bd01-473f-a389-4dcbeb9ecf4c,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d220c08-bd') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:06:11.509838 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:11.510112 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d220c08-bd, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:11.511150 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:11.512027 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:11.519127 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:11.521118 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:11.521450 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21e96539-95e8-46cf-910c-4d0bf626567f) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:11.521794 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:11.523810 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:11.530266 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:11.532889 np0000001475 nova-compute[98471]: INFO os_vif [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:ea:b1,bridge_name='br-int',has_traffic_filtering=True,id=9d220c08-bd01-473f-a389-4dcbeb9ecf4c,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d220c08-bd')
May 27 03:06:11.533218 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Deleting instance files /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0_del
May 27 03:06:11.535278 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Deletion of /opt/stack/data/nova/instances/3e5f7741-2c52-4242-9b37-566ff5f5a6a0_del complete
May 27 03:06:11.612595 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Creating config drive at /opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2/disk.config
May 27 03:06:11.619712 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphpntadko {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:11.684889 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphpntadko" returned: 0 in 0.068s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:12.043980 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Took 1.41 seconds to destroy the instance on the hypervisor.
May 27 03:06:12.044888 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:06:12.045345 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:06:12.045635 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:06:12.046710 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:12.125496 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:12.156076 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:12.163404 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a504f2e8-0f64-493a-84c3-520e942c2110 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Lock "c3954135-0707-4b78-bfe3-f458ab39f55c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.784s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:12.252673 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:12.256235 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:12.486703 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "70ca77a6-2f29-4558-abf0-07292a6200cd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:12.487067 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:12.521080 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:12.524019 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:12.528897 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:12.553166 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:12.672764 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:06:12.673070 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:06:12.699474 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-046c2956-73fd-4db3-a81c-4eff3d3b9f4c req-3e580641-9b22-4210-81be-7d1bdaa080ac service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Received event network-vif-unplugged-9d220c08-bd01-473f-a389-4dcbeb9ecf4c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:12.699680 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-046c2956-73fd-4db3-a81c-4eff3d3b9f4c req-3e580641-9b22-4210-81be-7d1bdaa080ac service nova] Acquiring lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:12.699906 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-046c2956-73fd-4db3-a81c-4eff3d3b9f4c req-3e580641-9b22-4210-81be-7d1bdaa080ac service nova] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:12.700101 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-046c2956-73fd-4db3-a81c-4eff3d3b9f4c req-3e580641-9b22-4210-81be-7d1bdaa080ac service nova] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:12.700290 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-046c2956-73fd-4db3-a81c-4eff3d3b9f4c req-3e580641-9b22-4210-81be-7d1bdaa080ac service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] No waiting events found dispatching network-vif-unplugged-9d220c08-bd01-473f-a389-4dcbeb9ecf4c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:06:12.701059 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-046c2956-73fd-4db3-a81c-4eff3d3b9f4c req-3e580641-9b22-4210-81be-7d1bdaa080ac service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Received event network-vif-unplugged-9d220c08-bd01-473f-a389-4dcbeb9ecf4c for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:06:12.701498 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-046c2956-73fd-4db3-a81c-4eff3d3b9f4c req-3e580641-9b22-4210-81be-7d1bdaa080ac service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Received event network-vif-unplugged-9d220c08-bd01-473f-a389-4dcbeb9ecf4c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:12.701787 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-046c2956-73fd-4db3-a81c-4eff3d3b9f4c req-3e580641-9b22-4210-81be-7d1bdaa080ac service nova] Acquiring lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:12.702247 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-046c2956-73fd-4db3-a81c-4eff3d3b9f4c req-3e580641-9b22-4210-81be-7d1bdaa080ac service nova] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:12.703185 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-046c2956-73fd-4db3-a81c-4eff3d3b9f4c req-3e580641-9b22-4210-81be-7d1bdaa080ac service nova] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:12.703313 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-046c2956-73fd-4db3-a81c-4eff3d3b9f4c req-3e580641-9b22-4210-81be-7d1bdaa080ac service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] No waiting events found dispatching network-vif-unplugged-9d220c08-bd01-473f-a389-4dcbeb9ecf4c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:06:12.703510 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-046c2956-73fd-4db3-a81c-4eff3d3b9f4c req-3e580641-9b22-4210-81be-7d1bdaa080ac service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Received event network-vif-unplugged-9d220c08-bd01-473f-a389-4dcbeb9ecf4c for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:06:12.703689 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-046c2956-73fd-4db3-a81c-4eff3d3b9f4c req-3e580641-9b22-4210-81be-7d1bdaa080ac service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Received event network-vif-plugged-4a157cbc-e218-493d-a824-c7318f618ed3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:12.703976 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-046c2956-73fd-4db3-a81c-4eff3d3b9f4c req-3e580641-9b22-4210-81be-7d1bdaa080ac service nova] Acquiring lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:12.704130 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-046c2956-73fd-4db3-a81c-4eff3d3b9f4c req-3e580641-9b22-4210-81be-7d1bdaa080ac service nova] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:12.704241 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-046c2956-73fd-4db3-a81c-4eff3d3b9f4c req-3e580641-9b22-4210-81be-7d1bdaa080ac service nova] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:12.704343 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-046c2956-73fd-4db3-a81c-4eff3d3b9f4c req-3e580641-9b22-4210-81be-7d1bdaa080ac service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Processing event network-vif-plugged-4a157cbc-e218-493d-a824-c7318f618ed3 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:06:12.990937 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Detaching volume fa027204-a605-4551-9c81-86ef0865bcdb
May 27 03:06:13.033800 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Attempting to driver detach volume fa027204-a605-4551-9c81-86ef0865bcdb from mountpoint /dev/vdb
May 27 03:06:13.039597 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Found disk vdb by alias ua-fa027204-a605-4551-9c81-86ef0865bcdb {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:06:13.040963 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Found disk vdb by alias ua-fa027204-a605-4551-9c81-86ef0865bcdb {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:06:13.041208 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Attempting to detach device vdb from instance 70ca77a6-2f29-4558-abf0-07292a6200cd from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:06:13.041351 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:06:13.041351 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:06:13.041351 np0000001475 nova-compute[98471]:   <alias name="ua-fa027204-a605-4551-9c81-86ef0865bcdb"/>
May 27 03:06:13.041351 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:06:13.041351 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:06:13.041351 np0000001475 nova-compute[98471]:   <serial>fa027204-a605-4551-9c81-86ef0865bcdb</serial>
May 27 03:06:13.041351 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:06:13.041351 np0000001475 nova-compute[98471]: </disk>
May 27 03:06:13.041351 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:06:13.048188 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Successfully detached device vdb from instance 70ca77a6-2f29-4558-abf0-07292a6200cd from the persistent domain config.
May 27 03:06:13.048399 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] (1/8): Attempting to detach device vdb with device alias ua-fa027204-a605-4551-9c81-86ef0865bcdb from instance 70ca77a6-2f29-4558-abf0-07292a6200cd from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:06:13.048667 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:06:13.048667 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:06:13.048667 np0000001475 nova-compute[98471]:   <alias name="ua-fa027204-a605-4551-9c81-86ef0865bcdb"/>
May 27 03:06:13.048667 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:06:13.048667 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:06:13.048667 np0000001475 nova-compute[98471]:   <serial>fa027204-a605-4551-9c81-86ef0865bcdb</serial>
May 27 03:06:13.048667 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:06:13.048667 np0000001475 nova-compute[98471]: </disk>
May 27 03:06:13.048667 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:06:13.095268 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851173.0947075, 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:13.095575 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] VM Started (Lifecycle Event)
May 27 03:06:13.096780 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:06:13.100088 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:06:13.102831 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Instance spawned successfully.
May 27 03:06:13.103803 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:06:13.178514 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:06:13.292509 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:13.550342 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-fa027204-a605-4551-9c81-86ef0865bcdb for instance 70ca77a6-2f29-4558-abf0-07292a6200cd {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:06:13.598262 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:13.601048 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:06:13.611136 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:13.612761 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:13.612761 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:13.612761 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:13.612761 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:13.612761 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:13.693912 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.605s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:13.694359 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:06:13.794267 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Took 1.75 seconds to deallocate network for instance.
May 27 03:06:14.103589 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:06:14.104074 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851174.103856, 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:14.104251 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] VM Paused (Lifecycle Event)
May 27 03:06:14.120710 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Took 7.90 seconds to spawn the instance on the hypervisor.
May 27 03:06:14.121025 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:14.200268 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:06:14.200969 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:06:14.200969 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:14.201241 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:14.301213 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:14.301293 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:14.317491 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c925bec6c37b4489b122eeff91a1f59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428862460731458481e46d92e7e023cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:06:14.606761 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:14.608976 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851174.608736, 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:14.609123 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] VM Resumed (Lifecycle Event)
May 27 03:06:14.630340 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Took 13.61 seconds to build instance.
May 27 03:06:14.704024 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:06:14.808414 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:06:14.808625 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:06:14.820093 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-370e4726-b76d-41f4-9437-c9bea8f44cc4 req-7b9238b7-592b-4e5d-98f1-7a9cc3384984 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Received event network-vif-plugged-4a157cbc-e218-493d-a824-c7318f618ed3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:14.820093 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-370e4726-b76d-41f4-9437-c9bea8f44cc4 req-7b9238b7-592b-4e5d-98f1-7a9cc3384984 service nova] Acquiring lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:14.820220 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-370e4726-b76d-41f4-9437-c9bea8f44cc4 req-7b9238b7-592b-4e5d-98f1-7a9cc3384984 service nova] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:14.820332 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-370e4726-b76d-41f4-9437-c9bea8f44cc4 req-7b9238b7-592b-4e5d-98f1-7a9cc3384984 service nova] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:14.820443 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-370e4726-b76d-41f4-9437-c9bea8f44cc4 req-7b9238b7-592b-4e5d-98f1-7a9cc3384984 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] No waiting events found dispatching network-vif-plugged-4a157cbc-e218-493d-a824-c7318f618ed3 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:06:14.820565 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-370e4726-b76d-41f4-9437-c9bea8f44cc4 req-7b9238b7-592b-4e5d-98f1-7a9cc3384984 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Received unexpected event network-vif-plugged-4a157cbc-e218-493d-a824-c7318f618ed3 for instance with vm_state active and task_state None.
May 27 03:06:14.820790 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-370e4726-b76d-41f4-9437-c9bea8f44cc4 req-7b9238b7-592b-4e5d-98f1-7a9cc3384984 service nova] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Received event network-vif-deleted-9d220c08-bd01-473f-a389-4dcbeb9ecf4c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:14.883263 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Successfully created port: ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:06:15.115338 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:15.118581 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:06:15.135952 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6cef93f3-350f-403b-b68d-4c8d0eeda7bd tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.125s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:15.208762 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:06:15.231232 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:15.231533 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:15.314538 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:06:15.391408 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Successfully updated port: ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:06:15.474494 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fabbd23a-a4e7-4e2f-9de2-176c74a77df4 req-3c62989e-3847-43c3-9e6c-256257c26a65 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Received event network-changed-ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:15.474681 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fabbd23a-a4e7-4e2f-9de2-176c74a77df4 req-3c62989e-3847-43c3-9e6c-256257c26a65 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Refreshing instance network info cache due to event network-changed-ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:06:15.474801 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fabbd23a-a4e7-4e2f-9de2-176c74a77df4 req-3c62989e-3847-43c3-9e6c-256257c26a65 service nova] Acquiring lock "refresh_cache-30e926af-236d-4544-9b8e-5fb9a3bddea6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:06:15.474872 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fabbd23a-a4e7-4e2f-9de2-176c74a77df4 req-3c62989e-3847-43c3-9e6c-256257c26a65 service nova] Acquired lock "refresh_cache-30e926af-236d-4544-9b8e-5fb9a3bddea6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:06:15.475838 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-fabbd23a-a4e7-4e2f-9de2-176c74a77df4 req-3c62989e-3847-43c3-9e6c-256257c26a65 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Refreshing network info cache for port ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:06:15.552652 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:15.621344 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851175.6209648, 70ca77a6-2f29-4558-abf0-07292a6200cd => ua-fa027204-a605-4551-9c81-86ef0865bcdb> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:06:15.624913 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Successfully detached device vdb from instance 70ca77a6-2f29-4558-abf0-07292a6200cd from the live domain config.
May 27 03:06:15.626516 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:06:15.627033 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb', 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fa027204-a605-4551-9c81-86ef0865bcdb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:06:15.627389 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:06:15.737466 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lazy-loading 'flavor' on Instance uuid a3cd35f5-3cbb-41fb-802e-22931d1089bd {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:15.824698 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.523s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:15.888457 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Deleted allocations for instance 3e5f7741-2c52-4242-9b37-566ff5f5a6a0
May 27 03:06:15.899106 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "refresh_cache-30e926af-236d-4544-9b8e-5fb9a3bddea6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:06:15.986767 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-fabbd23a-a4e7-4e2f-9de2-176c74a77df4 req-3c62989e-3847-43c3-9e6c-256257c26a65 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:16.059588 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-fabbd23a-a4e7-4e2f-9de2-176c74a77df4 req-3c62989e-3847-43c3-9e6c-256257c26a65 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:06:16.216443 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:06:16.217425 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:06:16.219940 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-fabbd23a-a4e7-4e2f-9de2-176c74a77df4 req-3c62989e-3847-43c3-9e6c-256257c26a65 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:16.220954 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Creating image(s)
May 27 03:06:16.221532 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "/opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:16.221768 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "/opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:16.222343 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "/opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:16.222829 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:06:16.225592 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:06:16.230772 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:16.252983 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:16.262307 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Ignoring supplied device name: /dev/vdb
May 27 03:06:16.283735 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.656s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:06:16.284611 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb', 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fa027204-a605-4551-9c81-86ef0865bcdb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:06:16.284809 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:06:16.320490 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:16.320490 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:16.320490 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:16.320490 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:16.320490 np0000001475 nova-compute[98471]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:16.320490 np0000001475 nova-compute[98471]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:16.320490 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:16.320490 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:16.320490 np0000001475 nova-compute[98471]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:06:16.320490 np0000001475 nova-compute[98471]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:06:16.320490 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:16.321124 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:16.321124 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:16.321124 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:16.321124 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:16.321124 np0000001475 nova-compute[98471]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:16.321124 np0000001475 nova-compute[98471]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb (non-flash)
May 27 03:06:16.321124 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:16.321124 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:16.321124 np0000001475 nova-compute[98471]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:06:16.321124 np0000001475 nova-compute[98471]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:06:16.321124 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:16.321124 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb', '91'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', '94'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', '95')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:06:16.321124 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb', '90')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:06:16.322305 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb', '91')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:06:16.323178 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572473d440>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb'): ({'sdi'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:06:16.323370 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Removing multipathed devices sdi, sdh {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:06:16.323594 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Flush multipath device 3300000004b9a3f4b {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:06:16.330921 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.103s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:16.331283 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:16.331647 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:16.332050 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:06:16.334517 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:06:16.335034 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:16.357592 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:06:16.428659 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:06:16.430211 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.095s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:16.430791 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:16.480612 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:06:16.480784 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:06:16.482211 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:06:16.495707 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:06:16.496099 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:06:16.500246 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6/disk 1073741824" returned: 0 in 0.069s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:16.500785 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:16.502834 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:16.522019 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:16.522621 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:16.566200 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 90, target: iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb, portal: 192.168.40.100,3260]
May 27 03:06:16.566200 np0000001475 nova-compute[98471]: Logout of [sid: 90, target: iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb, portal: 192.168.40.100,3260] successful.
May 27 03:06:16.566200 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:16.584616 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:16.596567 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:16.604365 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.103s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:16.604936 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:06:16.605265 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:16.651099 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 91, target: iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb, portal: 192.168.50.100,3260]
May 27 03:06:16.651099 np0000001475 nova-compute[98471]: Logout of [sid: 91, target: iqn.2023-03.storpool.com:os--volume-fa027204-a605-4551-9c81-86ef0865bcdb, portal: 192.168.50.100,3260] successful.
May 27 03:06:16.651099 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:16.679773 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:16.680194 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:16.680194 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] <== disconnect_volume: return (1052ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:06:16.680194 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:06:16.715610 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:16.717518 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Cannot resize image /opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:06:16.717518 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:06:16.717518 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Ensure instance console log exists: /opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:06:16.717518 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:16.717518 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:16.717518 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:16.722790 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fabbd23a-a4e7-4e2f-9de2-176c74a77df4 req-3c62989e-3847-43c3-9e6c-256257c26a65 service nova] Releasing lock "refresh_cache-30e926af-236d-4544-9b8e-5fb9a3bddea6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:06:16.723968 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquired lock "refresh_cache-30e926af-236d-4544-9b8e-5fb9a3bddea6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:06:16.724128 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:06:16.772205 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.540s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:16.900331 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eca2a9cd-809a-4ab1-be4c-afe938155b50 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "3e5f7741-2c52-4242-9b37-566ff5f5a6a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.773s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:17.254481 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lazy-loading 'flavor' on Instance uuid 70ca77a6-2f29-4558-abf0-07292a6200cd {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:17.334002 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:06:17.447958 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0007635560000380792 future=<Future at 0x755704784d70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:17.447958 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:17.448145 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=3.7728009429997655 future=<Future at 0x75572c12a2a0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:17.448145 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=3.772709281999596 future=<Future at 0x75572c12a2a0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:17.449161 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] Emitting event <LifecycleEvent: 1779851162.4468682, c2a5e735-d573-4ac4-bff0-d4a12648718e => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:17.449333 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] VM Stopped (Lifecycle Event)
May 27 03:06:17.476706 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:17.553978 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-67f555dd-9b64-404b-a9bc-116d83f037bb req-023c6b52-94d2-4351-9a37-28a52fb94641 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Received event network-changed-4a157cbc-e218-493d-a824-c7318f618ed3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:17.554161 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-67f555dd-9b64-404b-a9bc-116d83f037bb req-023c6b52-94d2-4351-9a37-28a52fb94641 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Refreshing instance network info cache due to event network-changed-4a157cbc-e218-493d-a824-c7318f618ed3. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:06:17.554341 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-67f555dd-9b64-404b-a9bc-116d83f037bb req-023c6b52-94d2-4351-9a37-28a52fb94641 service nova] Acquiring lock "refresh_cache-3593ceaa-ccfe-4242-9fcd-2582ac795dd2" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:06:17.554466 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-67f555dd-9b64-404b-a9bc-116d83f037bb req-023c6b52-94d2-4351-9a37-28a52fb94641 service nova] Acquired lock "refresh_cache-3593ceaa-ccfe-4242-9fcd-2582ac795dd2" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:06:17.555030 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-67f555dd-9b64-404b-a9bc-116d83f037bb req-023c6b52-94d2-4351-9a37-28a52fb94641 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Refreshing network info cache for port 4a157cbc-e218-493d-a824-c7318f618ed3 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:06:17.560174 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:17.586539 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "71af628e-b06d-446d-8c2e-dcfbb232df33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:17.586731 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:17.586956 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "71af628e-b06d-446d-8c2e-dcfbb232df33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:17.587109 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:17.587221 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:17.589486 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Terminating instance
May 27 03:06:17.720961 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Updating instance_info_cache with network_info: [{"id": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "address": "fa:16:3e:3e:7b:2f", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec37def5-0d", "ovs_interfaceid": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:17.874825 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:17.874967 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:17.875129 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Attaching volume a22033c7-7374-4c65-9764-35848d02c5a3 to /dev/vdb
May 27 03:06:17.922658 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:06:17.937350 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:06:17.958536 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-dc222dbb-2dfe-4542-a9c1-eee747f6a0fb tempest-ServersNegativeTestJSON-1895958758 tempest-ServersNegativeTestJSON-1895958758-project-member] [instance: c2a5e735-d573-4ac4-bff0-d4a12648718e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:17.962822 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:18.006453 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:06:18.006818 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:06:18.016520 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:06:18.017855 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe23:4b54', 'fe80::fc16:3eff:fe00:b7f', 'fe80::5060:75ff:fe06:71d8', 'fe80::fc16:3eff:febb:5a83', 'fe80::492:18ff:fe4d:a46d', 'fe80::fc16:3eff:fe21:ba30', 'fe80::787c:50ff:fed5:a1fc', 'fe80::fc16:3eff:fead:d206', 'fe80::8cdc:9fff:fe79:9907'] 
May 27 03:06:18.018069 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:06:18.018251 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:06:18.018388 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:06:18.018634 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Updating existing volume attachment record: cd117655-393d-40ef-93ed-e98d9ab413c4 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:06:18.066599 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-67f555dd-9b64-404b-a9bc-116d83f037bb req-023c6b52-94d2-4351-9a37-28a52fb94641 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:18.094171 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:06:18.119199 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:18.124871 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:18.151179 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:18.223994 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Releasing lock "refresh_cache-30e926af-236d-4544-9b8e-5fb9a3bddea6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:06:18.223994 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Instance network_info: |[{"id": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "address": "fa:16:3e:3e:7b:2f", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec37def5-0d", "ovs_interfaceid": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:06:18.229837 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Start _get_guest_xml network_info=[{"id": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "address": "fa:16:3e:3e:7b:2f", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec37def5-0d", "ovs_interfaceid": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:06:18.236728 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:06:18.238453 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-76506472', uuid='30e926af-236d-4544-9b8e-5fb9a3bddea6'), owner=OwnerMeta(userid='c925bec6c37b4489b122eeff91a1f59f', username='tempest-VolumesBackupsTest-655006446-project-member', projectid='428862460731458481e46d92e7e023cf', projectname='tempest-VolumesBackupsTest-655006446'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "address": "fa:16:3e:3e:7b:2f", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec37def5-0d", "ovs_interfaceid": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851178.2379663) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:06:18.241073 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:06:18.241073 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:06:18.242148 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:06:18.242375 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:06:18.243910 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:06:18.244125 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:06:18.244308 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:06:18.244437 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:06:18.244618 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:06:18.244800 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:06:18.244979 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:06:18.245180 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:06:18.246056 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:06:18.246056 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:06:18.246056 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:06:18.246056 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:06:18.263796 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:06:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-76506472',display_name='tempest-VolumesBackupsTest-instance-76506472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesbackupstest-instance-76506472',id=46,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQ0AKyFGMxhQSXo2O5dAprqjpbX45T+Cj/xJchNr+a2X9nDEihOHlLqvW3tmCpAjtCMWtJC/ZRW9wBSGou7kjBmOcVOmZtScU5Zs+IlOD6XP+Z5PeyHG30hjAwu3YbF+Q==',key_name='tempest-keypair-596232195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='428862460731458481e46d92e7e023cf',ramdisk_id='',reservation_id='r-xhr1ro6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-655006446',owner_user_name='tempest-VolumesBackupsTest-655006446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:06:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c925bec6c37b4489b122eeff91a1f59f',uuid=30e926af-236d-4544-9b8e-5fb9a3bddea6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "address": "fa:16:3e:3e:7b:2f", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec37def5-0d", "ovs_interfaceid": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:06:18.263796 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Converting VIF {"id": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "address": "fa:16:3e:3e:7b:2f", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec37def5-0d", "ovs_interfaceid": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:06:18.265095 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:7b:2f,bridge_name='br-int',has_traffic_filtering=True,id=ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a,network=Network(735ff26b-dab6-49dc-a6ef-ed11180803a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec37def5-0d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:06:18.265348 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lazy-loading 'pci_devices' on Instance uuid 30e926af-236d-4544-9b8e-5fb9a3bddea6 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:18.273092 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8b3ab06e-ed3a-4112-8c87-0bc2507c7e9e tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.785s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:18.328425 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:18.336999 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:18.348752 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a90d7eae-b96e-4317-98f9-5dcf4d5387ab req-ee5327be-afd3-4a39-919b-43cbf6f36fc6 service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Received event network-vif-unplugged-63e286dc-7977-40c8-b72b-fc4860de9e20 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:18.349231 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a90d7eae-b96e-4317-98f9-5dcf4d5387ab req-ee5327be-afd3-4a39-919b-43cbf6f36fc6 service nova] Acquiring lock "71af628e-b06d-446d-8c2e-dcfbb232df33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:18.349461 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a90d7eae-b96e-4317-98f9-5dcf4d5387ab req-ee5327be-afd3-4a39-919b-43cbf6f36fc6 service nova] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:18.349601 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a90d7eae-b96e-4317-98f9-5dcf4d5387ab req-ee5327be-afd3-4a39-919b-43cbf6f36fc6 service nova] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:18.349775 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a90d7eae-b96e-4317-98f9-5dcf4d5387ab req-ee5327be-afd3-4a39-919b-43cbf6f36fc6 service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] No waiting events found dispatching network-vif-unplugged-63e286dc-7977-40c8-b72b-fc4860de9e20 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:06:18.349944 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a90d7eae-b96e-4317-98f9-5dcf4d5387ab req-ee5327be-afd3-4a39-919b-43cbf6f36fc6 service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Received event network-vif-unplugged-63e286dc-7977-40c8-b72b-fc4860de9e20 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:06:18.467172 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999593553000068 future=<Future at 0x7557047391c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:18.469381 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Instance destroyed successfully.
May 27 03:06:18.471184 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'resources' on Instance uuid 71af628e-b06d-446d-8c2e-dcfbb232df33 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:18.579579 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-67f555dd-9b64-404b-a9bc-116d83f037bb req-023c6b52-94d2-4351-9a37-28a52fb94641 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:18.580901 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:06:18.581649 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a22033c7-7374-4c65-9764-35848d02c5a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:06:18.581983 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:06:18.582432 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:06:18.582672 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a22033c7-7374-4c65-9764-35848d02c5a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:06:18.601305 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:06:18.602389 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:06:18.603221 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:06:18.603685 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:06:18.604372 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:06:18.604493 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:06:18.621327 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:06:18.621327 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:18.629971 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:06:18.629971 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:18.641498 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3] added
May 27 03:06:18.641498 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:06:18.641498 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:06:18.641498 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:06:18.641498 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:06:18.641498 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:06:18.641498 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:18.641727 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:06:18.643076 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0374(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:06:18.643076 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:06:18.645779 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3] added
May 27 03:06:18.645779 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:06:18.645779 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:06:18.645779 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:06:18.645779 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:06:18.645779 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:06:18.645779 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:18.646533 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:06:18.646533 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0431(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:06:18.646533 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:06:18.768579 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] End _get_guest_xml xml=<domain type="qemu">
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:   <uuid>30e926af-236d-4544-9b8e-5fb9a3bddea6</uuid>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:   <name>instance-0000002e</name>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <nova:name>tempest-VolumesBackupsTest-instance-76506472</nova:name>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:06:18</nova:creationTime>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:         <nova:user uuid="c925bec6c37b4489b122eeff91a1f59f">tempest-VolumesBackupsTest-655006446-project-member</nova:user>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:         <nova:project uuid="428862460731458481e46d92e7e023cf">tempest-VolumesBackupsTest-655006446</nova:project>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:         <nova:port uuid="ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a">
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     <system>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <entry name="serial">30e926af-236d-4544-9b8e-5fb9a3bddea6</entry>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <entry name="uuid">30e926af-236d-4544-9b8e-5fb9a3bddea6</entry>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     </system>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:   <os>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:   </os>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:   <features>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:   </features>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:   <devices>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6/disk"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     </disk>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6/disk.config"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     </disk>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:3e:7b:2f"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <target dev="tapec37def5-0d"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     </interface>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6/console.log" append="off"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     </serial>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     <video>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     </video>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     </rng>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:   </devices>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]: </domain>
May 27 03:06:18.768579 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:06:18.771473 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Preparing to wait for external event network-vif-plugged-ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:06:18.771473 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:18.771473 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:18.771473 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:18.771473 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:06:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-76506472',display_name='tempest-VolumesBackupsTest-instance-76506472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesbackupstest-instance-76506472',id=46,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQ0AKyFGMxhQSXo2O5dAprqjpbX45T+Cj/xJchNr+a2X9nDEihOHlLqvW3tmCpAjtCMWtJC/ZRW9wBSGou7kjBmOcVOmZtScU5Zs+IlOD6XP+Z5PeyHG30hjAwu3YbF+Q==',key_name='tempest-keypair-596232195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='428862460731458481e46d92e7e023cf',ramdisk_id='',reservation_id='r-xhr1ro6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-655006446',owner_user_name='tempest-VolumesBackupsTest-655006446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:06:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c925bec6c37b4489b122eeff91a1f59f',uuid=30e926af-236d-4544-9b8e-5fb9a3bddea6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "address": "fa:16:3e:3e:7b:2f", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec37def5-0d", "ovs_interfaceid": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:06:18.771473 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Converting VIF {"id": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "address": "fa:16:3e:3e:7b:2f", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec37def5-0d", "ovs_interfaceid": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:06:18.771473 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:7b:2f,bridge_name='br-int',has_traffic_filtering=True,id=ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a,network=Network(735ff26b-dab6-49dc-a6ef-ed11180803a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec37def5-0d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:06:18.771473 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:7b:2f,bridge_name='br-int',has_traffic_filtering=True,id=ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a,network=Network(735ff26b-dab6-49dc-a6ef-ed11180803a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec37def5-0d') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:06:18.774733 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:18.774733 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:18.774733 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:06:18.774733 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:18.774944 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f310093f-c993-5496-82f8-fbfe0dcad158', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:18.778971 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:18.782720 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-67f555dd-9b64-404b-a9bc-116d83f037bb req-023c6b52-94d2-4351-9a37-28a52fb94641 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Updated VIF entry in instance network info cache for port 4a157cbc-e218-493d-a824-c7318f618ed3. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:06:18.782720 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-67f555dd-9b64-404b-a9bc-116d83f037bb req-023c6b52-94d2-4351-9a37-28a52fb94641 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Updating instance_info_cache with network_info: [{"id": "4a157cbc-e218-493d-a824-c7318f618ed3", "address": "fa:16:3e:ad:d2:06", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a157cbc-e2", "ovs_interfaceid": "4a157cbc-e218-493d-a824-c7318f618ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:18.782873 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:18.785800 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:18.786068 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec37def5-0d, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:18.786516 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec37def5-0d, col_values=(('qos', UUID('b0ff04e0-6716-456c-b54e-ff4977fb05e3')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:18.786709 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec37def5-0d, col_values=(('external_ids', {'iface-id': 'ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:7b:2f', 'vm-uuid': '30e926af-236d-4544-9b8e-5fb9a3bddea6'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:18.790114 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:18.793860 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:18.799832 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:18.801810 np0000001475 nova-compute[98471]: INFO os_vif [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:7b:2f,bridge_name='br-int',has_traffic_filtering=True,id=ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a,network=Network(735ff26b-dab6-49dc-a6ef-ed11180803a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec37def5-0d')
May 27 03:06:18.974958 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='multiattach-server-0',id=18,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7X60AtOl0SsfuAMV1LtNGpvh0yvi8THxioUm4x62ykVhuM7q4sXRNe3S5fa56OsOiAX0ZbtOowRZ4+AKeGhch21Oc/NUN3hQGbbFxrwclVqtJHRu4HOLbwt9JgM8J0mA==',key_name='tempest-keypair-1333870124',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:00:54Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-bv0hcghc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:00:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='092604511a8a467ba4ecb56261cb531f',uuid=71af628e-b06d-446d-8c2e-dcfbb232df33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63e286dc-7977-40c8-b72b-fc4860de9e20", "address": "fa:16:3e:23:4b:54", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e286dc-79", "ovs_interfaceid": "63e286dc-7977-40c8-b72b-fc4860de9e20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:06:18.975230 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "63e286dc-7977-40c8-b72b-fc4860de9e20", "address": "fa:16:3e:23:4b:54", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e286dc-79", "ovs_interfaceid": "63e286dc-7977-40c8-b72b-fc4860de9e20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:06:18.975885 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=63e286dc-7977-40c8-b72b-fc4860de9e20,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e286dc-79') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:06:18.976219 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=63e286dc-7977-40c8-b72b-fc4860de9e20,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e286dc-79') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:06:18.979767 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:18.979964 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63e286dc-79, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:18.981259 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:18.982216 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:18.987985 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:18.989246 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:18.989409 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=655e1814-2e59-48b0-a122-1c481a386d56) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:18.990250 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:18.990571 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:18.996223 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:18.997418 np0000001475 nova-compute[98471]: INFO os_vif [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:4b:54,bridge_name='br-int',has_traffic_filtering=True,id=63e286dc-7977-40c8-b72b-fc4860de9e20,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e286dc-79')
May 27 03:06:18.997662 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Deleting instance files /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33_del
May 27 03:06:18.998487 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Deletion of /opt/stack/data/nova/instances/71af628e-b06d-446d-8c2e-dcfbb232df33_del complete
May 27 03:06:19.284782 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-67f555dd-9b64-404b-a9bc-116d83f037bb req-023c6b52-94d2-4351-9a37-28a52fb94641 service nova] Releasing lock "refresh_cache-3593ceaa-ccfe-4242-9fcd-2582ac795dd2" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:06:19.509984 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Took 1.42 seconds to destroy the instance on the hypervisor.
May 27 03:06:19.511114 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:06:19.511315 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:06:19.511396 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:06:19.511594 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:19.644143 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "b9047e8c-855e-4623-8659-3c145e1706ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:19.644441 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "b9047e8c-855e-4623-8659-3c145e1706ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:19.646963 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:06:19.647209 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:06:19.665217 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:06:19.665217 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:19.668734 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-979995ce-859a-4e84-b246-305a23b338c5 req-81a4d849-6138-4342-ab68-e51f396cc387 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Received event network-vif-unplugged-ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:19.668734 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-979995ce-859a-4e84-b246-305a23b338c5 req-81a4d849-6138-4342-ab68-e51f396cc387 service nova] Acquiring lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:19.668734 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-979995ce-859a-4e84-b246-305a23b338c5 req-81a4d849-6138-4342-ab68-e51f396cc387 service nova] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:19.668734 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-979995ce-859a-4e84-b246-305a23b338c5 req-81a4d849-6138-4342-ab68-e51f396cc387 service nova] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:19.669172 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-979995ce-859a-4e84-b246-305a23b338c5 req-81a4d849-6138-4342-ab68-e51f396cc387 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] No event matching network-vif-unplugged-ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a in dict_keys([('network-vif-plugged', 'ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a')]) {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 27 03:06:19.669172 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-979995ce-859a-4e84-b246-305a23b338c5 req-81a4d849-6138-4342-ab68-e51f396cc387 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Received unexpected event network-vif-unplugged-ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a for instance with vm_state building and task_state spawning.
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:06:19.673173 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:06:19.673173 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:19.680099 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:19.682806 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:19.690277 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:19.704853 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:19.704853 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:19.704853 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:19.704853 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:19.704853 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:19.704853 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:19.704853 np0000001475 nova-compute[98471]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:06:19.704853 np0000001475 nova-compute[98471]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:06:19.704853 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:19.706186 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:19.706186 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:19.706186 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:19.706186 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:19.706186 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:19.706186 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:19.706186 np0000001475 nova-compute[98471]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:06:19.706186 np0000001475 nova-compute[98471]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:06:19.706186 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:19.716426 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:19.716426 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:19.716426 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:19.716426 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:19.716426 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:19.716426 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:19.716426 np0000001475 nova-compute[98471]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:06:19.716426 np0000001475 nova-compute[98471]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:06:19.716426 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:19.716904 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:19.716904 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:19.716904 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:19.716904 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:19.716904 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:19.716904 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:19.716904 np0000001475 nova-compute[98471]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:06:19.716904 np0000001475 nova-compute[98471]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:06:19.716904 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:19.771413 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3, portal: 192.168.50.100,3260]
May 27 03:06:19.771413 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3, portal: 192.168.50.100,3260] successful.
May 27 03:06:19.771413 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:19.780860 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3, portal: 192.168.40.100,3260]
May 27 03:06:19.780860 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3, portal: 192.168.40.100,3260] successful.
May 27 03:06:19.780860 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:19.788562 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:19.799825 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:19.818306 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:19.818306 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:19.818306 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:19.818306 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:19.818306 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:19.818306 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:19.818306 np0000001475 nova-compute[98471]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:06:19.818306 np0000001475 nova-compute[98471]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:06:19.818306 np0000001475 nova-compute[98471]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:19.818306 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:19.818306 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:19.818681 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:19.818681 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:19.818681 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:19.818681 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:19.818681 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:19.818681 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:19.818681 np0000001475 nova-compute[98471]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:06:19.818681 np0000001475 nova-compute[98471]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:06:19.818681 np0000001475 nova-compute[98471]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:19.818681 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:19.818681 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:19.819043 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:19.819043 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:06:19.820328 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] HCTL ('13', '-', '-', 0) found on session 96 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:06:19.820457 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:19.836775 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:19.836775 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:19.836775 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.234s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:19.837514 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:06:19.839703 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] HCTL ('14', '-', '-', 0) found on session 97 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:06:19.839980 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:06:19.853002 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Searching for a device in session 96 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:06:19.853002 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a22033c7-7374-4c65-9764-35848d02c5a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:06:19.875238 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Searching for a device in session 97 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:06:19.875238 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a22033c7-7374-4c65-9764-35848d02c5a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:06:20.133662 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9be6a311-497f-4eee-aa42-9fa5c7e9b2a9 req-3f8811f9-3b15-4fdc-9bcd-3cd1dc29f69f service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Received event network-vif-deleted-63e286dc-7977-40c8-b72b-fc4860de9e20 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:20.133922 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-9be6a311-497f-4eee-aa42-9fa5c7e9b2a9 req-3f8811f9-3b15-4fdc-9bcd-3cd1dc29f69f service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Neutron deleted interface 63e286dc-7977-40c8-b72b-fc4860de9e20; detaching it from the instance and deleting it from the info cache
May 27 03:06:20.134179 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-9be6a311-497f-4eee-aa42-9fa5c7e9b2a9 req-3f8811f9-3b15-4fdc-9bcd-3cd1dc29f69f service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:20.152381 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lazy-loading 'flavor' on Instance uuid b9047e8c-855e-4623-8659-3c145e1706ba {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:20.324828 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:06:20.325346 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:06:20.325346 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] No VIF found with MAC fa:16:3e:3e:7b:2f, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:06:20.325577 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Using config drive
May 27 03:06:20.433141 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d4ac1cd3-69e6-4212-ab6b-cedb04f203c0 req-9a32ffd3-cd63-41e9-9e0f-456ff958684a service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Received event network-vif-unplugged-63e286dc-7977-40c8-b72b-fc4860de9e20 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:20.433338 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d4ac1cd3-69e6-4212-ab6b-cedb04f203c0 req-9a32ffd3-cd63-41e9-9e0f-456ff958684a service nova] Acquiring lock "71af628e-b06d-446d-8c2e-dcfbb232df33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:20.433534 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d4ac1cd3-69e6-4212-ab6b-cedb04f203c0 req-9a32ffd3-cd63-41e9-9e0f-456ff958684a service nova] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:20.433683 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d4ac1cd3-69e6-4212-ab6b-cedb04f203c0 req-9a32ffd3-cd63-41e9-9e0f-456ff958684a service nova] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:20.433841 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d4ac1cd3-69e6-4212-ab6b-cedb04f203c0 req-9a32ffd3-cd63-41e9-9e0f-456ff958684a service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] No waiting events found dispatching network-vif-unplugged-63e286dc-7977-40c8-b72b-fc4860de9e20 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:06:20.433989 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d4ac1cd3-69e6-4212-ab6b-cedb04f203c0 req-9a32ffd3-cd63-41e9-9e0f-456ff958684a service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Received event network-vif-unplugged-63e286dc-7977-40c8-b72b-fc4860de9e20 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:06:20.548374 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:20.604100 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:06:20.639889 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9be6a311-497f-4eee-aa42-9fa5c7e9b2a9 req-3f8811f9-3b15-4fdc-9bcd-3cd1dc29f69f service nova] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Detach interface failed, port_id=63e286dc-7977-40c8-b72b-fc4860de9e20, reason: Instance 71af628e-b06d-446d-8c2e-dcfbb232df33 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:06:20.831715 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:20.992604 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Creating config drive at /opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6/disk.config
May 27 03:06:20.997191 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd7_p2dh_ {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:21.051195 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd7_p2dh_" returned: 0 in 0.053s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:21.052545 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Took 1.54 seconds to deallocate network for instance.
May 27 03:06:21.160341 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "b9047e8c-855e-4623-8659-3c145e1706ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:21.223111 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0005843920002917002 future=<Future at 0x75572c12a2a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:21.223111 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Emitting event <LifecycleEvent: 1779851166.2207315, c3954135-0707-4b78-bfe3-f458ab39f55c => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:21.223111 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:21.223111 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] VM Stopped (Lifecycle Event)
May 27 03:06:21.224035 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=4.772436061000008 future=<Future at 0x75572420e2a0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:21.224312 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=4.772113309999895 future=<Future at 0x75572420e2a0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:21.247655 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:21.563972 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:21.564480 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:21.601779 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:21.632824 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Found WWN 330000000558aa775 for multipath device dm-5 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:06:21.635477 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.052s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:21.635867 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] <== connect_volume: return (3054ms) {'type': 'block', 'scsi_wwn': '330000000558aa775', 'path': '/dev/dm-5', 'multipath_id': '330000000558aa775'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:06:21.636042 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000558aa775', 'path': '/dev/dm-5', 'multipath_id': '330000000558aa775'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:06:21.637978 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:21.647868 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lazy-loading 'flavor' on Instance uuid a3cd35f5-3cbb-41fb-802e-22931d1089bd {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:21.727593 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: c3954135-0707-4b78-bfe3-f458ab39f55c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:21.742784 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:21.881588 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f13fa4f5-14ca-48e6-8e42-f145ee6a63e9 req-9eeb930b-81d0-4f7e-85de-896ec26df0ac service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Received event network-vif-plugged-ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:21.881588 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f13fa4f5-14ca-48e6-8e42-f145ee6a63e9 req-9eeb930b-81d0-4f7e-85de-896ec26df0ac service nova] Acquiring lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:21.881588 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f13fa4f5-14ca-48e6-8e42-f145ee6a63e9 req-9eeb930b-81d0-4f7e-85de-896ec26df0ac service nova] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:21.881957 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f13fa4f5-14ca-48e6-8e42-f145ee6a63e9 req-9eeb930b-81d0-4f7e-85de-896ec26df0ac service nova] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:21.882145 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f13fa4f5-14ca-48e6-8e42-f145ee6a63e9 req-9eeb930b-81d0-4f7e-85de-896ec26df0ac service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Processing event network-vif-plugged-ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:06:22.031168 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:22.034410 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:22.065378 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:22.069382 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:22.120158 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:06:22.120158 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:06:22.158930 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Attempting to attach volume a22033c7-7374-4c65-9764-35848d02c5a3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:06:22.163932 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:06:22.163932 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:06:22.163932 np0000001475 nova-compute[98471]:   <alias name="ua-a22033c7-7374-4c65-9764-35848d02c5a3"/>
May 27 03:06:22.163932 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:06:22.163932 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:06:22.163932 np0000001475 nova-compute[98471]:   <serial>a22033c7-7374-4c65-9764-35848d02c5a3</serial>
May 27 03:06:22.163932 np0000001475 nova-compute[98471]: </disk>
May 27 03:06:22.163932 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:06:22.273601 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "b9047e8c-855e-4623-8659-3c145e1706ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:22.273836 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "b9047e8c-855e-4623-8659-3c145e1706ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:22.274097 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Attaching volume 4806b56c-b6a4-4692-bde6-798799088b1c to /dev/vdb
May 27 03:06:22.337858 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:06:22.354314 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:06:22.376934 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:22.433353 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:06:22.434262 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:06:22.444348 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:06:22.449771 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:feb0:5e79', 'fe80::5848:f8ff:fe04:8324', 'fe80::fc16:3eff:fe00:b7f', 'fe80::5060:75ff:fe06:71d8', 'fe80::fc16:3eff:febb:5a83', 'fe80::492:18ff:fe4d:a46d', 'fe80::fc16:3eff:fe21:ba30', 'fe80::787c:50ff:fed5:a1fc', 'fe80::fc16:3eff:fead:d206', 'fe80::8cdc:9fff:fe79:9907', 'fe80::fc16:3eff:fe3e:7b2f', 'fe80::bc95:85ff:fe5a:dff6'] 
May 27 03:06:22.449771 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:06:22.449771 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:06:22.449771 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:06:22.449771 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Updating existing volume attachment record: 451dc0e9-ef37-44c2-8b63-d550fd101ed0 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:06:22.624268 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:06:22.657242 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851182.6541867, 30e926af-236d-4544-9b8e-5fb9a3bddea6 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:22.657547 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] VM Started (Lifecycle Event)
May 27 03:06:22.659497 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:06:22.664700 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:06:22.668514 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Instance spawned successfully.
May 27 03:06:22.668861 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:06:23.009862 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:06:23.010257 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4806b56c-b6a4-4692-bde6-798799088b1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:06:23.010392 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:06:23.010848 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:06:23.011174 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4806b56c-b6a4-4692-bde6-798799088b1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:06:23.025128 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:06:23.026127 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:06:23.026688 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:06:23.026958 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:06:23.027859 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:06:23.027859 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:06:23.043348 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:06:23.043348 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:23.048679 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:06:23.048679 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:23.055259 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c] added
May 27 03:06:23.055259 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:06:23.055259 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:06:23.055259 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:06:23.055259 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:06:23.055259 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:06:23.055259 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:23.055513 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:06:23.055591 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0286(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:06:23.055807 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:06:23.063253 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c] added
May 27 03:06:23.063253 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:06:23.063253 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:06:23.063253 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:06:23.063253 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:06:23.063253 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:06:23.063253 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:23.063593 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:06:23.063704 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.036(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:06:23.063960 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:06:23.133167 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.569s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:23.164434 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:23.167660 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:06:23.176589 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:23.176699 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:23.177213 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:23.177546 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:23.177913 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:23.178285 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:23.213994 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Deleted allocations for instance 71af628e-b06d-446d-8c2e-dcfbb232df33
May 27 03:06:23.492591 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:23.670042 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:06:23.670623 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851183.6701329, 30e926af-236d-4544-9b8e-5fb9a3bddea6 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:23.670623 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] VM Paused (Lifecycle Event)
May 27 03:06:23.686087 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Took 7.47 seconds to spawn the instance on the hypervisor.
May 27 03:06:23.686307 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:23.855350 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:06:23.855511 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:06:23.855639 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:06:23.855792 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] No VIF found with MAC fa:16:3e:bb:5a:83, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:06:23.961245 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-511a923c-bb0d-41f9-851b-01278e57709d req-9dd1f5dd-503e-4ed7-9006-05dee9240f61 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Received event network-vif-plugged-ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:23.961442 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-511a923c-bb0d-41f9-851b-01278e57709d req-9dd1f5dd-503e-4ed7-9006-05dee9240f61 service nova] Acquiring lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:23.961597 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-511a923c-bb0d-41f9-851b-01278e57709d req-9dd1f5dd-503e-4ed7-9006-05dee9240f61 service nova] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:23.961710 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-511a923c-bb0d-41f9-851b-01278e57709d req-9dd1f5dd-503e-4ed7-9006-05dee9240f61 service nova] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:23.961835 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-511a923c-bb0d-41f9-851b-01278e57709d req-9dd1f5dd-503e-4ed7-9006-05dee9240f61 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] No waiting events found dispatching network-vif-plugged-ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:06:23.961955 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-511a923c-bb0d-41f9-851b-01278e57709d req-9dd1f5dd-503e-4ed7-9006-05dee9240f61 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Received unexpected event network-vif-plugged-ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a for instance with vm_state active and task_state None.
May 27 03:06:23.989967 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:24.058765 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:06:24.066754 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:06:24.077241 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:06:24.077241 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:06:24.086841 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:06:24.086841 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:24.096194 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:24.103584 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:24.116354 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:24.116354 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:24.116354 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:24.116354 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:24.116354 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:24.116354 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:24.116354 np0000001475 nova-compute[98471]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:24.116354 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:24.116354 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:24.116354 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:24.116354 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:24.116354 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:24.116354 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:24.116354 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:24.116354 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:24.116354 np0000001475 nova-compute[98471]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:24.116354 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:24.116354 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:24.130527 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:24.130527 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:24.130527 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:24.130527 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:24.130527 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:24.130527 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:24.130527 np0000001475 nova-compute[98471]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:24.130527 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:24.130527 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:24.130893 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:24.130893 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:24.130893 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:24.130893 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:24.130893 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:24.130893 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:24.130893 np0000001475 nova-compute[98471]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:24.130893 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:24.130893 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:24.170114 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c, portal: 192.168.40.100,3260]
May 27 03:06:24.170114 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c, portal: 192.168.40.100,3260] successful.
May 27 03:06:24.170114 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:24.174290 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:24.178455 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851184.177065, 30e926af-236d-4544-9b8e-5fb9a3bddea6 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:24.178455 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] VM Resumed (Lifecycle Event)
May 27 03:06:24.185224 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:24.193669 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c, portal: 192.168.50.100,3260]
May 27 03:06:24.193669 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c, portal: 192.168.50.100,3260] successful.
May 27 03:06:24.193669 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:24.199077 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Took 14.39 seconds to build instance.
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:24.202946 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:24.202946 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:24.202946 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:06:24.203947 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] HCTL ('11', '-', '-', 0) found on session 98 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:06:24.203947 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:06:24.209038 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:24.227190 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-74a405f3-1895-40a4-95e3-456a89748782 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "71af628e-b06d-446d-8c2e-dcfbb232df33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.640s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:24.228396 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Searching for a device in session 98 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:06:24.230242 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4806b56c-b6a4-4692-bde6-798799088b1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:06:24.236578 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:24.236578 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:24.236578 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:24.236578 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:24.236578 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:24.236578 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:24.236578 np0000001475 nova-compute[98471]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:24.236578 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:24.236578 np0000001475 nova-compute[98471]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:24.236578 np0000001475 nova-compute[98471]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:24.236578 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:24.236929 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:24.236929 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:24.236929 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:24.236929 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:24.236929 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:24.236929 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:24.236929 np0000001475 nova-compute[98471]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:24.236929 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:24.236929 np0000001475 nova-compute[98471]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:24.236929 np0000001475 nova-compute[98471]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:24.236929 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:24.237307 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.210s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:24.237390 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:06:24.239833 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] HCTL ('12', '-', '-', 0) found on session 99 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:06:24.239833 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:06:24.261179 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Searching for a device in session 99 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:06:24.262111 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4806b56c-b6a4-4692-bde6-798799088b1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:06:24.396937 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "70ca77a6-2f29-4558-abf0-07292a6200cd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:24.397644 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:24.685114 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:24.685114 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:06:24.702446 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.902s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:24.902238 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Detaching volume 84717294-7eb7-4a8e-a867-0d8ee34db75d
May 27 03:06:24.972459 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Attempting to driver detach volume 84717294-7eb7-4a8e-a867-0d8ee34db75d from mountpoint /dev/vdc
May 27 03:06:24.976917 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Found disk vdc by alias ua-84717294-7eb7-4a8e-a867-0d8ee34db75d {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:06:24.978654 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Found disk vdc by alias ua-84717294-7eb7-4a8e-a867-0d8ee34db75d {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:06:24.978878 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Attempting to detach device vdc from instance 70ca77a6-2f29-4558-abf0-07292a6200cd from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:06:24.979208 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:06:24.979208 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:06:24.979208 np0000001475 nova-compute[98471]:   <alias name="ua-84717294-7eb7-4a8e-a867-0d8ee34db75d"/>
May 27 03:06:24.979208 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-9"/>
May 27 03:06:24.979208 np0000001475 nova-compute[98471]:   <target dev="vdc" bus="virtio"/>
May 27 03:06:24.979208 np0000001475 nova-compute[98471]:   <serial>84717294-7eb7-4a8e-a867-0d8ee34db75d</serial>
May 27 03:06:24.979208 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 27 03:06:24.979208 np0000001475 nova-compute[98471]: </disk>
May 27 03:06:24.979208 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:06:24.988623 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Successfully detached device vdc from instance 70ca77a6-2f29-4558-abf0-07292a6200cd from the persistent domain config.
May 27 03:06:24.988806 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] (1/8): Attempting to detach device vdc with device alias ua-84717294-7eb7-4a8e-a867-0d8ee34db75d from instance 70ca77a6-2f29-4558-abf0-07292a6200cd from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:06:24.989115 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:06:24.989115 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:06:24.989115 np0000001475 nova-compute[98471]:   <alias name="ua-84717294-7eb7-4a8e-a867-0d8ee34db75d"/>
May 27 03:06:24.989115 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-9"/>
May 27 03:06:24.989115 np0000001475 nova-compute[98471]:   <target dev="vdc" bus="virtio"/>
May 27 03:06:24.989115 np0000001475 nova-compute[98471]:   <serial>84717294-7eb7-4a8e-a867-0d8ee34db75d</serial>
May 27 03:06:24.989115 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 27 03:06:24.989115 np0000001475 nova-compute[98471]: </disk>
May 27 03:06:24.989115 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:06:25.027329 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:06:25.090834 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6ca6b546-3e70-4a7c-bf0a-b596765ae644 req-cc5be8f2-ee67-4919-9b1a-4aa4a0be0fa0 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Received event network-changed-ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:25.090834 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6ca6b546-3e70-4a7c-bf0a-b596765ae644 req-cc5be8f2-ee67-4919-9b1a-4aa4a0be0fa0 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Refreshing instance network info cache due to event network-changed-ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:06:25.090834 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6ca6b546-3e70-4a7c-bf0a-b596765ae644 req-cc5be8f2-ee67-4919-9b1a-4aa4a0be0fa0 service nova] Acquiring lock "refresh_cache-30e926af-236d-4544-9b8e-5fb9a3bddea6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:06:25.090834 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6ca6b546-3e70-4a7c-bf0a-b596765ae644 req-cc5be8f2-ee67-4919-9b1a-4aa4a0be0fa0 service nova] Acquired lock "refresh_cache-30e926af-236d-4544-9b8e-5fb9a3bddea6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:06:25.091094 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-6ca6b546-3e70-4a7c-bf0a-b596765ae644 req-cc5be8f2-ee67-4919-9b1a-4aa4a0be0fa0 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Refreshing network info cache for port ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:06:25.210206 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "7af020cf-50ce-441d-b10d-cf57cc280856" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:25.210430 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "7af020cf-50ce-441d-b10d-cf57cc280856" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:25.460648 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d2f07be-cf06-4127-a050-acdd76539ddf tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.586s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:25.605293 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-6ca6b546-3e70-4a7c-bf0a-b596765ae644 req-cc5be8f2-ee67-4919-9b1a-4aa4a0be0fa0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:25.609957 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "f5d36573-c0e7-43a0-a7cc-66678f093375" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:25.610280 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "f5d36573-c0e7-43a0-a7cc-66678f093375" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:25.610429 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "f5d36573-c0e7-43a0-a7cc-66678f093375-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:25.610589 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "f5d36573-c0e7-43a0-a7cc-66678f093375-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:25.610777 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "f5d36573-c0e7-43a0-a7cc-66678f093375-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:25.613357 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Terminating instance
May 27 03:06:25.667404 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851185.6670377, 70ca77a6-2f29-4558-abf0-07292a6200cd => ua-84717294-7eb7-4a8e-a867-0d8ee34db75d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:06:25.668299 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-84717294-7eb7-4a8e-a867-0d8ee34db75d for instance 70ca77a6-2f29-4558-abf0-07292a6200cd {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:06:25.671174 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Successfully detached device vdc from instance 70ca77a6-2f29-4558-abf0-07292a6200cd from the live domain config.
May 27 03:06:25.672545 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:06:25.672812 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d', 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '84717294-7eb7-4a8e-a867-0d8ee34db75d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:06:25.672918 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:06:25.715305 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:06:25.997194 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0004715869999927236 future=<Future at 0x75572420e2a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:25.997389 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:25.997848 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Emitting event <LifecycleEvent: 1779851170.9963567, 3e5f7741-2c52-4242-9b37-566ff5f5a6a0 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:25.997958 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=7.468780047000109 future=<Future at 0x7557047391c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:25.998118 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=7.468604129000141 future=<Future at 0x7557047391c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:25.999065 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] VM Stopped (Lifecycle Event)
May 27 03:06:26.025152 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-6ca6b546-3e70-4a7c-bf0a-b596765ae644 req-cc5be8f2-ee67-4919-9b1a-4aa4a0be0fa0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:26.050262 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Found WWN 330000000d3e5f4d9 for multipath device dm-4 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:06:26.050649 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:26.050904 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '330000000d3e5f4d9', 'path': '/dev/dm-4', 'multipath_id': '330000000d3e5f4d9'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:06:26.051086 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d3e5f4d9', 'path': '/dev/dm-4', 'multipath_id': '330000000d3e5f4d9'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:06:26.051561 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.379s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:06:26.051960 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d', 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '84717294-7eb7-4a8e-a867-0d8ee34db75d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:06:26.052144 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:06:26.057170 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lazy-loading 'flavor' on Instance uuid b9047e8c-855e-4623-8659-3c145e1706ba {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:26.088191 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d (non-flash)
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:26.088191 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d', '93'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', '97'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', '99')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:06:26.088191 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d', '93')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:06:26.090108 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d', '92')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:06:26.090651 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755724759da0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d'): ({'sdj'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:06:26.091300 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Removing multipathed devices sdj, sdk {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:06:26.091300 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Flush multipath device 330000000023c2995 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:06:26.118567 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:06:26.129598 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:06:26.156855 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:26.181488 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:06:26.193336 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:26.202194 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:26.226234 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-6ca6b546-3e70-4a7c-bf0a-b596765ae644 req-cc5be8f2-ee67-4919-9b1a-4aa4a0be0fa0 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Updated VIF entry in instance network info cache for port ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:06:26.226796 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-6ca6b546-3e70-4a7c-bf0a-b596765ae644 req-cc5be8f2-ee67-4919-9b1a-4aa4a0be0fa0 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Updating instance_info_cache with network_info: [{"id": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "address": "fa:16:3e:3e:7b:2f", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec37def5-0d", "ovs_interfaceid": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:26.234772 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:26.238237 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:06:26.238237 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:06:26.241768 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:06:26.254912 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:26.257616 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:06:26.257860 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:06:26.274592 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:26.298993 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:26.299304 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:26.303774 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:06:26.304106 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Claim successful on node np0000001475
May 27 03:06:26.311291 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 93, target: iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d, portal: 192.168.40.100,3260]
May 27 03:06:26.311291 np0000001475 nova-compute[98471]: Logout of [sid: 93, target: iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d, portal: 192.168.40.100,3260] successful.
May 27 03:06:26.311291 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:26.332804 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:26.348252 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:26.388597 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 92, target: iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d, portal: 192.168.50.100,3260]
May 27 03:06:26.388597 np0000001475 nova-compute[98471]: Logout of [sid: 92, target: iqn.2023-03.storpool.com:os--volume-84717294-7eb7-4a8e-a867-0d8ee34db75d, portal: 192.168.50.100,3260] successful.
May 27 03:06:26.388597 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:26.407476 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:26.407804 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:26.408382 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] <== disconnect_volume: return (735ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:06:26.408382 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:06:26.474359 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999686414999815 future=<Future at 0x7557247c4a70 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:26.478876 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Instance destroyed successfully.
May 27 03:06:26.479554 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lazy-loading 'resources' on Instance uuid f5d36573-c0e7-43a0-a7cc-66678f093375 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:26.501494 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: 3e5f7741-2c52-4242-9b37-566ff5f5a6a0] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:26.504162 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:26.561257 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Attempting to attach volume 4806b56c-b6a4-4692-bde6-798799088b1c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:06:26.563959 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:06:26.563959 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:06:26.563959 np0000001475 nova-compute[98471]:   <alias name="ua-4806b56c-b6a4-4692-bde6-798799088b1c"/>
May 27 03:06:26.563959 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-4"/>
May 27 03:06:26.563959 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:06:26.563959 np0000001475 nova-compute[98471]:   <serial>4806b56c-b6a4-4692-bde6-798799088b1c</serial>
May 27 03:06:26.563959 np0000001475 nova-compute[98471]: </disk>
May 27 03:06:26.563959 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:06:26.735009 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6ca6b546-3e70-4a7c-bf0a-b596765ae644 req-cc5be8f2-ee67-4919-9b1a-4aa4a0be0fa0 service nova] Releasing lock "refresh_cache-30e926af-236d-4544-9b8e-5fb9a3bddea6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:06:26.984021 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1643817025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumemultiattachtest-server-1643817025',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:00:36Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9c48d6919e8435f876f3324616521ea',ramdisk_id='',reservation_id='r-f61mimih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-774919822',owner_user_name='tempest-AttachVolumeMultiAttachTest-774919822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:00:36Z,user_data=None,user_id='092604511a8a467ba4ecb56261cb531f',uuid=f5d36573-c0e7-43a0-a7cc-66678f093375,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "138260f4-bd1e-47ed-9760-9f234ebfdddc", "address": "fa:16:3e:b0:5e:79", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap138260f4-bd", "ovs_interfaceid": "138260f4-bd1e-47ed-9760-9f234ebfdddc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:06:26.984021 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converting VIF {"id": "138260f4-bd1e-47ed-9760-9f234ebfdddc", "address": "fa:16:3e:b0:5e:79", "network": {"id": "dfbfb4b3-470f-45e7-9054-908dc830fb29", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-987723940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a9c48d6919e8435f876f3324616521ea", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap138260f4-bd", "ovs_interfaceid": "138260f4-bd1e-47ed-9760-9f234ebfdddc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:06:26.984303 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5e:79,bridge_name='br-int',has_traffic_filtering=True,id=138260f4-bd1e-47ed-9760-9f234ebfdddc,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138260f4-bd') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:06:26.984575 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5e:79,bridge_name='br-int',has_traffic_filtering=True,id=138260f4-bd1e-47ed-9760-9f234ebfdddc,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138260f4-bd') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:06:26.985898 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:26.987238 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap138260f4-bd, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:26.989328 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lazy-loading 'flavor' on Instance uuid 70ca77a6-2f29-4558-abf0-07292a6200cd {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:26.990266 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:26.992412 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:26.992412 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:26.992412 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4143530a-9df8-495b-b2eb-b15ebc35b6e7) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:26.994265 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:26.994265 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:26.995921 np0000001475 nova-compute[98471]: INFO os_vif [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5e:79,bridge_name='br-int',has_traffic_filtering=True,id=138260f4-bd1e-47ed-9760-9f234ebfdddc,network=Network(dfbfb4b3-470f-45e7-9054-908dc830fb29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap138260f4-bd')
May 27 03:06:27.037262 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:06:27.037669 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:06:27.039101 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:06:27.039101 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:06:27.039101 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:06:27.039101 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:06:27.068700 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:27.068700 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:27.068700 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:27.068700 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:27.068700 np0000001475 nova-compute[98471]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:27.068700 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:27.068700 np0000001475 nova-compute[98471]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:27.068700 np0000001475 nova-compute[98471]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:27.068700 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:27.068987 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsi session list stdout=tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:27.068987 np0000001475 nova-compute[98471]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd (non-flash)
May 27 03:06:27.068987 np0000001475 nova-compute[98471]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:27.068987 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:27.068987 np0000001475 nova-compute[98471]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:27.068987 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:27.068987 np0000001475 nova-compute[98471]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:27.068987 np0000001475 nova-compute[98471]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:27.068987 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:27.068987 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', '97'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', '99')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:06:27.069207 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '38')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:06:27.070251 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd', '37')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:06:27.071216 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755724647880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd'): ({'sdd'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:06:27.071423 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Removing multipathed devices sdd, sde {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:06:27.071654 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Flush multipath device 33000000053058fee {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:06:27.138436 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:06:27.181628 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:06:27.234546 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:06:27.235893 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:06:27.237562 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:06:27.249830 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:06:27.249887 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:06:27.262751 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:27.302152 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd, portal: 192.168.40.100,3260]
May 27 03:06:27.302152 np0000001475 nova-compute[98471]: Logout of [sid: 38, target: iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd, portal: 192.168.40.100,3260] successful.
May 27 03:06:27.302152 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:27.323526 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:27.338277 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:27.373945 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd, portal: 192.168.50.100,3260]
May 27 03:06:27.373945 np0000001475 nova-compute[98471]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-b6f7cf5a-6c39-466d-a5fe-d87d0a7e9ebd, portal: 192.168.50.100,3260] successful.
May 27 03:06:27.373945 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:27.394904 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:27.395175 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:27.395312 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] <== disconnect_volume: return (357ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:06:27.395425 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:06:27.395661 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Deleting instance files /opt/stack/data/nova/instances/f5d36573-c0e7-43a0-a7cc-66678f093375_del
May 27 03:06:27.396403 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Deletion of /opt/stack/data/nova/instances/f5d36573-c0e7-43a0-a7cc-66678f093375_del complete
May 27 03:06:27.800365 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:06:27.800886 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:06:27.902133 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Took 1.78 seconds to destroy the instance on the hypervisor.
May 27 03:06:27.903716 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:06:27.904188 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:06:27.904353 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:06:27.904638 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:28.002765 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-aa39f2e0-f3c7-4b5e-b124-71dbd6dd6380 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.605s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:28.028005 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:28.241023 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:06:28.241181 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:06:28.241335 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:06:28.241404 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No VIF found with MAC fa:16:3e:21:ba:30, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:06:28.303620 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:06:28.395731 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-338d6f10-6964-4def-8f01-11d40b00ac4b req-95e852d5-00ff-4b7d-8f0e-ec8c46ace03c service nova] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Received event network-vif-deleted-138260f4-bd1e-47ed-9760-9f234ebfdddc {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:28.395731 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-338d6f10-6964-4def-8f01-11d40b00ac4b req-95e852d5-00ff-4b7d-8f0e-ec8c46ace03c service nova] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Neutron deleted interface 138260f4-bd1e-47ed-9760-9f234ebfdddc; detaching it from the instance and deleting it from the info cache
May 27 03:06:28.395731 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-338d6f10-6964-4def-8f01-11d40b00ac4b req-95e852d5-00ff-4b7d-8f0e-ec8c46ace03c service nova] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:28.811506 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.512s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:28.812048 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:06:28.824259 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:28.898042 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-338d6f10-6964-4def-8f01-11d40b00ac4b req-95e852d5-00ff-4b7d-8f0e-ec8c46ace03c service nova] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Detach interface failed, port_id=138260f4-bd1e-47ed-9760-9f234ebfdddc, reason: Instance f5d36573-c0e7-43a0-a7cc-66678f093375 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:06:29.022760 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2d4608d-8559-4458-940f-d42bfc401919 req-34ca7d8b-f445-4c4f-8715-e491e8003770 service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Received event network-changed-77f2ecc1-416d-42e8-8279-c8119022bfef {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:29.023195 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2d4608d-8559-4458-940f-d42bfc401919 req-34ca7d8b-f445-4c4f-8715-e491e8003770 service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Refreshing instance network info cache due to event network-changed-77f2ecc1-416d-42e8-8279-c8119022bfef. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:06:29.023195 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2d4608d-8559-4458-940f-d42bfc401919 req-34ca7d8b-f445-4c4f-8715-e491e8003770 service nova] Acquiring lock "refresh_cache-70ca77a6-2f29-4558-abf0-07292a6200cd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:06:29.023195 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2d4608d-8559-4458-940f-d42bfc401919 req-34ca7d8b-f445-4c4f-8715-e491e8003770 service nova] Acquired lock "refresh_cache-70ca77a6-2f29-4558-abf0-07292a6200cd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:06:29.023490 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f2d4608d-8559-4458-940f-d42bfc401919 req-34ca7d8b-f445-4c4f-8715-e491e8003770 service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Refreshing network info cache for port 77f2ecc1-416d-42e8-8279-c8119022bfef {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:06:29.319026 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:06:29.319332 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:06:29.319754 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:29.320022 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:29.330070 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Took 1.43 seconds to deallocate network for instance.
May 27 03:06:29.413773 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '358594214f7a4c71a13200be75c799cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0810d45b82c0476db38b1cabf8579ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:06:29.525631 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f2d4608d-8559-4458-940f-d42bfc401919 req-34ca7d8b-f445-4c4f-8715-e491e8003770 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:29.809555 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e2abca25-8827-42fe-be62-77208e33b711 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "b9047e8c-855e-4623-8659-3c145e1706ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.536s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:29.822616 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:06:29.887062 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Took 0.56 seconds to detach 1 volumes for instance.
May 27 03:06:30.079158 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:30.105769 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f2d4608d-8559-4458-940f-d42bfc401919 req-34ca7d8b-f445-4c4f-8715-e491e8003770 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:30.129676 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Successfully created port: 935fd58f-0c86-41ea-822b-947f831b1657 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:06:30.222864 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "70ca77a6-2f29-4558-abf0-07292a6200cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:30.223203 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:30.223425 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "70ca77a6-2f29-4558-abf0-07292a6200cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:30.223568 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:30.223673 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:30.225829 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Terminating instance
May 27 03:06:30.276613 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f2d4608d-8559-4458-940f-d42bfc401919 req-34ca7d8b-f445-4c4f-8715-e491e8003770 service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Updated VIF entry in instance network info cache for port 77f2ecc1-416d-42e8-8279-c8119022bfef. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:06:30.276613 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f2d4608d-8559-4458-940f-d42bfc401919 req-34ca7d8b-f445-4c4f-8715-e491e8003770 service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Updating instance_info_cache with network_info: [{"id": "77f2ecc1-416d-42e8-8279-c8119022bfef", "address": "fa:16:3e:00:0b:7f", "network": {"id": "0d667c62-7603-42bb-94fe-f2a3ac9ae7d5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-544867481-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0405565349241dd88ac22d535484e65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f2ecc1-41", "ovs_interfaceid": "77f2ecc1-416d-42e8-8279-c8119022bfef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:30.327470 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:06:30.402967 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:30.407022 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:30.430704 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "b9047e8c-855e-4623-8659-3c145e1706ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:30.430704 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "b9047e8c-855e-4623-8659-3c145e1706ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:30.483579 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0dbe7ea0-59cb-4a98-89fd-36d9a8f43d49 req-0ffa23ee-fb41-4ae0-b408-396e6f094edd service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Received event network-changed-77f2ecc1-416d-42e8-8279-c8119022bfef {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:30.483950 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0dbe7ea0-59cb-4a98-89fd-36d9a8f43d49 req-0ffa23ee-fb41-4ae0-b408-396e6f094edd service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Refreshing instance network info cache due to event network-changed-77f2ecc1-416d-42e8-8279-c8119022bfef. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:06:30.484208 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0dbe7ea0-59cb-4a98-89fd-36d9a8f43d49 req-0ffa23ee-fb41-4ae0-b408-396e6f094edd service nova] Acquiring lock "refresh_cache-70ca77a6-2f29-4558-abf0-07292a6200cd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:06:30.735529 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:06:30.768871 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:30.778275 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2d4608d-8559-4458-940f-d42bfc401919 req-34ca7d8b-f445-4c4f-8715-e491e8003770 service nova] Releasing lock "refresh_cache-70ca77a6-2f29-4558-abf0-07292a6200cd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:06:30.778275 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0dbe7ea0-59cb-4a98-89fd-36d9a8f43d49 req-0ffa23ee-fb41-4ae0-b408-396e6f094edd service nova] Acquired lock "refresh_cache-70ca77a6-2f29-4558-abf0-07292a6200cd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:06:30.778491 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-0dbe7ea0-59cb-4a98-89fd-36d9a8f43d49 req-0ffa23ee-fb41-4ae0-b408-396e6f094edd service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Refreshing network info cache for port 77f2ecc1-416d-42e8-8279-c8119022bfef {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:06:30.799666 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:30.836896 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:30.919655 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:06:30.920059 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:06:30.935126 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Detaching volume 4806b56c-b6a4-4692-bde6-798799088b1c
May 27 03:06:31.000765 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Attempting to driver detach volume 4806b56c-b6a4-4692-bde6-798799088b1c from mountpoint /dev/vdb
May 27 03:06:31.009595 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Found disk vdb by alias ua-4806b56c-b6a4-4692-bde6-798799088b1c {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:06:31.014074 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Found disk vdb by alias ua-4806b56c-b6a4-4692-bde6-798799088b1c {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:06:31.014074 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Attempting to detach device vdb from instance b9047e8c-855e-4623-8659-3c145e1706ba from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:06:31.014074 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:06:31.014074 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:06:31.014074 np0000001475 nova-compute[98471]:   <alias name="ua-4806b56c-b6a4-4692-bde6-798799088b1c"/>
May 27 03:06:31.014074 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-4"/>
May 27 03:06:31.014074 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:06:31.014074 np0000001475 nova-compute[98471]:   <serial>4806b56c-b6a4-4692-bde6-798799088b1c</serial>
May 27 03:06:31.014074 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:06:31.014074 np0000001475 nova-compute[98471]: </disk>
May 27 03:06:31.014074 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:06:31.028699 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Successfully detached device vdb from instance b9047e8c-855e-4623-8659-3c145e1706ba from the persistent domain config.
May 27 03:06:31.028864 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] (1/8): Attempting to detach device vdb with device alias ua-4806b56c-b6a4-4692-bde6-798799088b1c from instance b9047e8c-855e-4623-8659-3c145e1706ba from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:06:31.029190 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:06:31.029190 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:06:31.029190 np0000001475 nova-compute[98471]:   <alias name="ua-4806b56c-b6a4-4692-bde6-798799088b1c"/>
May 27 03:06:31.029190 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-4"/>
May 27 03:06:31.029190 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:06:31.029190 np0000001475 nova-compute[98471]:   <serial>4806b56c-b6a4-4692-bde6-798799088b1c</serial>
May 27 03:06:31.029190 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:06:31.029190 np0000001475 nova-compute[98471]: </disk>
May 27 03:06:31.029190 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:06:31.086007 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999658162000287 future=<Future at 0x75572461eae0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:31.092346 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Instance destroyed successfully.
May 27 03:06:31.092636 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lazy-loading 'resources' on Instance uuid 70ca77a6-2f29-4558-abf0-07292a6200cd {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:31.260832 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:31.281058 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-0dbe7ea0-59cb-4a98-89fd-36d9a8f43d49 req-0ffa23ee-fb41-4ae0-b408-396e6f094edd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:31.332811 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Successfully updated port: 935fd58f-0c86-41ea-822b-947f831b1657 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:06:31.340508 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:06:31.341718 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:06:31.341922 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Creating image(s)
May 27 03:06:31.343527 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "/opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:31.345145 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "/opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:31.345859 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "/opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:31.346190 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:06:31.352959 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:06:31.355871 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:31.412230 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-482621ca-cf5d-4d69-bc29-a450fc829922 req-847708ea-bd03-4a2e-948f-ef6a80fde2f3 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Received event network-changed-935fd58f-0c86-41ea-822b-947f831b1657 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:31.413430 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-482621ca-cf5d-4d69-bc29-a450fc829922 req-847708ea-bd03-4a2e-948f-ef6a80fde2f3 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Refreshing instance network info cache due to event network-changed-935fd58f-0c86-41ea-822b-947f831b1657. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:06:31.414124 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-482621ca-cf5d-4d69-bc29-a450fc829922 req-847708ea-bd03-4a2e-948f-ef6a80fde2f3 service nova] Acquiring lock "refresh_cache-7af020cf-50ce-441d-b10d-cf57cc280856" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:06:31.415542 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-482621ca-cf5d-4d69-bc29-a450fc829922 req-847708ea-bd03-4a2e-948f-ef6a80fde2f3 service nova] Acquired lock "refresh_cache-7af020cf-50ce-441d-b10d-cf57cc280856" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:06:31.415666 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-482621ca-cf5d-4d69-bc29-a450fc829922 req-847708ea-bd03-4a2e-948f-ef6a80fde2f3 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Refreshing network info cache for port 935fd58f-0c86-41ea-822b-947f831b1657 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:06:31.425602 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:06:31.468450 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.111s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:31.468450 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:31.468450 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:31.468754 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:06:31.474900 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:06:31.476728 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:31.592371 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.116s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:31.592881 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:31.622452 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:04:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-69520248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testinstanceswithcindervolumes-server-69520248',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClzQ8IT5GD8T6/VYM+Nx7JuDUk8vH9bUCBPOLf7nqUJg7LhOE/B+WTxIwvxcX9OVp68/cvV8Zp4uBY0TsjTbqEpHOWdXohePGPurTX8y9H/O0E09ZR2CRZMi5VwD5h1Lw==',key_name='tempest-TestInstancesWithCinderVolumes-1254397776',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:05:01Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0405565349241dd88ac22d535484e65',ramdisk_id='',reservation_id='r-e7ezli28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-TestInstancesWithCinderVolumes-518567810',owner_user_name='tempest-TestInstancesWithCinderVolumes-518567810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:05:01Z,user_data=None,user_id='06881b076ff74d528c49eedf998fac83',uuid=70ca77a6-2f29-4558-abf0-07292a6200cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77f2ecc1-416d-42e8-8279-c8119022bfef", "address": "fa:16:3e:00:0b:7f", "network": {"id": "0d667c62-7603-42bb-94fe-f2a3ac9ae7d5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-544867481-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0405565349241dd88ac22d535484e65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f2ecc1-41", "ovs_interfaceid": "77f2ecc1-416d-42e8-8279-c8119022bfef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:06:31.623074 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Converting VIF {"id": "77f2ecc1-416d-42e8-8279-c8119022bfef", "address": "fa:16:3e:00:0b:7f", "network": {"id": "0d667c62-7603-42bb-94fe-f2a3ac9ae7d5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-544867481-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0405565349241dd88ac22d535484e65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f2ecc1-41", "ovs_interfaceid": "77f2ecc1-416d-42e8-8279-c8119022bfef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:06:31.625512 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:0b:7f,bridge_name='br-int',has_traffic_filtering=True,id=77f2ecc1-416d-42e8-8279-c8119022bfef,network=Network(0d667c62-7603-42bb-94fe-f2a3ac9ae7d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f2ecc1-41') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:06:31.625952 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:0b:7f,bridge_name='br-int',has_traffic_filtering=True,id=77f2ecc1-416d-42e8-8279-c8119022bfef,network=Network(0d667c62-7603-42bb-94fe-f2a3ac9ae7d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f2ecc1-41') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:06:31.629464 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:31.631205 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77f2ecc1-41, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:31.643508 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:31.643508 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:31.644734 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:31.652218 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:31.652464 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04ae03ca-38c2-45e4-b0f6-d72d0a2cbed2) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:31.656084 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:31.657611 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:31.662700 np0000001475 nova-compute[98471]: INFO os_vif [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:0b:7f,bridge_name='br-int',has_traffic_filtering=True,id=77f2ecc1-416d-42e8-8279-c8119022bfef,network=Network(0d667c62-7603-42bb-94fe-f2a3ac9ae7d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f2ecc1-41')
May 27 03:06:31.668528 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:06:31.669102 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:06:31.669356 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:06:31.669951 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:06:31.670344 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:06:31.670542 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:06:31.684669 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856/disk 1073741824" returned: 0 in 0.092s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:31.687172 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:31.687172 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:31.707919 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:31.707919 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:31.707919 np0000001475 nova-compute[98471]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:31.707919 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:31.707919 np0000001475 nova-compute[98471]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:31.707919 np0000001475 nova-compute[98471]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:31.707919 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:31.719449 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsi session list stdout=tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:31.719449 np0000001475 nova-compute[98471]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b (non-flash)
May 27 03:06:31.719449 np0000001475 nova-compute[98471]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:31.719449 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:31.719449 np0000001475 nova-compute[98471]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:31.719449 np0000001475 nova-compute[98471]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:31.719449 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:31.719449 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', '83'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', '97'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', '99')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:06:31.719864 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', '84')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:06:31.727238 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4806b56c-b6a4-4692-bde6-798799088b1c for instance b9047e8c-855e-4623-8659-3c145e1706ba {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:06:31.728805 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851191.7280662, b9047e8c-855e-4623-8659-3c145e1706ba => ua-4806b56c-b6a4-4692-bde6-798799088b1c> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:06:31.732140 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b', '83')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:06:31.732795 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Successfully detached device vdb from instance b9047e8c-855e-4623-8659-3c145e1706ba from the live domain config.
May 27 03:06:31.734155 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c0dc720>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b'): ({'sdb'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:06:31.734620 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Removing multipathed devices sdc, sdb {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:06:31.735071 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Flush multipath device 3300000007c97f2ad {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:06:31.737373 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:06:31.737693 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4806b56c-b6a4-4692-bde6-798799088b1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:06:31.737988 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:06:31.795948 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:06:31.815604 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.129s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:31.815982 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:06:31.816236 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:31.841604 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "refresh_cache-7af020cf-50ce-441d-b10d-cf57cc280856" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:06:31.842925 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:06:31.892665 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:06:31.892926 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:06:31.894662 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:06:31.905510 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-0dbe7ea0-59cb-4a98-89fd-36d9a8f43d49 req-0ffa23ee-fb41-4ae0-b408-396e6f094edd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:31.914796 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:06:31.915541 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:06:31.918957 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-482621ca-cf5d-4d69-bc29-a450fc829922 req-847708ea-bd03-4a2e-948f-ef6a80fde2f3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:31.930232 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:31.936838 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:31.937371 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Cannot resize image /opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:06:31.937829 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:06:31.938081 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Ensure instance console log exists: /opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:06:31.938439 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:31.938661 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:31.938890 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:31.945147 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.542s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:31.968542 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 84, target: iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b, portal: 192.168.40.100,3260]
May 27 03:06:31.968542 np0000001475 nova-compute[98471]: Logout of [sid: 84, target: iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b, portal: 192.168.40.100,3260] successful.
May 27 03:06:31.968542 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:31.992429 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:32.005479 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:32.049470 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Deleted allocations for instance f5d36573-c0e7-43a0-a7cc-66678f093375
May 27 03:06:32.054186 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 83, target: iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b, portal: 192.168.50.100,3260]
May 27 03:06:32.054186 np0000001475 nova-compute[98471]: Logout of [sid: 83, target: iqn.2023-03.storpool.com:os--volume-efa3742d-ee2d-4e4e-9256-2cce7bc6724b, portal: 192.168.50.100,3260] successful.
May 27 03:06:32.054186 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:32.064620 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-482621ca-cf5d-4d69-bc29-a450fc829922 req-847708ea-bd03-4a2e-948f-ef6a80fde2f3 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:06:32.079393 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:32.079393 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:32.079393 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] <== disconnect_volume: return (409ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:06:32.079393 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:06:32.081872 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Deleting instance files /opt/stack/data/nova/instances/70ca77a6-2f29-4558-abf0-07292a6200cd_del
May 27 03:06:32.083608 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.345s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:06:32.083608 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4806b56c-b6a4-4692-bde6-798799088b1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:06:32.083608 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:06:32.086028 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Deletion of /opt/stack/data/nova/instances/70ca77a6-2f29-4558-abf0-07292a6200cd_del complete
May 27 03:06:32.115532 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:32.115532 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:32.115532 np0000001475 nova-compute[98471]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:32.115532 np0000001475 nova-compute[98471]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:32.115532 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:32.115690 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsi session list stdout=tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:32.115690 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:32.115690 np0000001475 nova-compute[98471]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:32.115690 np0000001475 nova-compute[98471]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c (non-flash)
May 27 03:06:32.115690 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:32.115880 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', '97'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', '99')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:06:32.116002 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', '98')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:06:32.116966 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c', '99')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:06:32.117409 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c4dbce0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c'): ({'sdg'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:06:32.117584 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Removing multipathed devices sdf, sdg {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:06:32.117833 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Flush multipath device 330000000d3e5f4d9 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:06:32.149760 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:06:32.177146 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-0dbe7ea0-59cb-4a98-89fd-36d9a8f43d49 req-0ffa23ee-fb41-4ae0-b408-396e6f094edd service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Updated VIF entry in instance network info cache for port 77f2ecc1-416d-42e8-8279-c8119022bfef. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:06:32.178403 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-0dbe7ea0-59cb-4a98-89fd-36d9a8f43d49 req-0ffa23ee-fb41-4ae0-b408-396e6f094edd service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Updating instance_info_cache with network_info: [{"id": "77f2ecc1-416d-42e8-8279-c8119022bfef", "address": "fa:16:3e:00:0b:7f", "network": {"id": "0d667c62-7603-42bb-94fe-f2a3ac9ae7d5", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-544867481-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c0405565349241dd88ac22d535484e65", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f2ecc1-41", "ovs_interfaceid": "77f2ecc1-416d-42e8-8279-c8119022bfef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:32.190583 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:06:32.260152 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:06:32.261084 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:06:32.261884 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:06:32.279847 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:06:32.279847 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:06:32.284280 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:32.295025 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:32.316431 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-482621ca-cf5d-4d69-bc29-a450fc829922 req-847708ea-bd03-4a2e-948f-ef6a80fde2f3 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:32.332421 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 98, target: iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c, portal: 192.168.40.100,3260]
May 27 03:06:32.332421 np0000001475 nova-compute[98471]: Logout of [sid: 98, target: iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c, portal: 192.168.40.100,3260] successful.
May 27 03:06:32.332421 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:32.349490 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:32.370604 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:32.405872 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 99, target: iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c, portal: 192.168.50.100,3260]
May 27 03:06:32.405872 np0000001475 nova-compute[98471]: Logout of [sid: 99, target: iqn.2023-03.storpool.com:os--volume-4806b56c-b6a4-4692-bde6-798799088b1c, portal: 192.168.50.100,3260] successful.
May 27 03:06:32.405872 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:32.419945 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:32.420567 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:32.420728 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] <== disconnect_volume: return (683ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:06:32.420908 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:06:32.600435 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Took 1.86 seconds to destroy the instance on the hypervisor.
May 27 03:06:32.602306 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:06:32.602445 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:06:32.602531 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:06:32.602795 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:32.683183 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0dbe7ea0-59cb-4a98-89fd-36d9a8f43d49 req-0ffa23ee-fb41-4ae0-b408-396e6f094edd service nova] Releasing lock "refresh_cache-70ca77a6-2f29-4558-abf0-07292a6200cd" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:06:32.699237 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:32.759325 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:32.759571 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:32.819487 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-482621ca-cf5d-4d69-bc29-a450fc829922 req-847708ea-bd03-4a2e-948f-ef6a80fde2f3 service nova] Releasing lock "refresh_cache-7af020cf-50ce-441d-b10d-cf57cc280856" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:06:32.820756 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquired lock "refresh_cache-7af020cf-50ce-441d-b10d-cf57cc280856" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:06:32.820901 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:06:32.871204 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:33.012825 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lazy-loading 'flavor' on Instance uuid b9047e8c-855e-4623-8659-3c145e1706ba {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:33.064583 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d1e02a33-2f7f-48ca-a4e7-9b61d3a38465 tempest-AttachVolumeMultiAttachTest-774919822 tempest-AttachVolumeMultiAttachTest-774919822-project-member] Lock "f5d36573-c0e7-43a0-a7cc-66678f093375" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.454s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:33.077234 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4aee931c-5173-472d-bb78-f19ee23b6c4d req-654943c7-4078-4dca-bf22-179a6d661c1b service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Received event network-vif-deleted-77f2ecc1-416d-42e8-8279-c8119022bfef {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:33.077393 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-4aee931c-5173-472d-bb78-f19ee23b6c4d req-654943c7-4078-4dca-bf22-179a6d661c1b service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Neutron deleted interface 77f2ecc1-416d-42e8-8279-c8119022bfef; detaching it from the instance and deleting it from the info cache
May 27 03:06:33.078804 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4aee931c-5173-472d-bb78-f19ee23b6c4d req-654943c7-4078-4dca-bf22-179a6d661c1b service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:33.263424 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Detaching volume a22033c7-7374-4c65-9764-35848d02c5a3
May 27 03:06:33.316464 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Attempting to driver detach volume a22033c7-7374-4c65-9764-35848d02c5a3 from mountpoint /dev/vdb
May 27 03:06:33.321254 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Found disk vdb by alias ua-a22033c7-7374-4c65-9764-35848d02c5a3 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:06:33.322418 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Found disk vdb by alias ua-a22033c7-7374-4c65-9764-35848d02c5a3 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:06:33.322528 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Attempting to detach device vdb from instance a3cd35f5-3cbb-41fb-802e-22931d1089bd from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:06:33.322829 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:06:33.322829 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:06:33.322829 np0000001475 nova-compute[98471]:   <alias name="ua-a22033c7-7374-4c65-9764-35848d02c5a3"/>
May 27 03:06:33.322829 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:06:33.322829 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:06:33.322829 np0000001475 nova-compute[98471]:   <serial>a22033c7-7374-4c65-9764-35848d02c5a3</serial>
May 27 03:06:33.322829 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:06:33.322829 np0000001475 nova-compute[98471]: </disk>
May 27 03:06:33.322829 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:06:33.333833 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Successfully detached device vdb from instance a3cd35f5-3cbb-41fb-802e-22931d1089bd from the persistent domain config.
May 27 03:06:33.333972 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] (1/8): Attempting to detach device vdb with device alias ua-a22033c7-7374-4c65-9764-35848d02c5a3 from instance a3cd35f5-3cbb-41fb-802e-22931d1089bd from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:06:33.334306 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:06:33.334306 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:06:33.334306 np0000001475 nova-compute[98471]:   <alias name="ua-a22033c7-7374-4c65-9764-35848d02c5a3"/>
May 27 03:06:33.334306 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:06:33.334306 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:06:33.334306 np0000001475 nova-compute[98471]:   <serial>a22033c7-7374-4c65-9764-35848d02c5a3</serial>
May 27 03:06:33.334306 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:06:33.334306 np0000001475 nova-compute[98471]: </disk>
May 27 03:06:33.334306 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:06:33.403544 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:06:33.467244 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0004630029998224927 future=<Future at 0x7557047391c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:33.467423 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:33.467489 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=8.006498112999907 future=<Future at 0x7557247c4a70 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:33.467656 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=8.006382006999957 future=<Future at 0x7557247c4a70 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:33.468140 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] Emitting event <LifecycleEvent: 1779851178.4666452, 71af628e-b06d-446d-8c2e-dcfbb232df33 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:33.468300 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] VM Stopped (Lifecycle Event)
May 27 03:06:33.517494 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:33.584871 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4aee931c-5173-472d-bb78-f19ee23b6c4d req-654943c7-4078-4dca-bf22-179a6d661c1b service nova] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Detach interface failed, port_id=77f2ecc1-416d-42e8-8279-c8119022bfef, reason: Instance 70ca77a6-2f29-4558-abf0-07292a6200cd could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:06:33.604913 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:33.829873 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Updating instance_info_cache with network_info: [{"id": "935fd58f-0c86-41ea-822b-947f831b1657", "address": "fa:16:3e:bc:d0:56", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap935fd58f-0c", "ovs_interfaceid": "935fd58f-0c86-41ea-822b-947f831b1657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:33.906906 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851193.9064014, a3cd35f5-3cbb-41fb-802e-22931d1089bd => ua-a22033c7-7374-4c65-9764-35848d02c5a3> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:06:33.907396 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a22033c7-7374-4c65-9764-35848d02c5a3 for instance a3cd35f5-3cbb-41fb-802e-22931d1089bd {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:06:33.909875 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Successfully detached device vdb from instance a3cd35f5-3cbb-41fb-802e-22931d1089bd from the live domain config.
May 27 03:06:33.911172 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:06:33.911465 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a22033c7-7374-4c65-9764-35848d02c5a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:06:33.911621 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:06:33.912117 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:06:33.912372 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a22033c7-7374-4c65-9764-35848d02c5a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:06:33.912537 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:06:33.939031 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:33.939031 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:33.939031 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:33.939240 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsi session list stdout=tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:33.939240 np0000001475 nova-compute[98471]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3 (non-flash)
May 27 03:06:33.939240 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:33.939307 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', '97')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:06:33.939383 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', '97')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:06:33.940092 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', '96')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:06:33.940651 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7557246463e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3'): ({'sdh'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:06:33.940856 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Removing multipathed devices sdi, sdh {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:06:33.941194 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Flush multipath device 330000000558aa775 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:06:33.971203 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-224481e7-1e7f-4aad-b754-76fff13f980b tempest-VolumesExtendAttachedTest-1858923834 tempest-VolumesExtendAttachedTest-1858923834-project-member] [instance: 71af628e-b06d-446d-8c2e-dcfbb232df33] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:33.992594 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:06:34.021876 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Took 1.42 seconds to deallocate network for instance.
May 27 03:06:34.026094 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4d1f0431-0b88-4aeb-b7e8-c5e6b0ec7ae2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "b9047e8c-855e-4623-8659-3c145e1706ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.595s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:34.050508 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:06:34.101134 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:06:34.101134 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:06:34.101134 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:06:34.116600 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:06:34.116600 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:06:34.127857 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:34.159112 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 97, target: iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3, portal: 192.168.40.100,3260]
May 27 03:06:34.159112 np0000001475 nova-compute[98471]: Logout of [sid: 97, target: iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3, portal: 192.168.40.100,3260] successful.
May 27 03:06:34.159112 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:34.178668 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:34.193142 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:34.232712 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 96, target: iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3, portal: 192.168.50.100,3260]
May 27 03:06:34.232712 np0000001475 nova-compute[98471]: Logout of [sid: 96, target: iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3, portal: 192.168.50.100,3260] successful.
May 27 03:06:34.232712 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:34.248885 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:34.248885 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:34.248885 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] <== disconnect_volume: return (335ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:06:34.248885 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:06:34.332607 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Releasing lock "refresh_cache-7af020cf-50ce-441d-b10d-cf57cc280856" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:06:34.332607 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Instance network_info: |[{"id": "935fd58f-0c86-41ea-822b-947f831b1657", "address": "fa:16:3e:bc:d0:56", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap935fd58f-0c", "ovs_interfaceid": "935fd58f-0c86-41ea-822b-947f831b1657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:06:34.334862 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Start _get_guest_xml network_info=[{"id": "935fd58f-0c86-41ea-822b-947f831b1657", "address": "fa:16:3e:bc:d0:56", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap935fd58f-0c", "ovs_interfaceid": "935fd58f-0c86-41ea-822b-947f831b1657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:06:34.338293 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:06:34.340046 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-675450899', uuid='7af020cf-50ce-441d-b10d-cf57cc280856'), owner=OwnerMeta(userid='358594214f7a4c71a13200be75c799cc', username='tempest-TestEncryptedCinderVolumes-913342494-project-member', projectid='0810d45b82c0476db38b1cabf8579ae1', projectname='tempest-TestEncryptedCinderVolumes-913342494'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "935fd58f-0c86-41ea-822b-947f831b1657", "address": "fa:16:3e:bc:d0:56", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap935fd58f-0c", "ovs_interfaceid": "935fd58f-0c86-41ea-822b-947f831b1657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851194.3395333) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:06:34.341495 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:06:34.341857 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:06:34.351837 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:06:34.352120 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:06:34.353301 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:06:34.353786 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:06:34.353980 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:06:34.354513 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:06:34.354513 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:06:34.354513 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:06:34.354706 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:06:34.354755 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:06:34.354936 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:06:34.355084 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:06:34.355192 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:06:34.355312 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:06:34.368858 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-675450899',display_name='tempest-TestEncryptedCinderVolumes-server-675450899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testencryptedcindervolumes-server-675450899',id=47,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFTNwmbeDObG2hZFrXfqVJFFklhf2PZrXPyr+xaxXz+TBaUmPCBy0Deqlur1boI0JCno8yfmeEuJSiBFFQNVLZkmTsEMl0W1SvcPO7gFA06wNzTYklpDeAQclJO5c5OBA==',key_name='tempest-keypair-439334451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0810d45b82c0476db38b1cabf8579ae1',ramdisk_id='',reservation_id='r-4zlpx81p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-913342494',owner_user_name='tempest-TestEncryptedCinderVolumes-913342494-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:06:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='358594214f7a4c71a13200be75c799cc',uuid=7af020cf-50ce-441d-b10d-cf57cc280856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "935fd58f-0c86-41ea-822b-947f831b1657", "address": "fa:16:3e:bc:d0:56", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap935fd58f-0c", "ovs_interfaceid": "935fd58f-0c86-41ea-822b-947f831b1657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:06:34.369076 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Converting VIF {"id": "935fd58f-0c86-41ea-822b-947f831b1657", "address": "fa:16:3e:bc:d0:56", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap935fd58f-0c", "ovs_interfaceid": "935fd58f-0c86-41ea-822b-947f831b1657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:06:34.369808 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d0:56,bridge_name='br-int',has_traffic_filtering=True,id=935fd58f-0c86-41ea-822b-947f831b1657,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935fd58f-0c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:06:34.370861 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lazy-loading 'pci_devices' on Instance uuid 7af020cf-50ce-441d-b10d-cf57cc280856 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:34.582281 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Took 0.56 seconds to detach 1 volumes for instance.
May 27 03:06:34.823257 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lazy-loading 'flavor' on Instance uuid a3cd35f5-3cbb-41fb-802e-22931d1089bd {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:34.866288 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "b9047e8c-855e-4623-8659-3c145e1706ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:34.866653 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "b9047e8c-855e-4623-8659-3c145e1706ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:34.866999 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "b9047e8c-855e-4623-8659-3c145e1706ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:34.867230 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "b9047e8c-855e-4623-8659-3c145e1706ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:34.867440 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "b9047e8c-855e-4623-8659-3c145e1706ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:34.870224 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Terminating instance
May 27 03:06:34.874337 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] End _get_guest_xml xml=<domain type="qemu">
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:   <uuid>7af020cf-50ce-441d-b10d-cf57cc280856</uuid>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:   <name>instance-0000002f</name>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-675450899</nova:name>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:06:34</nova:creationTime>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:         <nova:user uuid="358594214f7a4c71a13200be75c799cc">tempest-TestEncryptedCinderVolumes-913342494-project-member</nova:user>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:         <nova:project uuid="0810d45b82c0476db38b1cabf8579ae1">tempest-TestEncryptedCinderVolumes-913342494</nova:project>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:         <nova:port uuid="935fd58f-0c86-41ea-822b-947f831b1657">
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     <system>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <entry name="serial">7af020cf-50ce-441d-b10d-cf57cc280856</entry>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <entry name="uuid">7af020cf-50ce-441d-b10d-cf57cc280856</entry>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     </system>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:   <os>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:   </os>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:   <features>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:   </features>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:   <devices>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856/disk"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     </disk>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856/disk.config"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     </disk>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:bc:d0:56"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <target dev="tap935fd58f-0c"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     </interface>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856/console.log" append="off"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     </serial>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     <video>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     </video>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     </rng>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:   </devices>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]: </domain>
May 27 03:06:34.874337 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:06:34.876838 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Preparing to wait for external event network-vif-plugged-935fd58f-0c86-41ea-822b-947f831b1657 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:06:34.876838 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "7af020cf-50ce-441d-b10d-cf57cc280856-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:34.876838 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "7af020cf-50ce-441d-b10d-cf57cc280856-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:34.876838 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "7af020cf-50ce-441d-b10d-cf57cc280856-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:34.876838 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-675450899',display_name='tempest-TestEncryptedCinderVolumes-server-675450899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testencryptedcindervolumes-server-675450899',id=47,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFTNwmbeDObG2hZFrXfqVJFFklhf2PZrXPyr+xaxXz+TBaUmPCBy0Deqlur1boI0JCno8yfmeEuJSiBFFQNVLZkmTsEMl0W1SvcPO7gFA06wNzTYklpDeAQclJO5c5OBA==',key_name='tempest-keypair-439334451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0810d45b82c0476db38b1cabf8579ae1',ramdisk_id='',reservation_id='r-4zlpx81p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-913342494',owner_user_name='tempest-TestEncryptedCinderVolumes-913342494-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:06:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='358594214f7a4c71a13200be75c799cc',uuid=7af020cf-50ce-441d-b10d-cf57cc280856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "935fd58f-0c86-41ea-822b-947f831b1657", "address": "fa:16:3e:bc:d0:56", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap935fd58f-0c", "ovs_interfaceid": "935fd58f-0c86-41ea-822b-947f831b1657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:06:34.876838 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Converting VIF {"id": "935fd58f-0c86-41ea-822b-947f831b1657", "address": "fa:16:3e:bc:d0:56", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap935fd58f-0c", "ovs_interfaceid": "935fd58f-0c86-41ea-822b-947f831b1657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:06:34.877222 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d0:56,bridge_name='br-int',has_traffic_filtering=True,id=935fd58f-0c86-41ea-822b-947f831b1657,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935fd58f-0c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:06:34.878499 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d0:56,bridge_name='br-int',has_traffic_filtering=True,id=935fd58f-0c86-41ea-822b-947f831b1657,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935fd58f-0c') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:06:34.880174 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:34.880400 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:34.880631 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:06:34.881484 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:34.881636 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bec4b5b9-be48-5b97-9bd8-0ee6e4151f25', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:34.882619 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:34.883234 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:34.884263 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:34.887864 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:34.888087 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap935fd58f-0c, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:34.888576 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap935fd58f-0c, col_values=(('qos', UUID('769a76da-213e-4a82-8e5f-453e0db72e29')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:34.888576 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap935fd58f-0c, col_values=(('external_ids', {'iface-id': '935fd58f-0c86-41ea-822b-947f831b1657', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:d0:56', 'vm-uuid': '7af020cf-50ce-441d-b10d-cf57cc280856'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:34.891808 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:34.900371 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:34.901174 np0000001475 nova-compute[98471]: INFO os_vif [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d0:56,bridge_name='br-int',has_traffic_filtering=True,id=935fd58f-0c86-41ea-822b-947f831b1657,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935fd58f-0c')
May 27 03:06:35.089674 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:35.090106 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:35.380085 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:06:35.411398 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:35.416976 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:35.447933 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:35.486767 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:35.556699 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:06:35.557020 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:06:35.745968 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999714568999934 future=<Future at 0x75572477d550 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:35.748350 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Instance destroyed successfully.
May 27 03:06:35.749203 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lazy-loading 'resources' on Instance uuid b9047e8c-855e-4623-8659-3c145e1706ba {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:35.830448 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a2d9d217-3a41-4652-b4c3-a4bdbcf2db21 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.071s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:35.834927 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.960s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:35.836222 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:35.836222 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:35.836222 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:35.838281 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Terminating instance
May 27 03:06:35.856821 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:36.060728 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:06:36.254306 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:05:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1228693741',display_name='tempest-AttachVolumeNegativeTest-server-1228693741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumenegativetest-server-1228693741',id=44,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMC3BwOfYRgidjTcfEpPSCBDsOBjQeOl86QoTrFjnPb/1WjtkzweasHWkmC89B7QzyDs7OG7EEYXH55L96MyfXVu2NleGH9u76DNcNy4Xv+qPtVrgczGcVGrTZLK8D4L4A==',key_name='tempest-keypair-1451786771',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:05:40Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f1801e95925498cac899f1414f2b202',ramdisk_id='',reservation_id='r-r4en49wr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1854580419',owner_user_name='tempest-AttachVolumeNegativeTest-1854580419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:05:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca42144366ef44eb81e5c4a23624d281',uuid=b9047e8c-855e-4623-8659-3c145e1706ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "address": "fa:16:3e:21:ba:30", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01d57c3b-32", "ovs_interfaceid": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:06:36.254907 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converting VIF {"id": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "address": "fa:16:3e:21:ba:30", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap01d57c3b-32", "ovs_interfaceid": "01d57c3b-325e-43f9-9d7e-f0d3e24b75a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:06:36.255361 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:ba:30,bridge_name='br-int',has_traffic_filtering=True,id=01d57c3b-325e-43f9-9d7e-f0d3e24b75a1,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01d57c3b-32') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:06:36.255670 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:ba:30,bridge_name='br-int',has_traffic_filtering=True,id=01d57c3b-325e-43f9-9d7e-f0d3e24b75a1,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01d57c3b-32') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:06:36.257628 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:36.257938 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01d57c3b-32, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:36.259081 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:36.259993 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:36.265965 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:36.269208 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:36.269380 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d296ceba-5f2a-4e9a-9137-d28ed280be40) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:36.269933 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:36.271059 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:36.276980 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:36.278642 np0000001475 nova-compute[98471]: INFO os_vif [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:ba:30,bridge_name='br-int',has_traffic_filtering=True,id=01d57c3b-325e-43f9-9d7e-f0d3e24b75a1,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01d57c3b-32')
May 27 03:06:36.278979 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Deleting instance files /opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba_del
May 27 03:06:36.279710 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Deletion of /opt/stack/data/nova/instances/b9047e8c-855e-4623-8659-3c145e1706ba_del complete
May 27 03:06:36.342921 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:06:36.376343 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:36.380027 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:36.407962 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:36.410990 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:36.431056 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:06:36.431253 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:06:36.431410 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] No VIF found with MAC fa:16:3e:bc:d0:56, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:06:36.432079 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Using config drive
May 27 03:06:36.435793 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:36.448554 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:36.570100 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.480s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:36.657758 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Deleted allocations for instance 70ca77a6-2f29-4558-abf0-07292a6200cd
May 27 03:06:36.703420 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999678841999867 future=<Future at 0x75570479a750 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:36.705088 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Instance destroyed successfully.
May 27 03:06:36.705410 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lazy-loading 'resources' on Instance uuid a3cd35f5-3cbb-41fb-802e-22931d1089bd {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:36.787159 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Took 1.41 seconds to destroy the instance on the hypervisor.
May 27 03:06:36.788003 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:06:36.788311 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:06:36.788418 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:06:36.788654 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:36.872840 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:36.946177 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:37.142576 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:37.143914 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:37.178366 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Creating config drive at /opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856/disk.config
May 27 03:06:37.186928 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgu_72068 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:37.214312 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-110972352',display_name='tempest-VolumesSnapshotTestJSON-instance-110972352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumessnapshottestjson-instance-110972352',id=43,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNVJMYGTBNptxAkOWaVBNhPxgswjyBFHTc92D1l8+AqAnzLCEaJ5By/rNxyWhhOUuvDSAq5nOybbm58malgExGrveZhp+f0uLH+ctNvTjWH97OPvko9Ik4qRezyfncrvg==',key_name='tempest-keypair-158001254',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:05:36Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d79b15ea2254cd7adc804ece7e7cfae',ramdisk_id='',reservation_id='r-0sloqlwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-189213940',owner_user_name='tempest-VolumesSnapshotTestJSON-189213940-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:05:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ba707c9283c45989ff891306f972873',uuid=a3cd35f5-3cbb-41fb-802e-22931d1089bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "address": "fa:16:3e:bb:5a:83", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0c44e7-f8", "ovs_interfaceid": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:06:37.215542 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Converting VIF {"id": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "address": "fa:16:3e:bb:5a:83", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0c44e7-f8", "ovs_interfaceid": "8b0c44e7-f8e9-407f-b08c-e71f03b4ea30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:06:37.217456 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:5a:83,bridge_name='br-int',has_traffic_filtering=True,id=8b0c44e7-f8e9-407f-b08c-e71f03b4ea30,network=Network(3c97181e-8aba-4ea6-ac09-fed09f0812ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b0c44e7-f8') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:06:37.217945 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:5a:83,bridge_name='br-int',has_traffic_filtering=True,id=8b0c44e7-f8e9-407f-b08c-e71f03b4ea30,network=Network(3c97181e-8aba-4ea6-ac09-fed09f0812ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b0c44e7-f8') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:06:37.220640 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:37.221172 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b0c44e7-f8, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:37.222631 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:37.223715 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:37.229624 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:37.230898 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:37.231120 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d0977df-c416-4d1b-8cf2-23f592715e81) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:37.231878 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:37.232615 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:37.238416 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:37.241286 np0000001475 nova-compute[98471]: INFO os_vif [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:5a:83,bridge_name='br-int',has_traffic_filtering=True,id=8b0c44e7-f8e9-407f-b08c-e71f03b4ea30,network=Network(3c97181e-8aba-4ea6-ac09-fed09f0812ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b0c44e7-f8')
May 27 03:06:37.245377 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:06:37.246053 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a22033c7-7374-4c65-9764-35848d02c5a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:06:37.246323 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:06:37.246995 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:06:37.247500 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a22033c7-7374-4c65-9764-35848d02c5a3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:06:37.247976 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:06:37.253370 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgu_72068" returned: 0 in 0.066s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:37.262141 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
May 27 03:06:37.262141 np0000001475 nova-compute[98471]: 
May 27 03:06:37.274281 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 03:06:37.274281 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:37.274449 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 03:06:37.274449 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:37.274590 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 03:06:37.274590 np0000001475 nova-compute[98471]: 
May 27 03:06:37.274685 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Sessions list: [] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:06:37.274929 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3, 0): [] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:06:37.275079 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3') {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 03:06:37.275189 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3, 0): [] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:06:37.275293 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a22033c7-7374-4c65-9764-35848d02c5a3') {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 03:06:37.275430 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7557046e3420>, {}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:06:37.275605 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Disconnecting from: [] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:06:37.275837 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.029s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:37.275959 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] <== disconnect_volume: return (29ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:06:37.276085 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:06:37.276388 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Deleting instance files /opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd_del
May 27 03:06:37.277176 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Deletion of /opt/stack/data/nova/instances/a3cd35f5-3cbb-41fb-802e-22931d1089bd_del complete
May 27 03:06:37.607014 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-eb0ef8de-3fbf-4690-8aa9-951015c20ce7 req-b97d665e-796b-4641-a8fa-1e663aa0c762 service nova] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Received event network-vif-deleted-01d57c3b-325e-43f9-9d7e-f0d3e24b75a1 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:37.608676 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-eb0ef8de-3fbf-4690-8aa9-951015c20ce7 req-b97d665e-796b-4641-a8fa-1e663aa0c762 service nova] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Neutron deleted interface 01d57c3b-325e-43f9-9d7e-f0d3e24b75a1; detaching it from the instance and deleting it from the info cache
May 27 03:06:37.609080 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-eb0ef8de-3fbf-4690-8aa9-951015c20ce7 req-b97d665e-796b-4641-a8fa-1e663aa0c762 service nova] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:37.647896 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:06:37.690585 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-37d3271e-ddd3-4da6-a0ef-4405f01036f0 tempest-TestInstancesWithCinderVolumes-518567810 tempest-TestInstancesWithCinderVolumes-518567810-project-member] Lock "70ca77a6-2f29-4558-abf0-07292a6200cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.467s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:37.791078 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Took 1.45 seconds to destroy the instance on the hypervisor.
May 27 03:06:37.792877 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:06:37.793283 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:06:37.793472 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:06:37.793856 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:37.814205 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:37.843706 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:37.846016 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:37.910567 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:37.941390 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:38.050992 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:38.114819 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-eb0ef8de-3fbf-4690-8aa9-951015c20ce7 req-b97d665e-796b-4641-a8fa-1e663aa0c762 service nova] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Detach interface failed, port_id=01d57c3b-325e-43f9-9d7e-f0d3e24b75a1, reason: Instance b9047e8c-855e-4623-8659-3c145e1706ba could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:06:38.141190 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-cad8de03-b119-45d3-8a10-0e2c108734af req-34cf9989-f7a5-4f0f-af15-ce36dd82bf47 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Received event network-vif-plugged-935fd58f-0c86-41ea-822b-947f831b1657 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:38.141679 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cad8de03-b119-45d3-8a10-0e2c108734af req-34cf9989-f7a5-4f0f-af15-ce36dd82bf47 service nova] Acquiring lock "7af020cf-50ce-441d-b10d-cf57cc280856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:38.141933 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cad8de03-b119-45d3-8a10-0e2c108734af req-34cf9989-f7a5-4f0f-af15-ce36dd82bf47 service nova] Lock "7af020cf-50ce-441d-b10d-cf57cc280856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:38.142191 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cad8de03-b119-45d3-8a10-0e2c108734af req-34cf9989-f7a5-4f0f-af15-ce36dd82bf47 service nova] Lock "7af020cf-50ce-441d-b10d-cf57cc280856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:38.142443 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-cad8de03-b119-45d3-8a10-0e2c108734af req-34cf9989-f7a5-4f0f-af15-ce36dd82bf47 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Processing event network-vif-plugged-935fd58f-0c86-41ea-822b-947f831b1657 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:06:38.217603 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:38.223826 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:38.223826 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:38.223826 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:38.227345 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:38.234128 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:06:38.234128 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Claim successful on node np0000001475
May 27 03:06:38.261922 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:38.552898 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Took 1.76 seconds to deallocate network for instance.
May 27 03:06:38.643025 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-11c1f64e-56f4-40a5-ab5d-c5cafab6e4d6 req-2188b8b1-a997-4e81-9f8c-dc721b4ba818 service nova] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Received event network-vif-deleted-8b0c44e7-f8e9-407f-b08c-e71f03b4ea30 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:38.643228 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-11c1f64e-56f4-40a5-ab5d-c5cafab6e4d6 req-2188b8b1-a997-4e81-9f8c-dc721b4ba818 service nova] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Neutron deleted interface 8b0c44e7-f8e9-407f-b08c-e71f03b4ea30; detaching it from the instance and deleting it from the info cache
May 27 03:06:38.643500 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-11c1f64e-56f4-40a5-ab5d-c5cafab6e4d6 req-2188b8b1-a997-4e81-9f8c-dc721b4ba818 service nova] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:38.829959 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851198.8282516, 7af020cf-50ce-441d-b10d-cf57cc280856 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:38.829959 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] VM Started (Lifecycle Event)
May 27 03:06:38.830458 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:06:38.836397 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:06:38.839771 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Instance spawned successfully.
May 27 03:06:38.839976 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:06:39.071626 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:39.088268 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:39.150352 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-11c1f64e-56f4-40a5-ab5d-c5cafab6e4d6 req-2188b8b1-a997-4e81-9f8c-dc721b4ba818 service nova] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Detach interface failed, port_id=8b0c44e7-f8e9-407f-b08c-e71f03b4ea30, reason: Instance a3cd35f5-3cbb-41fb-802e-22931d1089bd could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:06:39.333035 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:39.342769 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:06:39.355629 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:39.355828 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:39.356148 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:39.356393 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:39.356732 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:39.357125 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:39.591665 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Took 1.80 seconds to deallocate network for instance.
May 27 03:06:39.622430 np0000001475 nova-compute[98471]: WARNING nova.volume.cinder [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Attachment cd117655-393d-40ef-93ed-e98d9ab413c4 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = cd117655-393d-40ef-93ed-e98d9ab413c4. (HTTP 404) (Request-ID: req-acbe75f7-5acb-483a-a030-fb7c8392d5ea)
May 27 03:06:39.622724 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Took 0.03 seconds to detach 1 volumes for instance.
May 27 03:06:39.682416 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:06:39.682664 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:06:39.850370 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:06:39.850370 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851199.8492434, 7af020cf-50ce-441d-b10d-cf57cc280856 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:39.850370 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] VM Paused (Lifecycle Event)
May 27 03:06:39.869656 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Took 8.53 seconds to spawn the instance on the hypervisor.
May 27 03:06:39.869897 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:40.128939 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:40.187175 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:06:40.257576 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-89a58f43-1586-4e35-8e18-76e8e677bc95 req-617f629b-ccf1-404a-8ead-ab1f8d1d0c92 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Received event network-vif-plugged-935fd58f-0c86-41ea-822b-947f831b1657 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:40.258290 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-89a58f43-1586-4e35-8e18-76e8e677bc95 req-617f629b-ccf1-404a-8ead-ab1f8d1d0c92 service nova] Acquiring lock "7af020cf-50ce-441d-b10d-cf57cc280856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:40.258290 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-89a58f43-1586-4e35-8e18-76e8e677bc95 req-617f629b-ccf1-404a-8ead-ab1f8d1d0c92 service nova] Lock "7af020cf-50ce-441d-b10d-cf57cc280856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:40.258416 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-89a58f43-1586-4e35-8e18-76e8e677bc95 req-617f629b-ccf1-404a-8ead-ab1f8d1d0c92 service nova] Lock "7af020cf-50ce-441d-b10d-cf57cc280856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:40.258517 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-89a58f43-1586-4e35-8e18-76e8e677bc95 req-617f629b-ccf1-404a-8ead-ab1f8d1d0c92 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] No waiting events found dispatching network-vif-plugged-935fd58f-0c86-41ea-822b-947f831b1657 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:06:40.258701 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-89a58f43-1586-4e35-8e18-76e8e677bc95 req-617f629b-ccf1-404a-8ead-ab1f8d1d0c92 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Received unexpected event network-vif-plugged-935fd58f-0c86-41ea-822b-947f831b1657 for instance with vm_state active and task_state None.
May 27 03:06:40.354766 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:40.357496 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851200.3568232, 7af020cf-50ce-441d-b10d-cf57cc280856 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:40.357496 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] VM Resumed (Lifecycle Event)
May 27 03:06:40.380483 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Took 14.16 seconds to build instance.
May 27 03:06:40.692637 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.471s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:40.693330 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.621s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:40.693563 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:06:40.861323 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:40.865874 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:06:40.881583 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-87ab83d9-93e7-416a-a56d-309437f3abe6 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "7af020cf-50ce-441d-b10d-cf57cc280856" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.671s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:41.115042 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:06:41.115332 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:06:41.200266 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:06:41.200462 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:06:41.200753 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:41.200990 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:41.269030 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:41.293469 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32837382cff144e5b70de0a400386d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc9c3d1d60841349d551f2d9874c730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:06:41.453393 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:41.474502 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.00047532600001432 future=<Future at 0x7557247c4a70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:41.474653 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:41.474842 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=4.6108175560002564 future=<Future at 0x75572461eae0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:41.475474 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=4.610319278000134 future=<Future at 0x75572461eae0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:41.476069 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Emitting event <LifecycleEvent: 1779851186.473917, f5d36573-c0e7-43a0-a7cc-66678f093375 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:41.476069 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] VM Stopped (Lifecycle Event)
May 27 03:06:41.619376 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:06:41.707168 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:06:41.981389 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c08e99cb-cb0f-42d0-861f-4ac7ed3314d6 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: f5d36573-c0e7-43a0-a7cc-66678f093375] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:42.130768 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Successfully created port: dd1d7aa2-c15c-43ce-a89e-db2233286368 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:06:42.136407 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.443s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:42.141651 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.013s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:42.150358 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3517d2ee-3d4a-4857-a23b-2f0c29c828d3 req-d97370df-d46c-41ec-badc-8e55ea535174 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Received event network-changed-935fd58f-0c86-41ea-822b-947f831b1657 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:42.150504 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3517d2ee-3d4a-4857-a23b-2f0c29c828d3 req-d97370df-d46c-41ec-badc-8e55ea535174 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Refreshing instance network info cache due to event network-changed-935fd58f-0c86-41ea-822b-947f831b1657. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:06:42.150688 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3517d2ee-3d4a-4857-a23b-2f0c29c828d3 req-d97370df-d46c-41ec-badc-8e55ea535174 service nova] Acquiring lock "refresh_cache-7af020cf-50ce-441d-b10d-cf57cc280856" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:06:42.150831 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3517d2ee-3d4a-4857-a23b-2f0c29c828d3 req-d97370df-d46c-41ec-badc-8e55ea535174 service nova] Acquired lock "refresh_cache-7af020cf-50ce-441d-b10d-cf57cc280856" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:06:42.150961 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-3517d2ee-3d4a-4857-a23b-2f0c29c828d3 req-d97370df-d46c-41ec-badc-8e55ea535174 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Refreshing network info cache for port 935fd58f-0c86-41ea-822b-947f831b1657 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:06:42.209875 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:06:42.233621 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:42.257879 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Deleted allocations for instance b9047e8c-855e-4623-8659-3c145e1706ba
May 27 03:06:42.617218 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:06:42.617526 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:06:42.657417 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-3517d2ee-3d4a-4857-a23b-2f0c29c828d3 req-d97370df-d46c-41ec-badc-8e55ea535174 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:42.714549 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Booting with volume 01f99269-975a-45fc-9a11-98dcfb62ab61 at /dev/vda
May 27 03:06:42.778679 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:06:42.791130 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:06:42.821178 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:42.880955 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:06:42.881495 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:06:42.893723 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Successfully updated port: dd1d7aa2-c15c-43ce-a89e-db2233286368 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:06:42.896893 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:06:42.898514 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fead:d206', 'fe80::8cdc:9fff:fe79:9907', 'fe80::fc16:3eff:fe3e:7b2f', 'fe80::bc95:85ff:fe5a:dff6', 'fe80::fc16:3eff:febc:d056', 'fe80::b80a:ccff:fec0:b891'] 
May 27 03:06:42.898711 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:06:42.898912 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:06:42.899244 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:06:42.899447 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Updating existing volume attachment record: cea07f15-cbb2-4e81-b4ef-b0a13650f57e {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:06:42.962454 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a548188d-593f-4a19-902e-93ee4db45a70 req-50defd63-eed3-451d-9598-5e00d95f20de service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Received event network-changed-dd1d7aa2-c15c-43ce-a89e-db2233286368 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:42.962658 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a548188d-593f-4a19-902e-93ee4db45a70 req-50defd63-eed3-451d-9598-5e00d95f20de service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Refreshing instance network info cache due to event network-changed-dd1d7aa2-c15c-43ce-a89e-db2233286368. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:06:42.962968 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a548188d-593f-4a19-902e-93ee4db45a70 req-50defd63-eed3-451d-9598-5e00d95f20de service nova] Acquiring lock "refresh_cache-5fe4c21d-3de1-479a-ad36-e4377e7cea11" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:06:42.963117 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a548188d-593f-4a19-902e-93ee4db45a70 req-50defd63-eed3-451d-9598-5e00d95f20de service nova] Acquired lock "refresh_cache-5fe4c21d-3de1-479a-ad36-e4377e7cea11" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:06:42.963278 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a548188d-593f-4a19-902e-93ee4db45a70 req-50defd63-eed3-451d-9598-5e00d95f20de service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Refreshing network info cache for port dd1d7aa2-c15c-43ce-a89e-db2233286368 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:06:43.122977 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:06:43.270775 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-fb740df1-6c82-4a80-866d-ad4f2d1f3277 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "b9047e8c-855e-4623-8659-3c145e1706ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.404s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:43.285421 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-3517d2ee-3d4a-4857-a23b-2f0c29c828d3 req-d97370df-d46c-41ec-badc-8e55ea535174 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:43.402176 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "refresh_cache-5fe4c21d-3de1-479a-ad36-e4377e7cea11" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:06:43.471357 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-a548188d-593f-4a19-902e-93ee4db45a70 req-50defd63-eed3-451d-9598-5e00d95f20de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:43.513753 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:43.612545 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-3517d2ee-3d4a-4857-a23b-2f0c29c828d3 req-d97370df-d46c-41ec-badc-8e55ea535174 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Updated VIF entry in instance network info cache for port 935fd58f-0c86-41ea-822b-947f831b1657. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:06:43.613411 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-3517d2ee-3d4a-4857-a23b-2f0c29c828d3 req-d97370df-d46c-41ec-badc-8e55ea535174 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Updating instance_info_cache with network_info: [{"id": "935fd58f-0c86-41ea-822b-947f831b1657", "address": "fa:16:3e:bc:d0:56", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap935fd58f-0c", "ovs_interfaceid": "935fd58f-0c86-41ea-822b-947f831b1657", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:43.632124 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.491s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:43.651833 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a548188d-593f-4a19-902e-93ee4db45a70 req-50defd63-eed3-451d-9598-5e00d95f20de service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:06:43.727016 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Deleted allocations for instance a3cd35f5-3cbb-41fb-802e-22931d1089bd
May 27 03:06:44.115737 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3517d2ee-3d4a-4857-a23b-2f0c29c828d3 req-d97370df-d46c-41ec-badc-8e55ea535174 service nova] Releasing lock "refresh_cache-7af020cf-50ce-441d-b10d-cf57cc280856" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:06:44.309652 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a548188d-593f-4a19-902e-93ee4db45a70 req-50defd63-eed3-451d-9598-5e00d95f20de service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:44.737481 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5338462e-24ff-44a0-95c5-4082a767f2b8 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "a3cd35f5-3cbb-41fb-802e-22931d1089bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.907s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:44.811829 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a548188d-593f-4a19-902e-93ee4db45a70 req-50defd63-eed3-451d-9598-5e00d95f20de service nova] Releasing lock "refresh_cache-5fe4c21d-3de1-479a-ad36-e4377e7cea11" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:06:44.812543 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquired lock "refresh_cache-5fe4c21d-3de1-479a-ad36-e4377e7cea11" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:06:44.812671 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:06:45.075882 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:06:45.077178 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:06:45.077470 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Creating image(s)
May 27 03:06:45.078237 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:06:45.078412 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Ensure instance console log exists: /opt/stack/data/nova/instances/5fe4c21d-3de1-479a-ad36-e4377e7cea11/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:06:45.078726 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:45.078959 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:45.079165 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:45.486236 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:06:45.773939 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:45.870407 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:45.935304 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:46.086506 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0008274649999293615 future=<Future at 0x75572461eae0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:46.086825 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:46.086825 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=4.657609804000003 future=<Future at 0x75572477d550 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:46.086970 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=4.65748613400001 future=<Future at 0x75572477d550 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:46.087520 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] Emitting event <LifecycleEvent: 1779851191.0855715, 70ca77a6-2f29-4558-abf0-07292a6200cd => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:46.087702 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] VM Stopped (Lifecycle Event)
May 27 03:06:46.178357 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Updating instance_info_cache with network_info: [{"id": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "address": "fa:16:3e:df:3a:b8", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd1d7aa2-c1", "ovs_interfaceid": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:46.271832 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:46.591821 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7c966255-5780-4503-a1d0-516e13628b37 None None] [instance: 70ca77a6-2f29-4558-abf0-07292a6200cd] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:46.682090 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Releasing lock "refresh_cache-5fe4c21d-3de1-479a-ad36-e4377e7cea11" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:06:46.682392 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Instance network_info: |[{"id": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "address": "fa:16:3e:df:3a:b8", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd1d7aa2-c1", "ovs_interfaceid": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:06:46.683750 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Start _get_guest_xml network_info=[{"id": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "address": "fa:16:3e:df:3a:b8", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd1d7aa2-c1", "ovs_interfaceid": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01f99269-975a-45fc-9a11-98dcfb62ab61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5fe4c21d-3de1-479a-ad36-e4377e7cea11', 'attached_at': '', 'detached_at': '', 'volume_id': '01f99269-975a-45fc-9a11-98dcfb62ab61', 'serial': '01f99269-975a-45fc-9a11-98dcfb62ab61'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'cea07f15-cbb2-4e81-b4ef-b0a13650f57e', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:06:46.692071 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:06:46.694314 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-215591698', uuid='5fe4c21d-3de1-479a-ad36-e4377e7cea11'), owner=OwnerMeta(userid='32837382cff144e5b70de0a400386d11', username='tempest-TestVolumeBootPatternV346-1509575509-project-member', projectid='bfc9c3d1d60841349d551f2d9874c730', projectname='tempest-TestVolumeBootPatternV346-1509575509'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "address": "fa:16:3e:df:3a:b8", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd1d7aa2-c1", "ovs_interfaceid": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851206.6935945) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:06:46.696545 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:06:46.697107 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:06:46.699726 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:06:46.700218 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:06:46.701736 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:06:46.702173 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:06:46.702442 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:06:46.702533 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:06:46.702764 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:06:46.702942 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:06:46.703102 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:06:46.703278 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:06:46.703647 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:06:46.704095 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:06:46.704227 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:06:46.704376 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:06:46.719476 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:06:46.719883 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01f99269-975a-45fc-9a11-98dcfb62ab61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:06:46.720171 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:06:46.720552 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:06:46.720872 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01f99269-975a-45fc-9a11-98dcfb62ab61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:06:46.735776 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:06:46.735776 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:06:46.735776 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:06:46.735776 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:06:46.735776 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:06:46.735776 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:06:46.750679 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:06:46.750679 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:46.751206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:06:46.751206 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:46.763978 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61] added
May 27 03:06:46.763978 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:06:46.763978 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:06:46.763978 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:06:46.763978 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:06:46.763978 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:06:46.763978 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:46.763978 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:06:46.763978 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0273(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:06:46.763978 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:06:46.767310 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61] added
May 27 03:06:46.767310 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:06:46.767310 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:06:46.767310 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:06:46.767310 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:06:46.767310 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:06:46.767310 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:46.767505 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:06:46.767616 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0325(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:06:46.767775 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:06:47.089175 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "f9cd3c05-0282-4843-b890-8be3eb097bfe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:47.089945 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:47.235713 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:47.572722 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:06:47.573115 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:06:47.573383 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:06:47.573621 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:06:47.573894 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:06:47.574036 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:06:47.574435 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.62 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:06:47.595387 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:06:47.763649 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:06:47.769496 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:06:47.781443 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:06:47.781443 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:06:47.791767 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:06:47.791767 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:47.802896 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:47.803915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:47.817364 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 03:06:47.817364 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:47.817583 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 03:06:47.817583 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:47.817815 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 03:06:47.817815 np0000001475 nova-compute[98471]: 
May 27 03:06:47.824188 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 03:06:47.824188 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:47.824340 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 03:06:47.824340 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:47.824455 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 03:06:47.824455 np0000001475 nova-compute[98471]: 
May 27 03:06:48.163088 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:48.163472 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:48.166851 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:06:48.167282 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Claim successful on node np0000001475
May 27 03:06:48.197552 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:06:48.200561 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:06:48.859358 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61, portal: 192.168.40.100,3260]
May 27 03:06:48.859358 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61, portal: 192.168.40.100,3260] successful.
May 27 03:06:48.859358 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:48.865318 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61, portal: 192.168.50.100,3260]
May 27 03:06:48.865318 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61, portal: 192.168.50.100,3260] successful.
May 27 03:06:48.865318 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:48.871177 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:48.880020 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:48.891397 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:48.891397 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:48.891397 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:48.891634 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:48.891634 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:48.891634 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:48.892132 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.157s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:48.892355 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:06:48.892995 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] HCTL ('7', '-', '-', 0) found on session 100 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:06:48.893224 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:06:48.897979 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:48.897979 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:48.897979 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:48.898174 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:48.898174 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:48.898174 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:48.898535 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.164s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:48.898615 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:06:48.899144 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] HCTL ('8', '-', '-', 0) found on session 101 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:06:48.899270 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:06:48.909728 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Searching for a device in session 100 and hctl ['7', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:06:48.925429 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Searching for a device in session 101 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:06:48.925669 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '01f99269-975a-45fc-9a11-98dcfb62ab61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:06:49.072128 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "a3d1d581-aaf0-4e14-99ae-5db434215c60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:49.072552 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:49.199822 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:06:49.200514 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:06:49.531251 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:06:49.531445 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:06:49.576003 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:06:49.910456 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Searching for a device in session 100 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:06:49.910632 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01f99269-975a-45fc-9a11-98dcfb62ab61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:06:50.035459 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:06:50.142941 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:50.544445 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.381s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:50.545331 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.402s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:50.545574 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:06:50.551173 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:06:50.551319 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Claim successful on node np0000001475
May 27 03:06:50.554837 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:50.744814 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.00034906500013676123 future=<Future at 0x75572477d550 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:50.744928 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:50.744981 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=0.9580840730000091 future=<Future at 0x75570479a750 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:50.745051 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=0.9579984130000412 future=<Future at 0x75570479a750 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:50.745503 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Emitting event <LifecycleEvent: 1779851195.7443047, b9047e8c-855e-4623-8659-3c145e1706ba => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:50.745700 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] VM Stopped (Lifecycle Event)
May 27 03:06:50.758547 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Found WWN 3300000005ed09b58 for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:06:50.759968 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.039s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:50.760680 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] <== connect_volume: return (4040ms) {'type': 'block', 'scsi_wwn': '3300000005ed09b58', 'path': '/dev/dm-0', 'multipath_id': '3300000005ed09b58'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:06:50.760899 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005ed09b58', 'path': '/dev/dm-0', 'multipath_id': '3300000005ed09b58'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:06:51.052121 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:06:51.052347 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:06:51.055477 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:51.055749 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:51.190552 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca42144366ef44eb81e5c4a23624d281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f1801e95925498cac899f1414f2b202', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:06:51.196547 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:06:51.196859 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:06:51.250405 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c23eb5b8-520d-49fb-8ba4-212f20d1f8a0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: b9047e8c-855e-4623-8659-3c145e1706ba] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:51.273592 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:06:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-215591698',display_name='tempest-TestVolumeBootPatternV346-server-215591698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpatternv346-server-215591698',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnWwof++ZwSJO1BO0i//TGiW5vGgg5M7q377hKaWb+cUT3r7s4xAaOPexCFtyayG/l0gG9lJdVAfvLChaH+kHd5gx/TtrNkAhVbzo13quU5e1rP12X6LQELwFvn/Wby0A==',key_name='tempest-keypair-525983288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfc9c3d1d60841349d551f2d9874c730',ramdisk_id='',reservation_id='r-3ad0r3cr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1509575509',owner_user_name='tempest-TestVolumeBootPatternV346-1509575509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:06:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32837382cff144e5b70de0a400386d11',uuid=5fe4c21d-3de1-479a-ad36-e4377e7cea11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "address": "fa:16:3e:df:3a:b8", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd1d7aa2-c1", "ovs_interfaceid": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:06:51.275636 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:51.277674 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Converting VIF {"id": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "address": "fa:16:3e:df:3a:b8", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd1d7aa2-c1", "ovs_interfaceid": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:06:51.278419 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:3a:b8,bridge_name='br-int',has_traffic_filtering=True,id=dd1d7aa2-c15c-43ce-a89e-db2233286368,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd1d7aa2-c1') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:06:51.279041 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fe4c21d-3de1-479a-ad36-e4377e7cea11 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:51.553312 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:06:51.703900 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0008033019998947566 future=<Future at 0x75570479a750 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:51.708009 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Emitting event <LifecycleEvent: 1779851196.7029998, a3cd35f5-3cbb-41fb-802e-22931d1089bd => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:51.708411 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:06:51.708546 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] VM Stopped (Lifecycle Event)
May 27 03:06:51.782469 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] End _get_guest_xml xml=<domain type="qemu">
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:   <uuid>5fe4c21d-3de1-479a-ad36-e4377e7cea11</uuid>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:   <name>instance-00000030</name>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestVolumeBootPatternV346-server-215591698</nova:name>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:06:46</nova:creationTime>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:         <nova:user uuid="32837382cff144e5b70de0a400386d11">tempest-TestVolumeBootPatternV346-1509575509-project-member</nova:user>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:         <nova:project uuid="bfc9c3d1d60841349d551f2d9874c730">tempest-TestVolumeBootPatternV346-1509575509</nova:project>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:         <nova:port uuid="dd1d7aa2-c15c-43ce-a89e-db2233286368">
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     <system>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <entry name="serial">5fe4c21d-3de1-479a-ad36-e4377e7cea11</entry>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <entry name="uuid">5fe4c21d-3de1-479a-ad36-e4377e7cea11</entry>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     </system>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:   <os>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:   </os>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:   <features>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:   </features>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:   <devices>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/5fe4c21d-3de1-479a-ad36-e4377e7cea11/disk.config"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     </disk>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <alias name="ua-01f99269-975a-45fc-9a11-98dcfb62ab61"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-0"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <serial>01f99269-975a-45fc-9a11-98dcfb62ab61</serial>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     </disk>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:df:3a:b8"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <target dev="tapdd1d7aa2-c1"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     </interface>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/5fe4c21d-3de1-479a-ad36-e4377e7cea11/console.log" append="off"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     </serial>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     <video>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     </video>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     </rng>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:   </devices>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]: </domain>
May 27 03:06:51.782469 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:06:51.785037 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Preparing to wait for external event network-vif-plugged-dd1d7aa2-c15c-43ce-a89e-db2233286368 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:06:51.785037 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:51.785037 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:51.785037 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:51.785037 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:06:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-215591698',display_name='tempest-TestVolumeBootPatternV346-server-215591698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpatternv346-server-215591698',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnWwof++ZwSJO1BO0i//TGiW5vGgg5M7q377hKaWb+cUT3r7s4xAaOPexCFtyayG/l0gG9lJdVAfvLChaH+kHd5gx/TtrNkAhVbzo13quU5e1rP12X6LQELwFvn/Wby0A==',key_name='tempest-keypair-525983288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfc9c3d1d60841349d551f2d9874c730',ramdisk_id='',reservation_id='r-3ad0r3cr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1509575509',owner_user_name='tempest-TestVolumeBootPatternV346-1509575509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:06:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32837382cff144e5b70de0a400386d11',uuid=5fe4c21d-3de1-479a-ad36-e4377e7cea11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "address": "fa:16:3e:df:3a:b8", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd1d7aa2-c1", "ovs_interfaceid": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:06:51.785037 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Converting VIF {"id": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "address": "fa:16:3e:df:3a:b8", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd1d7aa2-c1", "ovs_interfaceid": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:06:51.785037 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:3a:b8,bridge_name='br-int',has_traffic_filtering=True,id=dd1d7aa2-c15c-43ce-a89e-db2233286368,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd1d7aa2-c1') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:06:51.785037 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:3a:b8,bridge_name='br-int',has_traffic_filtering=True,id=dd1d7aa2-c15c-43ce-a89e-db2233286368,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd1d7aa2-c1') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:06:51.788471 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:51.788471 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:51.788471 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:06:51.789359 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:51.789585 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d6293df-b809-50ff-8232-728002967fe0', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:51.790685 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:51.792313 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:51.794870 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:51.795155 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd1d7aa2-c1, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:51.795527 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd1d7aa2-c1, col_values=(('qos', UUID('76ae80fb-46b3-480f-926f-1eb050873bd4')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:51.795793 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd1d7aa2-c1, col_values=(('external_ids', {'iface-id': 'dd1d7aa2-c15c-43ce-a89e-db2233286368', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:3a:b8', 'vm-uuid': '5fe4c21d-3de1-479a-ad36-e4377e7cea11'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:51.802186 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:51.806038 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:51.810046 np0000001475 nova-compute[98471]: INFO os_vif [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:3a:b8,bridge_name='br-int',has_traffic_filtering=True,id=dd1d7aa2-c15c-43ce-a89e-db2233286368,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd1d7aa2-c1')
May 27 03:06:51.958002 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Successfully created port: 9759ac1f-7540-440f-89ce-d18c9e430586 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:06:52.042682 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:06:52.043023 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:06:52.060143 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:06:52.213441 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: a3cd35f5-3cbb-41fb-802e-22931d1089bd] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:52.546326 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:06:52.729832 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Successfully updated port: 9759ac1f-7540-440f-89ce-d18c9e430586 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:06:52.787251 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-133470be-63f4-4a69-a460-b0d56322313c req-30f763f3-c382-4b1d-b055-226a4aab4ee7 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Received event network-changed-9759ac1f-7540-440f-89ce-d18c9e430586 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:52.787957 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-133470be-63f4-4a69-a460-b0d56322313c req-30f763f3-c382-4b1d-b055-226a4aab4ee7 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Refreshing instance network info cache due to event network-changed-9759ac1f-7540-440f-89ce-d18c9e430586. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:06:52.787957 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-133470be-63f4-4a69-a460-b0d56322313c req-30f763f3-c382-4b1d-b055-226a4aab4ee7 service nova] Acquiring lock "refresh_cache-f9cd3c05-0282-4843-b890-8be3eb097bfe" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:06:52.787957 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-133470be-63f4-4a69-a460-b0d56322313c req-30f763f3-c382-4b1d-b055-226a4aab4ee7 service nova] Acquired lock "refresh_cache-f9cd3c05-0282-4843-b890-8be3eb097bfe" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:06:52.788926 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-133470be-63f4-4a69-a460-b0d56322313c req-30f763f3-c382-4b1d-b055-226a4aab4ee7 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Refreshing network info cache for port 9759ac1f-7540-440f-89ce-d18c9e430586 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:06:53.058228 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.513s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:53.058657 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:06:53.080052 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:06:53.080052 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:06:53.080619 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Creating image(s)
May 27 03:06:53.080619 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:53.080817 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "/opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:53.081404 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "/opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:53.081938 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:06:53.085340 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:06:53.086803 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:53.211518 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:53.218926 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.132s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:53.219699 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:53.221888 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:53.223963 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:06:53.229663 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:06:53.230096 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:53.250271 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "refresh_cache-f9cd3c05-0282-4843-b890-8be3eb097bfe" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:06:53.292628 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-133470be-63f4-4a69-a460-b0d56322313c req-30f763f3-c382-4b1d-b055-226a4aab4ee7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:53.337699 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:06:53.338116 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:06:53.338116 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] No VIF found with MAC fa:16:3e:df:3a:b8, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:06:53.338694 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Using config drive
May 27 03:06:53.354726 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.125s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:53.355934 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:53.398821 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-133470be-63f4-4a69-a460-b0d56322313c req-30f763f3-c382-4b1d-b055-226a4aab4ee7 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:06:53.430550 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe/disk 1073741824" returned: 0 in 0.075s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:53.434769 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:53.434769 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:53.538886 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.106s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:53.542763 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:06:53.542763 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:53.576137 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:06:53.582770 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:06:53.582770 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:53.593381 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:53.634806 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-133470be-63f4-4a69-a460-b0d56322313c req-30f763f3-c382-4b1d-b055-226a4aab4ee7 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:53.645395 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:53.647570 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Cannot resize image /opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:06:53.647570 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:06:53.647570 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Ensure instance console log exists: /opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:06:53.647570 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:53.647570 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:53.647570 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:53.689430 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c72d670892e44d88e674c9b584bc718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c547b519adf248728dfd0b2232bfc118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:06:53.846453 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:53.891169 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-bce6a577-144f-4bc6-9352-1550cbb6ce7c req-35d822ca-645f-4f61-ab26-1218973ecef4 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Received event network-vif-unplugged-9759ac1f-7540-440f-89ce-d18c9e430586 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:53.891310 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bce6a577-144f-4bc6-9352-1550cbb6ce7c req-35d822ca-645f-4f61-ab26-1218973ecef4 service nova] Acquiring lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:53.891530 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bce6a577-144f-4bc6-9352-1550cbb6ce7c req-35d822ca-645f-4f61-ab26-1218973ecef4 service nova] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:53.892155 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bce6a577-144f-4bc6-9352-1550cbb6ce7c req-35d822ca-645f-4f61-ab26-1218973ecef4 service nova] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:53.892155 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-bce6a577-144f-4bc6-9352-1550cbb6ce7c req-35d822ca-645f-4f61-ab26-1218973ecef4 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] No waiting events found dispatching network-vif-unplugged-9759ac1f-7540-440f-89ce-d18c9e430586 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:06:53.892155 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-bce6a577-144f-4bc6-9352-1550cbb6ce7c req-35d822ca-645f-4f61-ab26-1218973ecef4 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Received unexpected event network-vif-unplugged-9759ac1f-7540-440f-89ce-d18c9e430586 for instance with vm_state building and task_state spawning.
May 27 03:06:54.019596 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Creating config drive at /opt/stack/data/nova/instances/5fe4c21d-3de1-479a-ad36-e4377e7cea11/disk.config
May 27 03:06:54.022465 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5fe4c21d-3de1-479a-ad36-e4377e7cea11/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp03ol1jpp {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:54.091058 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:06:54.287808 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-133470be-63f4-4a69-a460-b0d56322313c req-30f763f3-c382-4b1d-b055-226a4aab4ee7 service nova] Releasing lock "refresh_cache-f9cd3c05-0282-4843-b890-8be3eb097bfe" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:06:54.304800 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:06:54.306253 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquired lock "refresh_cache-f9cd3c05-0282-4843-b890-8be3eb097bfe" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:06:54.306805 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:06:54.313232 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5fe4c21d-3de1-479a-ad36-e4377e7cea11/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp03ol1jpp" returned: 0 in 0.289s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:54.319039 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Successfully created port: ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:06:54.324820 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:54.326112 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:54.812503 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:06:54.826832 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:54.827114 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:54.827270 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:54.827396 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:06:54.838044 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'flavor' on Instance uuid 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:54.852653 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:54.889089 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:54.893138 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:54.955859 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:06:54.997406 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:55.050425 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Successfully updated port: ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:06:55.133815 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-754b6c42-3bc6-4a3e-a663-149df765268a req-0112074e-f892-4dee-bcf5-e2268b3dc8de service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Received event network-changed-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:55.135840 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-754b6c42-3bc6-4a3e-a663-149df765268a req-0112074e-f892-4dee-bcf5-e2268b3dc8de service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Refreshing instance network info cache due to event network-changed-ad4ac3f9-a243-42a4-9e61-fb161205ae0a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:06:55.135840 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-754b6c42-3bc6-4a3e-a663-149df765268a req-0112074e-f892-4dee-bcf5-e2268b3dc8de service nova] Acquiring lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:06:55.135840 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-754b6c42-3bc6-4a3e-a663-149df765268a req-0112074e-f892-4dee-bcf5-e2268b3dc8de service nova] Acquired lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:06:55.135840 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-754b6c42-3bc6-4a3e-a663-149df765268a req-0112074e-f892-4dee-bcf5-e2268b3dc8de service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Refreshing network info cache for port ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:06:55.180300 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-dd41274c-3cb8-4bac-9591-d25fd5f03298 req-35fc977b-0bac-456b-8a5e-3f779ca8b4fb service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Received event network-vif-plugged-dd1d7aa2-c15c-43ce-a89e-db2233286368 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:55.180494 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-dd41274c-3cb8-4bac-9591-d25fd5f03298 req-35fc977b-0bac-456b-8a5e-3f779ca8b4fb service nova] Acquiring lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:55.180709 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-dd41274c-3cb8-4bac-9591-d25fd5f03298 req-35fc977b-0bac-456b-8a5e-3f779ca8b4fb service nova] Lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:55.180828 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-dd41274c-3cb8-4bac-9591-d25fd5f03298 req-35fc977b-0bac-456b-8a5e-3f779ca8b4fb service nova] Lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:55.181224 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-dd41274c-3cb8-4bac-9591-d25fd5f03298 req-35fc977b-0bac-456b-8a5e-3f779ca8b4fb service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Processing event network-vif-plugged-dd1d7aa2-c15c-43ce-a89e-db2233286368 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:06:55.203857 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:55.204258 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:55.210053 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:55.333654 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:55.349436 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:55.374828 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:55.436044 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Updating instance_info_cache with network_info: [{"id": "9759ac1f-7540-440f-89ce-d18c9e430586", "address": "fa:16:3e:69:cb:34", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ac1f-75", "ovs_interfaceid": "9759ac1f-7540-440f-89ce-d18c9e430586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:55.557886 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:06:55.641775 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-754b6c42-3bc6-4a3e-a663-149df765268a req-0112074e-f892-4dee-bcf5-e2268b3dc8de service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:55.707762 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:06:55.770354 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-754b6c42-3bc6-4a3e-a663-149df765268a req-0112074e-f892-4dee-bcf5-e2268b3dc8de service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:06:55.826757 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:06:55.827883 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:06:55.828102 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Creating image(s)
May 27 03:06:55.828538 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:55.828721 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "/opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:55.829269 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "/opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:55.829757 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:06:55.832531 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:06:55.834273 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:55.863198 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.537s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:55.895247 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851215.8947608, 5fe4c21d-3de1-479a-ad36-e4377e7cea11 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:55.895424 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] VM Started (Lifecycle Event)
May 27 03:06:55.897142 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:06:55.903639 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:06:55.909329 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Instance spawned successfully.
May 27 03:06:55.909706 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:06:55.936414 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.102s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:55.936590 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:55.937941 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:55.937941 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:06:55.939776 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:06:55.940410 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Releasing lock "refresh_cache-f9cd3c05-0282-4843-b890-8be3eb097bfe" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:06:55.940959 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:55.941287 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Instance network_info: |[{"id": "9759ac1f-7540-440f-89ce-d18c9e430586", "address": "fa:16:3e:69:cb:34", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ac1f-75", "ovs_interfaceid": "9759ac1f-7540-440f-89ce-d18c9e430586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:06:55.963342 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-754b6c42-3bc6-4a3e-a663-149df765268a req-0112074e-f892-4dee-bcf5-e2268b3dc8de service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:55.965715 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Start _get_guest_xml network_info=[{"id": "9759ac1f-7540-440f-89ce-d18c9e430586", "address": "fa:16:3e:69:cb:34", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ac1f-75", "ovs_interfaceid": "9759ac1f-7540-440f-89ce-d18c9e430586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:06:55.978280 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:06:55.982892 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-742378270', uuid='f9cd3c05-0282-4843-b890-8be3eb097bfe'), owner=OwnerMeta(userid='ca42144366ef44eb81e5c4a23624d281', username='tempest-AttachVolumeNegativeTest-1854580419-project-member', projectid='5f1801e95925498cac899f1414f2b202', projectname='tempest-AttachVolumeNegativeTest-1854580419'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9759ac1f-7540-440f-89ce-d18c9e430586", "address": "fa:16:3e:69:cb:34", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ac1f-75", "ovs_interfaceid": "9759ac1f-7540-440f-89ce-d18c9e430586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851215.982318) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:06:55.985954 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:06:55.986471 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:06:55.987589 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:06:55.987873 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:06:55.989603 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:06:55.990167 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:06:55.990407 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:06:55.990957 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:06:55.991169 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:06:55.991283 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:06:55.991428 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:06:55.991624 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:06:55.991754 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:06:55.991923 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:06:55.992054 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:06:55.992233 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:06:56.010162 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-742378270',display_name='tempest-AttachVolumeNegativeTest-server-742378270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumenegativetest-server-742378270',id=49,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWYX3l2S3rhj+f0exqf04b4xF6a8aT3A3TjGafu0ixB8CebL8THEHd1zBc2kB5obrBN3eyfQD4SFRx+Xg+ZqN7JnMo/H5oCxNaCTA6JzhekpF7fCoboF/ndo4T5k96cFw==',key_name='tempest-keypair-1969300216',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1801e95925498cac899f1414f2b202',ramdisk_id='',reservation_id='r-rvjj6pqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1854580419',owner_user_name='tempest-AttachVolumeNegativeTest-1854580419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:06:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca42144366ef44eb81e5c4a23624d281',uuid=f9cd3c05-0282-4843-b890-8be3eb097bfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9759ac1f-7540-440f-89ce-d18c9e430586", "address": "fa:16:3e:69:cb:34", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ac1f-75", "ovs_interfaceid": "9759ac1f-7540-440f-89ce-d18c9e430586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:06:56.010442 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converting VIF {"id": "9759ac1f-7540-440f-89ce-d18c9e430586", "address": "fa:16:3e:69:cb:34", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ac1f-75", "ovs_interfaceid": "9759ac1f-7540-440f-89ce-d18c9e430586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:06:56.011281 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:cb:34,bridge_name='br-int',has_traffic_filtering=True,id=9759ac1f-7540-440f-89ce-d18c9e430586,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9759ac1f-75') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:06:56.012146 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lazy-loading 'pci_devices' on Instance uuid f9cd3c05-0282-4843-b890-8be3eb097bfe {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:56.052013 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.111s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:56.052457 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:56.114000 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk 1073741824" returned: 0 in 0.061s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:56.114136 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.177s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:56.114489 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:56.146760 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:06:56.149964 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:56.217240 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.102s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:56.221169 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:06:56.221480 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:56.264890 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:56.265900 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:56.288166 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:56.314905 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:56.315332 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Cannot resize image /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:06:56.315766 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:06:56.315988 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Ensure instance console log exists: /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:06:56.316355 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:56.316756 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:56.318668 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:56.341709 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:56.342092 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:56.354092 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:06:56.354303 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Claim successful on node np0000001475
May 27 03:06:56.374862 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:56.378273 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:56.402985 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:56.416788 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:06:56.423770 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:56.423770 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:56.423770 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:56.423770 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:56.423770 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:56.423770 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:06:56.467603 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-754b6c42-3bc6-4a3e-a663-149df765268a req-0112074e-f892-4dee-bcf5-e2268b3dc8de service nova] Releasing lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:06:56.469487 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquired lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:06:56.469821 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:06:56.503817 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:56.504376 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:56.531768 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] End _get_guest_xml xml=<domain type="qemu">
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:   <uuid>f9cd3c05-0282-4843-b890-8be3eb097bfe</uuid>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:   <name>instance-00000031</name>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <nova:name>tempest-AttachVolumeNegativeTest-server-742378270</nova:name>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:06:55</nova:creationTime>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:         <nova:user uuid="ca42144366ef44eb81e5c4a23624d281">tempest-AttachVolumeNegativeTest-1854580419-project-member</nova:user>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:         <nova:project uuid="5f1801e95925498cac899f1414f2b202">tempest-AttachVolumeNegativeTest-1854580419</nova:project>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:         <nova:port uuid="9759ac1f-7540-440f-89ce-d18c9e430586">
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     <system>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <entry name="serial">f9cd3c05-0282-4843-b890-8be3eb097bfe</entry>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <entry name="uuid">f9cd3c05-0282-4843-b890-8be3eb097bfe</entry>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     </system>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:   <os>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:   </os>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:   <features>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:   </features>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:   <devices>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe/disk"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     </disk>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe/disk.config"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     </disk>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:69:cb:34"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <target dev="tap9759ac1f-75"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     </interface>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe/console.log" append="off"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     </serial>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     <video>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     </video>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     </rng>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:   </devices>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]: </domain>
May 27 03:06:56.531768 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:06:56.531768 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Preparing to wait for external event network-vif-plugged-9759ac1f-7540-440f-89ce-d18c9e430586 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:06:56.531768 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:56.531768 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:56.531768 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:56.534630 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-742378270',display_name='tempest-AttachVolumeNegativeTest-server-742378270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumenegativetest-server-742378270',id=49,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWYX3l2S3rhj+f0exqf04b4xF6a8aT3A3TjGafu0ixB8CebL8THEHd1zBc2kB5obrBN3eyfQD4SFRx+Xg+ZqN7JnMo/H5oCxNaCTA6JzhekpF7fCoboF/ndo4T5k96cFw==',key_name='tempest-keypair-1969300216',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f1801e95925498cac899f1414f2b202',ramdisk_id='',reservation_id='r-rvjj6pqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1854580419',owner_user_name='tempest-AttachVolumeNegativeTest-1854580419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:06:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca42144366ef44eb81e5c4a23624d281',uuid=f9cd3c05-0282-4843-b890-8be3eb097bfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9759ac1f-7540-440f-89ce-d18c9e430586", "address": "fa:16:3e:69:cb:34", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ac1f-75", "ovs_interfaceid": "9759ac1f-7540-440f-89ce-d18c9e430586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:06:56.534630 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converting VIF {"id": "9759ac1f-7540-440f-89ce-d18c9e430586", "address": "fa:16:3e:69:cb:34", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ac1f-75", "ovs_interfaceid": "9759ac1f-7540-440f-89ce-d18c9e430586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:06:56.539307 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:cb:34,bridge_name='br-int',has_traffic_filtering=True,id=9759ac1f-7540-440f-89ce-d18c9e430586,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9759ac1f-75') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:06:56.539307 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:cb:34,bridge_name='br-int',has_traffic_filtering=True,id=9759ac1f-7540-440f-89ce-d18c9e430586,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9759ac1f-75') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:06:56.539307 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:56.539307 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:56.539307 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:06:56.542966 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:56.543274 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05dbf0ff-b23e-5306-b009-06ce1068262d', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:56.545772 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:56.545772 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:56.549256 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:56.549511 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9759ac1f-75, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:56.550191 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9759ac1f-75, col_values=(('qos', UUID('11ae66a7-ad7e-4dce-9987-d2b199ca072d')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:56.550487 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9759ac1f-75, col_values=(('external_ids', {'iface-id': '9759ac1f-7540-440f-89ce-d18c9e430586', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:cb:34', 'vm-uuid': 'f9cd3c05-0282-4843-b890-8be3eb097bfe'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:56.551519 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:56.552994 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:56.558843 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:56.559887 np0000001475 nova-compute[98471]: INFO os_vif [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:cb:34,bridge_name='br-int',has_traffic_filtering=True,id=9759ac1f-7540-440f-89ce-d18c9e430586,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9759ac1f-75')
May 27 03:06:56.633880 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:56.639309 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:56.736931 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:56.740822 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:56.765328 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:56.765907 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:56.766406 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Attaching volume b8a83b2e-3d77-40b8-ad85-46d76ceb5698 to /dev/vdb
May 27 03:06:56.835344 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:06:56.855992 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:06:56.869445 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:56.877823 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:06:56.880500 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:56.902614 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:56.938587 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Took 11.86 seconds to spawn the instance on the hypervisor.
May 27 03:06:56.938587 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:56.939882 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:06:56.942240 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.059s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:56.942445 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851216.9416552, 5fe4c21d-3de1-479a-ad36-e4377e7cea11 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:56.942930 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=12829MB free_disk=73.05884552001953GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:06:56.943225 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] VM Paused (Lifecycle Event)
May 27 03:06:56.946795 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:56.984695 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:06:56.985108 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:06:56.996100 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:06:56.999230 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fead:d206', 'fe80::8cdc:9fff:fe79:9907', 'fe80::fc16:3eff:fe3e:7b2f', 'fe80::bc95:85ff:fe5a:dff6', 'fe80::fc16:3eff:febc:d056', 'fe80::b80a:ccff:fec0:b891', 'fe80::fc16:3eff:fedf:3ab8', 'fe80::7427:32ff:fe97:df09'] 
May 27 03:06:56.999945 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:06:57.000408 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:06:57.000807 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:06:57.001118 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Updating existing volume attachment record: 45be9050-a66d-4f7c-8454-112bb981f5a9 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:06:57.051310 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:57.103252 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:06:57.280962 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:57.286054 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3d22f4e3-b405-4a76-9162-9291faba395a req-d539e79a-f04d-434c-99c3-2467b6e0eb5f service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Received event network-vif-plugged-dd1d7aa2-c15c-43ce-a89e-db2233286368 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:57.286295 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3d22f4e3-b405-4a76-9162-9291faba395a req-d539e79a-f04d-434c-99c3-2467b6e0eb5f service nova] Acquiring lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:57.286475 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3d22f4e3-b405-4a76-9162-9291faba395a req-d539e79a-f04d-434c-99c3-2467b6e0eb5f service nova] Lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:57.286586 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3d22f4e3-b405-4a76-9162-9291faba395a req-d539e79a-f04d-434c-99c3-2467b6e0eb5f service nova] Lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:57.286698 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3d22f4e3-b405-4a76-9162-9291faba395a req-d539e79a-f04d-434c-99c3-2467b6e0eb5f service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] No waiting events found dispatching network-vif-plugged-dd1d7aa2-c15c-43ce-a89e-db2233286368 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:06:57.286828 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-3d22f4e3-b405-4a76-9162-9291faba395a req-d539e79a-f04d-434c-99c3-2467b6e0eb5f service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Received unexpected event network-vif-plugged-dd1d7aa2-c15c-43ce-a89e-db2233286368 for instance with vm_state active and task_state None.
May 27 03:06:57.435589 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Updating instance_info_cache with network_info: [{"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:57.451817 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:57.457468 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851217.456599, 5fe4c21d-3de1-479a-ad36-e4377e7cea11 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:06:57.457468 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] VM Resumed (Lifecycle Event)
May 27 03:06:57.464951 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Took 19.31 seconds to build instance.
May 27 03:06:57.576300 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:06:57.576839 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698', 'iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b8a83b2e-3d77-40b8-ad85-46d76ceb5698', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:06:57.576839 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:06:57.577141 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:06:57.577314 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698', 'iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b8a83b2e-3d77-40b8-ad85-46d76ceb5698', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:06:57.591607 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:06:57.592290 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:06:57.593025 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:06:57.593025 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:06:57.593466 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:06:57.593695 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:06:57.609225 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:06:57.609225 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:57.618216 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:06:57.618216 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:57.625039 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698] added
May 27 03:06:57.625039 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:06:57.625039 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:06:57.625039 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:06:57.625039 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:06:57.625039 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:06:57.625039 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:57.625039 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:06:57.628887 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:06:57.628887 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:06:57.631446 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698] added
May 27 03:06:57.631446 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:06:57.631446 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:06:57.631446 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:06:57.631446 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:06:57.631446 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:06:57.631446 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:57.631836 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:06:57.631836 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0381(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:06:57.631936 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:06:57.852829 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:06:57.853043 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:06:57.937699 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Releasing lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:06:57.938135 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Instance network_info: |[{"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:06:57.939804 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Start _get_guest_xml network_info=[{"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:06:57.942688 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:06:57.944281 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1049303833', uuid='a3d1d581-aaf0-4e14-99ae-5db434215c60'), owner=OwnerMeta(userid='1c72d670892e44d88e674c9b584bc718', username='tempest-AttachVolumeShelveTestJSON-1364873533-project-member', projectid='c547b519adf248728dfd0b2232bfc118', projectname='tempest-AttachVolumeShelveTestJSON-1364873533'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851217.943832) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:06:57.945523 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:06:57.945955 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:06:57.947662 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:06:57.947912 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:06:57.949439 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:06:57.949516 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:06:57.949707 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:06:57.949864 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:06:57.950039 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:06:57.950197 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:06:57.950320 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:06:57.950547 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:06:57.950686 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:06:57.950851 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:06:57.950995 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:06:57.951169 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:06:57.963495 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:06:57.968647 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1049303833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumeshelvetestjson-server-1049303833',id=50,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC74kMXXtTfu96CEeSeXm7lbe6InTg7PC6KekpYZjJWXgE8Ih1WDS9gVb82OCiOe6f4FJGyPwkR1yGy8I2MF96YLBrCB0ElxJLAhExDMR2s1v9S7JeN28lwHkG0A1+84GA==',key_name='tempest-keypair-951893173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c547b519adf248728dfd0b2232bfc118',ramdisk_id='',reservation_id='r-4h7euvrh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1364873533',owner_user_name='tempest-AttachVolumeShelveTestJSON-1364873533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:06:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c72d670892e44d88e674c9b584bc718',uuid=a3d1d581-aaf0-4e14-99ae-5db434215c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:06:57.968855 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converting VIF {"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:06:57.969550 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:69:1b,bridge_name='br-int',has_traffic_filtering=True,id=ad4ac3f9-a243-42a4-9e61-fb161205ae0a,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4ac3f9-a2') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:06:57.970262 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'pci_devices' on Instance uuid a3d1d581-aaf0-4e14-99ae-5db434215c60 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:06:57.971439 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:06:57.973584 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a33bc780-2058-412a-883f-88c35b92b69b tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.831s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:58.085163 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7781a99e-4605-4369-90bb-01cd2d0256f4 req-9eb62e91-b7c9-4986-819d-1db6bf6fbe2b service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Received event network-changed-dd1d7aa2-c15c-43ce-a89e-db2233286368 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:06:58.085590 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7781a99e-4605-4369-90bb-01cd2d0256f4 req-9eb62e91-b7c9-4986-819d-1db6bf6fbe2b service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Refreshing instance network info cache due to event network-changed-dd1d7aa2-c15c-43ce-a89e-db2233286368. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:06:58.086893 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7781a99e-4605-4369-90bb-01cd2d0256f4 req-9eb62e91-b7c9-4986-819d-1db6bf6fbe2b service nova] Acquiring lock "refresh_cache-5fe4c21d-3de1-479a-ad36-e4377e7cea11" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:06:58.087006 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7781a99e-4605-4369-90bb-01cd2d0256f4 req-9eb62e91-b7c9-4986-819d-1db6bf6fbe2b service nova] Acquired lock "refresh_cache-5fe4c21d-3de1-479a-ad36-e4377e7cea11" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:06:58.087146 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7781a99e-4605-4369-90bb-01cd2d0256f4 req-9eb62e91-b7c9-4986-819d-1db6bf6fbe2b service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Refreshing network info cache for port dd1d7aa2-c15c-43ce-a89e-db2233286368 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:06:58.092174 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:06:58.092298 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:06:58.092424 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No VIF found with MAC fa:16:3e:69:cb:34, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:06:58.092891 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Using config drive
May 27 03:06:58.357728 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:06:58.474523 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] End _get_guest_xml xml=<domain type="qemu">
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:   <uuid>a3d1d581-aaf0-4e14-99ae-5db434215c60</uuid>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:   <name>instance-00000032</name>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1049303833</nova:name>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:06:57</nova:creationTime>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:         <nova:user uuid="1c72d670892e44d88e674c9b584bc718">tempest-AttachVolumeShelveTestJSON-1364873533-project-member</nova:user>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:         <nova:project uuid="c547b519adf248728dfd0b2232bfc118">tempest-AttachVolumeShelveTestJSON-1364873533</nova:project>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:         <nova:port uuid="ad4ac3f9-a243-42a4-9e61-fb161205ae0a">
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     <system>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <entry name="serial">a3d1d581-aaf0-4e14-99ae-5db434215c60</entry>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <entry name="uuid">a3d1d581-aaf0-4e14-99ae-5db434215c60</entry>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     </system>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:   <os>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:   </os>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:   <features>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:   </features>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:   <devices>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     </disk>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk.config"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     </disk>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:ed:69:1b"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <target dev="tapad4ac3f9-a2"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     </interface>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/console.log" append="off"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     </serial>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     <video>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     </video>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     </rng>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:   </devices>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]: </domain>
May 27 03:06:58.474523 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:06:58.476603 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Preparing to wait for external event network-vif-plugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:06:58.476603 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:06:58.476603 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:58.476603 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:58.476603 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1049303833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumeshelvetestjson-server-1049303833',id=50,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC74kMXXtTfu96CEeSeXm7lbe6InTg7PC6KekpYZjJWXgE8Ih1WDS9gVb82OCiOe6f4FJGyPwkR1yGy8I2MF96YLBrCB0ElxJLAhExDMR2s1v9S7JeN28lwHkG0A1+84GA==',key_name='tempest-keypair-951893173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c547b519adf248728dfd0b2232bfc118',ramdisk_id='',reservation_id='r-4h7euvrh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1364873533',owner_user_name='tempest-AttachVolumeShelveTestJSON-1364873533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:06:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c72d670892e44d88e674c9b584bc718',uuid=a3d1d581-aaf0-4e14-99ae-5db434215c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:06:58.476603 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converting VIF {"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:06:58.476603 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:69:1b,bridge_name='br-int',has_traffic_filtering=True,id=ad4ac3f9-a243-42a4-9e61-fb161205ae0a,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4ac3f9-a2') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:06:58.476968 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:69:1b,bridge_name='br-int',has_traffic_filtering=True,id=ad4ac3f9-a243-42a4-9e61-fb161205ae0a,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4ac3f9-a2') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:06:58.477299 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:58.477691 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:58.478020 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:06:58.478799 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:58.479030 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22a4b69d-8dc5-5a97-988b-4ba62214e57a', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:58.480765 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:58.481550 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:58.487056 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:58.489564 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:58.489882 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad4ac3f9-a2, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:58.490290 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad4ac3f9-a2, col_values=(('qos', UUID('8e66a1c5-49e9-4eb9-b4f9-39f2c30966f3')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:58.490523 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad4ac3f9-a2, col_values=(('external_ids', {'iface-id': 'ad4ac3f9-a243-42a4-9e61-fb161205ae0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:69:1b', 'vm-uuid': 'a3d1d581-aaf0-4e14-99ae-5db434215c60'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:06:58.491968 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:58.493618 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:06:58.503504 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:58.504608 np0000001475 nova-compute[98471]: INFO os_vif [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:69:1b,bridge_name='br-int',has_traffic_filtering=True,id=ad4ac3f9-a243-42a4-9e61-fb161205ae0a,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4ac3f9-a2')
May 27 03:06:58.589312 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-7781a99e-4605-4369-90bb-01cd2d0256f4 req-9eb62e91-b7c9-4986-819d-1db6bf6fbe2b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:58.598244 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:58.629135 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:06:58.632333 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:06:58.644954 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:06:58.644954 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:06:58.650165 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:06:58.650165 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:58.660292 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:58.670894 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:58.679400 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:58.679400 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:58.679400 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:58.679631 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:58.679631 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:58.679631 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:58.689681 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:58.689681 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:58.689681 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:58.689881 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:58.689881 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:58.689881 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:58.712303 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698, portal: 192.168.50.100,3260]
May 27 03:06:58.712303 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698, portal: 192.168.50.100,3260] successful.
May 27 03:06:58.712303 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:58.727448 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:58.736632 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698, portal: 192.168.40.100,3260]
May 27 03:06:58.736632 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698, portal: 192.168.40.100,3260] successful.
May 27 03:06:58.736632 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:58.744606 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:58.744606 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:58.744606 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:06:58.744606 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:06:58.744606 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:58.744606 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:58.744606 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:58.744606 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:06:58.744606 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:06:58.744606 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:58.744962 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:58.745020 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:06:58.745778 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] HCTL ('9', '-', '-', 0) found on session 102 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:06:58.745920 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:06:58.753662 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:06:58.770171 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Searching for a device in session 102 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:06:58.770171 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b8a83b2e-3d77-40b8-ad85-46d76ceb5698', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:06:58.780471 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:58.780471 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:58.780471 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:06:58.780471 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:06:58.780471 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:06:58.780759 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:58.780759 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:06:58.780759 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:06:58.780759 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:06:58.780759 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:06:58.780900 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:06:58.781021 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:06:58.781655 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] HCTL ('10', '-', '-', 0) found on session 103 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:06:58.781806 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:06:58.789118 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Creating config drive at /opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe/disk.config
May 27 03:06:58.793670 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxnntzprr {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:06:58.811796 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Searching for a device in session 103 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:06:58.818800 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b8a83b2e-3d77-40b8-ad85-46d76ceb5698', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:06:58.866228 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.524s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:06:58.866826 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:06:58.872187 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxnntzprr" returned: 0 in 0.078s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:06:58.877555 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.934s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:06:59.082226 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-7781a99e-4605-4369-90bb-01cd2d0256f4 req-9eb62e91-b7c9-4986-819d-1db6bf6fbe2b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:59.239641 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7781a99e-4605-4369-90bb-01cd2d0256f4 req-9eb62e91-b7c9-4986-819d-1db6bf6fbe2b service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Updated VIF entry in instance network info cache for port dd1d7aa2-c15c-43ce-a89e-db2233286368. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:06:59.239915 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7781a99e-4605-4369-90bb-01cd2d0256f4 req-9eb62e91-b7c9-4986-819d-1db6bf6fbe2b service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Updating instance_info_cache with network_info: [{"id": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "address": "fa:16:3e:df:3a:b8", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd1d7aa2-c1", "ovs_interfaceid": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:06:59.360431 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:59.381689 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:06:59.386850 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:06:59.386850 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:59.386850 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:06:59.400682 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:59.403227 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:59.508655 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ba707c9283c45989ff891306f972873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d79b15ea2254cd7adc804ece7e7cfae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:06:59.510205 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:59.594889 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:06:59.741982 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7781a99e-4605-4369-90bb-01cd2d0256f4 req-9eb62e91-b7c9-4986-819d-1db6bf6fbe2b service nova] Releasing lock "refresh_cache-5fe4c21d-3de1-479a-ad36-e4377e7cea11" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:06:59.755311 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:59.762168 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:59.764177 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:59.795287 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:59.800225 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:59.839945 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:06:59.888699 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:06:59.974541 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:06:59.974726 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 30e926af-236d-4544-9b8e-5fb9a3bddea6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:06:59.974726 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 7af020cf-50ce-441d-b10d-cf57cc280856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:06:59.974892 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 5fe4c21d-3de1-479a-ad36-e4377e7cea11 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:06:59.975403 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance f9cd3c05-0282-4843-b890-8be3eb097bfe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:06:59.975530 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance a3d1d581-aaf0-4e14-99ae-5db434215c60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:06:59.975620 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 9de3772c-0fb1-4718-bd84-b0ea6540a00c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:06:59.975842 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:06:59.975983 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=1856MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:06:56 up 38 min,  2 users,  load average: 8.30, 8.34, 5.06\n', 'num_instances': '7', 'num_vm_active': '4', 'num_task_None': '5', 'num_os_type_None': '7', 'num_proj_ca3c6a3942eb41e8b6aefddc5faca789': '1', 'io_workload': '3', 'num_proj_428862460731458481e46d92e7e023cf': '1', 'num_proj_0810d45b82c0476db38b1cabf8579ae1': '1', 'num_proj_bfc9c3d1d60841349d551f2d9874c730': '1', 'num_vm_building': '3', 'num_task_spawning': '2', 'num_proj_5f1801e95925498cac899f1414f2b202': '1', 'num_proj_c547b519adf248728dfd0b2232bfc118': '1', 'num_proj_4d79b15ea2254cd7adc804ece7e7cfae': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:07:00.028959 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:00.029191 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:00.029273 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] No VIF found with MAC fa:16:3e:ed:69:1b, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:07:00.029821 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Using config drive
May 27 03:07:00.180996 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c3a3a8c9-4985-4bc8-a9be-7b22928546e3 req-1a561938-e0d5-49c4-b892-36a97c4cec00 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Received event network-vif-plugged-9759ac1f-7540-440f-89ce-d18c9e430586 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:00.181328 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3a3a8c9-4985-4bc8-a9be-7b22928546e3 req-1a561938-e0d5-49c4-b892-36a97c4cec00 service nova] Acquiring lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:00.181380 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3a3a8c9-4985-4bc8-a9be-7b22928546e3 req-1a561938-e0d5-49c4-b892-36a97c4cec00 service nova] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:00.181505 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3a3a8c9-4985-4bc8-a9be-7b22928546e3 req-1a561938-e0d5-49c4-b892-36a97c4cec00 service nova] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:00.181628 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c3a3a8c9-4985-4bc8-a9be-7b22928546e3 req-1a561938-e0d5-49c4-b892-36a97c4cec00 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Processing event network-vif-plugged-9759ac1f-7540-440f-89ce-d18c9e430586 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:07:00.181768 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c3a3a8c9-4985-4bc8-a9be-7b22928546e3 req-1a561938-e0d5-49c4-b892-36a97c4cec00 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Received event network-vif-plugged-9759ac1f-7540-440f-89ce-d18c9e430586 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:00.183230 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3a3a8c9-4985-4bc8-a9be-7b22928546e3 req-1a561938-e0d5-49c4-b892-36a97c4cec00 service nova] Acquiring lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:00.183384 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3a3a8c9-4985-4bc8-a9be-7b22928546e3 req-1a561938-e0d5-49c4-b892-36a97c4cec00 service nova] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:00.183498 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3a3a8c9-4985-4bc8-a9be-7b22928546e3 req-1a561938-e0d5-49c4-b892-36a97c4cec00 service nova] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:00.183667 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c3a3a8c9-4985-4bc8-a9be-7b22928546e3 req-1a561938-e0d5-49c4-b892-36a97c4cec00 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] No waiting events found dispatching network-vif-plugged-9759ac1f-7540-440f-89ce-d18c9e430586 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:07:00.183722 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c3a3a8c9-4985-4bc8-a9be-7b22928546e3 req-1a561938-e0d5-49c4-b892-36a97c4cec00 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Received unexpected event network-vif-plugged-9759ac1f-7540-440f-89ce-d18c9e430586 for instance with vm_state building and task_state spawning.
May 27 03:07:00.295158 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Successfully created port: a3f65859-14c9-4367-8d8d-465b49ebb7cc {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:07:00.310903 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:07:00.317346 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851220.3168993, f9cd3c05-0282-4843-b890-8be3eb097bfe => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:07:00.317572 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] VM Started (Lifecycle Event)
May 27 03:07:00.321313 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:07:00.326648 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Instance spawned successfully.
May 27 03:07:00.327054 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:07:00.396783 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:07:00.433771 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:07:00.433978 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:07:00.545769 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:00.612122 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Found WWN 3300000000a0b2fc1 for multipath device dm-3 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:07:00.612547 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:00.612788 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000000a0b2fc1', 'path': '/dev/dm-3', 'multipath_id': '3300000000a0b2fc1'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:07:00.612964 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000a0b2fc1', 'path': '/dev/dm-3', 'multipath_id': '3300000000a0b2fc1'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:07:00.615869 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'flavor' on Instance uuid 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:00.794776 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Creating config drive at /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk.config
May 27 03:07:00.800119 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6prmt6pi {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:00.825175 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:00.846148 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:07:00.855467 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:00.855635 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:00.857027 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:00.858615 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:00.858988 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:00.859506 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:00.867244 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6prmt6pi" returned: 0 in 0.067s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:07:00.937062 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:07:00.990948 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Successfully updated port: a3f65859-14c9-4367-8d8d-465b49ebb7cc {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:07:01.119133 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Attempting to attach volume b8a83b2e-3d77-40b8-ad85-46d76ceb5698 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:07:01.121529 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:07:01.121529 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:07:01.121529 np0000001475 nova-compute[98471]:   <alias name="ua-b8a83b2e-3d77-40b8-ad85-46d76ceb5698"/>
May 27 03:07:01.121529 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:07:01.121529 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:07:01.121529 np0000001475 nova-compute[98471]:   <serial>b8a83b2e-3d77-40b8-ad85-46d76ceb5698</serial>
May 27 03:07:01.121529 np0000001475 nova-compute[98471]: </disk>
May 27 03:07:01.121529 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:07:01.197755 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:07:01.198576 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:01.280465 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:01.308271 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "30e926af-236d-4544-9b8e-5fb9a3bddea6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:01.308482 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:01.358402 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:07:01.358712 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851221.3585083, f9cd3c05-0282-4843-b890-8be3eb097bfe => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:07:01.358882 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] VM Paused (Lifecycle Event)
May 27 03:07:01.367898 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Took 8.29 seconds to spawn the instance on the hypervisor.
May 27 03:07:01.367898 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:01.405652 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:07:01.406541 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:07:01.407197 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Creating image(s)
May 27 03:07:01.407371 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "/opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:01.407472 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "/opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:01.408917 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "/opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:01.412781 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:07:01.422144 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:07:01.427228 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:01.447083 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:01.453423 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:07:01.453423 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.576s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:01.459360 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.90 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:07:01.469448 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:01.474053 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:01.493802 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "refresh_cache-9de3772c-0fb1-4718-bd84-b0ea6540a00c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:07:01.494112 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquired lock "refresh_cache-9de3772c-0fb1-4718-bd84-b0ea6540a00c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:07:01.494200 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:07:01.536210 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.108s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:07:01.536792 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:01.537434 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:01.538553 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:07:01.543375 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:07:01.548863 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:01.571989 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:01.664156 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.116s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:07:01.664812 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:01.739862 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c/disk 1073741824" returned: 0 in 0.075s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:07:01.740477 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:01.740879 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:01.774063 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6c79e620-339f-42d0-9c04-e660630d93a5 req-3fe4464e-256e-493b-add9-597b8e544b14 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Received event network-vif-plugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:01.774063 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6c79e620-339f-42d0-9c04-e660630d93a5 req-3fe4464e-256e-493b-add9-597b8e544b14 service nova] Acquiring lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:01.774385 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6c79e620-339f-42d0-9c04-e660630d93a5 req-3fe4464e-256e-493b-add9-597b8e544b14 service nova] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:01.774604 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6c79e620-339f-42d0-9c04-e660630d93a5 req-3fe4464e-256e-493b-add9-597b8e544b14 service nova] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:01.774838 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6c79e620-339f-42d0-9c04-e660630d93a5 req-3fe4464e-256e-493b-add9-597b8e544b14 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Processing event network-vif-plugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:07:01.817699 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lazy-loading 'flavor' on Instance uuid 30e926af-236d-4544-9b8e-5fb9a3bddea6 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:01.833107 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:01.843203 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:01.845036 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:01.848054 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.107s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:07:01.848666 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:07:01.848666 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:01.865764 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:01.871700 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:01.899476 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Took 13.80 seconds to build instance.
May 27 03:07:01.899476 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851221.8987746, f9cd3c05-0282-4843-b890-8be3eb097bfe => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:07:01.899596 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] VM Resumed (Lifecycle Event)
May 27 03:07:01.988059 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:07:01.988326 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Cannot resize image /opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:07:01.988591 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:07:01.988732 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Ensure instance console log exists: /opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:07:01.989024 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:01.989217 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:01.989337 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:02.084413 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:07:02.249481 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-01179529-7341-4a46-a15a-19eafac6da3b req-95991079-54c9-4a1a-a956-39d3aed40210 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Received event network-changed-a3f65859-14c9-4367-8d8d-465b49ebb7cc {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:02.249950 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-01179529-7341-4a46-a15a-19eafac6da3b req-95991079-54c9-4a1a-a956-39d3aed40210 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Refreshing instance network info cache due to event network-changed-a3f65859-14c9-4367-8d8d-465b49ebb7cc. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:07:02.250179 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-01179529-7341-4a46-a15a-19eafac6da3b req-95991079-54c9-4a1a-a956-39d3aed40210 service nova] Acquiring lock "refresh_cache-9de3772c-0fb1-4718-bd84-b0ea6540a00c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:07:02.262458 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:02.334629 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Ignoring supplied device name: /dev/vdb
May 27 03:07:02.404586 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:02.406372 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.316s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:02.408377 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:07:02.440896 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:07:02.443302 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:07:02.447246 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Updating instance_info_cache with network_info: [{"id": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "address": "fa:16:3e:7b:f2:ac", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f65859-14", "ovs_interfaceid": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:07:02.449956 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Instance spawned successfully.
May 27 03:07:02.450458 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:07:02.836109 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.527s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:02.845660 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:02.845862 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:02.845969 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:02.846028 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No VIF found with MAC fa:16:3e:ad:d2:06, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:07:02.911488 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851222.9111526, a3d1d581-aaf0-4e14-99ae-5db434215c60 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:07:02.912948 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] VM Started (Lifecycle Event)
May 27 03:07:02.950460 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Releasing lock "refresh_cache-9de3772c-0fb1-4718-bd84-b0ea6540a00c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:07:02.950607 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Instance network_info: |[{"id": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "address": "fa:16:3e:7b:f2:ac", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f65859-14", "ovs_interfaceid": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:07:02.951223 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-01179529-7341-4a46-a15a-19eafac6da3b req-95991079-54c9-4a1a-a956-39d3aed40210 service nova] Acquired lock "refresh_cache-9de3772c-0fb1-4718-bd84-b0ea6540a00c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:07:02.951574 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-01179529-7341-4a46-a15a-19eafac6da3b req-95991079-54c9-4a1a-a956-39d3aed40210 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Refreshing network info cache for port a3f65859-14c9-4367-8d8d-465b49ebb7cc {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:07:02.957210 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Start _get_guest_xml network_info=[{"id": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "address": "fa:16:3e:7b:f2:ac", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f65859-14", "ovs_interfaceid": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:07:02.964470 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:02.964911 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:02.965211 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:02.965469 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:02.965753 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:02.966098 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:02.975579 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:07:02.977116 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-524695679', uuid='9de3772c-0fb1-4718-bd84-b0ea6540a00c'), owner=OwnerMeta(userid='4ba707c9283c45989ff891306f972873', username='tempest-VolumesSnapshotTestJSON-189213940-project-member', projectid='4d79b15ea2254cd7adc804ece7e7cfae', projectname='tempest-VolumesSnapshotTestJSON-189213940'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "address": "fa:16:3e:7b:f2:ac", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f65859-14", "ovs_interfaceid": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851222.9766467) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:07:02.978502 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:07:02.978947 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:07:02.979959 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:07:02.980188 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:07:02.981310 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:07:02.981683 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:07:02.982174 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:07:02.982346 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:07:02.982532 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:07:02.982650 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:07:02.982799 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:07:02.982965 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:07:02.983114 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:07:02.983264 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:07:02.983434 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:07:02.983560 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:07:02.997584 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-524695679',display_name='tempest-VolumesSnapshotTestJSON-instance-524695679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumessnapshottestjson-instance-524695679',id=51,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZNwkY6ZNdPIGRKFsiJc6cUzbgmrE/1KHYIh2AjhtNmSD7WDNAoX1q2noQbM5PoBSNnP16gwOxAyCcXv7l1CwlFhFT915m4zoThyRaG+lfwiKYBkfP0mlPztgjsqsnIrg==',key_name='tempest-keypair-86205110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d79b15ea2254cd7adc804ece7e7cfae',ramdisk_id='',reservation_id='r-o01qas8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-189213940',owner_user_name='tempest-VolumesSnapshotTestJSON-189213940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ba707c9283c45989ff891306f972873',uuid=9de3772c-0fb1-4718-bd84-b0ea6540a00c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "address": "fa:16:3e:7b:f2:ac", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f65859-14", "ovs_interfaceid": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:07:02.997830 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Converting VIF {"id": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "address": "fa:16:3e:7b:f2:ac", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f65859-14", "ovs_interfaceid": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:07:02.998512 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f2:ac,bridge_name='br-int',has_traffic_filtering=True,id=a3f65859-14c9-4367-8d8d-465b49ebb7cc,network=Network(3c97181e-8aba-4ea6-ac09-fed09f0812ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f65859-14') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:07:02.999168 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lazy-loading 'pci_devices' on Instance uuid 9de3772c-0fb1-4718-bd84-b0ea6540a00c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:03.415058 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:03.419427 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:07:03.460398 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-01179529-7341-4a46-a15a-19eafac6da3b req-95991079-54c9-4a1a-a956-39d3aed40210 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:03.471950 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Took 7.64 seconds to spawn the instance on the hypervisor.
May 27 03:07:03.472230 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:03.493332 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:03.501987 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] End _get_guest_xml xml=<domain type="qemu">
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:   <uuid>9de3772c-0fb1-4718-bd84-b0ea6540a00c</uuid>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:   <name>instance-00000033</name>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-524695679</nova:name>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:07:02</nova:creationTime>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:         <nova:user uuid="4ba707c9283c45989ff891306f972873">tempest-VolumesSnapshotTestJSON-189213940-project-member</nova:user>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:         <nova:project uuid="4d79b15ea2254cd7adc804ece7e7cfae">tempest-VolumesSnapshotTestJSON-189213940</nova:project>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:         <nova:port uuid="a3f65859-14c9-4367-8d8d-465b49ebb7cc">
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     <system>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <entry name="serial">9de3772c-0fb1-4718-bd84-b0ea6540a00c</entry>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <entry name="uuid">9de3772c-0fb1-4718-bd84-b0ea6540a00c</entry>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     </system>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:   <os>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:   </os>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:   <features>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:   </features>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:   <devices>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c/disk"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     </disk>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c/disk.config"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     </disk>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:7b:f2:ac"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <target dev="tapa3f65859-14"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     </interface>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c/console.log" append="off"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     </serial>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     <video>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     </video>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     </rng>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:   </devices>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]: </domain>
May 27 03:07:03.501987 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:07:03.504675 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Preparing to wait for external event network-vif-plugged-a3f65859-14c9-4367-8d8d-465b49ebb7cc {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:07:03.504675 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:03.504675 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:03.504675 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:03.504675 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-524695679',display_name='tempest-VolumesSnapshotTestJSON-instance-524695679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumessnapshottestjson-instance-524695679',id=51,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZNwkY6ZNdPIGRKFsiJc6cUzbgmrE/1KHYIh2AjhtNmSD7WDNAoX1q2noQbM5PoBSNnP16gwOxAyCcXv7l1CwlFhFT915m4zoThyRaG+lfwiKYBkfP0mlPztgjsqsnIrg==',key_name='tempest-keypair-86205110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d79b15ea2254cd7adc804ece7e7cfae',ramdisk_id='',reservation_id='r-o01qas8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-189213940',owner_user_name='tempest-VolumesSnapshotTestJSON-189213940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ba707c9283c45989ff891306f972873',uuid=9de3772c-0fb1-4718-bd84-b0ea6540a00c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "address": "fa:16:3e:7b:f2:ac", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f65859-14", "ovs_interfaceid": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:07:03.504675 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Converting VIF {"id": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "address": "fa:16:3e:7b:f2:ac", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f65859-14", "ovs_interfaceid": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:07:03.504675 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f2:ac,bridge_name='br-int',has_traffic_filtering=True,id=a3f65859-14c9-4367-8d8d-465b49ebb7cc,network=Network(3c97181e-8aba-4ea6-ac09-fed09f0812ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f65859-14') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:07:03.504675 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f2:ac,bridge_name='br-int',has_traffic_filtering=True,id=a3f65859-14c9-4367-8d8d-465b49ebb7cc,network=Network(3c97181e-8aba-4ea6-ac09-fed09f0812ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f65859-14') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:07:03.505051 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:03.505315 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:03.505362 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:07:03.506346 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:03.506522 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7daacca5-c100-58e2-af36-2983316ea061', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:03.507352 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:03.508171 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:07:03.511298 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:03.513921 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:03.514207 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3f65859-14, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:03.514700 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3f65859-14, col_values=(('qos', UUID('df373177-0096-469e-bf20-a0907c3a21fa')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:03.514920 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3f65859-14, col_values=(('external_ids', {'iface-id': 'a3f65859-14c9-4367-8d8d-465b49ebb7cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:f2:ac', 'vm-uuid': '9de3772c-0fb1-4718-bd84-b0ea6540a00c'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:03.516214 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:03.517815 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:07:03.524043 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:03.525446 np0000001475 nova-compute[98471]: INFO os_vif [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f2:ac,bridge_name='br-int',has_traffic_filtering=True,id=a3f65859-14c9-4367-8d8d-465b49ebb7cc,network=Network(3c97181e-8aba-4ea6-ac09-fed09f0812ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f65859-14')
May 27 03:07:03.811416 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-01179529-7341-4a46-a15a-19eafac6da3b req-95991079-54c9-4a1a-a956-39d3aed40210 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:03.841296 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5e284215-3fd2-4925-8fb2-da466aa67f1a req-b2f2a6cc-7d78-4818-b7dc-32c72e126a0e service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Received event network-vif-plugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:03.841589 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5e284215-3fd2-4925-8fb2-da466aa67f1a req-b2f2a6cc-7d78-4818-b7dc-32c72e126a0e service nova] Acquiring lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:03.842535 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5e284215-3fd2-4925-8fb2-da466aa67f1a req-b2f2a6cc-7d78-4818-b7dc-32c72e126a0e service nova] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:03.843009 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5e284215-3fd2-4925-8fb2-da466aa67f1a req-b2f2a6cc-7d78-4818-b7dc-32c72e126a0e service nova] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:03.843103 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5e284215-3fd2-4925-8fb2-da466aa67f1a req-b2f2a6cc-7d78-4818-b7dc-32c72e126a0e service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] No waiting events found dispatching network-vif-plugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:07:03.843555 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-5e284215-3fd2-4925-8fb2-da466aa67f1a req-b2f2a6cc-7d78-4818-b7dc-32c72e126a0e service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Received unexpected event network-vif-plugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a for instance with vm_state active and task_state None.
May 27 03:07:03.914578 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "30e926af-236d-4544-9b8e-5fb9a3bddea6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:03.916147 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:03.916147 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Attaching volume 0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb to /dev/vdb
May 27 03:07:03.921098 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:07:03.922828 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851223.921678, a3d1d581-aaf0-4e14-99ae-5db434215c60 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:07:03.924341 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] VM Paused (Lifecycle Event)
May 27 03:07:03.965096 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-01179529-7341-4a46-a15a-19eafac6da3b req-95991079-54c9-4a1a-a956-39d3aed40210 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Updated VIF entry in instance network info cache for port a3f65859-14c9-4367-8d8d-465b49ebb7cc. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:07:03.965402 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-01179529-7341-4a46-a15a-19eafac6da3b req-95991079-54c9-4a1a-a956-39d3aed40210 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Updating instance_info_cache with network_info: [{"id": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "address": "fa:16:3e:7b:f2:ac", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f65859-14", "ovs_interfaceid": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:07:03.973054 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:07:03.987609 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Took 13.91 seconds to build instance.
May 27 03:07:03.987609 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:07:04.010039 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:04.062083 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:07:04.062372 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:07:04.071183 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:07:04.072911 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fead:d206', 'fe80::8cdc:9fff:fe79:9907', 'fe80::fc16:3eff:fe3e:7b2f', 'fe80::bc95:85ff:fe5a:dff6', 'fe80::fc16:3eff:febc:d056', 'fe80::b80a:ccff:fec0:b891', 'fe80::fc16:3eff:fedf:3ab8', 'fe80::7427:32ff:fe97:df09', 'fe80::fc16:3eff:fe69:cb34', 'fe80::787c:50ff:fed5:a1fc', 'fe80::fc16:3eff:feed:691b', 'fe80::d018:f2ff:feb0:9e2b'] 
May 27 03:07:04.073106 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:07:04.073252 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:07:04.073652 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:07:04.074119 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Updating existing volume attachment record: 398d0819-33b4-479f-a7c8-538e8fe6d8eb {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:07:04.335166 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-eaa43c18-9c99-4812-bbc1-9f471bc2f202 req-5f9433b0-8276-4fd3-956d-9c0019ff5216 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Received event network-changed-9759ac1f-7540-440f-89ce-d18c9e430586 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:04.335787 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-eaa43c18-9c99-4812-bbc1-9f471bc2f202 req-5f9433b0-8276-4fd3-956d-9c0019ff5216 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Refreshing instance network info cache due to event network-changed-9759ac1f-7540-440f-89ce-d18c9e430586. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:07:04.336035 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-eaa43c18-9c99-4812-bbc1-9f471bc2f202 req-5f9433b0-8276-4fd3-956d-9c0019ff5216 service nova] Acquiring lock "refresh_cache-f9cd3c05-0282-4843-b890-8be3eb097bfe" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:07:04.336228 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-eaa43c18-9c99-4812-bbc1-9f471bc2f202 req-5f9433b0-8276-4fd3-956d-9c0019ff5216 service nova] Acquired lock "refresh_cache-f9cd3c05-0282-4843-b890-8be3eb097bfe" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:07:04.336283 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-eaa43c18-9c99-4812-bbc1-9f471bc2f202 req-5f9433b0-8276-4fd3-956d-9c0019ff5216 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Refreshing network info cache for port 9759ac1f-7540-440f-89ce-d18c9e430586 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:07:04.403417 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c7c41ee4-24a9-478b-96d0-c55736dda447 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.637s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:04.429768 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:04.439116 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851224.4374418, a3d1d581-aaf0-4e14-99ae-5db434215c60 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:07:04.439116 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] VM Resumed (Lifecycle Event)
May 27 03:07:04.467953 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-01179529-7341-4a46-a15a-19eafac6da3b req-95991079-54c9-4a1a-a956-39d3aed40210 service nova] Releasing lock "refresh_cache-9de3772c-0fb1-4718-bd84-b0ea6540a00c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:07:04.488917 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-eb068e6c-0f0c-4e52-9034-12cc4f494e4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.416s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:04.585142 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:04.585142 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:04.633656 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:07:04.633998 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:07:04.634177 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:04.634575 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:04.634791 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:07:04.647180 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:04.647514 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:04.648284 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:04.648593 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:07:04.648990 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:04.649205 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:07:04.660752 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:07:04.660752 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:04.666467 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:07:04.666467 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:04.677597 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb] added
May 27 03:07:04.677597 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:07:04.677597 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:04.677597 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:04.677597 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:04.677597 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:04.677597 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:04.677919 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:07:04.677977 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0294(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:07:04.678140 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:07:04.687250 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb] added
May 27 03:07:04.687250 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:07:04.687250 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:04.687250 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:04.687250 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:04.687250 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:04.687250 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:04.687583 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:07:04.687637 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0384(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:07:04.687843 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:07:04.838527 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-eaa43c18-9c99-4812-bbc1-9f471bc2f202 req-5f9433b0-8276-4fd3-956d-9c0019ff5216 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:04.944056 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:04.946243 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:07:05.053992 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:05.054154 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:05.054217 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] No VIF found with MAC fa:16:3e:7b:f2:ac, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:07:05.054664 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Using config drive
May 27 03:07:05.089084 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:07:05.192042 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-eaa43c18-9c99-4812-bbc1-9f471bc2f202 req-5f9433b0-8276-4fd3-956d-9c0019ff5216 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:05.346127 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-eaa43c18-9c99-4812-bbc1-9f471bc2f202 req-5f9433b0-8276-4fd3-956d-9c0019ff5216 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Updated VIF entry in instance network info cache for port 9759ac1f-7540-440f-89ce-d18c9e430586. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:07:05.346400 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-eaa43c18-9c99-4812-bbc1-9f471bc2f202 req-5f9433b0-8276-4fd3-956d-9c0019ff5216 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Updating instance_info_cache with network_info: [{"id": "9759ac1f-7540-440f-89ce-d18c9e430586", "address": "fa:16:3e:69:cb:34", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ac1f-75", "ovs_interfaceid": "9759ac1f-7540-440f-89ce-d18c9e430586", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:07:05.468144 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:05.468605 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:05.563387 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:05.646499 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:05.646499 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:05.649221 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:07:05.649602 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Claim successful on node np0000001475
May 27 03:07:05.678627 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:07:05.688377 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:07:05.702973 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:07:05.702973 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:07:05.711857 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:07:05.711857 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:05.721192 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:05.725994 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Creating config drive at /opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c/disk.config
May 27 03:07:05.729471 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:05.731381 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnwue1v7c {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:05.748396 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:05.748396 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:05.748396 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:05.748396 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:05.748396 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:05.748622 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:05.748622 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:05.748622 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:05.748622 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:05.748622 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:05.749752 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:05.749752 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:05.749752 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:05.749752 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:05.749752 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:05.750064 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:05.750064 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:05.750064 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:05.750064 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:05.750064 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:05.789124 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnwue1v7c" returned: 0 in 0.058s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:07:05.789596 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb, portal: 192.168.40.100,3260]
May 27 03:07:05.789596 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb, portal: 192.168.40.100,3260] successful.
May 27 03:07:05.789596 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:05.799814 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb, portal: 192.168.50.100,3260]
May 27 03:07:05.799814 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb, portal: 192.168.50.100,3260] successful.
May 27 03:07:05.799814 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:05.806151 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:05.815549 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:05.822144 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:05.822144 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:05.822144 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:05.822144 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:05.822144 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:05.822144 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:05.822144 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:05.822380 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:05.822380 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:05.822380 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:05.822380 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:05.822380 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:05.822380 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:05.822380 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:05.822671 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:05.822840 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:07:05.823592 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] HCTL ('11', '-', '-', 0) found on session 104 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:07:05.823704 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:07:05.830690 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:05.830690 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:05.830690 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:05.830690 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:05.830690 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:05.830690 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:05.830690 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:05.830895 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:05.830895 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:05.830895 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:05.830895 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:05.830895 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:05.830895 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:05.830895 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:05.832768 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:05.832768 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:07:05.832768 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] HCTL ('12', '-', '-', 0) found on session 105 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:07:05.832768 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:07:05.843120 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Searching for a device in session 104 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:07:05.843120 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:07:05.852000 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-eaa43c18-9c99-4812-bbc1-9f471bc2f202 req-5f9433b0-8276-4fd3-956d-9c0019ff5216 service nova] Releasing lock "refresh_cache-f9cd3c05-0282-4843-b890-8be3eb097bfe" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:07:05.852180 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Searching for a device in session 105 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:07:05.852343 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:07:05.910455 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-73df0227-32b8-40ab-a9bb-12e31ed028cd req-4e740b94-7ee6-42cb-a4f8-69e0c49b7fcb service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Received event network-changed-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:05.911184 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-73df0227-32b8-40ab-a9bb-12e31ed028cd req-4e740b94-7ee6-42cb-a4f8-69e0c49b7fcb service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Refreshing instance network info cache due to event network-changed-ad4ac3f9-a243-42a4-9e61-fb161205ae0a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:07:05.911424 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-73df0227-32b8-40ab-a9bb-12e31ed028cd req-4e740b94-7ee6-42cb-a4f8-69e0c49b7fcb service nova] Acquiring lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:07:05.913914 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-73df0227-32b8-40ab-a9bb-12e31ed028cd req-4e740b94-7ee6-42cb-a4f8-69e0c49b7fcb service nova] Acquired lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:07:05.914222 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-73df0227-32b8-40ab-a9bb-12e31ed028cd req-4e740b94-7ee6-42cb-a4f8-69e0c49b7fcb service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Refreshing network info cache for port ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:07:05.974056 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'flavor' on Instance uuid 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:06.272426 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:06.304033 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:06.396457 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:06.422290 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-73df0227-32b8-40ab-a9bb-12e31ed028cd req-4e740b94-7ee6-42cb-a4f8-69e0c49b7fcb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:06.497036 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a9a8ca13-dbe8-44d7-81d7-1e48f60d2fe5 req-659ad857-de96-4ba7-a611-80cd99e1e99d service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Received event network-vif-plugged-a3f65859-14c9-4367-8d8d-465b49ebb7cc {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:06.497643 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a9a8ca13-dbe8-44d7-81d7-1e48f60d2fe5 req-659ad857-de96-4ba7-a611-80cd99e1e99d service nova] Acquiring lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:06.498206 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a9a8ca13-dbe8-44d7-81d7-1e48f60d2fe5 req-659ad857-de96-4ba7-a611-80cd99e1e99d service nova] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:06.500027 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a9a8ca13-dbe8-44d7-81d7-1e48f60d2fe5 req-659ad857-de96-4ba7-a611-80cd99e1e99d service nova] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:06.501660 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a9a8ca13-dbe8-44d7-81d7-1e48f60d2fe5 req-659ad857-de96-4ba7-a611-80cd99e1e99d service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Processing event network-vif-plugged-a3f65859-14c9-4367-8d8d-465b49ebb7cc {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:07:06.650365 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:07:06.675923 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:06.704692 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:06.705253 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:06.930533 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-73df0227-32b8-40ab-a9bb-12e31ed028cd req-4e740b94-7ee6-42cb-a4f8-69e0c49b7fcb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:06.983309 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:07.138424 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-73df0227-32b8-40ab-a9bb-12e31ed028cd req-4e740b94-7ee6-42cb-a4f8-69e0c49b7fcb service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Updated VIF entry in instance network info cache for port ad4ac3f9-a243-42a4-9e61-fb161205ae0a. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:07:07.138843 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-73df0227-32b8-40ab-a9bb-12e31ed028cd req-4e740b94-7ee6-42cb-a4f8-69e0c49b7fcb service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Updating instance_info_cache with network_info: [{"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:07:07.181183 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851227.1807716, 9de3772c-0fb1-4718-bd84-b0ea6540a00c => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:07:07.181351 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] VM Started (Lifecycle Event)
May 27 03:07:07.183788 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:07:07.189301 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:07:07.192277 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Instance spawned successfully.
May 27 03:07:07.192602 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:07:07.236369 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:07:07.236681 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:07:07.641030 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-73df0227-32b8-40ab-a9bb-12e31ed028cd req-4e740b94-7ee6-42cb-a4f8-69e0c49b7fcb service nova] Releasing lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:07:07.666304 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Found WWN 3300000006865693f for multipath device dm-4 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:07:07.666668 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:07.666861 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '3300000006865693f', 'path': '/dev/dm-4', 'multipath_id': '3300000006865693f'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:07:07.667057 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006865693f', 'path': '/dev/dm-4', 'multipath_id': '3300000006865693f'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:07:07.673378 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lazy-loading 'flavor' on Instance uuid 30e926af-236d-4544-9b8e-5fb9a3bddea6 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:07.685326 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:07.687965 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:07:07.702786 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:07.703210 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:07.703519 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:07.703776 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:07.704102 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:07.704642 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:07.739701 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:07:08.066794 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:08.067041 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:08.067294 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Attaching volume 0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba to /dev/vdc
May 27 03:07:08.116941 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:07:08.129311 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:07:08.153926 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:08.179767 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Attempting to attach volume 0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:07:08.182651 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:07:08.182651 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:07:08.182651 np0000001475 nova-compute[98471]:   <alias name="ua-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb"/>
May 27 03:07:08.182651 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-4"/>
May 27 03:07:08.182651 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:07:08.182651 np0000001475 nova-compute[98471]:   <serial>0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb</serial>
May 27 03:07:08.182651 np0000001475 nova-compute[98471]: </disk>
May 27 03:07:08.182651 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:07:08.190820 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:07:08.191311 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851228.1910381, 9de3772c-0fb1-4718-bd84-b0ea6540a00c => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:07:08.191416 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] VM Paused (Lifecycle Event)
May 27 03:07:08.196190 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:07:08.196479 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:07:08.210089 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Took 6.80 seconds to spawn the instance on the hypervisor.
May 27 03:07:08.211513 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:08.212536 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:07:08.213526 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fead:d206', 'fe80::8cdc:9fff:fe79:9907', 'fe80::fc16:3eff:fe3e:7b2f', 'fe80::bc95:85ff:fe5a:dff6', 'fe80::fc16:3eff:febc:d056', 'fe80::b80a:ccff:fec0:b891', 'fe80::fc16:3eff:fedf:3ab8', 'fe80::7427:32ff:fe97:df09', 'fe80::fc16:3eff:fe69:cb34', 'fe80::787c:50ff:fed5:a1fc', 'fe80::fc16:3eff:feed:691b', 'fe80::d018:f2ff:feb0:9e2b', 'fe80::fc16:3eff:fe7b:f2ac', 'fe80::492:18ff:fe4d:a46d'] 
May 27 03:07:08.213731 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:07:08.213909 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:07:08.214166 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:07:08.214414 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Updating existing volume attachment record: 122226d2-8888-4ce6-9fb5-b4f99aa949a0 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:07:08.252263 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.604s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:08.252263 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:07:08.528682 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:08.581246 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c3f3e78b-cbca-44c9-ae63-9323c563ddbf req-5502bbc5-c414-4c97-b8ce-0037daa16830 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Received event network-vif-plugged-a3f65859-14c9-4367-8d8d-465b49ebb7cc {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:08.582161 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3f3e78b-cbca-44c9-ae63-9323c563ddbf req-5502bbc5-c414-4c97-b8ce-0037daa16830 service nova] Acquiring lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:08.582437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3f3e78b-cbca-44c9-ae63-9323c563ddbf req-5502bbc5-c414-4c97-b8ce-0037daa16830 service nova] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:08.582657 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3f3e78b-cbca-44c9-ae63-9323c563ddbf req-5502bbc5-c414-4c97-b8ce-0037daa16830 service nova] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:08.583195 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c3f3e78b-cbca-44c9-ae63-9323c563ddbf req-5502bbc5-c414-4c97-b8ce-0037daa16830 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] No waiting events found dispatching network-vif-plugged-a3f65859-14c9-4367-8d8d-465b49ebb7cc {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:07:08.583195 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c3f3e78b-cbca-44c9-ae63-9323c563ddbf req-5502bbc5-c414-4c97-b8ce-0037daa16830 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Received unexpected event network-vif-plugged-a3f65859-14c9-4367-8d8d-465b49ebb7cc for instance with vm_state active and task_state None.
May 27 03:07:08.695402 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:08.698407 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851228.6981955, 9de3772c-0fb1-4718-bd84-b0ea6540a00c => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:07:08.698678 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] VM Resumed (Lifecycle Event)
May 27 03:07:08.732050 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Took 12.52 seconds to build instance.
May 27 03:07:08.760218 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:07:08.762863 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:07:08.762863 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:08.762863 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:08.783727 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:07:08.783727 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:07:08.783727 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:08.783727 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:08.783727 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:07:08.799362 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:08.800148 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:08.800801 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:08.801009 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:07:08.801374 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:08.801531 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:07:08.817263 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:07:08.817263 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:08.818079 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:07:08.818079 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:08.833807 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba] added
May 27 03:07:08.833807 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:07:08.833807 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:08.833807 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:08.833807 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:08.833807 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:08.833807 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:08.834030 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:07:08.834172 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0326(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:07:08.834303 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:07:08.837700 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba] added
May 27 03:07:08.837700 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:07:08.837700 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:08.837700 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:08.837700 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:08.837700 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:08.837700 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:08.837952 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:07:08.838133 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0371(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:07:08.838294 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:07:08.860920 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7fe58d4cae1c4693adb1e227daa9706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ed6c288e2642cfa4fbb3761274cc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:07:09.201662 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:09.206576 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:07:09.233842 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.030s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:09.261488 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:07:09.414714 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Successfully created port: faa68bc7-6703-419c-886a-7c71c19e32c2 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:07:09.765577 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:07:09.834725 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:07:09.838838 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:07:09.850214 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:07:09.850214 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:07:09.860637 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:07:09.860637 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:09.868320 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:09.875057 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:09.875269 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:09.875409 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:09.875563 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] No VIF found with MAC fa:16:3e:3e:7b:2f, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:07:09.882768 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:09.889095 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:09.889095 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:09.889095 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:09.889095 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:09.889095 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:09.889095 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:09.889095 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:09.889410 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:09.889410 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:09.889410 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:09.889410 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:09.889410 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:09.889410 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:09.889410 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:09.902088 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:09.902088 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:09.902088 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:09.902088 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:09.902088 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:09.902088 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:09.902088 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:09.902427 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:09.902427 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:09.902427 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:09.902427 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:09.902427 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:09.902427 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:09.902427 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:09.924618 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba, portal: 192.168.40.100,3260]
May 27 03:07:09.924618 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba, portal: 192.168.40.100,3260] successful.
May 27 03:07:09.924618 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:09.941221 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:09.957762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba, portal: 192.168.50.100,3260]
May 27 03:07:09.957762 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba, portal: 192.168.50.100,3260] successful.
May 27 03:07:09.957762 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:09.967782 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:09.967782 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:09.967782 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:09.967782 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:09.967782 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:09.967782 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:09.967782 np0000001475 nova-compute[98471]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:09.967782 np0000001475 nova-compute[98471]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:09.967782 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:09.968193 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:09.968193 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:09.968193 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:09.968193 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:09.968193 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:09.968193 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:09.968193 np0000001475 nova-compute[98471]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:09.968193 np0000001475 nova-compute[98471]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:09.968193 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:09.969767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:09.969767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:09.969767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:07:09.970053 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] HCTL ('13', '-', '-', 0) found on session 106 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:07:09.970184 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:07:09.988477 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Searching for a device in session 106 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:07:09.988764 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:07:09.992195 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:09.992195 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:09.992195 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:09.992195 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:09.992195 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:09.992195 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:09.992195 np0000001475 nova-compute[98471]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:09.992195 np0000001475 nova-compute[98471]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:09.992195 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:09.993435 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:09.993435 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:09.993435 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:09.993435 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:09.993435 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:09.993435 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:09.993435 np0000001475 nova-compute[98471]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:09.993435 np0000001475 nova-compute[98471]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:09.993435 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:09.993435 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:09.993435 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:07:09.995959 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] HCTL ('14', '-', '-', 0) found on session 107 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:07:09.996185 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:07:10.012991 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Searching for a device in session 107 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:07:10.012991 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:07:10.022892 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Successfully updated port: faa68bc7-6703-419c-886a-7c71c19e32c2 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:07:10.105354 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7d6dea50-5c58-4058-9a87-7a363c6c3b4d req-69b0cc46-d5b9-44f1-b5e8-9e0fa61f604e service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Received event network-changed-faa68bc7-6703-419c-886a-7c71c19e32c2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:10.105354 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7d6dea50-5c58-4058-9a87-7a363c6c3b4d req-69b0cc46-d5b9-44f1-b5e8-9e0fa61f604e service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Refreshing instance network info cache due to event network-changed-faa68bc7-6703-419c-886a-7c71c19e32c2. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:07:10.105354 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7d6dea50-5c58-4058-9a87-7a363c6c3b4d req-69b0cc46-d5b9-44f1-b5e8-9e0fa61f604e service nova] Acquiring lock "refresh_cache-2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:07:10.105354 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7d6dea50-5c58-4058-9a87-7a363c6c3b4d req-69b0cc46-d5b9-44f1-b5e8-9e0fa61f604e service nova] Acquired lock "refresh_cache-2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:07:10.105354 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7d6dea50-5c58-4058-9a87-7a363c6c3b4d req-69b0cc46-d5b9-44f1-b5e8-9e0fa61f604e service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Refreshing network info cache for port faa68bc7-6703-419c-886a-7c71c19e32c2 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:07:10.525964 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "refresh_cache-2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:07:10.611809 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-7d6dea50-5c58-4058-9a87-7a363c6c3b4d req-69b0cc46-d5b9-44f1-b5e8-9e0fa61f604e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:10.642980 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1abc7d52-3cb1-4465-9010-675080beb26c req-bf964605-af58-4331-8a76-f9fd7a632282 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Received event network-changed-a3f65859-14c9-4367-8d8d-465b49ebb7cc {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:10.644124 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1abc7d52-3cb1-4465-9010-675080beb26c req-bf964605-af58-4331-8a76-f9fd7a632282 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Refreshing instance network info cache due to event network-changed-a3f65859-14c9-4367-8d8d-465b49ebb7cc. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:07:10.644478 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1abc7d52-3cb1-4465-9010-675080beb26c req-bf964605-af58-4331-8a76-f9fd7a632282 service nova] Acquiring lock "refresh_cache-9de3772c-0fb1-4718-bd84-b0ea6540a00c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:07:10.644693 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1abc7d52-3cb1-4465-9010-675080beb26c req-bf964605-af58-4331-8a76-f9fd7a632282 service nova] Acquired lock "refresh_cache-9de3772c-0fb1-4718-bd84-b0ea6540a00c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:07:10.644955 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-1abc7d52-3cb1-4465-9010-675080beb26c req-bf964605-af58-4331-8a76-f9fd7a632282 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Refreshing network info cache for port a3f65859-14c9-4367-8d8d-465b49ebb7cc {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:07:10.708139 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7d6dea50-5c58-4058-9a87-7a363c6c3b4d req-69b0cc46-d5b9-44f1-b5e8-9e0fa61f604e service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:07:10.775772 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:07:10.775772 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:07:10.775772 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Creating image(s)
May 27 03:07:10.776381 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "/opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:10.776381 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "/opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:10.776543 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "/opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:10.776959 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:07:10.779893 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:07:10.782532 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:10.805671 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:07:10.879779 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.097s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:07:10.880309 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:10.880791 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:10.882151 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:07:10.885933 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:07:10.886259 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:10.935036 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7d6dea50-5c58-4058-9a87-7a363c6c3b4d req-69b0cc46-d5b9-44f1-b5e8-9e0fa61f604e service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:07:10.994360 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.108s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:07:10.995464 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:11.057443 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk 1073741824" returned: 0 in 0.062s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:07:11.058301 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.177s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:11.058377 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:11.147237 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.088s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:07:11.147660 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:07:11.147927 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:11.161158 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-1abc7d52-3cb1-4465-9010-675080beb26c req-bf964605-af58-4331-8a76-f9fd7a632282 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:11.262841 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:07:11.263303 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Cannot resize image /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:07:11.263607 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:07:11.263809 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Ensure instance console log exists: /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:07:11.264066 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:11.264295 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:11.264440 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:11.313826 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:11.440761 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7d6dea50-5c58-4058-9a87-7a363c6c3b4d req-69b0cc46-d5b9-44f1-b5e8-9e0fa61f604e service nova] Releasing lock "refresh_cache-2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:07:11.441417 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquired lock "refresh_cache-2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:07:11.441706 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:07:11.480146 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-95b4ce0e-2173-44c7-8d91-6c83fcdc26ba tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.564s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:11.565693 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-1abc7d52-3cb1-4465-9010-675080beb26c req-bf964605-af58-4331-8a76-f9fd7a632282 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:11.698199 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-1abc7d52-3cb1-4465-9010-675080beb26c req-bf964605-af58-4331-8a76-f9fd7a632282 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Updated VIF entry in instance network info cache for port a3f65859-14c9-4367-8d8d-465b49ebb7cc. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:07:11.698638 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-1abc7d52-3cb1-4465-9010-675080beb26c req-bf964605-af58-4331-8a76-f9fd7a632282 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Updating instance_info_cache with network_info: [{"id": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "address": "fa:16:3e:7b:f2:ac", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f65859-14", "ovs_interfaceid": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:07:11.820532 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Found WWN 3300000002ebe039b for multipath device dm-5 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:07:11.820895 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:11.821085 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '3300000002ebe039b', 'path': '/dev/dm-5', 'multipath_id': '3300000002ebe039b'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:07:11.821263 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002ebe039b', 'path': '/dev/dm-5', 'multipath_id': '3300000002ebe039b'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:07:11.825419 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'flavor' on Instance uuid 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:12.015684 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:07:12.187171 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:12.201324 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1abc7d52-3cb1-4465-9010-675080beb26c req-bf964605-af58-4331-8a76-f9fd7a632282 service nova] Releasing lock "refresh_cache-9de3772c-0fb1-4718-bd84-b0ea6540a00c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:07:12.330466 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Attempting to attach volume 0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:07:12.330466 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:07:12.330466 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:07:12.330466 np0000001475 nova-compute[98471]:   <alias name="ua-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba"/>
May 27 03:07:12.330466 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:07:12.330466 np0000001475 nova-compute[98471]:   <target dev="vdc" bus="virtio"/>
May 27 03:07:12.330466 np0000001475 nova-compute[98471]:   <serial>0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba</serial>
May 27 03:07:12.330466 np0000001475 nova-compute[98471]: </disk>
May 27 03:07:12.330466 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:07:12.333065 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Updating instance_info_cache with network_info: [{"id": "faa68bc7-6703-419c-886a-7c71c19e32c2", "address": "fa:16:3e:21:cf:cf", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa68bc7-67", "ovs_interfaceid": "faa68bc7-6703-419c-886a-7c71c19e32c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:07:12.834819 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Releasing lock "refresh_cache-2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:07:12.835386 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Instance network_info: |[{"id": "faa68bc7-6703-419c-886a-7c71c19e32c2", "address": "fa:16:3e:21:cf:cf", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa68bc7-67", "ovs_interfaceid": "faa68bc7-6703-419c-886a-7c71c19e32c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:07:12.836832 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Start _get_guest_xml network_info=[{"id": "faa68bc7-6703-419c-886a-7c71c19e32c2", "address": "fa:16:3e:21:cf:cf", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa68bc7-67", "ovs_interfaceid": "faa68bc7-6703-419c-886a-7c71c19e32c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:07:12.839482 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:07:12.840849 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-1180651749', uuid='2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa'), owner=OwnerMeta(userid='7fe58d4cae1c4693adb1e227daa9706d', username='tempest-TestStampPattern-1535526847-project-member', projectid='78ed6c288e2642cfa4fbb3761274cc4e', projectname='tempest-TestStampPattern-1535526847'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "faa68bc7-6703-419c-886a-7c71c19e32c2", "address": "fa:16:3e:21:cf:cf", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa68bc7-67", "ovs_interfaceid": "faa68bc7-6703-419c-886a-7c71c19e32c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851232.8403914) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:07:12.842292 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:07:12.842643 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:07:12.843620 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:07:12.843856 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:07:12.844789 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:07:12.845172 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:07:12.845349 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:07:12.845418 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:07:12.845532 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:07:12.845620 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:07:12.845701 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:07:12.845863 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:07:12.845972 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:07:12.846170 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:07:12.846310 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:07:12.846468 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:07:12.857052 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:07:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1180651749',display_name='tempest-TestStampPattern-server-1180651749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-teststamppattern-server-1180651749',id=52,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDZto3UEnSkHw1ZHyfMviV7eTmAwKMkc0vbfI2ZmPSYaEGZx8JCGyVLm9M3ISeDAEJ6PAcHMeO78i6xhagI2+NfgSC+XdyYyiXOSKNWg+tsw2p97Ky1ahauWZw+akj0Fg==',key_name='tempest-TestStampPattern-2046987046',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78ed6c288e2642cfa4fbb3761274cc4e',ramdisk_id='',reservation_id='r-my0ausfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1535526847',owner_user_name='tempest-TestStampPattern-1535526847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:07:10Z,user_data=None,user_id='7fe58d4cae1c4693adb1e227daa9706d',uuid=2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "faa68bc7-6703-419c-886a-7c71c19e32c2", "address": "fa:16:3e:21:cf:cf", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa68bc7-67", "ovs_interfaceid": "faa68bc7-6703-419c-886a-7c71c19e32c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:07:12.857297 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Converting VIF {"id": "faa68bc7-6703-419c-886a-7c71c19e32c2", "address": "fa:16:3e:21:cf:cf", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa68bc7-67", "ovs_interfaceid": "faa68bc7-6703-419c-886a-7c71c19e32c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:07:12.857856 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:cf:cf,bridge_name='br-int',has_traffic_filtering=True,id=faa68bc7-6703-419c-886a-7c71c19e32c2,network=Network(ae8febf4-ab96-4db6-bfef-62abb6610b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaa68bc7-67') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:07:12.858388 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:13.361972 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] End _get_guest_xml xml=<domain type="qemu">
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:   <uuid>2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa</uuid>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:   <name>instance-00000034</name>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestStampPattern-server-1180651749</nova:name>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:07:12</nova:creationTime>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:         <nova:user uuid="7fe58d4cae1c4693adb1e227daa9706d">tempest-TestStampPattern-1535526847-project-member</nova:user>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:         <nova:project uuid="78ed6c288e2642cfa4fbb3761274cc4e">tempest-TestStampPattern-1535526847</nova:project>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:         <nova:port uuid="faa68bc7-6703-419c-886a-7c71c19e32c2">
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     <system>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <entry name="serial">2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa</entry>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <entry name="uuid">2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa</entry>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     </system>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:   <os>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:   </os>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:   <features>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:   </features>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:   <devices>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     </disk>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk.config"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     </disk>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:21:cf:cf"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <target dev="tapfaa68bc7-67"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     </interface>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/console.log" append="off"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     </serial>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     <video>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     </video>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     </rng>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:   </devices>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]: </domain>
May 27 03:07:13.361972 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:07:13.361972 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Preparing to wait for external event network-vif-plugged-faa68bc7-6703-419c-886a-7c71c19e32c2 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:07:13.361972 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:13.361972 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:13.361972 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:13.363822 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:07:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1180651749',display_name='tempest-TestStampPattern-server-1180651749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-teststamppattern-server-1180651749',id=52,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDZto3UEnSkHw1ZHyfMviV7eTmAwKMkc0vbfI2ZmPSYaEGZx8JCGyVLm9M3ISeDAEJ6PAcHMeO78i6xhagI2+NfgSC+XdyYyiXOSKNWg+tsw2p97Ky1ahauWZw+akj0Fg==',key_name='tempest-TestStampPattern-2046987046',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78ed6c288e2642cfa4fbb3761274cc4e',ramdisk_id='',reservation_id='r-my0ausfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1535526847',owner_user_name='tempest-TestStampPattern-1535526847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:07:10Z,user_data=None,user_id='7fe58d4cae1c4693adb1e227daa9706d',uuid=2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "faa68bc7-6703-419c-886a-7c71c19e32c2", "address": "fa:16:3e:21:cf:cf", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa68bc7-67", "ovs_interfaceid": "faa68bc7-6703-419c-886a-7c71c19e32c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:07:13.363822 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Converting VIF {"id": "faa68bc7-6703-419c-886a-7c71c19e32c2", "address": "fa:16:3e:21:cf:cf", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa68bc7-67", "ovs_interfaceid": "faa68bc7-6703-419c-886a-7c71c19e32c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:07:13.363822 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:cf:cf,bridge_name='br-int',has_traffic_filtering=True,id=faa68bc7-6703-419c-886a-7c71c19e32c2,network=Network(ae8febf4-ab96-4db6-bfef-62abb6610b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaa68bc7-67') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:07:13.363822 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:cf:cf,bridge_name='br-int',has_traffic_filtering=True,id=faa68bc7-6703-419c-886a-7c71c19e32c2,network=Network(ae8febf4-ab96-4db6-bfef-62abb6610b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaa68bc7-67') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:07:13.364030 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:13.364930 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:13.364930 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:07:13.365462 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:13.365670 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7db5ebc7-36e1-5121-ab57-060c1db9fb0a', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:13.379056 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:13.381453 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:07:13.382909 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:13.383062 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfaa68bc7-67, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:13.383355 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfaa68bc7-67, col_values=(('qos', UUID('2a035417-e7f4-413e-bade-1e3d7c5ee263')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:13.383837 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfaa68bc7-67, col_values=(('external_ids', {'iface-id': 'faa68bc7-6703-419c-886a-7c71c19e32c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:cf:cf', 'vm-uuid': '2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:13.385991 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:07:13.391826 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:13.394798 np0000001475 nova-compute[98471]: INFO os_vif [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:cf:cf,bridge_name='br-int',has_traffic_filtering=True,id=faa68bc7-6703-419c-886a-7c71c19e32c2,network=Network(ae8febf4-ab96-4db6-bfef-62abb6610b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaa68bc7-67')
May 27 03:07:13.981935 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:13.982385 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:13.982385 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:13.982385 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:13.982520 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] No VIF found with MAC fa:16:3e:ad:d2:06, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:07:14.920554 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:14.922218 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:14.922417 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] No VIF found with MAC fa:16:3e:21:cf:cf, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:07:14.923598 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Using config drive
May 27 03:07:15.434975 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:15.541886 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ee7dde29-35fb-4415-a525-13b615af09d9 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.475s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:15.645193 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Creating config drive at /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk.config
May 27 03:07:15.655436 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphhscprsy {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:15.735947 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphhscprsy" returned: 0 in 0.081s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:07:16.232767 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:16.281970 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:16.316797 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:16.360417 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:16.360417 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:16.366544 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:16.503543 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c3f66d42-b5cd-46b5-8c75-2e6e9e6c2e39 req-8895d9f4-f97d-490e-8902-c4cfdf86147c service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Received event network-vif-plugged-faa68bc7-6703-419c-886a-7c71c19e32c2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:16.503944 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3f66d42-b5cd-46b5-8c75-2e6e9e6c2e39 req-8895d9f4-f97d-490e-8902-c4cfdf86147c service nova] Acquiring lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:16.503944 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3f66d42-b5cd-46b5-8c75-2e6e9e6c2e39 req-8895d9f4-f97d-490e-8902-c4cfdf86147c service nova] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:16.504133 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c3f66d42-b5cd-46b5-8c75-2e6e9e6c2e39 req-8895d9f4-f97d-490e-8902-c4cfdf86147c service nova] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:16.504394 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c3f66d42-b5cd-46b5-8c75-2e6e9e6c2e39 req-8895d9f4-f97d-490e-8902-c4cfdf86147c service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Processing event network-vif-plugged-faa68bc7-6703-419c-886a-7c71c19e32c2 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:07:16.667898 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:16.670326 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:16.672643 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:16.700586 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:16.861429 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Detaching volume b8a83b2e-3d77-40b8-ad85-46d76ceb5698
May 27 03:07:16.940892 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Attempting to driver detach volume b8a83b2e-3d77-40b8-ad85-46d76ceb5698 from mountpoint /dev/vdb
May 27 03:07:16.954624 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Found disk vdb by alias ua-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:07:16.958212 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Found disk vdb by alias ua-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:07:16.958297 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Attempting to detach device vdb from instance 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:07:16.958536 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:07:16.958536 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:07:16.958536 np0000001475 nova-compute[98471]:   <alias name="ua-b8a83b2e-3d77-40b8-ad85-46d76ceb5698"/>
May 27 03:07:16.958536 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:07:16.958536 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:07:16.958536 np0000001475 nova-compute[98471]:   <serial>b8a83b2e-3d77-40b8-ad85-46d76ceb5698</serial>
May 27 03:07:16.958536 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:07:16.958536 np0000001475 nova-compute[98471]: </disk>
May 27 03:07:16.958536 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:07:16.970809 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Successfully detached device vdb from instance 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 from the persistent domain config.
May 27 03:07:16.970928 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] (1/8): Attempting to detach device vdb with device alias ua-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 from instance 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:07:16.971776 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:07:16.971776 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:07:16.971776 np0000001475 nova-compute[98471]:   <alias name="ua-b8a83b2e-3d77-40b8-ad85-46d76ceb5698"/>
May 27 03:07:16.971776 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:07:16.971776 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:07:16.971776 np0000001475 nova-compute[98471]:   <serial>b8a83b2e-3d77-40b8-ad85-46d76ceb5698</serial>
May 27 03:07:16.971776 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:07:16.971776 np0000001475 nova-compute[98471]: </disk>
May 27 03:07:16.971776 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:07:17.204809 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:07:17.205332 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851237.2049031, 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:07:17.205875 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] VM Started (Lifecycle Event)
May 27 03:07:17.207467 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:07:17.212891 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Instance spawned successfully.
May 27 03:07:17.213325 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:07:17.581685 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 for instance 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:07:17.709581 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:17.711382 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:07:17.721049 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:17.721395 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:17.721612 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:17.721917 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:17.722263 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:17.722625 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:18.213840 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:07:18.214039 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851238.2138476, 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:07:18.214200 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] VM Paused (Lifecycle Event)
May 27 03:07:18.229829 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Took 7.46 seconds to spawn the instance on the hypervisor.
May 27 03:07:18.230100 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:18.387444 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:18.569942 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "7af020cf-50ce-441d-b10d-cf57cc280856" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:18.570205 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "7af020cf-50ce-441d-b10d-cf57cc280856" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:18.586401 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-317a2f2b-d7bd-4060-942c-e95938556f8a req-4f076500-0d7c-4a99-99b1-4f54d52659ee service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Received event network-vif-plugged-faa68bc7-6703-419c-886a-7c71c19e32c2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:18.588923 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-317a2f2b-d7bd-4060-942c-e95938556f8a req-4f076500-0d7c-4a99-99b1-4f54d52659ee service nova] Acquiring lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:18.588923 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-317a2f2b-d7bd-4060-942c-e95938556f8a req-4f076500-0d7c-4a99-99b1-4f54d52659ee service nova] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:18.588923 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-317a2f2b-d7bd-4060-942c-e95938556f8a req-4f076500-0d7c-4a99-99b1-4f54d52659ee service nova] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:18.590119 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-317a2f2b-d7bd-4060-942c-e95938556f8a req-4f076500-0d7c-4a99-99b1-4f54d52659ee service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] No waiting events found dispatching network-vif-plugged-faa68bc7-6703-419c-886a-7c71c19e32c2 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:07:18.590119 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-317a2f2b-d7bd-4060-942c-e95938556f8a req-4f076500-0d7c-4a99-99b1-4f54d52659ee service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Received unexpected event network-vif-plugged-faa68bc7-6703-419c-886a-7c71c19e32c2 for instance with vm_state active and task_state None.
May 27 03:07:18.719324 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:18.721332 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851238.7210839, 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:07:18.721467 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] VM Resumed (Lifecycle Event)
May 27 03:07:18.758859 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Took 13.17 seconds to build instance.
May 27 03:07:19.074602 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lazy-loading 'flavor' on Instance uuid 7af020cf-50ce-441d-b10d-cf57cc280856 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:19.224495 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:19.227720 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:07:19.263286 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.679s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:19.734233 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851239.7337084, 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 => ua-b8a83b2e-3d77-40b8-ad85-46d76ceb5698> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:07:19.738248 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Successfully detached device vdb from instance 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 from the live domain config.
May 27 03:07:19.741448 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:07:19.741972 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698', 'iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b8a83b2e-3d77-40b8-ad85-46d76ceb5698', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:07:19.742195 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:19.742607 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:19.743013 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698', 'iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b8a83b2e-3d77-40b8-ad85-46d76ceb5698', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:07:19.743184 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:07:19.773939 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:19.773939 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:19.773939 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:19.773939 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:19.773939 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:19.773939 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:19.773939 np0000001475 nova-compute[98471]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:19.773939 np0000001475 nova-compute[98471]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:19.773939 np0000001475 nova-compute[98471]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe2a65c1-6def-4aa5-ab80-dfbb1724f157 (non-flash)
May 27 03:07:19.773939 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:19.774775 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:19.774775 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:19.774775 np0000001475 nova-compute[98471]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:19.774775 np0000001475 nova-compute[98471]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698 (non-flash)
May 27 03:07:19.774775 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:19.774775 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:19.774775 np0000001475 nova-compute[98471]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:19.774775 np0000001475 nova-compute[98471]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:19.774775 np0000001475 nova-compute[98471]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe2a65c1-6def-4aa5-ab80-dfbb1724f157 (non-flash)
May 27 03:07:19.774775 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:19.774775 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698', '102'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe2a65c1-6def-4aa5-ab80-dfbb1724f157', '108')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:07:19.774775 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698', '103')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:07:19.776650 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698', '102')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:07:19.778100 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755724759c60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698'): ({'sdd'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:07:19.778100 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Removing multipathed devices sdd, sde {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:07:19.778853 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Flush multipath device 3300000000a0b2fc1 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:07:19.816407 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:07:19.868966 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:07:19.923451 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:07:19.923594 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:07:19.925047 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:07:19.940294 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:07:19.940294 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:07:19.961762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:20.000814 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 103, target: iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698, portal: 192.168.40.100,3260]
May 27 03:07:20.000814 np0000001475 nova-compute[98471]: Logout of [sid: 103, target: iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698, portal: 192.168.40.100,3260] successful.
May 27 03:07:20.000814 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:20.017769 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:20.029569 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:20.072480 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 102, target: iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698, portal: 192.168.50.100,3260]
May 27 03:07:20.072480 np0000001475 nova-compute[98471]: Logout of [sid: 102, target: iqn.2023-03.storpool.com:os--volume-b8a83b2e-3d77-40b8-ad85-46d76ceb5698, portal: 192.168.50.100,3260] successful.
May 27 03:07:20.072480 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:20.082289 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "7af020cf-50ce-441d-b10d-cf57cc280856" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:20.091360 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:20.091623 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:20.091781 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] <== disconnect_volume: return (350ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:07:20.091871 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:07:20.658281 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'flavor' on Instance uuid 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:21.170984 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "7af020cf-50ce-441d-b10d-cf57cc280856" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:21.170984 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "7af020cf-50ce-441d-b10d-cf57cc280856" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:21.170984 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Attaching volume bfba7f97-201d-44a9-bb07-1e451342a313 to /dev/vdb
May 27 03:07:21.284544 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:07:21.320225 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:21.324994 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:07:21.359332 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:21.412286 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:07:21.415408 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:07:21.425771 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:07:21.429389 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fead:d206', 'fe80::8cdc:9fff:fe79:9907', 'fe80::fc16:3eff:fe3e:7b2f', 'fe80::bc95:85ff:fe5a:dff6', 'fe80::fc16:3eff:febc:d056', 'fe80::b80a:ccff:fec0:b891', 'fe80::fc16:3eff:fedf:3ab8', 'fe80::7427:32ff:fe97:df09', 'fe80::fc16:3eff:fe69:cb34', 'fe80::787c:50ff:fed5:a1fc', 'fe80::fc16:3eff:feed:691b', 'fe80::d018:f2ff:feb0:9e2b', 'fe80::fc16:3eff:fe7b:f2ac', 'fe80::492:18ff:fe4d:a46d', 'fe80::fc16:3eff:fe21:cfcf', 'fe80::58d4:6eff:fe81:c6fc'] 
May 27 03:07:21.429639 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:07:21.429853 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:07:21.430201 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:07:21.430509 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Updating existing volume attachment record: b728ac5c-e669-4c2e-95ff-2dfc74bae338 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:07:21.668715 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-966a2651-a40f-4166-98fc-b92fa91f5bca req-14df15fe-b48f-405b-9056-fa36c1b9b770 service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Received event network-changed-faa68bc7-6703-419c-886a-7c71c19e32c2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:21.668715 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-966a2651-a40f-4166-98fc-b92fa91f5bca req-14df15fe-b48f-405b-9056-fa36c1b9b770 service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Refreshing instance network info cache due to event network-changed-faa68bc7-6703-419c-886a-7c71c19e32c2. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:07:21.668715 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-966a2651-a40f-4166-98fc-b92fa91f5bca req-14df15fe-b48f-405b-9056-fa36c1b9b770 service nova] Acquiring lock "refresh_cache-2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:07:21.668715 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-966a2651-a40f-4166-98fc-b92fa91f5bca req-14df15fe-b48f-405b-9056-fa36c1b9b770 service nova] Acquired lock "refresh_cache-2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:07:21.669163 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-966a2651-a40f-4166-98fc-b92fa91f5bca req-14df15fe-b48f-405b-9056-fa36c1b9b770 service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Refreshing network info cache for port faa68bc7-6703-419c-886a-7c71c19e32c2 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:07:21.676434 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ad62e4bc-4b87-4ac8-bb77-2f27aac1edd6 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.318s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:21.903985 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:21.903985 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:22.039568 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfba7f97-201d-44a9-bb07-1e451342a313', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7af020cf-50ce-441d-b10d-cf57cc280856', 'attached_at': '', 'detached_at': '', 'volume_id': 'bfba7f97-201d-44a9-bb07-1e451342a313', 'serial': 'bfba7f97-201d-44a9-bb07-1e451342a313'} {{(pid=98471) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 03:07:22.042651 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:07:22.042990 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfba7f97-201d-44a9-bb07-1e451342a313', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:07:22.043179 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:22.043914 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:22.044118 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfba7f97-201d-44a9-bb07-1e451342a313', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:07:22.057684 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:22.058151 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:22.058533 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:22.058810 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:07:22.059292 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:22.059292 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:07:22.074719 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:07:22.074719 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:22.075262 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:07:22.075262 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:22.089532 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313] added
May 27 03:07:22.089532 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:07:22.089532 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:22.089532 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:22.089532 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:22.089532 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:22.089532 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:22.089810 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:07:22.089950 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:07:22.090111 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:07:22.090682 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313] added
May 27 03:07:22.090682 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:07:22.090682 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:22.090682 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:22.090682 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:22.090682 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:22.090682 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:22.090862 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:07:22.091018 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0322(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:07:22.091104 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:07:22.172438 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-966a2651-a40f-4166-98fc-b92fa91f5bca req-14df15fe-b48f-405b-9056-fa36c1b9b770 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:22.406350 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Detaching volume 0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba
May 27 03:07:22.453316 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Attempting to driver detach volume 0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba from mountpoint /dev/vdc
May 27 03:07:22.457715 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Found disk vdc by alias ua-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:07:22.458839 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Found disk vdc by alias ua-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:07:22.459004 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Attempting to detach device vdc from instance 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:07:22.459374 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:07:22.459374 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:07:22.459374 np0000001475 nova-compute[98471]:   <alias name="ua-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba"/>
May 27 03:07:22.459374 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:07:22.459374 np0000001475 nova-compute[98471]:   <target dev="vdc" bus="virtio"/>
May 27 03:07:22.459374 np0000001475 nova-compute[98471]:   <serial>0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba</serial>
May 27 03:07:22.459374 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 27 03:07:22.459374 np0000001475 nova-compute[98471]: </disk>
May 27 03:07:22.459374 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:07:22.465762 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Successfully detached device vdc from instance 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 from the persistent domain config.
May 27 03:07:22.465980 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] (1/8): Attempting to detach device vdc with device alias ua-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba from instance 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:07:22.466301 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:07:22.466301 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:07:22.466301 np0000001475 nova-compute[98471]:   <alias name="ua-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba"/>
May 27 03:07:22.466301 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:07:22.466301 np0000001475 nova-compute[98471]:   <target dev="vdc" bus="virtio"/>
May 27 03:07:22.466301 np0000001475 nova-compute[98471]:   <serial>0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba</serial>
May 27 03:07:22.466301 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 27 03:07:22.466301 np0000001475 nova-compute[98471]: </disk>
May 27 03:07:22.466301 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:07:22.693996 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-966a2651-a40f-4166-98fc-b92fa91f5bca req-14df15fe-b48f-405b-9056-fa36c1b9b770 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:22.896174 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-966a2651-a40f-4166-98fc-b92fa91f5bca req-14df15fe-b48f-405b-9056-fa36c1b9b770 service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Updated VIF entry in instance network info cache for port faa68bc7-6703-419c-886a-7c71c19e32c2. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:07:22.896478 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-966a2651-a40f-4166-98fc-b92fa91f5bca req-14df15fe-b48f-405b-9056-fa36c1b9b770 service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Updating instance_info_cache with network_info: [{"id": "faa68bc7-6703-419c-886a-7c71c19e32c2", "address": "fa:16:3e:21:cf:cf", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa68bc7-67", "ovs_interfaceid": "faa68bc7-6703-419c-886a-7c71c19e32c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:07:23.070171 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851243.0695603, 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 => ua-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:07:23.071972 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba for instance 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:07:23.074555 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Successfully detached device vdc from instance 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 from the live domain config.
May 27 03:07:23.075669 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:07:23.076143 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:07:23.076412 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:23.090524 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:07:23.091332 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:07:23.105687 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:07:23.105687 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:07:23.111867 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:07:23.111867 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:23.119946 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:23.127377 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:23.138643 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:23.138643 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:23.138643 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:23.138643 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:23.138643 np0000001475 nova-compute[98471]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:23.138643 np0000001475 nova-compute[98471]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:23.138643 np0000001475 nova-compute[98471]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe2a65c1-6def-4aa5-ab80-dfbb1724f157 (non-flash)
May 27 03:07:23.138643 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:23.138970 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:23.138970 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:23.138970 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:23.138970 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:23.138970 np0000001475 nova-compute[98471]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:23.138970 np0000001475 nova-compute[98471]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:23.138970 np0000001475 nova-compute[98471]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe2a65c1-6def-4aa5-ab80-dfbb1724f157 (non-flash)
May 27 03:07:23.138970 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:23.147207 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:23.147207 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:23.147207 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:23.147207 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:23.147207 np0000001475 nova-compute[98471]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:23.147207 np0000001475 nova-compute[98471]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:23.147207 np0000001475 nova-compute[98471]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe2a65c1-6def-4aa5-ab80-dfbb1724f157 (non-flash)
May 27 03:07:23.147207 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:23.147207 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:23.147207 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:23.147207 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:23.147207 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:23.147207 np0000001475 nova-compute[98471]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:23.147207 np0000001475 nova-compute[98471]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:23.147207 np0000001475 nova-compute[98471]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe2a65c1-6def-4aa5-ab80-dfbb1724f157 (non-flash)
May 27 03:07:23.147207 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:23.182257 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313, portal: 192.168.40.100,3260]
May 27 03:07:23.182257 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313, portal: 192.168.40.100,3260] successful.
May 27 03:07:23.182257 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:23.197627 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:23.203262 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313, portal: 192.168.50.100,3260]
May 27 03:07:23.203262 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313, portal: 192.168.50.100,3260] successful.
May 27 03:07:23.203262 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:23.217287 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:23.223066 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:23.223066 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:23.223066 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:23.223066 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:23.223066 np0000001475 nova-compute[98471]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:23.223066 np0000001475 nova-compute[98471]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:23.223066 np0000001475 nova-compute[98471]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe2a65c1-6def-4aa5-ab80-dfbb1724f157 (non-flash)
May 27 03:07:23.223066 np0000001475 nova-compute[98471]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:07:23.223066 np0000001475 nova-compute[98471]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:07:23.223066 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:23.223287 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:23.223287 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:23.223287 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:23.223287 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:23.223287 np0000001475 nova-compute[98471]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:23.223287 np0000001475 nova-compute[98471]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:23.223287 np0000001475 nova-compute[98471]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe2a65c1-6def-4aa5-ab80-dfbb1724f157 (non-flash)
May 27 03:07:23.223287 np0000001475 nova-compute[98471]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:07:23.223287 np0000001475 nova-compute[98471]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:07:23.223287 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:23.223599 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:23.223714 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:07:23.224631 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] HCTL ('9', '-', '-', 0) found on session 109 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:07:23.224728 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe2a65c1-6def-4aa5-ab80-dfbb1724f157 (non-flash)
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:07:23.246887 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe2a65c1-6def-4aa5-ab80-dfbb1724f157 (non-flash)
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:07:23.246887 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Searching for a device in session 109 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:07:23.246887 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfba7f97-201d-44a9-bb07-1e451342a313', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:07:23.249387 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] HCTL ('10', '-', '-', 0) found on session 110 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:07:23.249387 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:07:23.266627 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Searching for a device in session 110 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:07:23.266627 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bfba7f97-201d-44a9-bb07-1e451342a313', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:07:23.389401 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:23.398410 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-966a2651-a40f-4166-98fc-b92fa91f5bca req-14df15fe-b48f-405b-9056-fa36c1b9b770 service nova] Releasing lock "refresh_cache-2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:07:24.060838 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:07:25.085041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Found WWN 330000000784e78af for multipath device dm-3 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:07:25.085527 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:25.087585 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.010s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:25.090517 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:07:25.091417 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] <== connect_volume: return (3048ms) {'type': 'block', 'scsi_wwn': '330000000784e78af', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '330000000784e78af'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:07:25.091656 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000784e78af', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '330000000784e78af'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:07:25.092008 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:07:25.093581 np0000001475 nova-compute[98471]: WARNING stevedore.named [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 03:07:25.093920 np0000001475 nova-compute[98471]: WARNING castellan.key_manager [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:07:25.094139 np0000001475 nova-compute[98471]: WARNING nova.keymgr.conf_key_mgr [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:07:25.129351 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Secret XML: <secret ephemeral="no" private="no">
May 27 03:07:25.129351 np0000001475 nova-compute[98471]:   <usage type="volume">
May 27 03:07:25.129351 np0000001475 nova-compute[98471]:     <volume>bfba7f97-201d-44a9-bb07-1e451342a313</volume>
May 27 03:07:25.129351 np0000001475 nova-compute[98471]:   </usage>
May 27 03:07:25.129351 np0000001475 nova-compute[98471]: </secret>
May 27 03:07:25.129351 np0000001475 nova-compute[98471]:  {{(pid=98471) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 27 03:07:25.144051 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lazy-loading 'flavor' on Instance uuid 7af020cf-50ce-441d-b10d-cf57cc280856 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:25.148532 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:25.148532 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:25.148532 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:25.148532 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:25.148532 np0000001475 nova-compute[98471]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:25.148532 np0000001475 nova-compute[98471]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:25.148532 np0000001475 nova-compute[98471]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe2a65c1-6def-4aa5-ab80-dfbb1724f157 (non-flash)
May 27 03:07:25.148532 np0000001475 nova-compute[98471]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:07:25.148532 np0000001475 nova-compute[98471]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:07:25.148532 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:25.151006 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:25.151006 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:25.151006 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:25.151006 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:25.151006 np0000001475 nova-compute[98471]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:25.151006 np0000001475 nova-compute[98471]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba (non-flash)
May 27 03:07:25.151006 np0000001475 nova-compute[98471]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe2a65c1-6def-4aa5-ab80-dfbb1724f157 (non-flash)
May 27 03:07:25.151006 np0000001475 nova-compute[98471]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:07:25.151006 np0000001475 nova-compute[98471]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:07:25.151006 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:25.151006 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe2a65c1-6def-4aa5-ab80-dfbb1724f157', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', '109'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', '110')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:07:25.151510 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', '106')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:07:25.159110 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba', '107')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:07:25.170917 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755724788680>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba'): ({'sdi'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:07:25.172256 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Removing multipathed devices sdi, sdh {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:07:25.173648 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Flush multipath device 3300000002ebe039b {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:07:25.227760 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:07:25.276068 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:07:25.333371 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:07:25.333618 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:07:25.335248 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:07:25.347734 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:07:25.347965 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:07:25.358799 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:25.395836 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 106, target: iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba, portal: 192.168.40.100,3260]
May 27 03:07:25.395836 np0000001475 nova-compute[98471]: Logout of [sid: 106, target: iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba, portal: 192.168.40.100,3260] successful.
May 27 03:07:25.395836 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:25.416273 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:25.427354 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:25.462235 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 107, target: iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba, portal: 192.168.50.100,3260]
May 27 03:07:25.462235 np0000001475 nova-compute[98471]: Logout of [sid: 107, target: iqn.2023-03.storpool.com:os--volume-0e4a9d21-786d-45af-bd4e-d7aefd4ae8ba, portal: 192.168.50.100,3260] successful.
May 27 03:07:25.462235 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:25.482393 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:25.482714 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:25.482714 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] <== disconnect_volume: return (2406ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:07:25.482966 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:07:25.649921 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Attempting to attach volume bfba7f97-201d-44a9-bb07-1e451342a313 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:07:25.651661 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:07:25.651661 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:07:25.651661 np0000001475 nova-compute[98471]:   <alias name="ua-bfba7f97-201d-44a9-bb07-1e451342a313"/>
May 27 03:07:25.651661 np0000001475 nova-compute[98471]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 27 03:07:25.651661 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:07:25.651661 np0000001475 nova-compute[98471]:   <serial>bfba7f97-201d-44a9-bb07-1e451342a313</serial>
May 27 03:07:25.651661 np0000001475 nova-compute[98471]:   <encryption format="luks">
May 27 03:07:25.651661 np0000001475 nova-compute[98471]:     <secret type="passphrase" uuid="595f140c-8559-4a1f-aec8-3a518dc90b68"/>
May 27 03:07:25.651661 np0000001475 nova-compute[98471]:   </encryption>
May 27 03:07:25.651661 np0000001475 nova-compute[98471]: </disk>
May 27 03:07:25.651661 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:07:26.034206 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'flavor' on Instance uuid 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:26.322093 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:27.040058 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6495a1c6-6f51-46b0-8929-86a3bcf9c2db tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.137s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:27.542382 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:27.542963 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:27.543240 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:27.543461 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:27.543614 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:27.547612 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Terminating instance
May 27 03:07:28.051850 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:07:28.075893 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:28.079283 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:28.101393 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:28.105067 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:28.130540 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:28.133067 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:28.133615 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:28.133615 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:28.133615 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] No VIF found with MAC fa:16:3e:bc:d0:56, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:07:28.252784 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-313eb6be-2d6a-4871-98f9-ce67854565df req-ec5bf0c1-ca7e-432b-8037-5e71e2677a40 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Received event network-vif-unplugged-4a157cbc-e218-493d-a824-c7318f618ed3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:28.254196 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-313eb6be-2d6a-4871-98f9-ce67854565df req-ec5bf0c1-ca7e-432b-8037-5e71e2677a40 service nova] Acquiring lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:28.254196 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-313eb6be-2d6a-4871-98f9-ce67854565df req-ec5bf0c1-ca7e-432b-8037-5e71e2677a40 service nova] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:28.254196 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-313eb6be-2d6a-4871-98f9-ce67854565df req-ec5bf0c1-ca7e-432b-8037-5e71e2677a40 service nova] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:28.254196 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-313eb6be-2d6a-4871-98f9-ce67854565df req-ec5bf0c1-ca7e-432b-8037-5e71e2677a40 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] No waiting events found dispatching network-vif-unplugged-4a157cbc-e218-493d-a824-c7318f618ed3 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:07:28.254196 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-313eb6be-2d6a-4871-98f9-ce67854565df req-ec5bf0c1-ca7e-432b-8037-5e71e2677a40 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Received event network-vif-unplugged-4a157cbc-e218-493d-a824-c7318f618ed3 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:07:28.391874 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:28.424035 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999643656999979 future=<Future at 0x7557043d7890 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:07:28.424950 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.998692256999675 future=<Future at 0x7557043d7890 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:07:28.425132 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.998541916999784 future=<Future at 0x7557043d7890 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:07:28.426315 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Instance destroyed successfully.
May 27 03:07:28.426914 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lazy-loading 'resources' on Instance uuid 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:28.930427 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:05:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1832726814',display_name='tempest-AttachVolumeTestJSON-server-1832726814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumetestjson-server-1832726814',id=45,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgMwAk3Mc1SEYQ0aF1gRSiwHjVQMMTyaB1GQTy8x8jOeMDCicH5Z6dLT2cLieY14z6ysLiBJU/K3RNmk57bbqTiZSDPN/igldnxcZekFaYPwSvyqnQG6BSNvx6oFrTgOw==',key_name='tempest-keypair-1591828618',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:06:14Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca3c6a3942eb41e8b6aefddc5faca789',ramdisk_id='',reservation_id='r-h40jc4a4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1635503347',owner_user_name='tempest-AttachVolumeTestJSON-1635503347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0d83ca7002c41e0897c39e7b8d91bff',uuid=3593ceaa-ccfe-4242-9fcd-2582ac795dd2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a157cbc-e218-493d-a824-c7318f618ed3", "address": "fa:16:3e:ad:d2:06", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a157cbc-e2", "ovs_interfaceid": "4a157cbc-e218-493d-a824-c7318f618ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:07:28.931147 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converting VIF {"id": "4a157cbc-e218-493d-a824-c7318f618ed3", "address": "fa:16:3e:ad:d2:06", "network": {"id": "38fa06c2-1987-4239-9b03-f05ebf00d1b5", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-57692493-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ca3c6a3942eb41e8b6aefddc5faca789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a157cbc-e2", "ovs_interfaceid": "4a157cbc-e218-493d-a824-c7318f618ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:07:28.931283 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:d2:06,bridge_name='br-int',has_traffic_filtering=True,id=4a157cbc-e218-493d-a824-c7318f618ed3,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a157cbc-e2') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:07:28.931564 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:d2:06,bridge_name='br-int',has_traffic_filtering=True,id=4a157cbc-e218-493d-a824-c7318f618ed3,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a157cbc-e2') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:07:28.934648 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:28.934648 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a157cbc-e2, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:28.937367 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:07:28.938228 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:28.938515 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6846c130-c2ef-4605-971c-e8c060432f08) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:28.940536 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:07:28.942187 np0000001475 nova-compute[98471]: INFO os_vif [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:d2:06,bridge_name='br-int',has_traffic_filtering=True,id=4a157cbc-e218-493d-a824-c7318f618ed3,network=Network(38fa06c2-1987-4239-9b03-f05ebf00d1b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a157cbc-e2')
May 27 03:07:28.942621 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Deleting instance files /opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2_del
May 27 03:07:28.943554 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Deletion of /opt/stack/data/nova/instances/3593ceaa-ccfe-4242-9fcd-2582ac795dd2_del complete
May 27 03:07:29.451830 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Took 1.40 seconds to destroy the instance on the hypervisor.
May 27 03:07:29.452813 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:07:29.453090 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:07:29.453234 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:07:29.453965 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:29.602813 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:29.692459 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-56cfb92c-a0a5-4cf9-b308-fa3690f28ccc tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "7af020cf-50ce-441d-b10d-cf57cc280856" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.523s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:30.078327 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b7b989b0-5bd6-4edf-bc80-80c1844de7f8 req-bfd873a6-f353-4fdf-90dc-bc1c586a1409 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Received event network-vif-deleted-4a157cbc-e218-493d-a824-c7318f618ed3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:30.078677 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-b7b989b0-5bd6-4edf-bc80-80c1844de7f8 req-bfd873a6-f353-4fdf-90dc-bc1c586a1409 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Neutron deleted interface 4a157cbc-e218-493d-a824-c7318f618ed3; detaching it from the instance and deleting it from the info cache
May 27 03:07:30.078775 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-b7b989b0-5bd6-4edf-bc80-80c1844de7f8 req-bfd873a6-f353-4fdf-90dc-bc1c586a1409 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:07:30.104726 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "7af020cf-50ce-441d-b10d-cf57cc280856" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:30.105245 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "7af020cf-50ce-441d-b10d-cf57cc280856" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:30.329089 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-36a99c8d-d0a1-4069-ab1b-d3b00cfe7999 req-66a2df84-b271-49bb-9200-d9944dcb6b36 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Received event network-vif-unplugged-4a157cbc-e218-493d-a824-c7318f618ed3 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:30.329249 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-36a99c8d-d0a1-4069-ab1b-d3b00cfe7999 req-66a2df84-b271-49bb-9200-d9944dcb6b36 service nova] Acquiring lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:30.329401 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-36a99c8d-d0a1-4069-ab1b-d3b00cfe7999 req-66a2df84-b271-49bb-9200-d9944dcb6b36 service nova] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:30.329674 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-36a99c8d-d0a1-4069-ab1b-d3b00cfe7999 req-66a2df84-b271-49bb-9200-d9944dcb6b36 service nova] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:30.329809 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-36a99c8d-d0a1-4069-ab1b-d3b00cfe7999 req-66a2df84-b271-49bb-9200-d9944dcb6b36 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] No waiting events found dispatching network-vif-unplugged-4a157cbc-e218-493d-a824-c7318f618ed3 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:07:30.329920 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-36a99c8d-d0a1-4069-ab1b-d3b00cfe7999 req-66a2df84-b271-49bb-9200-d9944dcb6b36 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Received event network-vif-unplugged-4a157cbc-e218-493d-a824-c7318f618ed3 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:07:30.521462 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:07:30.582659 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b7b989b0-5bd6-4edf-bc80-80c1844de7f8 req-bfd873a6-f353-4fdf-90dc-bc1c586a1409 service nova] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Detach interface failed, port_id=4a157cbc-e218-493d-a824-c7318f618ed3, reason: Instance 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:07:30.608764 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Detaching volume bfba7f97-201d-44a9-bb07-1e451342a313
May 27 03:07:30.667033 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Attempting to driver detach volume bfba7f97-201d-44a9-bb07-1e451342a313 from mountpoint /dev/vdb
May 27 03:07:30.709996 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfba7f97-201d-44a9-bb07-1e451342a313', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '7af020cf-50ce-441d-b10d-cf57cc280856', 'attached_at': '', 'detached_at': '', 'volume_id': 'bfba7f97-201d-44a9-bb07-1e451342a313', 'serial': 'bfba7f97-201d-44a9-bb07-1e451342a313'} {{(pid=98471) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 03:07:30.713561 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Found disk vdb by alias ua-bfba7f97-201d-44a9-bb07-1e451342a313 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:07:30.714988 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Found disk vdb by alias ua-bfba7f97-201d-44a9-bb07-1e451342a313 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:07:30.715241 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Attempting to detach device vdb from instance 7af020cf-50ce-441d-b10d-cf57cc280856 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:07:30.715485 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:07:30.715485 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:07:30.715485 np0000001475 nova-compute[98471]:   <alias name="ua-bfba7f97-201d-44a9-bb07-1e451342a313"/>
May 27 03:07:30.715485 np0000001475 nova-compute[98471]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 27 03:07:30.715485 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:07:30.715485 np0000001475 nova-compute[98471]:   <serial>bfba7f97-201d-44a9-bb07-1e451342a313</serial>
May 27 03:07:30.715485 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:07:30.715485 np0000001475 nova-compute[98471]:   <encryption format="luks">
May 27 03:07:30.715485 np0000001475 nova-compute[98471]:     <secret type="passphrase" uuid="595f140c-8559-4a1f-aec8-3a518dc90b68"/>
May 27 03:07:30.715485 np0000001475 nova-compute[98471]:   </encryption>
May 27 03:07:30.715485 np0000001475 nova-compute[98471]: </disk>
May 27 03:07:30.715485 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:07:30.723053 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Successfully detached device vdb from instance 7af020cf-50ce-441d-b10d-cf57cc280856 from the persistent domain config.
May 27 03:07:30.723321 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] (1/8): Attempting to detach device vdb with device alias ua-bfba7f97-201d-44a9-bb07-1e451342a313 from instance 7af020cf-50ce-441d-b10d-cf57cc280856 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:07:30.723618 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:07:30.723618 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:07:30.723618 np0000001475 nova-compute[98471]:   <alias name="ua-bfba7f97-201d-44a9-bb07-1e451342a313"/>
May 27 03:07:30.723618 np0000001475 nova-compute[98471]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 27 03:07:30.723618 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:07:30.723618 np0000001475 nova-compute[98471]:   <serial>bfba7f97-201d-44a9-bb07-1e451342a313</serial>
May 27 03:07:30.723618 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:07:30.723618 np0000001475 nova-compute[98471]:   <encryption format="luks">
May 27 03:07:30.723618 np0000001475 nova-compute[98471]:     <secret type="passphrase" uuid="595f140c-8559-4a1f-aec8-3a518dc90b68"/>
May 27 03:07:30.723618 np0000001475 nova-compute[98471]:   </encryption>
May 27 03:07:30.723618 np0000001475 nova-compute[98471]: </disk>
May 27 03:07:30.723618 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:07:31.025883 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Took 1.57 seconds to deallocate network for instance.
May 27 03:07:31.230533 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851251.2301478, 7af020cf-50ce-441d-b10d-cf57cc280856 => ua-bfba7f97-201d-44a9-bb07-1e451342a313> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:07:31.232330 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-bfba7f97-201d-44a9-bb07-1e451342a313 for instance 7af020cf-50ce-441d-b10d-cf57cc280856 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:07:31.234538 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Successfully detached device vdb from instance 7af020cf-50ce-441d-b10d-cf57cc280856 from the live domain config.
May 27 03:07:31.236381 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:07:31.236635 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfba7f97-201d-44a9-bb07-1e451342a313', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:07:31.236873 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:31.237189 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:31.237434 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bfba7f97-201d-44a9-bb07-1e451342a313', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:07:31.237535 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:07:31.260461 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:31.260461 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:31.260461 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:31.260461 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:31.260461 np0000001475 nova-compute[98471]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:07:31.260461 np0000001475 nova-compute[98471]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:07:31.260461 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:31.260865 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:31.260865 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:31.260865 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:31.260865 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:31.260865 np0000001475 nova-compute[98471]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:07:31.260865 np0000001475 nova-compute[98471]: tcp: [110] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313 (non-flash)
May 27 03:07:31.260865 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:31.260865 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', '109'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', '110')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:07:31.260865 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', '109')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:07:31.261575 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313', '110')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:07:31.262281 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572472e660>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313'): ({'sde'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:07:31.262431 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Removing multipathed devices sdd, sde {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:07:31.262641 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Flush multipath device 330000000784e78af {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:07:31.293053 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:07:31.322860 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:31.342018 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:07:31.393098 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:07:31.393232 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:07:31.394050 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:07:31.404304 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:07:31.404545 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:07:31.413984 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:31.445764 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 109, target: iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313, portal: 192.168.40.100,3260]
May 27 03:07:31.445764 np0000001475 nova-compute[98471]: Logout of [sid: 109, target: iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313, portal: 192.168.40.100,3260] successful.
May 27 03:07:31.445764 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:31.460671 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:31.472710 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:31.499002 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 110, target: iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313, portal: 192.168.50.100,3260]
May 27 03:07:31.499002 np0000001475 nova-compute[98471]: Logout of [sid: 110, target: iqn.2023-03.storpool.com:os--volume-bfba7f97-201d-44a9-bb07-1e451342a313, portal: 192.168.50.100,3260] successful.
May 27 03:07:31.499002 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:31.511975 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:31.512963 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:31.513128 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] <== disconnect_volume: return (276ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:07:31.513271 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:07:31.533238 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:31.533238 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:31.689331 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "30e926af-236d-4544-9b8e-5fb9a3bddea6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:31.689501 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:31.959172 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:07:31.959172 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:07:32.066535 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lazy-loading 'flavor' on Instance uuid 7af020cf-50ce-441d-b10d-cf57cc280856 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:32.191704 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Detaching volume 0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb
May 27 03:07:32.243720 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Attempting to driver detach volume 0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb from mountpoint /dev/vdb
May 27 03:07:32.249664 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Found disk vdb by alias ua-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:07:32.251512 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Found disk vdb by alias ua-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:07:32.251701 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Attempting to detach device vdb from instance 30e926af-236d-4544-9b8e-5fb9a3bddea6 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:07:32.252026 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:07:32.252026 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:07:32.252026 np0000001475 nova-compute[98471]:   <alias name="ua-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb"/>
May 27 03:07:32.252026 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-4"/>
May 27 03:07:32.252026 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:07:32.252026 np0000001475 nova-compute[98471]:   <serial>0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb</serial>
May 27 03:07:32.252026 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:07:32.252026 np0000001475 nova-compute[98471]: </disk>
May 27 03:07:32.252026 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:07:32.258267 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Successfully detached device vdb from instance 30e926af-236d-4544-9b8e-5fb9a3bddea6 from the persistent domain config.
May 27 03:07:32.258462 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] (1/8): Attempting to detach device vdb with device alias ua-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb from instance 30e926af-236d-4544-9b8e-5fb9a3bddea6 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:07:32.259232 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:07:32.259232 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:07:32.259232 np0000001475 nova-compute[98471]:   <alias name="ua-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb"/>
May 27 03:07:32.259232 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-4"/>
May 27 03:07:32.259232 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:07:32.259232 np0000001475 nova-compute[98471]:   <serial>0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb</serial>
May 27 03:07:32.259232 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:07:32.259232 np0000001475 nova-compute[98471]: </disk>
May 27 03:07:32.259232 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:07:32.461528 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:07:32.836827 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851252.8362923, 30e926af-236d-4544-9b8e-5fb9a3bddea6 => ua-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:07:32.838373 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb for instance 30e926af-236d-4544-9b8e-5fb9a3bddea6 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:07:32.842765 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Successfully detached device vdb from instance 30e926af-236d-4544-9b8e-5fb9a3bddea6 from the live domain config.
May 27 03:07:32.845663 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:07:32.846489 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:07:32.846489 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:32.847089 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:32.847505 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:07:32.847704 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:07:32.875531 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:32.875531 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:32.875531 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:32.875531 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:32.875531 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:32.875856 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:32.875856 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:32.875856 np0000001475 nova-compute[98471]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:32.875856 np0000001475 nova-compute[98471]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb (non-flash)
May 27 03:07:32.875856 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:32.876009 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', '105')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:07:32.876110 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', '104')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:07:32.877117 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb', '105')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:07:32.882646 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c0c3d80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb'): ({'sdg'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:07:32.883211 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Removing multipathed devices sdf, sdg {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:07:32.883536 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Flush multipath device 3300000006865693f {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:07:32.918520 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:07:32.962114 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:07:32.972312 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.440s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:33.006533 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:07:33.006533 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:07:33.006533 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:07:33.019993 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:07:33.019993 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:07:33.034216 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:33.059679 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Deleted allocations for instance 3593ceaa-ccfe-4242-9fcd-2582ac795dd2
May 27 03:07:33.070648 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 104, target: iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb, portal: 192.168.40.100,3260]
May 27 03:07:33.070648 np0000001475 nova-compute[98471]: Logout of [sid: 104, target: iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb, portal: 192.168.40.100,3260] successful.
May 27 03:07:33.070648 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:33.073792 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-df97e8c4-023e-46ce-b93e-11bc9d73263d tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "7af020cf-50ce-441d-b10d-cf57cc280856" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.968s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:33.087234 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:33.100226 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:33.127433 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 105, target: iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb, portal: 192.168.50.100,3260]
May 27 03:07:33.127433 np0000001475 nova-compute[98471]: Logout of [sid: 105, target: iqn.2023-03.storpool.com:os--volume-0c7fe61c-4ae3-4077-98a8-1f60c66bc5bb, portal: 192.168.50.100,3260] successful.
May 27 03:07:33.127433 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:33.141947 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:33.141947 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:33.141947 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] <== disconnect_volume: return (294ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:07:33.141947 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:07:33.461015 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "7af020cf-50ce-441d-b10d-cf57cc280856" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:33.461535 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "7af020cf-50ce-441d-b10d-cf57cc280856" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:33.461535 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "7af020cf-50ce-441d-b10d-cf57cc280856-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:33.461535 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "7af020cf-50ce-441d-b10d-cf57cc280856-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:33.461535 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "7af020cf-50ce-441d-b10d-cf57cc280856-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:33.463414 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Terminating instance
May 27 03:07:33.708462 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lazy-loading 'flavor' on Instance uuid 30e926af-236d-4544-9b8e-5fb9a3bddea6 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:33.940634 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:33.966203 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:07:33.993039 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:33.996615 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:34.020723 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:34.023491 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:34.054891 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:34.074228 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9854a1e0-508e-4d9c-a7e2-9fcda3269742 tempest-AttachVolumeTestJSON-1635503347 tempest-AttachVolumeTestJSON-1635503347-project-member] Lock "3593ceaa-ccfe-4242-9fcd-2582ac795dd2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.531s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:34.226509 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-02bdfebf-3b0e-4ce4-b14e-86e1258ada7f req-ec95ddd9-1ffc-4329-a550-20dd17a746df service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Received event network-vif-unplugged-935fd58f-0c86-41ea-822b-947f831b1657 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:34.230134 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-02bdfebf-3b0e-4ce4-b14e-86e1258ada7f req-ec95ddd9-1ffc-4329-a550-20dd17a746df service nova] Acquiring lock "7af020cf-50ce-441d-b10d-cf57cc280856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:34.233771 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-02bdfebf-3b0e-4ce4-b14e-86e1258ada7f req-ec95ddd9-1ffc-4329-a550-20dd17a746df service nova] Lock "7af020cf-50ce-441d-b10d-cf57cc280856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:34.233771 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-02bdfebf-3b0e-4ce4-b14e-86e1258ada7f req-ec95ddd9-1ffc-4329-a550-20dd17a746df service nova] Lock "7af020cf-50ce-441d-b10d-cf57cc280856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:34.233771 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-02bdfebf-3b0e-4ce4-b14e-86e1258ada7f req-ec95ddd9-1ffc-4329-a550-20dd17a746df service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] No waiting events found dispatching network-vif-unplugged-935fd58f-0c86-41ea-822b-947f831b1657 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:07:34.233771 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-02bdfebf-3b0e-4ce4-b14e-86e1258ada7f req-ec95ddd9-1ffc-4329-a550-20dd17a746df service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Received event network-vif-unplugged-935fd58f-0c86-41ea-822b-947f831b1657 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:07:34.276304 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:34.287034 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:34.309121 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999730258 future=<Future at 0x755704634b30 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:07:34.312319 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Instance destroyed successfully.
May 27 03:07:34.312601 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lazy-loading 'resources' on Instance uuid 7af020cf-50ce-441d-b10d-cf57cc280856 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:34.717272 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4395a97-1732-4f3b-b91c-ba719b38d371 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.028s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:34.816699 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-675450899',display_name='tempest-TestEncryptedCinderVolumes-server-675450899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testencryptedcindervolumes-server-675450899',id=47,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFTNwmbeDObG2hZFrXfqVJFFklhf2PZrXPyr+xaxXz+TBaUmPCBy0Deqlur1boI0JCno8yfmeEuJSiBFFQNVLZkmTsEMl0W1SvcPO7gFA06wNzTYklpDeAQclJO5c5OBA==',key_name='tempest-keypair-439334451',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:06:39Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0810d45b82c0476db38b1cabf8579ae1',ramdisk_id='',reservation_id='r-4zlpx81p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-913342494',owner_user_name='tempest-TestEncryptedCinderVolumes-913342494-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:06:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='358594214f7a4c71a13200be75c799cc',uuid=7af020cf-50ce-441d-b10d-cf57cc280856,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "935fd58f-0c86-41ea-822b-947f831b1657", "address": "fa:16:3e:bc:d0:56", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap935fd58f-0c", "ovs_interfaceid": "935fd58f-0c86-41ea-822b-947f831b1657", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:07:34.816946 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Converting VIF {"id": "935fd58f-0c86-41ea-822b-947f831b1657", "address": "fa:16:3e:bc:d0:56", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap935fd58f-0c", "ovs_interfaceid": "935fd58f-0c86-41ea-822b-947f831b1657", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:07:34.817484 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:d0:56,bridge_name='br-int',has_traffic_filtering=True,id=935fd58f-0c86-41ea-822b-947f831b1657,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935fd58f-0c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:07:34.817680 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:d0:56,bridge_name='br-int',has_traffic_filtering=True,id=935fd58f-0c86-41ea-822b-947f831b1657,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935fd58f-0c') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:07:34.819436 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:34.819622 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap935fd58f-0c, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:34.822391 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:07:34.824099 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:34.824269 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=769a76da-213e-4a82-8e5f-453e0db72e29) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:34.825047 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:34.826554 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:07:34.828254 np0000001475 nova-compute[98471]: INFO os_vif [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:d0:56,bridge_name='br-int',has_traffic_filtering=True,id=935fd58f-0c86-41ea-822b-947f831b1657,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap935fd58f-0c')
May 27 03:07:34.828511 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Deleting instance files /opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856_del
May 27 03:07:34.829223 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Deletion of /opt/stack/data/nova/instances/7af020cf-50ce-441d-b10d-cf57cc280856_del complete
May 27 03:07:34.938326 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "30e926af-236d-4544-9b8e-5fb9a3bddea6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:34.938467 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:34.938649 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:34.938805 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:34.938989 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:34.940691 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Terminating instance
May 27 03:07:35.336148 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Took 1.37 seconds to destroy the instance on the hypervisor.
May 27 03:07:35.336717 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:07:35.337109 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:07:35.337229 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:07:35.337460 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:35.400687 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:35.445108 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:07:35.464658 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:35.469865 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:35.490087 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:35.494223 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:35.521143 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:35.522165 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:35.802571 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999658603999706 future=<Future at 0x7557241dc8c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:07:35.807683 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Instance destroyed successfully.
May 27 03:07:35.807683 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lazy-loading 'resources' on Instance uuid 30e926af-236d-4544-9b8e-5fb9a3bddea6 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:35.966385 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-db44a809-eda4-4be5-855e-052e08e3de9e req-dd07676f-0dfe-47ca-a536-0f5a1e886603 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Received event network-vif-deleted-935fd58f-0c86-41ea-822b-947f831b1657 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:35.966565 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-db44a809-eda4-4be5-855e-052e08e3de9e req-dd07676f-0dfe-47ca-a536-0f5a1e886603 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Neutron deleted interface 935fd58f-0c86-41ea-822b-947f831b1657; detaching it from the instance and deleting it from the info cache
May 27 03:07:35.966787 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-db44a809-eda4-4be5-855e-052e08e3de9e req-dd07676f-0dfe-47ca-a536-0f5a1e886603 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:07:36.295009 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-558c2687-58bd-4dd6-896c-4c0ae3db747e req-36b0d83e-cb20-453b-bed9-b6e61a91a728 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Received event network-vif-unplugged-935fd58f-0c86-41ea-822b-947f831b1657 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:36.295217 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-558c2687-58bd-4dd6-896c-4c0ae3db747e req-36b0d83e-cb20-453b-bed9-b6e61a91a728 service nova] Acquiring lock "7af020cf-50ce-441d-b10d-cf57cc280856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:36.295365 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-558c2687-58bd-4dd6-896c-4c0ae3db747e req-36b0d83e-cb20-453b-bed9-b6e61a91a728 service nova] Lock "7af020cf-50ce-441d-b10d-cf57cc280856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:36.295477 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-558c2687-58bd-4dd6-896c-4c0ae3db747e req-36b0d83e-cb20-453b-bed9-b6e61a91a728 service nova] Lock "7af020cf-50ce-441d-b10d-cf57cc280856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:36.295632 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-558c2687-58bd-4dd6-896c-4c0ae3db747e req-36b0d83e-cb20-453b-bed9-b6e61a91a728 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] No waiting events found dispatching network-vif-unplugged-935fd58f-0c86-41ea-822b-947f831b1657 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:07:36.295996 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-558c2687-58bd-4dd6-896c-4c0ae3db747e req-36b0d83e-cb20-453b-bed9-b6e61a91a728 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Received event network-vif-unplugged-935fd58f-0c86-41ea-822b-947f831b1657 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:07:36.295996 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-558c2687-58bd-4dd6-896c-4c0ae3db747e req-36b0d83e-cb20-453b-bed9-b6e61a91a728 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Received event network-vif-unplugged-ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:36.296308 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-558c2687-58bd-4dd6-896c-4c0ae3db747e req-36b0d83e-cb20-453b-bed9-b6e61a91a728 service nova] Acquiring lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:36.296308 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-558c2687-58bd-4dd6-896c-4c0ae3db747e req-36b0d83e-cb20-453b-bed9-b6e61a91a728 service nova] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:36.296462 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-558c2687-58bd-4dd6-896c-4c0ae3db747e req-36b0d83e-cb20-453b-bed9-b6e61a91a728 service nova] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:36.296644 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-558c2687-58bd-4dd6-896c-4c0ae3db747e req-36b0d83e-cb20-453b-bed9-b6e61a91a728 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] No waiting events found dispatching network-vif-unplugged-ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:07:36.297035 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-558c2687-58bd-4dd6-896c-4c0ae3db747e req-36b0d83e-cb20-453b-bed9-b6e61a91a728 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Received event network-vif-unplugged-ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:07:36.297035 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-558c2687-58bd-4dd6-896c-4c0ae3db747e req-36b0d83e-cb20-453b-bed9-b6e61a91a728 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Received event network-vif-unplugged-ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:36.297188 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-558c2687-58bd-4dd6-896c-4c0ae3db747e req-36b0d83e-cb20-453b-bed9-b6e61a91a728 service nova] Acquiring lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:36.297344 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-558c2687-58bd-4dd6-896c-4c0ae3db747e req-36b0d83e-cb20-453b-bed9-b6e61a91a728 service nova] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:36.297520 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-558c2687-58bd-4dd6-896c-4c0ae3db747e req-36b0d83e-cb20-453b-bed9-b6e61a91a728 service nova] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:36.297665 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-558c2687-58bd-4dd6-896c-4c0ae3db747e req-36b0d83e-cb20-453b-bed9-b6e61a91a728 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] No waiting events found dispatching network-vif-unplugged-ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:07:36.297784 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-558c2687-58bd-4dd6-896c-4c0ae3db747e req-36b0d83e-cb20-453b-bed9-b6e61a91a728 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Received event network-vif-unplugged-ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:07:36.310401 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:06:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-76506472',display_name='tempest-VolumesBackupsTest-instance-76506472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesbackupstest-instance-76506472',id=46,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQ0AKyFGMxhQSXo2O5dAprqjpbX45T+Cj/xJchNr+a2X9nDEihOHlLqvW3tmCpAjtCMWtJC/ZRW9wBSGou7kjBmOcVOmZtScU5Zs+IlOD6XP+Z5PeyHG30hjAwu3YbF+Q==',key_name='tempest-keypair-596232195',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:06:23Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='428862460731458481e46d92e7e023cf',ramdisk_id='',reservation_id='r-xhr1ro6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-655006446',owner_user_name='tempest-VolumesBackupsTest-655006446-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:06:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c925bec6c37b4489b122eeff91a1f59f',uuid=30e926af-236d-4544-9b8e-5fb9a3bddea6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "address": "fa:16:3e:3e:7b:2f", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec37def5-0d", "ovs_interfaceid": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:07:36.310611 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Converting VIF {"id": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "address": "fa:16:3e:3e:7b:2f", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapec37def5-0d", "ovs_interfaceid": "ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:07:36.311117 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:7b:2f,bridge_name='br-int',has_traffic_filtering=True,id=ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a,network=Network(735ff26b-dab6-49dc-a6ef-ed11180803a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec37def5-0d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:07:36.311321 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:7b:2f,bridge_name='br-int',has_traffic_filtering=True,id=ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a,network=Network(735ff26b-dab6-49dc-a6ef-ed11180803a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec37def5-0d') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:07:36.313942 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:36.314219 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec37def5-0d, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:36.316561 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:36.317554 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:07:36.318151 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:36.318808 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:36.318950 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0ff04e0-6716-456c-b54e-ff4977fb05e3) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:36.320972 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:07:36.322454 np0000001475 nova-compute[98471]: INFO os_vif [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:7b:2f,bridge_name='br-int',has_traffic_filtering=True,id=ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a,network=Network(735ff26b-dab6-49dc-a6ef-ed11180803a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec37def5-0d')
May 27 03:07:36.322734 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Deleting instance files /opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6_del
May 27 03:07:36.323449 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Deletion of /opt/stack/data/nova/instances/30e926af-236d-4544-9b8e-5fb9a3bddea6_del complete
May 27 03:07:36.327199 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:36.396371 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:07:36.472169 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-db44a809-eda4-4be5-855e-052e08e3de9e req-dd07676f-0dfe-47ca-a536-0f5a1e886603 service nova] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Detach interface failed, port_id=935fd58f-0c86-41ea-822b-947f831b1657, reason: Instance 7af020cf-50ce-441d-b10d-cf57cc280856 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:07:36.832606 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Took 1.39 seconds to destroy the instance on the hypervisor.
May 27 03:07:36.833358 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:07:36.833712 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:07:36.833827 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:07:36.834103 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:36.898350 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Took 1.56 seconds to deallocate network for instance.
May 27 03:07:36.970364 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:37.403838 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:37.404013 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:37.569425 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-38b73fe8-d71d-4eba-b3d8-3ba23221259d req-78c67875-7a26-4ebe-9b79-7c2f2ac44b67 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Received event network-vif-deleted-ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:37.569425 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-38b73fe8-d71d-4eba-b3d8-3ba23221259d req-78c67875-7a26-4ebe-9b79-7c2f2ac44b67 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Neutron deleted interface ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a; detaching it from the instance and deleting it from the info cache
May 27 03:07:37.569425 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-38b73fe8-d71d-4eba-b3d8-3ba23221259d req-78c67875-7a26-4ebe-9b79-7c2f2ac44b67 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:07:37.776793 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:07:37.777002 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:07:37.984412 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:07:38.074510 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-38b73fe8-d71d-4eba-b3d8-3ba23221259d req-78c67875-7a26-4ebe-9b79-7c2f2ac44b67 service nova] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Detach interface failed, port_id=ec37def5-0dd3-4a5d-868d-ead8bbbc3f5a, reason: Instance 30e926af-236d-4544-9b8e-5fb9a3bddea6 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:07:38.279436 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:07:38.487583 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Took 1.65 seconds to deallocate network for instance.
May 27 03:07:38.790257 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.386s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:38.846453 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Deleted allocations for instance 7af020cf-50ce-441d-b10d-cf57cc280856
May 27 03:07:38.993645 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:38.994117 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:39.339246 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:07:39.339524 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:07:39.842729 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:07:39.863432 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-01770a36-255c-4b26-a105-c55b464c1d0f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "7af020cf-50ce-441d-b10d-cf57cc280856" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.402s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:39.996619 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:40.363178 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.369s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:40.443046 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Deleted allocations for instance 30e926af-236d-4544-9b8e-5fb9a3bddea6
May 27 03:07:41.321192 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:41.326489 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:41.458760 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:41.462140 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-42cda42e-ed8c-4230-853a-525f1189d5b2 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "30e926af-236d-4544-9b8e-5fb9a3bddea6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.521s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:41.463005 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:41.967983 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:07:42.520190 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:42.520619 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:42.524291 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:07:42.524473 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Claim successful on node np0000001475
May 27 03:07:43.424438 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.00043331599999874015 future=<Future at 0x7557043d7890 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:07:43.424438 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:07:43.424438 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=5.8845256249996964 future=<Future at 0x755704634b30 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:07:43.424438 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=5.884455955999783 future=<Future at 0x755704634b30 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:07:43.426082 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Emitting event <LifecycleEvent: 1779851248.4235532, 3593ceaa-ccfe-4242-9fcd-2582ac795dd2 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:07:43.426376 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] VM Stopped (Lifecycle Event)
May 27 03:07:43.929168 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-de5765b9-011d-44a0-a47b-ef801803a770 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 3593ceaa-ccfe-4242-9fcd-2582ac795dd2] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:43.968989 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:07:43.968989 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:07:44.471553 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:07:44.909036 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "a3d1d581-aaf0-4e14-99ae-5db434215c60" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:44.909231 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:44.909381 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Shelving
May 27 03:07:44.981410 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.461s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:44.983991 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:07:45.494599 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:07:45.494850 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:07:45.495097 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:45.495302 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:45.580560 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32837382cff144e5b70de0a400386d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc9c3d1d60841349d551f2d9874c730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:07:45.943233 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:45.948840 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:45.968032 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:45.974871 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:46.002668 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:07:46.004965 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:46.150350 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Successfully created port: efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:07:46.156990 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b8c2d500-476e-4f76-8144-295cef370458 req-27e38822-136a-4c0e-a7ef-4f7cd6105ac2 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Received event network-vif-unplugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:46.158809 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b8c2d500-476e-4f76-8144-295cef370458 req-27e38822-136a-4c0e-a7ef-4f7cd6105ac2 service nova] Acquiring lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:46.158809 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b8c2d500-476e-4f76-8144-295cef370458 req-27e38822-136a-4c0e-a7ef-4f7cd6105ac2 service nova] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:46.158809 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b8c2d500-476e-4f76-8144-295cef370458 req-27e38822-136a-4c0e-a7ef-4f7cd6105ac2 service nova] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:46.158809 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b8c2d500-476e-4f76-8144-295cef370458 req-27e38822-136a-4c0e-a7ef-4f7cd6105ac2 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] No waiting events found dispatching network-vif-unplugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:07:46.158809 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-b8c2d500-476e-4f76-8144-295cef370458 req-27e38822-136a-4c0e-a7ef-4f7cd6105ac2 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Received unexpected event network-vif-unplugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a for instance with vm_state active and task_state shelving.
May 27 03:07:46.294589 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999735268000222 future=<Future at 0x75570444e660 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:07:46.296784 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Instance destroyed successfully.
May 27 03:07:46.297675 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'numa_topology' on Instance uuid a3d1d581-aaf0-4e14-99ae-5db434215c60 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:46.324383 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:46.331073 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:46.341759 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:46.342058 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:46.506702 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:07:46.845614 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lazy-loading 'flavor' on Instance uuid 9de3772c-0fb1-4718-bd84-b0ea6540a00c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:46.898220 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Successfully updated port: efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:07:46.916544 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Beginning cold snapshot process
May 27 03:07:47.012374 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Booting with volume bd53cd55-5bc9-4b04-899d-7f7004f0e613 at /dev/vda
May 27 03:07:47.083667 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:07:47.096360 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:07:47.116849 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:47.167314 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:07:47.167641 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:07:47.179764 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:07:47.179764 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fedf:3ab8', 'fe80::7427:32ff:fe97:df09', 'fe80::fc16:3eff:fe69:cb34', 'fe80::787c:50ff:fed5:a1fc', 'fe80::fc16:3eff:fe7b:f2ac', 'fe80::492:18ff:fe4d:a46d', 'fe80::fc16:3eff:fe21:cfcf', 'fe80::58d4:6eff:fe81:c6fc'] 
May 27 03:07:47.179764 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:07:47.179764 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:07:47.179764 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:07:47.179764 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Updating existing volume attachment record: 610c11e0-32e6-4992-8b7d-3456b02c26e1 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:07:47.350771 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Ignoring supplied device name: /dev/vdb
May 27 03:07:47.401899 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "refresh_cache-dbecddfd-649b-4343-a5d2-bbbbf0c67de5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:07:47.402034 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquired lock "refresh_cache-dbecddfd-649b-4343-a5d2-bbbbf0c67de5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:07:47.402181 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:07:47.853334 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:47.997504 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:07:48.188680 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:48.225156 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f1ea0b5b-af82-447e-ad00-b294d96bc48f req-c1a9f387-24f5-4394-b726-aa281d036217 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Received event network-vif-unplugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:48.225981 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f1ea0b5b-af82-447e-ad00-b294d96bc48f req-c1a9f387-24f5-4394-b726-aa281d036217 service nova] Acquiring lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:48.226246 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f1ea0b5b-af82-447e-ad00-b294d96bc48f req-c1a9f387-24f5-4394-b726-aa281d036217 service nova] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:48.226428 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f1ea0b5b-af82-447e-ad00-b294d96bc48f req-c1a9f387-24f5-4394-b726-aa281d036217 service nova] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:48.226604 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f1ea0b5b-af82-447e-ad00-b294d96bc48f req-c1a9f387-24f5-4394-b726-aa281d036217 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] No waiting events found dispatching network-vif-unplugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:07:48.226798 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-f1ea0b5b-af82-447e-ad00-b294d96bc48f req-c1a9f387-24f5-4394-b726-aa281d036217 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Received unexpected event network-vif-unplugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a for instance with vm_state active and task_state shelving_image_pending_upload.
May 27 03:07:48.227729 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f1ea0b5b-af82-447e-ad00-b294d96bc48f req-c1a9f387-24f5-4394-b726-aa281d036217 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Received event network-changed-efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:48.228310 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f1ea0b5b-af82-447e-ad00-b294d96bc48f req-c1a9f387-24f5-4394-b726-aa281d036217 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Refreshing instance network info cache due to event network-changed-efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:07:48.228710 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f1ea0b5b-af82-447e-ad00-b294d96bc48f req-c1a9f387-24f5-4394-b726-aa281d036217 service nova] Acquiring lock "refresh_cache-dbecddfd-649b-4343-a5d2-bbbbf0c67de5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:07:48.339908 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Updating instance_info_cache with network_info: [{"id": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "address": "fa:16:3e:43:62:08", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdd6bcb-2c", "ovs_interfaceid": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:07:48.355440 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:07:48.355774 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:07:48.356531 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:07:48.356531 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:07:48.356531 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:07:48.356719 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:07:48.357828 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.84 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:07:48.430337 np0000001475 nova-compute[98471]: DEBUG nova.privsep.utils [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98471) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 03:07:48.430681 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk /opt/stack/data/nova/instances/snapshots/tmpkb4kl32a/05e17ad82e07475d89942ef2a66fad22 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:48.743735 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk /opt/stack/data/nova/instances/snapshots/tmpkb4kl32a/05e17ad82e07475d89942ef2a66fad22" returned: 0 in 0.313s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:07:48.744114 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Snapshot extracted, beginning image upload
May 27 03:07:48.841844 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Releasing lock "refresh_cache-dbecddfd-649b-4343-a5d2-bbbbf0c67de5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:07:48.842520 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Instance network_info: |[{"id": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "address": "fa:16:3e:43:62:08", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdd6bcb-2c", "ovs_interfaceid": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:07:48.845117 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f1ea0b5b-af82-447e-ad00-b294d96bc48f req-c1a9f387-24f5-4394-b726-aa281d036217 service nova] Acquired lock "refresh_cache-dbecddfd-649b-4343-a5d2-bbbbf0c67de5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:07:48.845186 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f1ea0b5b-af82-447e-ad00-b294d96bc48f req-c1a9f387-24f5-4394-b726-aa281d036217 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Refreshing network info cache for port efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:07:48.929399 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:48.929629 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:48.929891 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Attaching volume 418bb384-85e5-45c6-a7f0-28ac5d64433f to /dev/vdb
May 27 03:07:48.977090 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:07:48.989730 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:07:49.017340 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:49.083836 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:07:49.084287 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:07:49.096020 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:07:49.096020 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fedf:3ab8', 'fe80::7427:32ff:fe97:df09', 'fe80::fc16:3eff:fe69:cb34', 'fe80::787c:50ff:fed5:a1fc', 'fe80::fc16:3eff:fe7b:f2ac', 'fe80::492:18ff:fe4d:a46d', 'fe80::fc16:3eff:fe21:cfcf', 'fe80::58d4:6eff:fe81:c6fc'] 
May 27 03:07:49.096295 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:07:49.096295 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:07:49.096604 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:07:49.097851 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Updating existing volume attachment record: 2caaaade-c9ff-4888-b883-8a5ead3efa03 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:07:49.203243 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:07:49.203243 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:07:49.204965 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.99 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:07:49.291479 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:07:49.291479 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:07:49.291479 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Creating image(s)
May 27 03:07:49.291479 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:07:49.291479 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Ensure instance console log exists: /opt/stack/data/nova/instances/dbecddfd-649b-4343-a5d2-bbbbf0c67de5/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:07:49.291987 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:49.292190 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:49.292246 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:49.293216 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Start _get_guest_xml network_info=[{"id": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "address": "fa:16:3e:43:62:08", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdd6bcb-2c", "ovs_interfaceid": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd53cd55-5bc9-4b04-899d-7f7004f0e613', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'dbecddfd-649b-4343-a5d2-bbbbf0c67de5', 'attached_at': '', 'detached_at': '', 'volume_id': 'bd53cd55-5bc9-4b04-899d-7f7004f0e613', 'serial': 'bd53cd55-5bc9-4b04-899d-7f7004f0e613'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '610c11e0-32e6-4992-8b7d-3456b02c26e1', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:07:49.299255 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:07:49.299709 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1304934566', uuid='dbecddfd-649b-4343-a5d2-bbbbf0c67de5'), owner=OwnerMeta(userid='32837382cff144e5b70de0a400386d11', username='tempest-TestVolumeBootPatternV346-1509575509-project-member', projectid='bfc9c3d1d60841349d551f2d9874c730', projectname='tempest-TestVolumeBootPatternV346-1509575509'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "address": "fa:16:3e:43:62:08", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdd6bcb-2c", "ovs_interfaceid": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851269.2991636) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:07:49.301799 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:07:49.302127 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:07:49.304056 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:07:49.304056 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:07:49.305124 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:07:49.305408 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:07:49.305524 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:07:49.306000 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:07:49.306295 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:07:49.306359 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:07:49.306456 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:07:49.306624 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:07:49.306769 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:07:49.306881 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:07:49.306982 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:07:49.307150 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:07:49.313235 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.004363554000065051 future=<Future at 0x755704634b30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:07:49.314945 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:07:49.315194 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=1.4867605619997448 future=<Future at 0x7557241dc8c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:07:49.315781 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=1.4866108329997587 future=<Future at 0x7557241dc8c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:07:49.315862 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Emitting event <LifecycleEvent: 1779851254.3087323, 7af020cf-50ce-441d-b10d-cf57cc280856 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:07:49.316063 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] VM Stopped (Lifecycle Event)
May 27 03:07:49.320643 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:07:49.321159 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd53cd55-5bc9-4b04-899d-7f7004f0e613', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:07:49.321159 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:49.347827 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f1ea0b5b-af82-447e-ad00-b294d96bc48f req-c1a9f387-24f5-4394-b726-aa281d036217 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:49.675251 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:07:49.675655 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '418bb384-85e5-45c6-a7f0-28ac5d64433f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:07:49.675853 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:49.826795 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 7af020cf-50ce-441d-b10d-cf57cc280856] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:49.836424 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f1ea0b5b-af82-447e-ad00-b294d96bc48f req-c1a9f387-24f5-4394-b726-aa281d036217 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:50.007484 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f1ea0b5b-af82-447e-ad00-b294d96bc48f req-c1a9f387-24f5-4394-b726-aa281d036217 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Updated VIF entry in instance network info cache for port efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:07:50.007711 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f1ea0b5b-af82-447e-ad00-b294d96bc48f req-c1a9f387-24f5-4394-b726-aa281d036217 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Updating instance_info_cache with network_info: [{"id": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "address": "fa:16:3e:43:62:08", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdd6bcb-2c", "ovs_interfaceid": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:07:50.509617 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f1ea0b5b-af82-447e-ad00-b294d96bc48f req-c1a9f387-24f5-4394-b726-aa281d036217 service nova] Releasing lock "refresh_cache-dbecddfd-649b-4343-a5d2-bbbbf0c67de5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:07:50.650931 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "f9cd3c05-0282-4843-b890-8be3eb097bfe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:50.651164 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:50.802553 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0006132329999672947 future=<Future at 0x7557241dc8c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:07:50.804608 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Emitting event <LifecycleEvent: 1779851255.8018227, 30e926af-236d-4544-9b8e-5fb9a3bddea6 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:07:50.804830 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:07:50.805129 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] VM Stopped (Lifecycle Event)
May 27 03:07:50.806194 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=10.488087165000252 future=<Future at 0x75570444e660 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:07:50.806325 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=10.487934441000107 future=<Future at 0x75570444e660 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:07:51.158190 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lazy-loading 'flavor' on Instance uuid f9cd3c05-0282-4843-b890-8be3eb097bfe {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:51.183374 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.862s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:51.183697 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd53cd55-5bc9-4b04-899d-7f7004f0e613', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:07:51.200275 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:51.201150 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:51.202062 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:51.202062 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:07:51.202541 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:51.202799 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:07:51.225190 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:07:51.225190 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:51.231095 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:07:51.231095 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:51.246136 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613] added
May 27 03:07:51.246136 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:07:51.246136 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:51.246136 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:51.246136 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:51.246136 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:51.246136 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:51.246136 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:07:51.246136 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0439(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:07:51.246136 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:07:51.248641 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613] added
May 27 03:07:51.248641 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:07:51.248641 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:51.248641 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:51.248641 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:51.248641 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:51.248641 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:51.249001 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:07:51.249117 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0463(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:07:51.249471 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:07:51.307633 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 30e926af-236d-4544-9b8e-5fb9a3bddea6] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:51.325984 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:51.330460 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:51.847142 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Snapshot image upload complete
May 27 03:07:51.847720 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:52.165887 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:52.246513 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:07:52.249850 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:07:52.262489 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:07:52.262489 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:07:52.268020 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:07:52.268020 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:52.276422 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:52.282619 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:52.291280 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:52.291280 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:52.291280 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:52.291280 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:52.291280 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:52.291280 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:52.291562 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:52.291562 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:52.291562 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:52.291562 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:52.291562 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:52.291562 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:52.299388 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:52.299388 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:52.299388 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:52.299388 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:52.299388 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:52.299388 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:52.299674 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:52.299674 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:52.299674 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:52.299674 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:52.299674 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:52.299674 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:52.339881 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613, portal: 192.168.40.100,3260]
May 27 03:07:52.339881 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613, portal: 192.168.40.100,3260] successful.
May 27 03:07:52.339881 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:52.347859 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613, portal: 192.168.50.100,3260]
May 27 03:07:52.347859 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613, portal: 192.168.50.100,3260] successful.
May 27 03:07:52.347859 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:52.357088 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:52.359131 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Shelve offloading
May 27 03:07:52.370449 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:52.380767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:52.380767 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:52.380767 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:52.380767 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:52.380767 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:52.380767 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:52.380767 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:52.380767 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:52.380767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:52.380767 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:52.380767 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:52.380767 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:52.380767 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:52.380767 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:52.380767 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:52.380767 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:52.380767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:52.380767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:07:52.381412 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] HCTL ('12', '-', '-', 0) found on session 114 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:07:52.381516 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:07:52.388662 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:52.388662 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:52.388662 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:52.388662 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:52.388662 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:52.388662 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:52.388662 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:52.388662 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:52.388923 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:52.388923 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:52.388923 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:52.388923 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:52.388923 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:52.388923 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:52.388923 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:52.388923 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:52.389308 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:52.389557 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:07:52.390703 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] HCTL ('13', '-', '-', 0) found on session 115 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:07:52.390899 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:07:52.403018 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Searching for a device in session 114 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:07:52.403082 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd53cd55-5bc9-4b04-899d-7f7004f0e613', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:07:52.420563 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Searching for a device in session 115 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:07:52.420563 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bd53cd55-5bc9-4b04-899d-7f7004f0e613', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:07:52.868123 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Instance destroyed successfully.
May 27 03:07:52.869589 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:52.872007 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:07:52.872007 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquired lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:07:52.872007 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:07:53.202420 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:07:53.273045 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "f9cd3c05-0282-4843-b890-8be3eb097bfe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:53.273359 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:53.273637 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Attaching volume d570d0d1-cf21-4c60-84fe-7a6445cad954 to /dev/vdb
May 27 03:07:53.323198 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:07:53.334273 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:07:53.365406 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:53.394775 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:53.420231 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:07:53.420630 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:07:53.429777 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:07:53.435918 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fedf:3ab8', 'fe80::7427:32ff:fe97:df09', 'fe80::fc16:3eff:fe69:cb34', 'fe80::787c:50ff:fed5:a1fc', 'fe80::fc16:3eff:fe7b:f2ac', 'fe80::492:18ff:fe4d:a46d', 'fe80::fc16:3eff:fe21:cfcf', 'fe80::58d4:6eff:fe81:c6fc'] 
May 27 03:07:53.435918 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:07:53.436124 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:07:53.436494 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:07:53.436874 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Updating existing volume attachment record: b6ec16b1-e908-44ff-9356-073f41f28572 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:07:53.740638 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:53.891772 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Updating instance_info_cache with network_info: [{"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:07:54.024277 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:07:54.024626 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954', 'iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd570d0d1-cf21-4c60-84fe-7a6445cad954', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:07:54.024815 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:54.223507 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Found WWN 330000000780b61cf for multipath device dm-4 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:07:54.223932 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:54.224126 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] <== connect_volume: return (4903ms) {'type': 'block', 'scsi_wwn': '330000000780b61cf', 'path': '/dev/dm-4', 'multipath_id': '330000000780b61cf'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:07:54.224279 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000780b61cf', 'path': '/dev/dm-4', 'multipath_id': '330000000780b61cf'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:07:54.228106 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 4.549s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:54.228472 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '418bb384-85e5-45c6-a7f0-28ac5d64433f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:07:54.242831 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:54.243639 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:54.244253 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:54.244491 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:07:54.245167 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:54.246080 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:07:54.256586 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:07:54.256586 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:54.268107 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:07:54.268107 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:54.268795 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f] added
May 27 03:07:54.268795 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:07:54.268795 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:54.268795 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:54.268795 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:54.268795 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:54.268795 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:54.269002 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:07:54.270414 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0247(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:07:54.270414 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:07:54.279697 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f] added
May 27 03:07:54.279697 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:07:54.279697 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:54.279697 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:54.279697 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:54.279697 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:54.279697 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:54.279947 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:07:54.280188 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0345(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:07:54.280364 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:07:54.395214 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Releasing lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:07:54.395590 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:54.395898 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:54.737065 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:07:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1304934566',display_name='tempest-TestVolumeBootPatternV346-server-1304934566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpatternv346-server-1304934566',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1Gm7TCHafFGWPx7+gaqf0KNgx04LjJJHz80sR0jW3/AHFgrWUjXPNzxapIHdT+cqlf2yxUegAPPSNbQx1dtysyxS49ctl/sMmw5fCSk05Z43MvSX2XdLQqhWHpEgk+fw==',key_name='tempest-keypair-375867860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfc9c3d1d60841349d551f2d9874c730',ramdisk_id='',reservation_id='r-nz5hjzpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1509575509',owner_user_name='tempest-TestVolumeBootPatternV346-1509575509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:07:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32837382cff144e5b70de0a400386d11',uuid=dbecddfd-649b-4343-a5d2-bbbbf0c67de5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "address": "fa:16:3e:43:62:08", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdd6bcb-2c", "ovs_interfaceid": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:07:54.737374 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Converting VIF {"id": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "address": "fa:16:3e:43:62:08", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdd6bcb-2c", "ovs_interfaceid": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:07:54.738080 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:62:08,bridge_name='br-int',has_traffic_filtering=True,id=efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefdd6bcb-2c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:07:54.743413 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lazy-loading 'pci_devices' on Instance uuid dbecddfd-649b-4343-a5d2-bbbbf0c67de5 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:54.957533 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Instance destroyed successfully.
May 27 03:07:54.960321 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'resources' on Instance uuid a3d1d581-aaf0-4e14-99ae-5db434215c60 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:55.003313 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f68b8c41-48b1-46c0-bc5c-9f34fdb388e0 req-33afa7ca-fd81-4779-9162-47b44adaa8d5 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Received event network-changed-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:55.003441 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f68b8c41-48b1-46c0-bc5c-9f34fdb388e0 req-33afa7ca-fd81-4779-9162-47b44adaa8d5 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Refreshing instance network info cache due to event network-changed-ad4ac3f9-a243-42a4-9e61-fb161205ae0a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:07:55.003599 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f68b8c41-48b1-46c0-bc5c-9f34fdb388e0 req-33afa7ca-fd81-4779-9162-47b44adaa8d5 service nova] Acquiring lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:07:55.003728 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f68b8c41-48b1-46c0-bc5c-9f34fdb388e0 req-33afa7ca-fd81-4779-9162-47b44adaa8d5 service nova] Acquired lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:07:55.003972 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f68b8c41-48b1-46c0-bc5c-9f34fdb388e0 req-33afa7ca-fd81-4779-9162-47b44adaa8d5 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Refreshing network info cache for port ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:07:55.247486 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] End _get_guest_xml xml=<domain type="qemu">
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:   <uuid>dbecddfd-649b-4343-a5d2-bbbbf0c67de5</uuid>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:   <name>instance-00000035</name>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1304934566</nova:name>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:07:49</nova:creationTime>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:         <nova:user uuid="32837382cff144e5b70de0a400386d11">tempest-TestVolumeBootPatternV346-1509575509-project-member</nova:user>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:         <nova:project uuid="bfc9c3d1d60841349d551f2d9874c730">tempest-TestVolumeBootPatternV346-1509575509</nova:project>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:         <nova:port uuid="efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528">
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     <system>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <entry name="serial">dbecddfd-649b-4343-a5d2-bbbbf0c67de5</entry>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <entry name="uuid">dbecddfd-649b-4343-a5d2-bbbbf0c67de5</entry>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     </system>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:   <os>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:   </os>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:   <features>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:   </features>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:   <devices>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/dbecddfd-649b-4343-a5d2-bbbbf0c67de5/disk.config"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     </disk>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <alias name="ua-bd53cd55-5bc9-4b04-899d-7f7004f0e613"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-4"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <serial>bd53cd55-5bc9-4b04-899d-7f7004f0e613</serial>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     </disk>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:43:62:08"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <target dev="tapefdd6bcb-2c"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     </interface>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/dbecddfd-649b-4343-a5d2-bbbbf0c67de5/console.log" append="off"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     </serial>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     <video>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     </video>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     </rng>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:   </devices>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]: </domain>
May 27 03:07:55.247486 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:07:55.250304 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Preparing to wait for external event network-vif-plugged-efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:07:55.250304 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:55.250304 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:55.250304 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:55.250304 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:07:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1304934566',display_name='tempest-TestVolumeBootPatternV346-server-1304934566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpatternv346-server-1304934566',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1Gm7TCHafFGWPx7+gaqf0KNgx04LjJJHz80sR0jW3/AHFgrWUjXPNzxapIHdT+cqlf2yxUegAPPSNbQx1dtysyxS49ctl/sMmw5fCSk05Z43MvSX2XdLQqhWHpEgk+fw==',key_name='tempest-keypair-375867860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfc9c3d1d60841349d551f2d9874c730',ramdisk_id='',reservation_id='r-nz5hjzpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1509575509',owner_user_name='tempest-TestVolumeBootPatternV346-1509575509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:07:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32837382cff144e5b70de0a400386d11',uuid=dbecddfd-649b-4343-a5d2-bbbbf0c67de5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "address": "fa:16:3e:43:62:08", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdd6bcb-2c", "ovs_interfaceid": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:07:55.250304 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Converting VIF {"id": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "address": "fa:16:3e:43:62:08", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdd6bcb-2c", "ovs_interfaceid": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:07:55.253125 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:62:08,bridge_name='br-int',has_traffic_filtering=True,id=efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefdd6bcb-2c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:07:55.253416 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:62:08,bridge_name='br-int',has_traffic_filtering=True,id=efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefdd6bcb-2c') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:07:55.254872 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:55.254872 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:55.254872 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:07:55.255765 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:55.256551 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '163a932b-d2a6-56e0-943f-b80c797a5bc4', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:55.258011 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:55.258011 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:07:55.263926 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:55.269537 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:55.269537 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefdd6bcb-2c, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:55.269537 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapefdd6bcb-2c, col_values=(('qos', UUID('164fd5cf-7929-4332-8d92-e8e1e2c3c740')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:55.269537 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapefdd6bcb-2c, col_values=(('external_ids', {'iface-id': 'efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:62:08', 'vm-uuid': 'dbecddfd-649b-4343-a5d2-bbbbf0c67de5'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:55.273015 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:07:55.275059 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:07:55.280793 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:07:55.285149 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:55.285547 np0000001475 nova-compute[98471]: INFO os_vif [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:62:08,bridge_name='br-int',has_traffic_filtering=True,id=efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefdd6bcb-2c')
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:07:55.288683 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:07:55.288683 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:07:55.297870 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:07:55.297870 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:55.305210 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:55.313105 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:55.326952 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:55.326952 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:55.326952 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:55.326952 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:55.326952 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:55.326952 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:55.326952 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:55.326952 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:55.327266 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:55.327266 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:55.327266 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:55.327266 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:55.327266 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:55.327266 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:55.327266 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:55.327266 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:55.333763 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:55.333763 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:55.333763 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:55.333763 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:55.333763 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:55.333763 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:55.333763 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:55.333763 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:55.333763 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:55.333763 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:55.333763 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:55.333763 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:55.333763 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:55.333763 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:55.333763 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:55.333763 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:55.376083 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f, portal: 192.168.40.100,3260]
May 27 03:07:55.376083 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f, portal: 192.168.40.100,3260] successful.
May 27 03:07:55.376083 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:55.388921 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:55.392551 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f, portal: 192.168.50.100,3260]
May 27 03:07:55.392551 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f, portal: 192.168.50.100,3260] successful.
May 27 03:07:55.392551 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:55.407194 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:55.407194 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:55.407194 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:55.407194 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:55.407194 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:55.407194 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:55.407194 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:55.407194 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:55.407194 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:55.407194 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:55.407194 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:55.407194 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:55.407194 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:55.407194 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:55.407194 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:55.407194 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:55.407194 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:55.407194 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:55.407194 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:55.407194 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:55.410231 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:55.410231 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:07:55.410231 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] HCTL ('14', '-', '-', 0) found on session 116 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:07:55.410231 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:07:55.417620 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:55.428427 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Searching for a device in session 116 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:07:55.428511 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '418bb384-85e5-45c6-a7f0-28ac5d64433f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:55.444543 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:55.444543 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.198s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] HCTL ('15', '-', '-', 0) found on session 117 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:07:55.444543 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:07:55.464309 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Object Instance<a3d1d581-aaf0-4e14-99ae-5db434215c60> lazy-loaded attributes: numa_topology,resources {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:07:55.467492 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1049303833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumeshelvetestjson-server-1049303833',id=50,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC74kMXXtTfu96CEeSeXm7lbe6InTg7PC6KekpYZjJWXgE8Ih1WDS9gVb82OCiOe6f4FJGyPwkR1yGy8I2MF96YLBrCB0ElxJLAhExDMR2s1v9S7JeN28lwHkG0A1+84GA==',key_name='tempest-keypair-951893173',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:07:03Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c547b519adf248728dfd0b2232bfc118',ramdisk_id='',reservation_id='r-4h7euvrh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1364873533',owner_user_name='tempest-AttachVolumeShelveTestJSON-1364873533-project-member',shelved_at='2026-05-27T03:07:51.847188',shelved_host='np0000001475',shelved_image_id='c975161a-b72d-400b-8b3c-816fa6106f86'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:07:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c72d670892e44d88e674c9b584bc718',uuid=a3d1d581-aaf0-4e14-99ae-5db434215c60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:07:55.467952 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converting VIF {"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:07:55.468933 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:69:1b,bridge_name='br-int',has_traffic_filtering=True,id=ad4ac3f9-a243-42a4-9e61-fb161205ae0a,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4ac3f9-a2') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:07:55.469312 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:69:1b,bridge_name='br-int',has_traffic_filtering=True,id=ad4ac3f9-a243-42a4-9e61-fb161205ae0a,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4ac3f9-a2') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:07:55.470317 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Searching for a device in session 117 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:07:55.470317 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '418bb384-85e5-45c6-a7f0-28ac5d64433f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:07:55.472117 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:55.472354 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad4ac3f9-a2, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:55.486089 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:55.487363 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:07:55.492487 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:55.493486 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:55.493653 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e66a1c5-49e9-4eb9-b4f9-39f2c30966f3) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:07:55.498978 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:55.499490 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:07:55.504525 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:55.506754 np0000001475 nova-compute[98471]: INFO os_vif [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:69:1b,bridge_name='br-int',has_traffic_filtering=True,id=ad4ac3f9-a243-42a4-9e61-fb161205ae0a,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4ac3f9-a2')
May 27 03:07:55.507040 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Deleting instance files /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60_del
May 27 03:07:55.510012 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f68b8c41-48b1-46c0-bc5c-9f34fdb388e0 req-33afa7ca-fd81-4779-9162-47b44adaa8d5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:55.514585 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Deletion of /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60_del complete
May 27 03:07:55.924250 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f68b8c41-48b1-46c0-bc5c-9f34fdb388e0 req-33afa7ca-fd81-4779-9162-47b44adaa8d5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:56.120694 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f68b8c41-48b1-46c0-bc5c-9f34fdb388e0 req-33afa7ca-fd81-4779-9162-47b44adaa8d5 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Updated VIF entry in instance network info cache for port ad4ac3f9-a243-42a4-9e61-fb161205ae0a. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:07:56.122143 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Deleted allocations for instance a3d1d581-aaf0-4e14-99ae-5db434215c60
May 27 03:07:56.125461 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f68b8c41-48b1-46c0-bc5c-9f34fdb388e0 req-33afa7ca-fd81-4779-9162-47b44adaa8d5 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Updating instance_info_cache with network_info: [{"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:07:56.199987 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:07:56.245011 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:07:56.334332 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:56.630372 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:56.630372 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:56.630372 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f68b8c41-48b1-46c0-bc5c-9f34fdb388e0 req-33afa7ca-fd81-4779-9162-47b44adaa8d5 service nova] Releasing lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:07:56.707927 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:56.816645 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:56.816645 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:56.816645 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] No VIF found with MAC fa:16:3e:43:62:08, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:07:56.816645 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Using config drive
May 27 03:07:57.015890 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:07:57.016183 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:07:57.261667 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Found WWN 3300000004b252198 for multipath device dm-7 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:07:57.262106 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:57.262196 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] <== connect_volume: return (7586ms) {'type': 'block', 'scsi_wwn': '3300000004b252198', 'path': '/dev/dm-7', 'multipath_id': '3300000004b252198'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:07:57.262332 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004b252198', 'path': '/dev/dm-7', 'multipath_id': '3300000004b252198'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:07:57.262932 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.238s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:57.263249 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954', 'iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd570d0d1-cf21-4c60-84fe-7a6445cad954', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:07:57.265901 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lazy-loading 'flavor' on Instance uuid 9de3772c-0fb1-4718-bd84-b0ea6540a00c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:57.279561 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:57.280115 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:07:57.280546 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:57.280758 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:07:57.283948 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:07:57.284156 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:07:57.296777 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:07:57.296777 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:57.304250 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:07:57.304250 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:57.313823 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954] added
May 27 03:07:57.313823 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:07:57.313823 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:57.313823 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:57.313823 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:57.313823 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:57.313823 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:57.314167 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:07:57.314223 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0334(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:07:57.314379 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:07:57.327365 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954] added
May 27 03:07:57.327365 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:07:57.327365 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:57.327365 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:57.327365 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:07:57.327365 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:07:57.327365 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:57.328338 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:07:57.330785 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:07:57.331077 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0468(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:07:57.331280 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:07:57.520593 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:07:57.530200 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Creating config drive at /opt/stack/data/nova/instances/dbecddfd-649b-4343-a5d2-bbbbf0c67de5/disk.config
May 27 03:07:57.535769 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dbecddfd-649b-4343-a5d2-bbbbf0c67de5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzxz1oylm {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:57.593378 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dbecddfd-649b-4343-a5d2-bbbbf0c67de5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzxz1oylm" returned: 0 in 0.058s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:07:57.770323 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Attempting to attach volume 418bb384-85e5-45c6-a7f0-28ac5d64433f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:07:57.773097 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:07:57.773097 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:07:57.773097 np0000001475 nova-compute[98471]:   <alias name="ua-418bb384-85e5-45c6-a7f0-28ac5d64433f"/>
May 27 03:07:57.773097 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-7"/>
May 27 03:07:57.773097 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:07:57.773097 np0000001475 nova-compute[98471]:   <serial>418bb384-85e5-45c6-a7f0-28ac5d64433f</serial>
May 27 03:07:57.773097 np0000001475 nova-compute[98471]: </disk>
May 27 03:07:57.773097 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:07:58.003684 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:58.003918 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:58.036507 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.408s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:58.041869 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.334s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:58.042931 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:58.042931 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:07:58.191580 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:58.218088 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:58.304272 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:58.314854 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:07:58.333063 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:07:58.333879 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:07:58.333879 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:07:58.347453 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:07:58.347453 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:58.353044 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:58.361273 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:58.375150 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:58.375150 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:58.375150 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:58.375150 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:58.375150 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:58.375150 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:58.375150 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:58.375150 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:58.375150 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:58.375150 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:58.375150 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:58.375150 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:58.375150 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:58.375150 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:58.375150 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:58.375150 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:58.375150 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:58.375150 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:58.375150 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:58.375150 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:58.390364 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:58.390364 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:58.390364 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:58.390364 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:58.390364 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:58.390364 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:58.390364 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:58.390364 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:58.390364 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:58.390364 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:58.390587 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:58.390587 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:58.390587 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:58.390587 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:58.390587 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:58.390587 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:58.390587 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:58.390587 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:58.390587 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:58.390587 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:58.418848 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:58.418848 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:07:58.423779 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-704ff9dc-36d3-44eb-b0ec-fd63baa8d5ac req-fb710725-f208-429e-87b1-806f23b95103 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Received event network-vif-plugged-efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:07:58.423779 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-704ff9dc-36d3-44eb-b0ec-fd63baa8d5ac req-fb710725-f208-429e-87b1-806f23b95103 service nova] Acquiring lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:58.424487 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-704ff9dc-36d3-44eb-b0ec-fd63baa8d5ac req-fb710725-f208-429e-87b1-806f23b95103 service nova] Lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:58.424990 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-704ff9dc-36d3-44eb-b0ec-fd63baa8d5ac req-fb710725-f208-429e-87b1-806f23b95103 service nova] Lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:58.425729 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954, portal: 192.168.50.100,3260]
May 27 03:07:58.425729 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954, portal: 192.168.50.100,3260] successful.
May 27 03:07:58.425729 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:58.426069 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-704ff9dc-36d3-44eb-b0ec-fd63baa8d5ac req-fb710725-f208-429e-87b1-806f23b95103 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Processing event network-vif-plugged-efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:07:58.441274 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:58.451316 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954, portal: 192.168.40.100,3260]
May 27 03:07:58.451316 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954, portal: 192.168.40.100,3260] successful.
May 27 03:07:58.451316 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:58.468773 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:07:58.473576 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:58.473576 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:58.473576 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:58.473576 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:58.473576 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:58.473576 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:58.473576 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:58.473576 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:58.473576 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:58.473576 np0000001475 nova-compute[98471]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:07:58.473576 np0000001475 nova-compute[98471]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:07:58.473576 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:58.476179 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:58.476179 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:58.476179 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:58.476179 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:58.476179 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:58.476179 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:58.476179 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:58.476179 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:58.476179 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:58.476179 np0000001475 nova-compute[98471]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:07:58.476179 np0000001475 nova-compute[98471]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:07:58.476179 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:58.476179 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:58.476179 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:07:58.480219 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] HCTL ('16', '-', '-', 0) found on session 118 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:07:58.480219 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:07:58.488315 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:58.488315 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:58.488315 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:58.488315 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:58.488315 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:58.488315 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:58.488315 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:58.488315 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:58.488315 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:58.488315 np0000001475 nova-compute[98471]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:07:58.488315 np0000001475 nova-compute[98471]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:07:58.488315 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:07:58.489186 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:58.489186 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:07:58.489186 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:07:58.489186 np0000001475 nova-compute[98471]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:58.489186 np0000001475 nova-compute[98471]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:07:58.489186 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:58.489186 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:07:58.489186 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:58.489186 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:07:58.489186 np0000001475 nova-compute[98471]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:07:58.489186 np0000001475 nova-compute[98471]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:07:58.489186 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:07:58.490474 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:07:58.490621 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:07:58.491963 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] HCTL ('17', '-', '-', 0) found on session 119 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:07:58.492177 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:07:58.516515 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Searching for a device in session 118 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:07:58.516515 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd570d0d1-cf21-4c60-84fe-7a6445cad954', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:07:58.516515 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lazy-loading 'flavor' on Instance uuid 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:07:58.532635 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Searching for a device in session 119 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:07:58.532881 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd570d0d1-cf21-4c60-84fe-7a6445cad954', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:07:58.554205 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ed119074-32e8-447c-9615-5b703f09f17c tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 13.645s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:59.140705 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:07:59.141203 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851279.1408563, dbecddfd-649b-4343-a5d2-bbbbf0c67de5 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:07:59.141324 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] VM Started (Lifecycle Event)
May 27 03:07:59.143672 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:07:59.147380 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Instance spawned successfully.
May 27 03:07:59.149231 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:07:59.281782 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:07:59.450904 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:59.524960 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.520s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:07:59.553357 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:07:59.553756 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:59.626468 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:59.626653 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:59.626828 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:07:59.626995 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] No VIF found with MAC fa:16:3e:7b:f2:ac, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:07:59.647758 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:07:59.649874 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:07:59.656832 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:07:59.659642 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:59.661468 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:59.661601 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:59.663074 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:59.663074 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:59.663454 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:07:59.670340 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:59.787895 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:07:59.791172 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:07:59.834212 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "a3d1d581-aaf0-4e14-99ae-5db434215c60" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:07:59.834530 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:07:59.834789 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Unshelving
May 27 03:07:59.893078 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:07:59.917853 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:00.066848 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:00.067060 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:00.157389 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:08:00.157717 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851280.1575108, dbecddfd-649b-4343-a5d2-bbbbf0c67de5 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:08:00.157850 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] VM Paused (Lifecycle Event)
May 27 03:08:00.163411 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:00.163850 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:08:00.168534 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:08:00.170588 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:08:00.172918 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Took 10.89 seconds to spawn the instance on the hypervisor.
May 27 03:08:00.173303 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:00.188547 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:08:00.189750 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:00.245203 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.055s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:00.245509 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=12303MB free_disk=73.00212478637695GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:08:00.245700 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:00.245948 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:00.301454 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Found WWN 3300000009fa7b4ef for multipath device dm-9 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:08:00.302062 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:08:00.302380 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] <== connect_volume: return (6277ms) {'type': 'block', 'scsi_wwn': '3300000009fa7b4ef', 'path': '/dev/dm-9', 'multipath_id': '3300000009fa7b4ef'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:08:00.302583 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009fa7b4ef', 'path': '/dev/dm-9', 'multipath_id': '3300000009fa7b4ef'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:08:00.309552 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lazy-loading 'flavor' on Instance uuid f9cd3c05-0282-4843-b890-8be3eb097bfe {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:08:00.499168 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:00.524698 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c2cd2a31-8d2e-40c2-98d1-b8fcb9b44653 req-a1d4b738-4255-4a7a-bba6-78ade4408d00 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Received event network-vif-plugged-efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:00.524988 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c2cd2a31-8d2e-40c2-98d1-b8fcb9b44653 req-a1d4b738-4255-4a7a-bba6-78ade4408d00 service nova] Acquiring lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:00.525376 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c2cd2a31-8d2e-40c2-98d1-b8fcb9b44653 req-a1d4b738-4255-4a7a-bba6-78ade4408d00 service nova] Lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:00.525478 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c2cd2a31-8d2e-40c2-98d1-b8fcb9b44653 req-a1d4b738-4255-4a7a-bba6-78ade4408d00 service nova] Lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:00.525620 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c2cd2a31-8d2e-40c2-98d1-b8fcb9b44653 req-a1d4b738-4255-4a7a-bba6-78ade4408d00 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] No waiting events found dispatching network-vif-plugged-efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:08:00.525750 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c2cd2a31-8d2e-40c2-98d1-b8fcb9b44653 req-a1d4b738-4255-4a7a-bba6-78ade4408d00 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Received unexpected event network-vif-plugged-efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528 for instance with vm_state active and task_state None.
May 27 03:08:00.615002 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:00.615691 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:00.615956 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Attaching volume cee19510-084b-451e-84b2-15368ba8a40f to /dev/vdb
May 27 03:08:00.661447 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:00.673773 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851280.6696806, dbecddfd-649b-4343-a5d2-bbbbf0c67de5 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:08:00.673773 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] VM Resumed (Lifecycle Event)
May 27 03:08:00.686382 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:08:00.701116 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:08:00.730903 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Took 18.26 seconds to build instance.
May 27 03:08:00.736660 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:00.796337 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:08:00.797044 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:08:00.804766 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:08:00.805374 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fedf:3ab8', 'fe80::7427:32ff:fe97:df09', 'fe80::fc16:3eff:fe69:cb34', 'fe80::787c:50ff:fed5:a1fc', 'fe80::fc16:3eff:fe7b:f2ac', 'fe80::492:18ff:fe4d:a46d', 'fe80::fc16:3eff:fe21:cfcf', 'fe80::58d4:6eff:fe81:c6fc', 'fe80::fc16:3eff:fe43:6208'] 
May 27 03:08:00.805498 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:08:00.805626 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:08:00.805877 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:08:00.806362 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Updating existing volume attachment record: 55bd34b7-ad2e-4248-8053-a2d891b37791 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:08:00.816274 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Attempting to attach volume d570d0d1-cf21-4c60-84fe-7a6445cad954 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:08:00.818833 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:08:00.818833 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:08:00.818833 np0000001475 nova-compute[98471]:   <alias name="ua-d570d0d1-cf21-4c60-84fe-7a6445cad954"/>
May 27 03:08:00.818833 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-9"/>
May 27 03:08:00.818833 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:08:00.818833 np0000001475 nova-compute[98471]:   <serial>d570d0d1-cf21-4c60-84fe-7a6445cad954</serial>
May 27 03:08:00.818833 np0000001475 nova-compute[98471]: </disk>
May 27 03:08:00.818833 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:08:01.180128 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:01.182502 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:08:01.210778 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1683e066-5b1a-4a59-b1eb-f2cdbea621b4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.280s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:01.235568 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.773s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:01.294838 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0004926029996568104 future=<Future at 0x75570444e660 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:08:01.295552 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] Emitting event <LifecycleEvent: 1779851266.294204, a3d1d581-aaf0-4e14-99ae-5db434215c60 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:08:01.296090 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:08:01.296607 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] VM Stopped (Lifecycle Event)
May 27 03:08:01.320167 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 5fe4c21d-3de1-479a-ad36-e4377e7cea11 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:08:01.320324 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance f9cd3c05-0282-4843-b890-8be3eb097bfe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:08:01.320467 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 9de3772c-0fb1-4718-bd84-b0ea6540a00c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:08:01.320602 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:08:01.320916 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance dbecddfd-649b-4343-a5d2-bbbbf0c67de5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:08:01.338973 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:01.361824 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:08:01.361824 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cee19510-084b-451e-84b2-15368ba8a40f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:08:01.361824 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:08:01.361824 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:08:01.361824 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cee19510-084b-451e-84b2-15368ba8a40f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:08:01.364420 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Booting with volume 116ba0ab-e23e-4afb-af0d-8a4c566cbab7 at /dev/vdc
May 27 03:08:01.373547 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:08:01.377040 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:08:01.377862 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:08:01.378428 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:08:01.378728 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:08:01.379516 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:08:01.390174 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:08:01.390174 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:01.398151 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:08:01.398151 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:01.409580 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f] added
May 27 03:08:01.409580 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:08:01.409580 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:08:01.409580 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:08:01.409580 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:08:01.409580 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:08:01.409580 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:01.409829 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:08:01.410241 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0313(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:08:01.410241 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:08:01.411431 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f] added
May 27 03:08:01.411431 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:08:01.411431 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:08:01.411431 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:08:01.411431 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:08:01.411431 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:08:01.411431 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:01.411431 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:08:01.411675 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0332(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:08:01.411675 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:08:01.427564 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:08:01.439751 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:08:01.456832 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:01.505427 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:08:01.505870 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:08:01.518694 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:08:01.519879 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fedf:3ab8', 'fe80::7427:32ff:fe97:df09', 'fe80::fc16:3eff:fe69:cb34', 'fe80::787c:50ff:fed5:a1fc', 'fe80::fc16:3eff:fe7b:f2ac', 'fe80::492:18ff:fe4d:a46d', 'fe80::fc16:3eff:fe21:cfcf', 'fe80::58d4:6eff:fe81:c6fc', 'fe80::fc16:3eff:fe43:6208'] 
May 27 03:08:01.519999 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:08:01.520110 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:08:01.520331 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:08:01.520533 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Updating existing volume attachment record: f8588e25-59b0-4848-8700-e36368894e10 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:08:01.801950 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a92ea927-9cff-42aa-889a-0a2c76244d24 tempest-TestEncryptedCinderVolumes-727613157 tempest-TestEncryptedCinderVolumes-727613157-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:01.824214 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance a3d1d581-aaf0-4e14-99ae-5db434215c60 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 27 03:08:01.824547 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:08:01.824789 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:08:00 up 39 min,  2 users,  load average: 6.97, 8.03, 5.17\n', 'num_instances': '5', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '5', 'num_proj_bfc9c3d1d60841349d551f2d9874c730': '2', 'io_workload': '1', 'num_proj_5f1801e95925498cac899f1414f2b202': '1', 'num_proj_4d79b15ea2254cd7adc804ece7e7cfae': '1', 'num_proj_78ed6c288e2642cfa4fbb3761274cc4e': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:08:02.203010 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:08:02.203320 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:08:02.410769 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:08:02.412873 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:08:02.426461 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:08:02.426461 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:08:02.431063 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:08:02.431063 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:02.440101 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:02.447314 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:02.461862 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:02.461862 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:02.461862 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:08:02.461862 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:02.461862 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:02.461862 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:02.461862 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:02.461862 np0000001475 nova-compute[98471]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:08:02.461862 np0000001475 nova-compute[98471]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:08:02.461862 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:08:02.462221 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:02.462221 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:02.462221 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:08:02.462221 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:02.462221 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:02.462221 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:02.462221 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:02.462221 np0000001475 nova-compute[98471]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:08:02.462221 np0000001475 nova-compute[98471]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:08:02.462221 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:08:02.470571 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:02.470571 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:02.470571 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:08:02.470571 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:02.470571 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:02.470571 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:02.470571 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:02.470571 np0000001475 nova-compute[98471]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:08:02.470571 np0000001475 nova-compute[98471]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:08:02.470571 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:08:02.471000 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:02.471000 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:02.471000 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:08:02.471000 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:02.471000 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:02.471000 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:02.471000 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:02.471000 np0000001475 nova-compute[98471]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:08:02.471000 np0000001475 nova-compute[98471]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:08:02.471000 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:08:02.496630 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:08:02.496933 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:08:02.497138 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:08:02.497315 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] No VIF found with MAC fa:16:3e:69:cb:34, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:08:02.512943 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f, portal: 192.168.50.100,3260]
May 27 03:08:02.512943 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f, portal: 192.168.50.100,3260] successful.
May 27 03:08:02.512943 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:02.521860 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f, portal: 192.168.40.100,3260]
May 27 03:08:02.521860 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f, portal: 192.168.40.100,3260] successful.
May 27 03:08:02.521860 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:02.527486 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:02.539664 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:02.552979 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:02.552979 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:02.552979 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:08:02.552979 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:02.552979 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:02.552979 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:02.552979 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:02.552979 np0000001475 nova-compute[98471]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:08:02.552979 np0000001475 nova-compute[98471]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:08:02.552979 np0000001475 nova-compute[98471]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:02.552979 np0000001475 nova-compute[98471]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:02.552979 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:08:02.553432 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:02.553432 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:02.553432 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:08:02.553432 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:02.553432 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:02.553432 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:02.553432 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:02.553432 np0000001475 nova-compute[98471]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:08:02.553432 np0000001475 nova-compute[98471]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:08:02.553432 np0000001475 nova-compute[98471]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:02.553432 np0000001475 nova-compute[98471]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:02.553432 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:08:02.553978 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:08:02.553978 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:08:02.554856 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] HCTL ('10', '-', '-', 0) found on session 120 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:08:02.554965 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a3448e2b-49bc-4081-82ff-fd0c8546dbbc (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:02.563419 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:08:02.563419 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:08:02.564409 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] HCTL ('11', '-', '-', 0) found on session 121 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:08:02.564409 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:08:02.575469 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Searching for a device in session 120 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:08:02.575469 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'cee19510-084b-451e-84b2-15368ba8a40f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:08:02.591417 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Searching for a device in session 121 and hctl ['11', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:08:02.611087 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7ad01dd5-e461-48cb-a2bf-5bbc8e179c6e req-e11dd10a-feb5-4367-8a2e-ccc53c7bbd87 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Received event network-changed-efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:02.611263 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7ad01dd5-e461-48cb-a2bf-5bbc8e179c6e req-e11dd10a-feb5-4367-8a2e-ccc53c7bbd87 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Refreshing instance network info cache due to event network-changed-efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:08:02.611444 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7ad01dd5-e461-48cb-a2bf-5bbc8e179c6e req-e11dd10a-feb5-4367-8a2e-ccc53c7bbd87 service nova] Acquiring lock "refresh_cache-dbecddfd-649b-4343-a5d2-bbbbf0c67de5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:08:02.611535 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7ad01dd5-e461-48cb-a2bf-5bbc8e179c6e req-e11dd10a-feb5-4367-8a2e-ccc53c7bbd87 service nova] Acquired lock "refresh_cache-dbecddfd-649b-4343-a5d2-bbbbf0c67de5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:08:02.611655 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7ad01dd5-e461-48cb-a2bf-5bbc8e179c6e req-e11dd10a-feb5-4367-8a2e-ccc53c7bbd87 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Refreshing network info cache for port efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:08:02.706659 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:08:03.115140 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-7ad01dd5-e461-48cb-a2bf-5bbc8e179c6e req-e11dd10a-feb5-4367-8a2e-ccc53c7bbd87 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:03.207394 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:03.216587 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:08:03.216767 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.971s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:03.217042 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.010s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:03.217378 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:08:03.219342 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'pci_requests' on Instance uuid a3d1d581-aaf0-4e14-99ae-5db434215c60 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:08:03.457405 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-7ad01dd5-e461-48cb-a2bf-5bbc8e179c6e req-e11dd10a-feb5-4367-8a2e-ccc53c7bbd87 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:03.572596 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:03.573296 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:03.583209 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Searching for a device in session 121 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:08:03.583348 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cee19510-084b-451e-84b2-15368ba8a40f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:08:03.615508 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7ad01dd5-e461-48cb-a2bf-5bbc8e179c6e req-e11dd10a-feb5-4367-8a2e-ccc53c7bbd87 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Updated VIF entry in instance network info cache for port efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:08:03.615822 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7ad01dd5-e461-48cb-a2bf-5bbc8e179c6e req-e11dd10a-feb5-4367-8a2e-ccc53c7bbd87 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Updating instance_info_cache with network_info: [{"id": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "address": "fa:16:3e:43:62:08", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdd6bcb-2c", "ovs_interfaceid": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:08:03.723393 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'numa_topology' on Instance uuid a3d1d581-aaf0-4e14-99ae-5db434215c60 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:08:04.075228 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:08:04.083200 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de04b29e-8a92-4cbf-8223-9ddd603bb125 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.810s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:04.117493 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7ad01dd5-e461-48cb-a2bf-5bbc8e179c6e req-e11dd10a-feb5-4367-8a2e-ccc53c7bbd87 service nova] Releasing lock "refresh_cache-dbecddfd-649b-4343-a5d2-bbbbf0c67de5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:08:04.226722 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:08:04.226964 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Claim successful on node np0000001475
May 27 03:08:04.398527 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Found WWN 330000000e59a2fd5 for multipath device dm-3 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:08:04.398855 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:08:04.399035 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000e59a2fd5', 'path': '/dev/dm-3', 'multipath_id': '330000000e59a2fd5'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:08:04.399165 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e59a2fd5', 'path': '/dev/dm-3', 'multipath_id': '330000000e59a2fd5'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:08:04.402045 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lazy-loading 'flavor' on Instance uuid 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:08:04.435912 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "f9cd3c05-0282-4843-b890-8be3eb097bfe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:04.436163 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:04.644055 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:04.904703 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Attempting to attach volume cee19510-084b-451e-84b2-15368ba8a40f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:08:04.907101 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:08:04.907101 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:08:04.907101 np0000001475 nova-compute[98471]:   <alias name="ua-cee19510-084b-451e-84b2-15368ba8a40f"/>
May 27 03:08:04.907101 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:08:04.907101 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:08:04.907101 np0000001475 nova-compute[98471]:   <serial>cee19510-084b-451e-84b2-15368ba8a40f</serial>
May 27 03:08:04.907101 np0000001475 nova-compute[98471]: </disk>
May 27 03:08:04.907101 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:08:04.940051 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Detaching volume d570d0d1-cf21-4c60-84fe-7a6445cad954
May 27 03:08:04.983324 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Attempting to driver detach volume d570d0d1-cf21-4c60-84fe-7a6445cad954 from mountpoint /dev/vdb
May 27 03:08:04.989933 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Found disk vdb by alias ua-d570d0d1-cf21-4c60-84fe-7a6445cad954 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:08:04.991524 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Found disk vdb by alias ua-d570d0d1-cf21-4c60-84fe-7a6445cad954 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:08:04.991651 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Attempting to detach device vdb from instance f9cd3c05-0282-4843-b890-8be3eb097bfe from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:08:04.991889 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:08:04.991889 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:08:04.991889 np0000001475 nova-compute[98471]:   <alias name="ua-d570d0d1-cf21-4c60-84fe-7a6445cad954"/>
May 27 03:08:04.991889 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-9"/>
May 27 03:08:04.991889 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:08:04.991889 np0000001475 nova-compute[98471]:   <serial>d570d0d1-cf21-4c60-84fe-7a6445cad954</serial>
May 27 03:08:04.991889 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:08:04.991889 np0000001475 nova-compute[98471]: </disk>
May 27 03:08:04.991889 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:08:04.999098 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Successfully detached device vdb from instance f9cd3c05-0282-4843-b890-8be3eb097bfe from the persistent domain config.
May 27 03:08:04.999275 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] (1/8): Attempting to detach device vdb with device alias ua-d570d0d1-cf21-4c60-84fe-7a6445cad954 from instance f9cd3c05-0282-4843-b890-8be3eb097bfe from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:08:04.999529 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:08:04.999529 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:08:04.999529 np0000001475 nova-compute[98471]:   <alias name="ua-d570d0d1-cf21-4c60-84fe-7a6445cad954"/>
May 27 03:08:04.999529 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-9"/>
May 27 03:08:04.999529 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:08:04.999529 np0000001475 nova-compute[98471]:   <serial>d570d0d1-cf21-4c60-84fe-7a6445cad954</serial>
May 27 03:08:04.999529 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:08:04.999529 np0000001475 nova-compute[98471]: </disk>
May 27 03:08:04.999529 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:08:05.502586 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:05.584557 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:08:05.584811 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:08:05.589599 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851285.587429, f9cd3c05-0282-4843-b890-8be3eb097bfe => ua-d570d0d1-cf21-4c60-84fe-7a6445cad954> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:08:05.590257 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d570d0d1-cf21-4c60-84fe-7a6445cad954 for instance f9cd3c05-0282-4843-b890-8be3eb097bfe {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:08:05.593033 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Successfully detached device vdb from instance f9cd3c05-0282-4843-b890-8be3eb097bfe from the live domain config.
May 27 03:08:05.594561 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:08:05.594993 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954', 'iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd570d0d1-cf21-4c60-84fe-7a6445cad954', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:08:05.595190 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:08:05.599196 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:08:05.599503 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954', 'iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd570d0d1-cf21-4c60-84fe-7a6445cad954', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:08:05.599627 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:08:05.634450 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:05.634450 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:05.634450 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:05.634450 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:05.634450 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:05.634450 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:05.634450 np0000001475 nova-compute[98471]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:08:05.634450 np0000001475 nova-compute[98471]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:08:05.634450 np0000001475 nova-compute[98471]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:05.634450 np0000001475 nova-compute[98471]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:05.634450 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:08:05.635067 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:05.635067 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:05.635067 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:05.635067 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:05.635067 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:05.635067 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:05.635067 np0000001475 nova-compute[98471]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:08:05.635067 np0000001475 nova-compute[98471]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954 (non-flash)
May 27 03:08:05.635067 np0000001475 nova-compute[98471]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:05.635067 np0000001475 nova-compute[98471]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:05.635067 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:08:05.635067 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954', '118'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954', '119'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', '121')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:08:05.635333 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954', '119')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:08:05.636206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954', '118')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:08:05.637444 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c518e00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954'): ({'sdk'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:08:05.637706 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Removing multipathed devices sdk, sdl {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:08:05.638045 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Flush multipath device 3300000009fa7b4ef {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:08:05.677628 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:08:05.732808 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:08:05.787394 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Checking to see if SCSI volumes sdk, sdl have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:08:05.787658 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] SCSI volumes sdk, sdl have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:08:05.789327 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Checking to see if device paths {'sdk', 'sdl'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:08:05.800428 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Device paths {'sdk', 'sdl'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:08:05.800708 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:08:05.813866 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:05.848479 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 119, target: iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954, portal: 192.168.40.100,3260]
May 27 03:08:05.848479 np0000001475 nova-compute[98471]: Logout of [sid: 119, target: iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954, portal: 192.168.40.100,3260] successful.
May 27 03:08:05.848479 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:05.868026 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:05.880550 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:05.919298 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 118, target: iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954, portal: 192.168.50.100,3260]
May 27 03:08:05.919298 np0000001475 nova-compute[98471]: Logout of [sid: 118, target: iqn.2023-03.storpool.com:os--volume-d570d0d1-cf21-4c60-84fe-7a6445cad954, portal: 192.168.50.100,3260] successful.
May 27 03:08:05.919298 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:05.941513 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:05.944376 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:08:05.944376 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] <== disconnect_volume: return (347ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:08:05.944376 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:08:06.088166 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:08:06.182113 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:06.339527 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:06.518082 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lazy-loading 'flavor' on Instance uuid f9cd3c05-0282-4843-b890-8be3eb097bfe {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:08:06.551068 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:08:06.551210 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:08:06.551383 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:08:06.551437 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] No VIF found with MAC fa:16:3e:21:cf:cf, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:08:06.595436 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.378s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:06.596264 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.952s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:06.597380 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:06.600372 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:08:06.600547 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Claim successful on node np0000001475
May 27 03:08:06.682444 np0000001475 nova-compute[98471]: INFO nova.network.neutron [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Updating port ad4ac3f9-a243-42a4-9e61-fb161205ae0a with attributes {'binding:host_id': 'np0000001475', 'device_owner': 'compute:nova'}
May 27 03:08:07.254750 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:08:07.255763 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquired lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:08:07.256619 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:08:07.328571 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-691a40d6-9f83-455c-9b80-88522553efcf req-2aa9426e-cfe4-4068-8c1f-4cd4018519e6 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Received event network-changed-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:07.334330 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-691a40d6-9f83-455c-9b80-88522553efcf req-2aa9426e-cfe4-4068-8c1f-4cd4018519e6 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Refreshing instance network info cache due to event network-changed-ad4ac3f9-a243-42a4-9e61-fb161205ae0a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:08:07.334330 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-691a40d6-9f83-455c-9b80-88522553efcf req-2aa9426e-cfe4-4068-8c1f-4cd4018519e6 service nova] Acquiring lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:08:07.525768 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8ba847ca-a761-4711-9e8d-3c8fc710b456 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.090s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:07.657833 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:07.658737 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:07.767871 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:07.769382 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:07.774892 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "f9cd3c05-0282-4843-b890-8be3eb097bfe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:07.775165 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:07.775390 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:07.775710 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:07.775797 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:07.783698 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Terminating instance
May 27 03:08:08.074154 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:08:08.074408 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:08:08.123810 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-19fdb10e-793f-422e-950f-ea9c342ff864 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.508s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:08.161218 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Detaching volume 418bb384-85e5-45c6-a7f0-28ac5d64433f
May 27 03:08:08.216766 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Attempting to driver detach volume 418bb384-85e5-45c6-a7f0-28ac5d64433f from mountpoint /dev/vdb
May 27 03:08:08.222731 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Found disk vdb by alias ua-418bb384-85e5-45c6-a7f0-28ac5d64433f {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:08:08.224208 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Found disk vdb by alias ua-418bb384-85e5-45c6-a7f0-28ac5d64433f {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:08:08.224348 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Attempting to detach device vdb from instance 9de3772c-0fb1-4718-bd84-b0ea6540a00c from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:08:08.224615 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:08:08.224615 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:08:08.224615 np0000001475 nova-compute[98471]:   <alias name="ua-418bb384-85e5-45c6-a7f0-28ac5d64433f"/>
May 27 03:08:08.224615 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-7"/>
May 27 03:08:08.224615 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:08:08.224615 np0000001475 nova-compute[98471]:   <serial>418bb384-85e5-45c6-a7f0-28ac5d64433f</serial>
May 27 03:08:08.224615 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:08:08.224615 np0000001475 nova-compute[98471]: </disk>
May 27 03:08:08.224615 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:08:08.232288 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Successfully detached device vdb from instance 9de3772c-0fb1-4718-bd84-b0ea6540a00c from the persistent domain config.
May 27 03:08:08.232508 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] (1/8): Attempting to detach device vdb with device alias ua-418bb384-85e5-45c6-a7f0-28ac5d64433f from instance 9de3772c-0fb1-4718-bd84-b0ea6540a00c from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:08:08.232687 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:08:08.232687 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:08:08.232687 np0000001475 nova-compute[98471]:   <alias name="ua-418bb384-85e5-45c6-a7f0-28ac5d64433f"/>
May 27 03:08:08.232687 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-7"/>
May 27 03:08:08.232687 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:08:08.232687 np0000001475 nova-compute[98471]:   <serial>418bb384-85e5-45c6-a7f0-28ac5d64433f</serial>
May 27 03:08:08.232687 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:08:08.232687 np0000001475 nova-compute[98471]: </disk>
May 27 03:08:08.232687 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:08:08.278708 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:08.295258 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:08:08.322256 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:08.325210 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:08.352810 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:08.369415 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:08.402926 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:08.493783 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Updating instance_info_cache with network_info: [{"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:08:08.579719 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:08:08.634775 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:08.661844 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999610505999954 future=<Future at 0x755704773800 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:08:08.662721 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.998668933999852 future=<Future at 0x755704773800 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:08:08.662967 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.998363766999773 future=<Future at 0x755704773800 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:08:08.665656 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Instance destroyed successfully.
May 27 03:08:08.666145 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lazy-loading 'resources' on Instance uuid f9cd3c05-0282-4843-b890-8be3eb097bfe {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:08:08.683795 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5ef88117-de21-4dd7-acef-edc993e14752 req-916e13e0-594e-4da7-a67a-bf35288625f8 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Received event network-vif-unplugged-9759ac1f-7540-440f-89ce-d18c9e430586 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:08.684024 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5ef88117-de21-4dd7-acef-edc993e14752 req-916e13e0-594e-4da7-a67a-bf35288625f8 service nova] Acquiring lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:08.684385 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5ef88117-de21-4dd7-acef-edc993e14752 req-916e13e0-594e-4da7-a67a-bf35288625f8 service nova] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:08.684684 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5ef88117-de21-4dd7-acef-edc993e14752 req-916e13e0-594e-4da7-a67a-bf35288625f8 service nova] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:08.684858 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5ef88117-de21-4dd7-acef-edc993e14752 req-916e13e0-594e-4da7-a67a-bf35288625f8 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] No waiting events found dispatching network-vif-unplugged-9759ac1f-7540-440f-89ce-d18c9e430586 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:08:08.685010 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5ef88117-de21-4dd7-acef-edc993e14752 req-916e13e0-594e-4da7-a67a-bf35288625f8 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Received event network-vif-unplugged-9759ac1f-7540-440f-89ce-d18c9e430586 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:08:08.793831 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851288.7934306, 9de3772c-0fb1-4718-bd84-b0ea6540a00c => ua-418bb384-85e5-45c6-a7f0-28ac5d64433f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:08:08.795349 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-418bb384-85e5-45c6-a7f0-28ac5d64433f for instance 9de3772c-0fb1-4718-bd84-b0ea6540a00c {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:08:08.798302 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Successfully detached device vdb from instance 9de3772c-0fb1-4718-bd84-b0ea6540a00c from the live domain config.
May 27 03:08:08.799510 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:08:08.799867 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '418bb384-85e5-45c6-a7f0-28ac5d64433f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:08:08.800071 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:08:08.800433 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:08:08.800727 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '418bb384-85e5-45c6-a7f0-28ac5d64433f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:08:08.801059 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:08:08.829234 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:08.829234 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:08.829234 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:08.829234 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:08.829234 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:08.829234 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:08.829234 np0000001475 nova-compute[98471]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:08.829234 np0000001475 nova-compute[98471]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:08.829234 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:08:08.829572 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:08.829572 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:08.829572 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:08.829572 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:08.829572 np0000001475 nova-compute[98471]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:08.829572 np0000001475 nova-compute[98471]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f (non-flash)
May 27 03:08:08.829572 np0000001475 nova-compute[98471]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:08.829572 np0000001475 nova-compute[98471]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:08.829572 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:08:08.829572 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', '121')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:08:08.829806 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', '116')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:08:08.830939 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', '117')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:08:08.832084 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c287240>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f'): ({'sdj'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:08:08.832308 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Removing multipathed devices sdj, sdi {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:08:08.832579 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Flush multipath device 3300000004b252198 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:08:08.870284 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:08:08.917366 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:08:08.965066 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Checking to see if SCSI volumes sdj, sdi have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:08:08.965222 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] SCSI volumes sdj, sdi have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:08:08.966166 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Checking to see if device paths {'sdj', 'sdi'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:08:08.977510 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Device paths {'sdj', 'sdi'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:08:08.977704 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:08:08.992912 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:08.997147 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Releasing lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:08:08.998615 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:08:08.999108 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-691a40d6-9f83-455c-9b80-88522553efcf req-2aa9426e-cfe4-4068-8c1f-4cd4018519e6 service nova] Acquired lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:08:08.999261 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-691a40d6-9f83-455c-9b80-88522553efcf req-2aa9426e-cfe4-4068-8c1f-4cd4018519e6 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Refreshing network info cache for port ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:08:09.000442 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Creating image(s)
May 27 03:08:09.003435 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:09.003435 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "/opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:09.003435 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "/opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:09.003435 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'trusted_certs' on Instance uuid a3d1d581-aaf0-4e14-99ae-5db434215c60 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:08:09.029329 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 116, target: iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f, portal: 192.168.40.100,3260]
May 27 03:08:09.029329 np0000001475 nova-compute[98471]: Logout of [sid: 116, target: iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f, portal: 192.168.40.100,3260] successful.
May 27 03:08:09.029329 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:09.051183 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:09.065943 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:09.100410 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.505s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:09.100666 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:08:09.108055 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 117, target: iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f, portal: 192.168.50.100,3260]
May 27 03:08:09.108055 np0000001475 nova-compute[98471]: Logout of [sid: 117, target: iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f, portal: 192.168.50.100,3260] successful.
May 27 03:08:09.108055 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:09.124305 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:09.124552 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:08:09.124709 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] <== disconnect_volume: return (325ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:08:09.124874 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:08:09.168894 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-742378270',display_name='tempest-AttachVolumeNegativeTest-server-742378270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumenegativetest-server-742378270',id=49,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWYX3l2S3rhj+f0exqf04b4xF6a8aT3A3TjGafu0ixB8CebL8THEHd1zBc2kB5obrBN3eyfQD4SFRx+Xg+ZqN7JnMo/H5oCxNaCTA6JzhekpF7fCoboF/ndo4T5k96cFw==',key_name='tempest-keypair-1969300216',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:07:01Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f1801e95925498cac899f1414f2b202',ramdisk_id='',reservation_id='r-rvjj6pqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1854580419',owner_user_name='tempest-AttachVolumeNegativeTest-1854580419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:07:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca42144366ef44eb81e5c4a23624d281',uuid=f9cd3c05-0282-4843-b890-8be3eb097bfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9759ac1f-7540-440f-89ce-d18c9e430586", "address": "fa:16:3e:69:cb:34", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ac1f-75", "ovs_interfaceid": "9759ac1f-7540-440f-89ce-d18c9e430586", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:08:09.169172 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converting VIF {"id": "9759ac1f-7540-440f-89ce-d18c9e430586", "address": "fa:16:3e:69:cb:34", "network": {"id": "ed7920d4-6d44-4234-8ca8-8c0d7ea88682", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-750842958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5f1801e95925498cac899f1414f2b202", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9759ac1f-75", "ovs_interfaceid": "9759ac1f-7540-440f-89ce-d18c9e430586", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:08:09.169940 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:cb:34,bridge_name='br-int',has_traffic_filtering=True,id=9759ac1f-7540-440f-89ce-d18c9e430586,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9759ac1f-75') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:08:09.170240 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:cb:34,bridge_name='br-int',has_traffic_filtering=True,id=9759ac1f-7540-440f-89ce-d18c9e430586,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9759ac1f-75') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:08:09.173115 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:09.173115 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9759ac1f-75, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:09.174524 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:09.174524 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:08:09.175162 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:09.176096 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:09.176360 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11ae66a7-ad7e-4dce-9987-d2b199ca072d) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:09.176923 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:09.177499 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:08:09.178788 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:09.180361 np0000001475 nova-compute[98471]: INFO os_vif [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:cb:34,bridge_name='br-int',has_traffic_filtering=True,id=9759ac1f-7540-440f-89ce-d18c9e430586,network=Network(ed7920d4-6d44-4234-8ca8-8c0d7ea88682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9759ac1f-75')
May 27 03:08:09.180795 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Deleting instance files /opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe_del
May 27 03:08:09.181790 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Deletion of /opt/stack/data/nova/instances/f9cd3c05-0282-4843-b890-8be3eb097bfe_del complete
May 27 03:08:09.502369 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-691a40d6-9f83-455c-9b80-88522553efcf req-2aa9426e-cfe4-4068-8c1f-4cd4018519e6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:09.504832 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Object Instance<a3d1d581-aaf0-4e14-99ae-5db434215c60> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:08:09.505552 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "ddb90b5132460a9afd35cf98bfe728479a9e3f8f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:09.506581 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "ddb90b5132460a9afd35cf98bfe728479a9e3f8f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:09.606050 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:08:09.606247 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:08:09.606522 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:09.606768 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:09.684330 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lazy-loading 'flavor' on Instance uuid 9de3772c-0fb1-4718-bd84-b0ea6540a00c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:08:09.701704 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Took 1.41 seconds to destroy the instance on the hypervisor.
May 27 03:08:09.704587 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:08:09.705489 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:08:09.705837 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:08:09.706159 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:09.728706 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '358594214f7a4c71a13200be75c799cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0810d45b82c0476db38b1cabf8579ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:08:09.912588 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:09.979511 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-691a40d6-9f83-455c-9b80-88522553efcf req-2aa9426e-cfe4-4068-8c1f-4cd4018519e6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:10.114481 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:08:10.293401 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-691a40d6-9f83-455c-9b80-88522553efcf req-2aa9426e-cfe4-4068-8c1f-4cd4018519e6 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Updated VIF entry in instance network info cache for port ad4ac3f9-a243-42a4-9e61-fb161205ae0a. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:08:10.293710 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-691a40d6-9f83-455c-9b80-88522553efcf req-2aa9426e-cfe4-4068-8c1f-4cd4018519e6 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Updating instance_info_cache with network_info: [{"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:08:10.585326 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:08:10.588862 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:08:10.589629 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddb90b5132460a9afd35cf98bfe728479a9e3f8f.part --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:10.613084 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Successfully created port: 07d47fc5-99ae-4875-8336-7244d0678fa7 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:08:10.622314 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:08:10.693569 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-438cf2f8-9d51-4a92-9f0b-e4ec55f1e151 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.036s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:10.695917 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.926s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:10.697331 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:10.697331 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:10.697479 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:10.701646 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Terminating instance
May 27 03:08:10.709709 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddb90b5132460a9afd35cf98bfe728479a9e3f8f.part --force-share --output=json" returned: 0 in 0.118s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:10.709709 np0000001475 nova-compute[98471]: DEBUG nova.virt.images [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] c975161a-b72d-400b-8b3c-816fa6106f86 was qcow2, converting to raw {{(pid=98471) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 03:08:10.709936 np0000001475 nova-compute[98471]: DEBUG nova.privsep.utils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98471) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 03:08:10.710132 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ddb90b5132460a9afd35cf98bfe728479a9e3f8f.part /opt/stack/data/nova/instances/_base/ddb90b5132460a9afd35cf98bfe728479a9e3f8f.converted {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:10.764634 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7944f954-9054-4ed7-8e6d-5dfc83113489 req-e05555d8-ff7b-48e8-9a72-4ac1d84302a7 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Received event network-vif-unplugged-9759ac1f-7540-440f-89ce-d18c9e430586 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:10.764881 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7944f954-9054-4ed7-8e6d-5dfc83113489 req-e05555d8-ff7b-48e8-9a72-4ac1d84302a7 service nova] Acquiring lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:10.765085 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7944f954-9054-4ed7-8e6d-5dfc83113489 req-e05555d8-ff7b-48e8-9a72-4ac1d84302a7 service nova] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:10.765202 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7944f954-9054-4ed7-8e6d-5dfc83113489 req-e05555d8-ff7b-48e8-9a72-4ac1d84302a7 service nova] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:10.765321 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7944f954-9054-4ed7-8e6d-5dfc83113489 req-e05555d8-ff7b-48e8-9a72-4ac1d84302a7 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] No waiting events found dispatching network-vif-unplugged-9759ac1f-7540-440f-89ce-d18c9e430586 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:08:10.765441 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7944f954-9054-4ed7-8e6d-5dfc83113489 req-e05555d8-ff7b-48e8-9a72-4ac1d84302a7 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Received event network-vif-unplugged-9759ac1f-7540-440f-89ce-d18c9e430586 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:08:10.765541 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7944f954-9054-4ed7-8e6d-5dfc83113489 req-e05555d8-ff7b-48e8-9a72-4ac1d84302a7 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Received event network-vif-deleted-9759ac1f-7540-440f-89ce-d18c9e430586 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:10.765646 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-7944f954-9054-4ed7-8e6d-5dfc83113489 req-e05555d8-ff7b-48e8-9a72-4ac1d84302a7 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Neutron deleted interface 9759ac1f-7540-440f-89ce-d18c9e430586; detaching it from the instance and deleting it from the info cache
May 27 03:08:10.766194 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7944f954-9054-4ed7-8e6d-5dfc83113489 req-e05555d8-ff7b-48e8-9a72-4ac1d84302a7 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:08:10.797469 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-691a40d6-9f83-455c-9b80-88522553efcf req-2aa9426e-cfe4-4068-8c1f-4cd4018519e6 service nova] Releasing lock "refresh_cache-a3d1d581-aaf0-4e14-99ae-5db434215c60" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:08:10.885721 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ddb90b5132460a9afd35cf98bfe728479a9e3f8f.part /opt/stack/data/nova/instances/_base/ddb90b5132460a9afd35cf98bfe728479a9e3f8f.converted" returned: 0 in 0.175s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:10.900331 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddb90b5132460a9afd35cf98bfe728479a9e3f8f.converted --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:10.994613 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddb90b5132460a9afd35cf98bfe728479a9e3f8f.converted --force-share --output=json" returned: 0 in 0.094s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:10.995520 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "ddb90b5132460a9afd35cf98bfe728479a9e3f8f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.489s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:10.996155 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:08:10.999199 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:08:11.001761 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddb90b5132460a9afd35cf98bfe728479a9e3f8f --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:11.076877 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:08:11.094770 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddb90b5132460a9afd35cf98bfe728479a9e3f8f --force-share --output=json" returned: 0 in 0.093s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:11.095807 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "ddb90b5132460a9afd35cf98bfe728479a9e3f8f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:11.097431 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "ddb90b5132460a9afd35cf98bfe728479a9e3f8f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:11.098169 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:08:11.104402 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:08:11.104725 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddb90b5132460a9afd35cf98bfe728479a9e3f8f --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:11.138378 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Booting with volume 9d6ae676-a143-4096-8131-416697041c3d at /dev/vda
May 27 03:08:11.209125 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:08:11.215844 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:08:11.225881 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddb90b5132460a9afd35cf98bfe728479a9e3f8f --force-share --output=json" returned: 0 in 0.120s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:11.225881 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ddb90b5132460a9afd35cf98bfe728479a9e3f8f,backing_fmt=raw /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:11.242201 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:08:11.243664 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:11.267559 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:11.273863 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:11.275335 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:11.306453 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:11.324125 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Successfully updated port: 07d47fc5-99ae-4875-8336-7244d0678fa7 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:08:11.329681 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ddb90b5132460a9afd35cf98bfe728479a9e3f8f,backing_fmt=raw /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk 1073741824" returned: 0 in 0.104s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:11.331852 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7944f954-9054-4ed7-8e6d-5dfc83113489 req-e05555d8-ff7b-48e8-9a72-4ac1d84302a7 service nova] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Detach interface failed, port_id=9759ac1f-7540-440f-89ce-d18c9e430586, reason: Instance f9cd3c05-0282-4843-b890-8be3eb097bfe could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:08:11.333405 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "ddb90b5132460a9afd35cf98bfe728479a9e3f8f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:11.333770 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddb90b5132460a9afd35cf98bfe728479a9e3f8f --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:11.364934 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:11.364934 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:08:11.366152 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:08:11.380329 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:08:11.381851 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fedf:3ab8', 'fe80::7427:32ff:fe97:df09', 'fe80::fc16:3eff:fe21:cfcf', 'fe80::58d4:6eff:fe81:c6fc', 'fe80::fc16:3eff:fe43:6208'] 
May 27 03:08:11.382405 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:08:11.382405 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:08:11.383885 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:08:11.383885 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Updating existing volume attachment record: a8e6697c-f6db-4ebc-9325-ec2ea3fcaba6 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:08:11.393979 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-917d6251-556a-4977-bc4a-491e44840f0b req-de54c1b6-e0de-4e40-9847-e55b7a8a7424 service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Received event network-changed-07d47fc5-99ae-4875-8336-7244d0678fa7 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:11.396424 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-917d6251-556a-4977-bc4a-491e44840f0b req-de54c1b6-e0de-4e40-9847-e55b7a8a7424 service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Refreshing instance network info cache due to event network-changed-07d47fc5-99ae-4875-8336-7244d0678fa7. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:08:11.399132 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-917d6251-556a-4977-bc4a-491e44840f0b req-de54c1b6-e0de-4e40-9847-e55b7a8a7424 service nova] Acquiring lock "refresh_cache-6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:08:11.399132 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-917d6251-556a-4977-bc4a-491e44840f0b req-de54c1b6-e0de-4e40-9847-e55b7a8a7424 service nova] Acquired lock "refresh_cache-6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:08:11.399132 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-917d6251-556a-4977-bc4a-491e44840f0b req-de54c1b6-e0de-4e40-9847-e55b7a8a7424 service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Refreshing network info cache for port 07d47fc5-99ae-4875-8336-7244d0678fa7 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:08:11.459208 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddb90b5132460a9afd35cf98bfe728479a9e3f8f --force-share --output=json" returned: 0 in 0.125s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:11.461875 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'migration_context' on Instance uuid a3d1d581-aaf0-4e14-99ae-5db434215c60 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:08:11.550528 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:11.559581 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:11.581811 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Took 1.88 seconds to deallocate network for instance.
May 27 03:08:11.588825 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999576020999939 future=<Future at 0x755704771250 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:08:11.590924 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Instance destroyed successfully.
May 27 03:08:11.592156 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lazy-loading 'resources' on Instance uuid 9de3772c-0fb1-4718-bd84-b0ea6540a00c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:08:11.830671 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "refresh_cache-6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:08:11.899854 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-917d6251-556a-4977-bc4a-491e44840f0b req-de54c1b6-e0de-4e40-9847-e55b7a8a7424 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:11.967831 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Object Instance<a3d1d581-aaf0-4e14-99ae-5db434215c60> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:08:11.968570 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Rebasing disk image.
May 27 03:08:11.968570 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:12.001846 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-917d6251-556a-4977-bc4a-491e44840f0b req-de54c1b6-e0de-4e40-9847-e55b7a8a7424 service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:08:12.070236 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.101s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:12.070806 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c -F raw /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:12.099126 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:12.101662 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:12.107564 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-524695679',display_name='tempest-VolumesSnapshotTestJSON-instance-524695679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumessnapshottestjson-instance-524695679',id=51,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZNwkY6ZNdPIGRKFsiJc6cUzbgmrE/1KHYIh2AjhtNmSD7WDNAoX1q2noQbM5PoBSNnP16gwOxAyCcXv7l1CwlFhFT915m4zoThyRaG+lfwiKYBkfP0mlPztgjsqsnIrg==',key_name='tempest-keypair-86205110',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:07:08Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d79b15ea2254cd7adc804ece7e7cfae',ramdisk_id='',reservation_id='r-o01qas8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-189213940',owner_user_name='tempest-VolumesSnapshotTestJSON-189213940-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:07:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ba707c9283c45989ff891306f972873',uuid=9de3772c-0fb1-4718-bd84-b0ea6540a00c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "address": "fa:16:3e:7b:f2:ac", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f65859-14", "ovs_interfaceid": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:08:12.108332 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Converting VIF {"id": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "address": "fa:16:3e:7b:f2:ac", "network": {"id": "3c97181e-8aba-4ea6-ac09-fed09f0812ec", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1092101262-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d79b15ea2254cd7adc804ece7e7cfae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f65859-14", "ovs_interfaceid": "a3f65859-14c9-4367-8d8d-465b49ebb7cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:08:12.109624 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:f2:ac,bridge_name='br-int',has_traffic_filtering=True,id=a3f65859-14c9-4367-8d8d-465b49ebb7cc,network=Network(3c97181e-8aba-4ea6-ac09-fed09f0812ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f65859-14') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:08:12.110017 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:f2:ac,bridge_name='br-int',has_traffic_filtering=True,id=a3f65859-14c9-4367-8d8d-465b49ebb7cc,network=Network(3c97181e-8aba-4ea6-ac09-fed09f0812ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f65859-14') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:08:12.114522 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:12.119273 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3f65859-14, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:12.122197 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:12.122197 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:08:12.122197 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:12.122817 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:12.122975 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df373177-0096-469e-bf20-a0907c3a21fa) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:12.123510 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:12.124046 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:08:12.124525 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:12.126869 np0000001475 nova-compute[98471]: INFO os_vif [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:f2:ac,bridge_name='br-int',has_traffic_filtering=True,id=a3f65859-14c9-4367-8d8d-465b49ebb7cc,network=Network(3c97181e-8aba-4ea6-ac09-fed09f0812ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f65859-14')
May 27 03:08:12.128819 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:08:12.129288 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '418bb384-85e5-45c6-a7f0-28ac5d64433f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:08:12.129461 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:08:12.129907 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:08:12.130336 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '418bb384-85e5-45c6-a7f0-28ac5d64433f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:08:12.130519 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:08:12.165090 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:12.165090 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:12.165090 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:12.165090 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:12.165090 np0000001475 nova-compute[98471]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:12.165090 np0000001475 nova-compute[98471]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:12.165090 np0000001475 nova-compute[98471]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e (non-flash)
May 27 03:08:12.165090 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:08:12.165374 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:12.165374 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:12.165374 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:12.165374 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:12.165374 np0000001475 nova-compute[98471]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:12.165374 np0000001475 nova-compute[98471]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:12.165374 np0000001475 nova-compute[98471]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e (non-flash)
May 27 03:08:12.165374 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:08:12.165374 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e', '122')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:08:12.165684 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f, 0): [] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:08:12.165684 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f') {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 03:08:12.165684 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f, 0): [] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:08:12.165905 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-418bb384-85e5-45c6-a7f0-28ac5d64433f') {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 03:08:12.166058 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c29f420>, {}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:08:12.166186 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Disconnecting from: [] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:08:12.166566 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.037s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:08:12.166767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] <== disconnect_volume: return (37ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:08:12.167038 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:08:12.167264 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Deleting instance files /opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c_del
May 27 03:08:12.168028 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Deletion of /opt/stack/data/nova/instances/9de3772c-0fb1-4718-bd84-b0ea6540a00c_del complete
May 27 03:08:12.237577 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-917d6251-556a-4977-bc4a-491e44840f0b req-de54c1b6-e0de-4e40-9847-e55b7a8a7424 service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:08:12.423685 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:12.423933 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:12.619044 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:08:12.619494 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:08:12.683241 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Took 1.47 seconds to destroy the instance on the hypervisor.
May 27 03:08:12.683912 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:08:12.684423 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:08:12.684584 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:08:12.685064 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:12.739991 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-917d6251-556a-4977-bc4a-491e44840f0b req-de54c1b6-e0de-4e40-9847-e55b7a8a7424 service nova] Releasing lock "refresh_cache-6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:08:12.741327 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquired lock "refresh_cache-6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:08:12.741327 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:08:12.785762 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:12.861326 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-306c087b-7783-4fd4-9830-33452496749d req-17071039-1dd9-4d9e-9b30-a7909c6f0a15 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Received event network-vif-unplugged-a3f65859-14c9-4367-8d8d-465b49ebb7cc {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:12.862198 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-306c087b-7783-4fd4-9830-33452496749d req-17071039-1dd9-4d9e-9b30-a7909c6f0a15 service nova] Acquiring lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:12.862399 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-306c087b-7783-4fd4-9830-33452496749d req-17071039-1dd9-4d9e-9b30-a7909c6f0a15 service nova] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:12.862533 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-306c087b-7783-4fd4-9830-33452496749d req-17071039-1dd9-4d9e-9b30-a7909c6f0a15 service nova] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:12.862655 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-306c087b-7783-4fd4-9830-33452496749d req-17071039-1dd9-4d9e-9b30-a7909c6f0a15 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] No waiting events found dispatching network-vif-unplugged-a3f65859-14c9-4367-8d8d-465b49ebb7cc {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:08:12.863557 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-306c087b-7783-4fd4-9830-33452496749d req-17071039-1dd9-4d9e-9b30-a7909c6f0a15 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Received event network-vif-unplugged-a3f65859-14c9-4367-8d8d-465b49ebb7cc for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:08:12.863697 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-306c087b-7783-4fd4-9830-33452496749d req-17071039-1dd9-4d9e-9b30-a7909c6f0a15 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Received event network-vif-unplugged-a3f65859-14c9-4367-8d8d-465b49ebb7cc {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:12.864677 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-306c087b-7783-4fd4-9830-33452496749d req-17071039-1dd9-4d9e-9b30-a7909c6f0a15 service nova] Acquiring lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:12.865393 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-306c087b-7783-4fd4-9830-33452496749d req-17071039-1dd9-4d9e-9b30-a7909c6f0a15 service nova] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:12.865682 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-306c087b-7783-4fd4-9830-33452496749d req-17071039-1dd9-4d9e-9b30-a7909c6f0a15 service nova] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:12.866099 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-306c087b-7783-4fd4-9830-33452496749d req-17071039-1dd9-4d9e-9b30-a7909c6f0a15 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] No waiting events found dispatching network-vif-unplugged-a3f65859-14c9-4367-8d8d-465b49ebb7cc {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:08:12.866277 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-306c087b-7783-4fd4-9830-33452496749d req-17071039-1dd9-4d9e-9b30-a7909c6f0a15 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Received event network-vif-unplugged-a3f65859-14c9-4367-8d8d-465b49ebb7cc for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:08:12.926696 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Detaching volume cee19510-084b-451e-84b2-15368ba8a40f
May 27 03:08:12.978039 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Attempting to driver detach volume cee19510-084b-451e-84b2-15368ba8a40f from mountpoint /dev/vdb
May 27 03:08:12.985902 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Found disk vdb by alias ua-cee19510-084b-451e-84b2-15368ba8a40f {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:08:12.988294 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Found disk vdb by alias ua-cee19510-084b-451e-84b2-15368ba8a40f {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:08:12.988448 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Attempting to detach device vdb from instance 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:08:12.988810 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:08:12.988810 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:08:12.988810 np0000001475 nova-compute[98471]:   <alias name="ua-cee19510-084b-451e-84b2-15368ba8a40f"/>
May 27 03:08:12.988810 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:08:12.988810 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:08:12.988810 np0000001475 nova-compute[98471]:   <serial>cee19510-084b-451e-84b2-15368ba8a40f</serial>
May 27 03:08:12.988810 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:08:12.988810 np0000001475 nova-compute[98471]: </disk>
May 27 03:08:12.988810 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:08:13.000091 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Successfully detached device vdb from instance 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa from the persistent domain config.
May 27 03:08:13.000695 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] (1/8): Attempting to detach device vdb with device alias ua-cee19510-084b-451e-84b2-15368ba8a40f from instance 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:08:13.001542 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:08:13.001542 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:08:13.001542 np0000001475 nova-compute[98471]:   <alias name="ua-cee19510-084b-451e-84b2-15368ba8a40f"/>
May 27 03:08:13.001542 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:08:13.001542 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:08:13.001542 np0000001475 nova-compute[98471]:   <serial>cee19510-084b-451e-84b2-15368ba8a40f</serial>
May 27 03:08:13.001542 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:08:13.001542 np0000001475 nova-compute[98471]: </disk>
May 27 03:08:13.001542 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:08:13.062707 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c -F raw /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk" returned: 0 in 0.992s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:13.066076 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:08:13.066076 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Ensure instance console log exists: /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:08:13.066076 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:13.066076 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:13.066076 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:13.066076 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Start _get_guest_xml network_info=[{"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='d8ede83b7cb02551800b690b672cd619',container_format='bare',created_at=2026-05-27T03:07:44Z,direct_url=<?>,disk_format='qcow2',id=c975161a-b72d-400b-8b3c-816fa6106f86,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1049303833-shelved',owner='c547b519adf248728dfd0b2232bfc118',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-27T03:07:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attached', 'instance': 'a3d1d581-aaf0-4e14-99ae-5db434215c60', 'attached_at': '', 'detached_at': '', 'volume_id': '116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 'serial': '116ba0ab-e23e-4afb-af0d-8a4c566cbab7'}, 'mount_device': '/dev/vdc', 'boot_index': None, 'attachment_id': 'f8588e25-59b0-4848-8700-e36368894e10', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:08:13.068890 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:08:13.070435 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1049303833', uuid='a3d1d581-aaf0-4e14-99ae-5db434215c60'), owner=OwnerMeta(userid='1c72d670892e44d88e674c9b584bc718', username='tempest-AttachVolumeShelveTestJSON-1364873533-project-member', projectid='c547b519adf248728dfd0b2232bfc118', projectname='tempest-AttachVolumeShelveTestJSON-1364873533'), image=ImageMeta(id='c975161a-b72d-400b-8b3c-816fa6106f86', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851293.0700839) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:08:13.072856 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:08:13.073428 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:08:13.074445 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:08:13.077762 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:08:13.077762 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:08:13.077762 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d8ede83b7cb02551800b690b672cd619',container_format='bare',created_at=2026-05-27T03:07:44Z,direct_url=<?>,disk_format='qcow2',id=c975161a-b72d-400b-8b3c-816fa6106f86,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1049303833-shelved',owner='c547b519adf248728dfd0b2232bfc118',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-27T03:07:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:08:13.077762 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:08:13.077762 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:08:13.077762 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:08:13.077762 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:08:13.077762 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:08:13.077762 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:08:13.077762 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:08:13.077762 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:08:13.077762 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:08:13.077762 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:08:13.077762 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'vcpu_model' on Instance uuid a3d1d581-aaf0-4e14-99ae-5db434215c60 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:08:13.123835 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:08:13.361643 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:08:13.470406 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-69b3fa3d-e453-45e3-9cac-77adbeca4e66 req-a68d593d-40cc-4eb4-9c3a-04c486f0edc7 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Received event network-vif-deleted-a3f65859-14c9-4367-8d8d-465b49ebb7cc {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:13.476311 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-69b3fa3d-e453-45e3-9cac-77adbeca4e66 req-a68d593d-40cc-4eb4-9c3a-04c486f0edc7 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Neutron deleted interface a3f65859-14c9-4367-8d8d-465b49ebb7cc; detaching it from the instance and deleting it from the info cache
May 27 03:08:13.476311 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-69b3fa3d-e453-45e3-9cac-77adbeca4e66 req-a68d593d-40cc-4eb4-9c3a-04c486f0edc7 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:08:13.546816 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:08:13.549217 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:08:13.549217 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Creating image(s)
May 27 03:08:13.549217 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:08:13.554348 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Ensure instance console log exists: /opt/stack/data/nova/instances/6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:08:13.554675 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:13.555471 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:13.555471 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:13.581923 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Object Instance<a3d1d581-aaf0-4e14-99ae-5db434215c60> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:08:13.596298 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:08:13.596659 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:08:13.596820 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:08:13.597837 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:08:13.598093 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:08:13.601343 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:13.615458 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:08:13.617040 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:08:13.617969 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:08:13.618311 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:08:13.619260 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:08:13.619902 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:08:13.633656 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.532s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:13.635949 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:08:13.635949 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:13.640520 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:08:13.640520 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:13.650306 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851293.6498702, 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa => ua-cee19510-084b-451e-84b2-15368ba8a40f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:08:13.653261 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-cee19510-084b-451e-84b2-15368ba8a40f for instance 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:08:13.658138 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7] added
May 27 03:08:13.658138 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:08:13.658138 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:08:13.658138 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:08:13.658138 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:08:13.658138 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:08:13.658138 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:13.658138 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:08:13.658138 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0395(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:08:13.658138 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:08:13.658725 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Successfully detached device vdb from instance 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa from the live domain config.
May 27 03:08:13.664752 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7] added
May 27 03:08:13.664752 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:08:13.664752 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:08:13.664752 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:08:13.664752 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:08:13.664752 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:08:13.664752 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:13.664752 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:08:13.666277 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0458(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:08:13.666277 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:08:13.668205 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:08:13.668926 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cee19510-084b-451e-84b2-15368ba8a40f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:08:13.668926 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:08:13.714726 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Deleted allocations for instance f9cd3c05-0282-4843-b890-8be3eb097bfe
May 27 03:08:13.799162 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Updating instance_info_cache with network_info: [{"id": "07d47fc5-99ae-4875-8336-7244d0678fa7", "address": "fa:16:3e:bf:9a:7a", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d47fc5-99", "ovs_interfaceid": "07d47fc5-99ae-4875-8336-7244d0678fa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:08:13.816869 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:08:13.980818 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-69b3fa3d-e453-45e3-9cac-77adbeca4e66 req-a68d593d-40cc-4eb4-9c3a-04c486f0edc7 service nova] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Detach interface failed, port_id=a3f65859-14c9-4367-8d8d-465b49ebb7cc, reason: Instance 9de3772c-0fb1-4718-bd84-b0ea6540a00c could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:08:14.302529 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Releasing lock "refresh_cache-6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:08:14.302960 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Instance network_info: |[{"id": "07d47fc5-99ae-4875-8336-7244d0678fa7", "address": "fa:16:3e:bf:9a:7a", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d47fc5-99", "ovs_interfaceid": "07d47fc5-99ae-4875-8336-7244d0678fa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:08:14.303650 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Start _get_guest_xml network_info=[{"id": "07d47fc5-99ae-4875-8336-7244d0678fa7", "address": "fa:16:3e:bf:9a:7a", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d47fc5-99", "ovs_interfaceid": "07d47fc5-99ae-4875-8336-7244d0678fa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d6ae676-a143-4096-8131-416697041c3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef', 'attached_at': '', 'detached_at': '', 'volume_id': '9d6ae676-a143-4096-8131-416697041c3d', 'serial': '9d6ae676-a143-4096-8131-416697041c3d'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'a8e6697c-f6db-4ebc-9325-ec2ea3fcaba6', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:08:14.308157 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:08:14.308157 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1902338634', uuid='6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef'), owner=OwnerMeta(userid='358594214f7a4c71a13200be75c799cc', username='tempest-TestEncryptedCinderVolumes-913342494-project-member', projectid='0810d45b82c0476db38b1cabf8579ae1', projectname='tempest-TestEncryptedCinderVolumes-913342494'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "07d47fc5-99ae-4875-8336-7244d0678fa7", "address": "fa:16:3e:bf:9a:7a", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d47fc5-99", "ovs_interfaceid": "07d47fc5-99ae-4875-8336-7244d0678fa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851294.3072574) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:08:14.308959 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:08:14.309327 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:08:14.310414 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:08:14.310612 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:08:14.311457 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:08:14.311759 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:08:14.311949 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:08:14.312098 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:08:14.312294 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:08:14.312458 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:08:14.314351 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:08:14.314351 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:08:14.314351 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:08:14.314351 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:08:14.314351 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:08:14.314351 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:08:14.322470 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Took 1.64 seconds to deallocate network for instance.
May 27 03:08:14.326239 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:08:14.326517 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d6ae676-a143-4096-8131-416697041c3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:08:14.326680 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:08:14.340659 np0000001475 nova-compute[98471]: WARNING nova.volume.cinder [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Attachment 2caaaade-c9ff-4888-b883-8a5ead3efa03 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 2caaaade-c9ff-4888-b883-8a5ead3efa03. (HTTP 404) (Request-ID: req-be9faf15-3bf7-45d8-9a39-ec654ef675eb)
May 27 03:08:14.341031 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Took 0.02 seconds to detach 1 volumes for instance.
May 27 03:08:14.658460 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:08:14.666523 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:08:14.674945 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:08:14.674945 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:08:14.683017 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:08:14.683017 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:14.690075 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:14.699209 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:14.709438 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:14.709438 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:14.709438 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:14.709438 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:14.709438 np0000001475 nova-compute[98471]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:14.709438 np0000001475 nova-compute[98471]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:14.709438 np0000001475 nova-compute[98471]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e (non-flash)
May 27 03:08:14.709438 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:08:14.709438 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:14.709438 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:14.709438 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:14.709438 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:14.709438 np0000001475 nova-compute[98471]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:14.709438 np0000001475 nova-compute[98471]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:14.709438 np0000001475 nova-compute[98471]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e (non-flash)
May 27 03:08:14.709438 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:08:14.717338 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:14.717338 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:14.717338 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:14.717338 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:14.717338 np0000001475 nova-compute[98471]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:14.717338 np0000001475 nova-compute[98471]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:14.717338 np0000001475 nova-compute[98471]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e (non-flash)
May 27 03:08:14.717338 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:08:14.717660 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:14.717660 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:14.717660 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:14.717660 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:14.717660 np0000001475 nova-compute[98471]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:14.717660 np0000001475 nova-compute[98471]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:14.717660 np0000001475 nova-compute[98471]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e (non-flash)
May 27 03:08:14.717660 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:08:14.724532 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-3d20fdec-c55c-4c96-9a2f-548bdbbccb78 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Lock "f9cd3c05-0282-4843-b890-8be3eb097bfe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.949s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:14.753570 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7, portal: 192.168.40.100,3260]
May 27 03:08:14.753570 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7, portal: 192.168.40.100,3260] successful.
May 27 03:08:14.753570 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:14.771166 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:14.783318 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7, portal: 192.168.50.100,3260]
May 27 03:08:14.783318 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7, portal: 192.168.50.100,3260] successful.
May 27 03:08:14.783318 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:14.791606 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:14.791606 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:14.791606 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:14.791606 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:14.791606 np0000001475 nova-compute[98471]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:14.791606 np0000001475 nova-compute[98471]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:14.791606 np0000001475 nova-compute[98471]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e (non-flash)
May 27 03:08:14.791606 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:14.791606 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:14.791606 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:08:14.792752 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:14.792752 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:14.792752 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:14.792752 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:14.792752 np0000001475 nova-compute[98471]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:14.792752 np0000001475 nova-compute[98471]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:14.792752 np0000001475 nova-compute[98471]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e (non-flash)
May 27 03:08:14.792752 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:14.792752 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:14.792752 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:08:14.792752 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:08:14.792752 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:08:14.794644 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] HCTL ('14', '-', '-', 0) found on session 123 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:08:14.794644 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:08:14.803299 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:14.813688 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Searching for a device in session 123 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:08:14.813994 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:08:14.825593 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:14.825593 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:14.825593 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:14.825593 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:14.825593 np0000001475 nova-compute[98471]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:14.825593 np0000001475 nova-compute[98471]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:14.825593 np0000001475 nova-compute[98471]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e (non-flash)
May 27 03:08:14.825593 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:14.825593 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:14.825593 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:08:14.825908 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:14.825908 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:14.825908 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:14.825908 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:14.825908 np0000001475 nova-compute[98471]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:14.825908 np0000001475 nova-compute[98471]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:14.825908 np0000001475 nova-compute[98471]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e (non-flash)
May 27 03:08:14.825908 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:14.825908 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:14.825908 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:08:14.826122 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:08:14.827289 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:08:14.828157 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] HCTL ('15', '-', '-', 0) found on session 124 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:08:14.828157 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:08:14.848552 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:14.850288 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:14.853538 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Searching for a device in session 124 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:08:14.853845 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:08:15.196754 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:08:15.197170 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:08:15.618437 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:08:15.700763 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:08:16.208604 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.360s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:16.275561 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Deleted allocations for instance 9de3772c-0fb1-4718-bd84-b0ea6540a00c
May 27 03:08:16.341284 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:16.634807 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Found WWN 3300000009fb16a5c for multipath device dm-7 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:08:16.635272 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:08:16.635423 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '3300000009fb16a5c', 'path': '/dev/dm-7', 'multipath_id': '3300000009fb16a5c'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:08:16.635538 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009fb16a5c', 'path': '/dev/dm-7', 'multipath_id': '3300000009fb16a5c'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:08:16.636244 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.967s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:08:16.636780 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cee19510-084b-451e-84b2-15368ba8a40f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:08:16.637143 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:08:16.669852 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:16.669852 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:16.669852 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:16.669852 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:16.669852 np0000001475 nova-compute[98471]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:16.669852 np0000001475 nova-compute[98471]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:16.669852 np0000001475 nova-compute[98471]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e (non-flash)
May 27 03:08:16.669852 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:16.669852 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:16.669852 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:08:16.672000 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:16.672000 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:16.672000 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:16.672000 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:16.672000 np0000001475 nova-compute[98471]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:16.672000 np0000001475 nova-compute[98471]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f (non-flash)
May 27 03:08:16.672000 np0000001475 nova-compute[98471]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e (non-flash)
May 27 03:08:16.672000 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:16.672000 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:16.672000 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:08:16.672000 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7', '124')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:08:16.672000 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', '121')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:08:16.672000 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f', '120')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:08:16.673832 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75570462df80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f'): ({'sde'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:08:16.674183 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Removing multipathed devices sdf, sde {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:08:16.674526 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Flush multipath device 330000000e59a2fd5 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:08:16.712233 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:08:16.749543 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:08:16.796452 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:08:16.796452 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:08:16.796452 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:08:16.809784 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:08:16.809784 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:08:16.823587 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:16.867376 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 121, target: iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f, portal: 192.168.40.100,3260]
May 27 03:08:16.867376 np0000001475 nova-compute[98471]: Logout of [sid: 121, target: iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f, portal: 192.168.40.100,3260] successful.
May 27 03:08:16.867376 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:16.886186 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:16.901170 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:16.939948 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 120, target: iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f, portal: 192.168.50.100,3260]
May 27 03:08:16.939948 np0000001475 nova-compute[98471]: Logout of [sid: 120, target: iqn.2023-03.storpool.com:os--volume-cee19510-084b-451e-84b2-15368ba8a40f, portal: 192.168.50.100,3260] successful.
May 27 03:08:16.939948 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:16.960913 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:16.960913 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:08:16.960913 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] <== disconnect_volume: return (3292ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:08:16.960913 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:08:16.961408 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.635s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:08:16.963601 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d6ae676-a143-4096-8131-416697041c3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:08:16.976761 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:08:16.977104 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:08:16.977268 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:08:16.977916 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:08:16.978951 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:08:16.979138 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:08:16.990653 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:08:16.990653 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:16.997376 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:08:16.997376 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:17.004539 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d] added
May 27 03:08:17.004539 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:08:17.004539 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:08:17.004539 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:08:17.004539 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:08:17.004539 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:08:17.004539 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:17.004999 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:08:17.004999 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:08:17.005122 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:08:17.011243 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d] added
May 27 03:08:17.011243 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:08:17.011243 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:08:17.011243 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:08:17.011243 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:08:17.011243 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:08:17.011243 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:17.011418 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:08:17.011624 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0324(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:08:17.011728 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:08:17.124353 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:17.144527 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T03:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1049303833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumeshelvetestjson-server-1049303833',id=50,image_ref='c975161a-b72d-400b-8b3c-816fa6106f86',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-951893173',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:07:03Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c547b519adf248728dfd0b2232bfc118',ramdisk_id='',reservation_id='r-4h7euvrh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1364873533',owner_user_name='tempest-AttachVolumeShelveTestJSON-1364873533-project-member',shelved_at='2026-05-27T03:07:51.847188',shelved_host='np0000001475',shelved_image_id='c975161a-b72d-400b-8b3c-816fa6106f86'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:08:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c72d670892e44d88e674c9b584bc718',uuid=a3d1d581-aaf0-4e14-99ae-5db434215c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:08:17.144699 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converting VIF {"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:08:17.145273 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:69:1b,bridge_name='br-int',has_traffic_filtering=True,id=ad4ac3f9-a243-42a4-9e61-fb161205ae0a,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4ac3f9-a2') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:08:17.145833 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'pci_devices' on Instance uuid a3d1d581-aaf0-4e14-99ae-5db434215c60 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:08:17.287773 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ae55e2be-9596-4595-8db4-948ec7af7ac4 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Lock "9de3772c-0fb1-4718-bd84-b0ea6540a00c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.594s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:17.529683 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lazy-loading 'flavor' on Instance uuid 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:08:17.647770 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Object Instance<a3d1d581-aaf0-4e14-99ae-5db434215c60> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:08:17.649240 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] End _get_guest_xml xml=<domain type="qemu">
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:   <uuid>a3d1d581-aaf0-4e14-99ae-5db434215c60</uuid>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:   <name>instance-00000032</name>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1049303833</nova:name>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:08:13</nova:creationTime>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:         <nova:user uuid="1c72d670892e44d88e674c9b584bc718">tempest-AttachVolumeShelveTestJSON-1364873533-project-member</nova:user>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:         <nova:project uuid="c547b519adf248728dfd0b2232bfc118">tempest-AttachVolumeShelveTestJSON-1364873533</nova:project>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:         <nova:port uuid="ad4ac3f9-a243-42a4-9e61-fb161205ae0a">
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     <system>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <entry name="serial">a3d1d581-aaf0-4e14-99ae-5db434215c60</entry>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <entry name="uuid">a3d1d581-aaf0-4e14-99ae-5db434215c60</entry>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     </system>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:   <os>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:   </os>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:   <features>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:   </features>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:   <devices>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     </disk>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk.config"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     </disk>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <alias name="ua-116ba0ab-e23e-4afb-af0d-8a4c566cbab7"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-7"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <target dev="vdc" bus="virtio"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <serial>116ba0ab-e23e-4afb-af0d-8a4c566cbab7</serial>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     </disk>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:ed:69:1b"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <target dev="tapad4ac3f9-a2"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     </interface>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/console.log" append="off"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     </serial>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     <video>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     </video>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     </rng>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:   </devices>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]: </domain>
May 27 03:08:17.649240 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:08:17.651691 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Preparing to wait for external event network-vif-plugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:08:17.651691 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:17.651691 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:17.651691 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:17.651691 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T03:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1049303833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumeshelvetestjson-server-1049303833',id=50,image_ref='c975161a-b72d-400b-8b3c-816fa6106f86',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-951893173',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:07:03Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c547b519adf248728dfd0b2232bfc118',ramdisk_id='',reservation_id='r-4h7euvrh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1364873533',owner_user_name='tempest-AttachVolumeShelveTestJSON-1364873533-project-member',shelved_at='2026-05-27T03:07:51.847188',shelved_host='np0000001475',shelved_image_id='c975161a-b72d-400b-8b3c-816fa6106f86'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:08:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c72d670892e44d88e674c9b584bc718',uuid=a3d1d581-aaf0-4e14-99ae-5db434215c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:08:17.651691 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converting VIF {"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:08:17.651691 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:69:1b,bridge_name='br-int',has_traffic_filtering=True,id=ad4ac3f9-a243-42a4-9e61-fb161205ae0a,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4ac3f9-a2') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:08:17.652143 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:69:1b,bridge_name='br-int',has_traffic_filtering=True,id=ad4ac3f9-a243-42a4-9e61-fb161205ae0a,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4ac3f9-a2') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:08:17.652527 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:17.652818 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:17.653068 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:08:17.653878 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:17.654149 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22a4b69d-8dc5-5a97-988b-4ba62214e57a', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:17.655111 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:17.655879 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:08:17.656143 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:17.658434 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:17.658793 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad4ac3f9-a2, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:17.659324 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad4ac3f9-a2, col_values=(('qos', UUID('a5c8266a-ad63-426f-b41c-b2adcf60bba6')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:17.659638 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad4ac3f9-a2, col_values=(('external_ids', {'iface-id': 'ad4ac3f9-a243-42a4-9e61-fb161205ae0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:69:1b', 'vm-uuid': 'a3d1d581-aaf0-4e14-99ae-5db434215c60'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:17.662388 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:17.663127 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:08:17.669156 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:17.670484 np0000001475 nova-compute[98471]: INFO os_vif [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:69:1b,bridge_name='br-int',has_traffic_filtering=True,id=ad4ac3f9-a243-42a4-9e61-fb161205ae0a,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4ac3f9-a2')
May 27 03:08:18.005457 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:08:18.012175 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:08:18.018905 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:08:18.018905 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:08:18.026803 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:08:18.026803 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:18.033453 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:18.045050 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:18.053326 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:18.053326 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:18.053326 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:18.053326 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:18.053326 np0000001475 nova-compute[98471]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e (non-flash)
May 27 03:08:18.053326 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:18.053326 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:18.053326 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:08:18.053584 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:18.053584 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:18.053584 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:18.053584 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:18.053584 np0000001475 nova-compute[98471]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e (non-flash)
May 27 03:08:18.053584 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:18.053584 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:18.053584 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:08:18.062036 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:18.062036 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:18.062036 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:18.062036 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:18.062036 np0000001475 nova-compute[98471]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e (non-flash)
May 27 03:08:18.062036 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:18.062036 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:18.062036 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:08:18.062036 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:18.062036 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:18.062036 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:18.062036 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:18.062036 np0000001475 nova-compute[98471]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e (non-flash)
May 27 03:08:18.062036 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:18.062036 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:18.062036 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:08:18.107364 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d, portal: 192.168.40.100,3260]
May 27 03:08:18.107364 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d, portal: 192.168.40.100,3260] successful.
May 27 03:08:18.107364 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:18.125873 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:18.127453 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d, portal: 192.168.50.100,3260]
May 27 03:08:18.127453 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d, portal: 192.168.50.100,3260] successful.
May 27 03:08:18.127453 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:18.144799 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:18.149962 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:18.149962 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:18.149962 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:18.149962 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:18.149962 np0000001475 nova-compute[98471]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e (non-flash)
May 27 03:08:18.149962 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:18.149962 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:18.149962 np0000001475 nova-compute[98471]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:18.149962 np0000001475 nova-compute[98471]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:18.149962 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:08:18.150394 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:18.150394 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:18.150394 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:18.150394 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:18.150394 np0000001475 nova-compute[98471]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e (non-flash)
May 27 03:08:18.150394 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:18.150394 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:18.150394 np0000001475 nova-compute[98471]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:18.150394 np0000001475 nova-compute[98471]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:18.150394 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:08:18.150665 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:08:18.152761 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:08:18.152761 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] HCTL ('10', '-', '-', 0) found on session 125 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:08:18.152761 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:08:18.169690 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Searching for a device in session 125 and hctl ['10', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:08:18.170011 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:18.170011 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:18.170011 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:18.170011 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:18.170011 np0000001475 nova-compute[98471]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e (non-flash)
May 27 03:08:18.170011 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:18.170011 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:18.170011 np0000001475 nova-compute[98471]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:18.170011 np0000001475 nova-compute[98471]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:18.170011 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:08:18.171794 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:18.171794 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:18.171794 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:18.171794 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:18.171794 np0000001475 nova-compute[98471]: tcp: [122] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b20cdf2e-b0d7-485f-8084-fe789713d60e (non-flash)
May 27 03:08:18.171794 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:18.171794 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:18.171794 np0000001475 nova-compute[98471]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:18.171794 np0000001475 nova-compute[98471]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:18.171794 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:08:18.172240 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:08:18.172351 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:08:18.176482 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] HCTL ('11', '-', '-', 0) found on session 126 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:08:18.176482 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:08:18.194597 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Searching for a device in session 126 and hctl ['11', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:08:18.538679 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d8c2b44f-993f-4e30-911d-835d1ef4ca12 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.115s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:19.169512 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Searching for a device in session 125 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:08:19.171128 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d6ae676-a143-4096-8131-416697041c3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:08:19.195215 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Searching for a device in session 126 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:08:19.195411 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9d6ae676-a143-4096-8131-416697041c3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:08:19.201127 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:08:19.201835 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:08:19.201835 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:08:19.201835 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] No VIF found with MAC fa:16:3e:ed:69:1b, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:08:19.203276 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Using config drive
May 27 03:08:19.706615 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'ec2_ids' on Instance uuid a3d1d581-aaf0-4e14-99ae-5db434215c60 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:08:19.979238 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:08:20.213040 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Object Instance<a3d1d581-aaf0-4e14-99ae-5db434215c60> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:08:20.213370 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'keypairs' on Instance uuid a3d1d581-aaf0-4e14-99ae-5db434215c60 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:08:20.486126 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:20.715939 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Object Instance<a3d1d581-aaf0-4e14-99ae-5db434215c60> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:08:20.719096 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:20.871909 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Creating config drive at /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk.config
May 27 03:08:20.880004 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd1qilh_7 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:20.942198 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd1qilh_7" returned: 0 in 0.062s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:20.996538 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Found WWN 3300000002de82d32 for multipath device dm-3 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:08:20.997231 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.036s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:08:20.998490 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] <== connect_volume: return (6671ms) {'type': 'block', 'scsi_wwn': '3300000002de82d32', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '3300000002de82d32'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:08:20.998635 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002de82d32', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '3300000002de82d32'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:08:21.040113 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d6ae676-a143-4096-8131-416697041c3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef', 'attached_at': '', 'detached_at': '', 'volume_id': '9d6ae676-a143-4096-8131-416697041c3d', 'serial': '9d6ae676-a143-4096-8131-416697041c3d'} {{(pid=98471) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 03:08:21.041016 np0000001475 nova-compute[98471]: WARNING stevedore.named [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 03:08:21.041610 np0000001475 nova-compute[98471]: WARNING castellan.key_manager [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:08:21.041882 np0000001475 nova-compute[98471]: WARNING nova.keymgr.conf_key_mgr [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:08:21.059637 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Secret XML: <secret ephemeral="no" private="no">
May 27 03:08:21.059637 np0000001475 nova-compute[98471]:   <usage type="volume">
May 27 03:08:21.059637 np0000001475 nova-compute[98471]:     <volume>9d6ae676-a143-4096-8131-416697041c3d</volume>
May 27 03:08:21.059637 np0000001475 nova-compute[98471]:   </usage>
May 27 03:08:21.059637 np0000001475 nova-compute[98471]: </secret>
May 27 03:08:21.059637 np0000001475 nova-compute[98471]:  {{(pid=98471) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 27 03:08:21.182778 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:21.343934 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:21.401899 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:21.429329 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:21.432081 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:21.535731 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:21.574425 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:08:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1902338634',display_name='tempest-TestEncryptedCinderVolumes-server-1902338634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testencryptedcindervolumes-server-1902338634',id=54,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsKE8mApOuH6pQpMeoaM1711p44BdU5w63deegp3kTmD9SDXsbd+S4T7tQJxMwMSGixch3LkbnnDZXpLGGTHeoe63rCS6XTN2kyvsWQlISndr8KsTd/l4xT3HCDOGuK4Q==',key_name='tempest-TestEncryptedCinderVolumes-1532145403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0810d45b82c0476db38b1cabf8579ae1',ramdisk_id='',reservation_id='r-x9a5rz94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-913342494',owner_user_name='tempest-TestEncryptedCinderVolumes-913342494-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:08:11Z,user_data=None,user_id='358594214f7a4c71a13200be75c799cc',uuid=6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07d47fc5-99ae-4875-8336-7244d0678fa7", "address": "fa:16:3e:bf:9a:7a", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d47fc5-99", "ovs_interfaceid": "07d47fc5-99ae-4875-8336-7244d0678fa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:08:21.574425 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Converting VIF {"id": "07d47fc5-99ae-4875-8336-7244d0678fa7", "address": "fa:16:3e:bf:9a:7a", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d47fc5-99", "ovs_interfaceid": "07d47fc5-99ae-4875-8336-7244d0678fa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:08:21.575326 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:9a:7a,bridge_name='br-int',has_traffic_filtering=True,id=07d47fc5-99ae-4875-8336-7244d0678fa7,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d47fc5-99') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:08:21.576704 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:08:21.648375 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4cd0580c-8087-458e-a33d-6befca910381 req-6d55811e-be1e-4253-af0f-a0d2bce4c2e1 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Received event network-vif-plugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:21.649605 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4cd0580c-8087-458e-a33d-6befca910381 req-6d55811e-be1e-4253-af0f-a0d2bce4c2e1 service nova] Acquiring lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:21.649929 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4cd0580c-8087-458e-a33d-6befca910381 req-6d55811e-be1e-4253-af0f-a0d2bce4c2e1 service nova] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:21.650107 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4cd0580c-8087-458e-a33d-6befca910381 req-6d55811e-be1e-4253-af0f-a0d2bce4c2e1 service nova] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:21.650310 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4cd0580c-8087-458e-a33d-6befca910381 req-6d55811e-be1e-4253-af0f-a0d2bce4c2e1 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Processing event network-vif-plugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:08:21.690084 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] instance snapshotting
May 27 03:08:21.809686 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Beginning live snapshot process
May 27 03:08:21.812278 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:21.814911 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:21.817204 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:21.818695 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:21.842266 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:22.080037 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] End _get_guest_xml xml=<domain type="qemu">
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:   <uuid>6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef</uuid>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:   <name>instance-00000036</name>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1902338634</nova:name>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:08:14</nova:creationTime>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:         <nova:user uuid="358594214f7a4c71a13200be75c799cc">tempest-TestEncryptedCinderVolumes-913342494-project-member</nova:user>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:         <nova:project uuid="0810d45b82c0476db38b1cabf8579ae1">tempest-TestEncryptedCinderVolumes-913342494</nova:project>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:         <nova:port uuid="07d47fc5-99ae-4875-8336-7244d0678fa7">
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     <system>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <entry name="serial">6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef</entry>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <entry name="uuid">6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef</entry>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     </system>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:   <os>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:   </os>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:   <features>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:   </features>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:   <devices>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef/disk.config"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     </disk>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <alias name="ua-9d6ae676-a143-4096-8131-416697041c3d"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <serial>9d6ae676-a143-4096-8131-416697041c3d</serial>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <encryption format="luks">
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:         <secret type="passphrase" uuid="013956cb-b398-48d7-8226-ba82bf0d121e"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       </encryption>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     </disk>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:bf:9a:7a"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <target dev="tap07d47fc5-99"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     </interface>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef/console.log" append="off"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     </serial>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     <video>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     </video>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     </rng>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:   </devices>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]: </domain>
May 27 03:08:22.080037 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:08:22.082525 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Preparing to wait for external event network-vif-plugged-07d47fc5-99ae-4875-8336-7244d0678fa7 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:08:22.082525 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:22.082525 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:22.082525 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:22.082525 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:08:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1902338634',display_name='tempest-TestEncryptedCinderVolumes-server-1902338634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testencryptedcindervolumes-server-1902338634',id=54,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsKE8mApOuH6pQpMeoaM1711p44BdU5w63deegp3kTmD9SDXsbd+S4T7tQJxMwMSGixch3LkbnnDZXpLGGTHeoe63rCS6XTN2kyvsWQlISndr8KsTd/l4xT3HCDOGuK4Q==',key_name='tempest-TestEncryptedCinderVolumes-1532145403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0810d45b82c0476db38b1cabf8579ae1',ramdisk_id='',reservation_id='r-x9a5rz94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-913342494',owner_user_name='tempest-TestEncryptedCinderVolumes-913342494-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:08:11Z,user_data=None,user_id='358594214f7a4c71a13200be75c799cc',uuid=6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07d47fc5-99ae-4875-8336-7244d0678fa7", "address": "fa:16:3e:bf:9a:7a", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d47fc5-99", "ovs_interfaceid": "07d47fc5-99ae-4875-8336-7244d0678fa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:08:22.082525 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Converting VIF {"id": "07d47fc5-99ae-4875-8336-7244d0678fa7", "address": "fa:16:3e:bf:9a:7a", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d47fc5-99", "ovs_interfaceid": "07d47fc5-99ae-4875-8336-7244d0678fa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:08:22.082525 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:9a:7a,bridge_name='br-int',has_traffic_filtering=True,id=07d47fc5-99ae-4875-8336-7244d0678fa7,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d47fc5-99') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:08:22.083015 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:9a:7a,bridge_name='br-int',has_traffic_filtering=True,id=07d47fc5-99ae-4875-8336-7244d0678fa7,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d47fc5-99') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:08:22.083618 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:22.083618 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:22.083847 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:08:22.084583 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:22.084813 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2ed87fe-5678-52fc-8e05-533ff1cdc9b0', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:22.085636 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:22.086516 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:08:22.086778 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:22.088823 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:22.089112 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07d47fc5-99, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:22.089823 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07d47fc5-99, col_values=(('qos', UUID('33e7b3fb-b2b2-4be3-bd6d-70b0e1cae658')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:22.089823 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07d47fc5-99, col_values=(('external_ids', {'iface-id': '07d47fc5-99ae-4875-8336-7244d0678fa7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:9a:7a', 'vm-uuid': '6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:22.090698 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:22.092275 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:08:22.097070 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:22.098253 np0000001475 nova-compute[98471]: INFO os_vif [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:9a:7a,bridge_name='br-int',has_traffic_filtering=True,id=07d47fc5-99ae-4875-8336-7244d0678fa7,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d47fc5-99')
May 27 03:08:22.289298 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851302.2889001, a3d1d581-aaf0-4e14-99ae-5db434215c60 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:08:22.289594 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] VM Started (Lifecycle Event)
May 27 03:08:22.291054 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:08:22.294613 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:08:22.297284 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Instance spawned successfully.
May 27 03:08:22.752055 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:22.792320 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:22.795249 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:08:23.261589 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0cba70d7-82ad-41ff-bf9a-d5e7fa7a0956 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.427s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:23.298486 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:08:23.298720 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851303.2985685, a3d1d581-aaf0-4e14-99ae-5db434215c60 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:08:23.298855 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] VM Paused (Lifecycle Event)
May 27 03:08:23.326179 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk --force-share --output=json -f qcow2 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:23.437139 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk --force-share --output=json -f qcow2" returned: 0 in 0.111s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:23.437614 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk --force-share --output=json -f qcow2 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:23.542362 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk --force-share --output=json -f qcow2" returned: 0 in 0.104s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:23.543590 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:08:23.551384 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:08:23.553667 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:23.621021 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:08:23.621085 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:08:23.621221 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] No VIF found with MAC fa:16:3e:bf:9a:7a, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:08:23.622254 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Using config drive
May 27 03:08:23.663023 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0005456029998640588 future=<Future at 0x755704773800 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:08:23.663023 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Emitting event <LifecycleEvent: 1779851288.6612616, f9cd3c05-0282-4843-b890-8be3eb097bfe => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:08:23.663023 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:08:23.663173 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] VM Stopped (Lifecycle Event)
May 27 03:08:23.664372 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=2.92397907700024 future=<Future at 0x755704771250 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:08:23.664491 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=2.9238489350000236 future=<Future at 0x755704771250 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:08:23.672724 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.121s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:23.673423 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp718ctyxi/a4c91dc06f2a4b75a700210c8d72e835.delta 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:23.732014 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6ae9b728-0471-4e89-aed1-2f3055a4ec7a req-f3cf5a95-fab1-40c0-b7c9-f32af33554d0 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Received event network-vif-plugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:23.732014 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6ae9b728-0471-4e89-aed1-2f3055a4ec7a req-f3cf5a95-fab1-40c0-b7c9-f32af33554d0 service nova] Acquiring lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:23.732014 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6ae9b728-0471-4e89-aed1-2f3055a4ec7a req-f3cf5a95-fab1-40c0-b7c9-f32af33554d0 service nova] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:23.732014 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6ae9b728-0471-4e89-aed1-2f3055a4ec7a req-f3cf5a95-fab1-40c0-b7c9-f32af33554d0 service nova] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:23.732014 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6ae9b728-0471-4e89-aed1-2f3055a4ec7a req-f3cf5a95-fab1-40c0-b7c9-f32af33554d0 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] No waiting events found dispatching network-vif-plugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:08:23.732014 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-6ae9b728-0471-4e89-aed1-2f3055a4ec7a req-f3cf5a95-fab1-40c0-b7c9-f32af33554d0 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Received unexpected event network-vif-plugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a for instance with vm_state active and task_state None.
May 27 03:08:23.753465 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp718ctyxi/a4c91dc06f2a4b75a700210c8d72e835.delta 1073741824" returned: 0 in 0.080s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:23.754038 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Quiescing instance not available: QEMU guest agent is not enabled.
May 27 03:08:23.801817 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:23.806309 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851303.8041492, a3d1d581-aaf0-4e14-99ae-5db434215c60 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:08:23.806309 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] VM Resumed (Lifecycle Event)
May 27 03:08:24.019402 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] COPY block job progress, current cursor: 0 final cursor: 76742656 {{(pid=98471) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 27 03:08:24.132547 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:24.171050 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: f9cd3c05-0282-4843-b890-8be3eb097bfe] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:24.285906 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Creating config drive at /opt/stack/data/nova/instances/6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef/disk.config
May 27 03:08:24.288563 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw5id684h {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:24.311446 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:24.324314 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:08:24.354067 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw5id684h" returned: 0 in 0.064s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:24.523170 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] COPY block job progress, current cursor: 76742656 final cursor: 76742656 {{(pid=98471) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 27 03:08:24.526630 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Skipping quiescing instance: QEMU guest agent is not enabled.
May 27 03:08:24.736526 np0000001475 nova-compute[98471]: DEBUG nova.privsep.utils [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98471) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 03:08:24.736857 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp718ctyxi/a4c91dc06f2a4b75a700210c8d72e835.delta /opt/stack/data/nova/instances/snapshots/tmp718ctyxi/a4c91dc06f2a4b75a700210c8d72e835 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:24.839536 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:24.874691 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:24.879931 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:24.996669 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:25.074431 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-84f37dfd-09bb-4d57-9c06-006c2f5e48e2 req-164247c1-b724-40c4-b4b6-30fd6b70188e service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Received event network-vif-plugged-07d47fc5-99ae-4875-8336-7244d0678fa7 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:25.075191 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-84f37dfd-09bb-4d57-9c06-006c2f5e48e2 req-164247c1-b724-40c4-b4b6-30fd6b70188e service nova] Acquiring lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:25.075497 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-84f37dfd-09bb-4d57-9c06-006c2f5e48e2 req-164247c1-b724-40c4-b4b6-30fd6b70188e service nova] Lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:25.075720 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-84f37dfd-09bb-4d57-9c06-006c2f5e48e2 req-164247c1-b724-40c4-b4b6-30fd6b70188e service nova] Lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:25.075967 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-84f37dfd-09bb-4d57-9c06-006c2f5e48e2 req-164247c1-b724-40c4-b4b6-30fd6b70188e service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Processing event network-vif-plugged-07d47fc5-99ae-4875-8336-7244d0678fa7 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:08:25.113278 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp718ctyxi/a4c91dc06f2a4b75a700210c8d72e835.delta /opt/stack/data/nova/instances/snapshots/tmp718ctyxi/a4c91dc06f2a4b75a700210c8d72e835" returned: 0 in 0.376s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:25.118873 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Snapshot extracted, beginning image upload
May 27 03:08:25.280557 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:25.283137 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:25.285861 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:25.287811 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:25.316380 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:26.346475 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:26.590439 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0013595810000879283 future=<Future at 0x755704771250 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:08:26.590439 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:08:26.590439 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Emitting event <LifecycleEvent: 1779851291.5882485, 9de3772c-0fb1-4718-bd84-b0ea6540a00c => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:08:26.590439 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] VM Stopped (Lifecycle Event)
May 27 03:08:26.705668 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:08:26.706931 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851306.7057319, 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:08:26.707125 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] VM Started (Lifecycle Event)
May 27 03:08:26.713448 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:08:26.719218 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Instance spawned successfully.
May 27 03:08:26.719587 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:08:27.092271 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:27.093981 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 9de3772c-0fb1-4718-bd84-b0ea6540a00c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:27.152991 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-814d7275-eb7d-484e-844a-be230e6be46c req-904c416d-a664-4274-8063-6818ae3f1689 service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Received event network-vif-plugged-07d47fc5-99ae-4875-8336-7244d0678fa7 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:27.153171 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-814d7275-eb7d-484e-844a-be230e6be46c req-904c416d-a664-4274-8063-6818ae3f1689 service nova] Acquiring lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:27.153373 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-814d7275-eb7d-484e-844a-be230e6be46c req-904c416d-a664-4274-8063-6818ae3f1689 service nova] Lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:27.153514 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-814d7275-eb7d-484e-844a-be230e6be46c req-904c416d-a664-4274-8063-6818ae3f1689 service nova] Lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:27.153655 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-814d7275-eb7d-484e-844a-be230e6be46c req-904c416d-a664-4274-8063-6818ae3f1689 service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] No waiting events found dispatching network-vif-plugged-07d47fc5-99ae-4875-8336-7244d0678fa7 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:08:27.154963 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-814d7275-eb7d-484e-844a-be230e6be46c req-904c416d-a664-4274-8063-6818ae3f1689 service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Received unexpected event network-vif-plugged-07d47fc5-99ae-4875-8336-7244d0678fa7 for instance with vm_state building and task_state spawning.
May 27 03:08:27.209720 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:27.213270 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:08:27.235731 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:08:27.235912 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:08:27.236293 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:08:27.236559 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:08:27.236898 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:08:27.237212 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:08:27.715926 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:08:27.716476 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851307.7160287, 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:08:27.716476 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] VM Paused (Lifecycle Event)
May 27 03:08:27.745473 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Took 14.20 seconds to spawn the instance on the hypervisor.
May 27 03:08:27.745616 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:28.162981 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Snapshot image upload complete
May 27 03:08:28.163283 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-d5cf7cfa-7c43-4d25-a6eb-24f6790b1ed2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Took 6.47 seconds to snapshot the instance on the hypervisor.
May 27 03:08:28.219507 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:28.221874 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851308.221581, 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:08:28.222087 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] VM Resumed (Lifecycle Event)
May 27 03:08:28.259894 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Took 23.68 seconds to build instance.
May 27 03:08:28.513129 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:28.725443 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:28.728456 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:08:28.764205 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c47df669-ce23-422c-b6b5-a803b2b24e43 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.191s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:30.500553 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-750d2f12-ab84-4982-a4b6-112a1168bec6 req-4b7055cd-9805-4df9-ad38-14c3beeb6753 service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Received event network-changed-07d47fc5-99ae-4875-8336-7244d0678fa7 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:30.501254 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-750d2f12-ab84-4982-a4b6-112a1168bec6 req-4b7055cd-9805-4df9-ad38-14c3beeb6753 service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Refreshing instance network info cache due to event network-changed-07d47fc5-99ae-4875-8336-7244d0678fa7. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:08:30.501462 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-750d2f12-ab84-4982-a4b6-112a1168bec6 req-4b7055cd-9805-4df9-ad38-14c3beeb6753 service nova] Acquiring lock "refresh_cache-6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:08:30.501573 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-750d2f12-ab84-4982-a4b6-112a1168bec6 req-4b7055cd-9805-4df9-ad38-14c3beeb6753 service nova] Acquired lock "refresh_cache-6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:08:30.501714 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-750d2f12-ab84-4982-a4b6-112a1168bec6 req-4b7055cd-9805-4df9-ad38-14c3beeb6753 service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Refreshing network info cache for port 07d47fc5-99ae-4875-8336-7244d0678fa7 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:08:30.569741 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:30.570213 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:31.005187 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-750d2f12-ab84-4982-a4b6-112a1168bec6 req-4b7055cd-9805-4df9-ad38-14c3beeb6753 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:31.077160 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:08:31.171283 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:31.350114 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:31.542342 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-750d2f12-ab84-4982-a4b6-112a1168bec6 req-4b7055cd-9805-4df9-ad38-14c3beeb6753 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:31.660226 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:31.660226 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:31.669896 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:08:31.670171 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Claim successful on node np0000001475
May 27 03:08:31.791716 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-750d2f12-ab84-4982-a4b6-112a1168bec6 req-4b7055cd-9805-4df9-ad38-14c3beeb6753 service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Updated VIF entry in instance network info cache for port 07d47fc5-99ae-4875-8336-7244d0678fa7. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:08:31.792266 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-750d2f12-ab84-4982-a4b6-112a1168bec6 req-4b7055cd-9805-4df9-ad38-14c3beeb6753 service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Updating instance_info_cache with network_info: [{"id": "07d47fc5-99ae-4875-8336-7244d0678fa7", "address": "fa:16:3e:bf:9a:7a", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d47fc5-99", "ovs_interfaceid": "07d47fc5-99ae-4875-8336-7244d0678fa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:08:32.096410 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:32.295478 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-750d2f12-ab84-4982-a4b6-112a1168bec6 req-4b7055cd-9805-4df9-ad38-14c3beeb6753 service nova] Releasing lock "refresh_cache-6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:08:33.116311 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:08:33.117355 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:08:33.620855 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:08:34.132727 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.472s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:34.134702 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:08:34.646277 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:08:34.646571 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:08:34.646911 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:34.647204 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:34.788464 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:34.798542 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7fe58d4cae1c4693adb1e227daa9706d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ed6c288e2642cfa4fbb3761274cc4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:08:35.152167 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:08:35.422999 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Successfully created port: d31da235-bc6a-4a71-b77d-7e4645764be5 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:08:35.656376 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:08:35.734020 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:36.141003 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Successfully updated port: d31da235-bc6a-4a71-b77d-7e4645764be5 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:08:36.236137 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e8a98da7-6ec5-438c-aec3-7c6b2bd163df req-4c6b5451-8053-4208-b8aa-e1dfc5030552 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Received event network-changed-d31da235-bc6a-4a71-b77d-7e4645764be5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:36.236765 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e8a98da7-6ec5-438c-aec3-7c6b2bd163df req-4c6b5451-8053-4208-b8aa-e1dfc5030552 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Refreshing instance network info cache due to event network-changed-d31da235-bc6a-4a71-b77d-7e4645764be5. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:08:36.236765 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e8a98da7-6ec5-438c-aec3-7c6b2bd163df req-4c6b5451-8053-4208-b8aa-e1dfc5030552 service nova] Acquiring lock "refresh_cache-254dc58c-6b2f-4350-bea3-5c74d571ed2c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:08:36.236765 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e8a98da7-6ec5-438c-aec3-7c6b2bd163df req-4c6b5451-8053-4208-b8aa-e1dfc5030552 service nova] Acquired lock "refresh_cache-254dc58c-6b2f-4350-bea3-5c74d571ed2c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:08:36.236765 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-e8a98da7-6ec5-438c-aec3-7c6b2bd163df req-4c6b5451-8053-4208-b8aa-e1dfc5030552 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Refreshing network info cache for port d31da235-bc6a-4a71-b77d-7e4645764be5 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:08:36.354766 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:36.648439 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "refresh_cache-254dc58c-6b2f-4350-bea3-5c74d571ed2c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:08:36.668711 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:08:36.669882 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:08:36.670220 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Creating image(s)
May 27 03:08:36.671122 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "/opt/stack/data/nova/instances/254dc58c-6b2f-4350-bea3-5c74d571ed2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:36.671567 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "/opt/stack/data/nova/instances/254dc58c-6b2f-4350-bea3-5c74d571ed2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:36.672260 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "/opt/stack/data/nova/instances/254dc58c-6b2f-4350-bea3-5c74d571ed2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:36.672768 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "127c36dabf8439920213bfe1bcc2c078a9d400e3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:36.673567 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "127c36dabf8439920213bfe1bcc2c078a9d400e3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:36.745776 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-e8a98da7-6ec5-438c-aec3-7c6b2bd163df req-4c6b5451-8053-4208-b8aa-e1dfc5030552 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:36.842260 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-e8a98da7-6ec5-438c-aec3-7c6b2bd163df req-4c6b5451-8053-4208-b8aa-e1dfc5030552 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:08:37.026760 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-e8a98da7-6ec5-438c-aec3-7c6b2bd163df req-4c6b5451-8053-4208-b8aa-e1dfc5030552 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:08:37.110371 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:37.532328 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e8a98da7-6ec5-438c-aec3-7c6b2bd163df req-4c6b5451-8053-4208-b8aa-e1dfc5030552 service nova] Releasing lock "refresh_cache-254dc58c-6b2f-4350-bea3-5c74d571ed2c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:08:37.532328 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquired lock "refresh_cache-254dc58c-6b2f-4350-bea3-5c74d571ed2c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:08:37.532328 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:08:37.752707 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:08:37.756792 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:08:37.757100 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/127c36dabf8439920213bfe1bcc2c078a9d400e3.part --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:37.935120 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/127c36dabf8439920213bfe1bcc2c078a9d400e3.part --force-share --output=json" returned: 0 in 0.177s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:37.935579 np0000001475 nova-compute[98471]: DEBUG nova.virt.images [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] 1c8f099b-d986-47ab-85c0-6df840da8cd1 was qcow2, converting to raw {{(pid=98471) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 03:08:37.936412 np0000001475 nova-compute[98471]: DEBUG nova.privsep.utils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98471) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 03:08:37.936583 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/127c36dabf8439920213bfe1bcc2c078a9d400e3.part /opt/stack/data/nova/instances/_base/127c36dabf8439920213bfe1bcc2c078a9d400e3.converted {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:38.153644 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:08:38.207783 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/127c36dabf8439920213bfe1bcc2c078a9d400e3.part /opt/stack/data/nova/instances/_base/127c36dabf8439920213bfe1bcc2c078a9d400e3.converted" returned: 0 in 0.271s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:38.227960 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/127c36dabf8439920213bfe1bcc2c078a9d400e3.converted --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:38.353187 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/127c36dabf8439920213bfe1bcc2c078a9d400e3.converted --force-share --output=json" returned: 0 in 0.124s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:38.354348 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "127c36dabf8439920213bfe1bcc2c078a9d400e3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.680s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:38.354872 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:08:38.359852 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:08:38.362041 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/127c36dabf8439920213bfe1bcc2c078a9d400e3 --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:38.428345 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5691e6ca-9b9f-405c-bdba-ac2a78a8095b req-4a92a4c2-832e-446b-b4b9-0fcb56420c20 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Received event network-vif-unplugged-d31da235-bc6a-4a71-b77d-7e4645764be5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:38.434131 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5691e6ca-9b9f-405c-bdba-ac2a78a8095b req-4a92a4c2-832e-446b-b4b9-0fcb56420c20 service nova] Acquiring lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:38.434594 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5691e6ca-9b9f-405c-bdba-ac2a78a8095b req-4a92a4c2-832e-446b-b4b9-0fcb56420c20 service nova] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:38.434594 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5691e6ca-9b9f-405c-bdba-ac2a78a8095b req-4a92a4c2-832e-446b-b4b9-0fcb56420c20 service nova] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:38.435108 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5691e6ca-9b9f-405c-bdba-ac2a78a8095b req-4a92a4c2-832e-446b-b4b9-0fcb56420c20 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] No waiting events found dispatching network-vif-unplugged-d31da235-bc6a-4a71-b77d-7e4645764be5 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:08:38.435108 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-5691e6ca-9b9f-405c-bdba-ac2a78a8095b req-4a92a4c2-832e-446b-b4b9-0fcb56420c20 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Received unexpected event network-vif-unplugged-d31da235-bc6a-4a71-b77d-7e4645764be5 for instance with vm_state building and task_state spawning.
May 27 03:08:38.508192 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:38.514564 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/127c36dabf8439920213bfe1bcc2c078a9d400e3 --force-share --output=json" returned: 0 in 0.152s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:38.515199 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "127c36dabf8439920213bfe1bcc2c078a9d400e3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:38.515199 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "127c36dabf8439920213bfe1bcc2c078a9d400e3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:38.515662 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:08:38.521308 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:08:38.521308 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/127c36dabf8439920213bfe1bcc2c078a9d400e3 --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:38.642417 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/127c36dabf8439920213bfe1bcc2c078a9d400e3 --force-share --output=json" returned: 0 in 0.121s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:38.643002 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/127c36dabf8439920213bfe1bcc2c078a9d400e3,backing_fmt=raw /opt/stack/data/nova/instances/254dc58c-6b2f-4350-bea3-5c74d571ed2c/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:38.729506 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/127c36dabf8439920213bfe1bcc2c078a9d400e3,backing_fmt=raw /opt/stack/data/nova/instances/254dc58c-6b2f-4350-bea3-5c74d571ed2c/disk 1073741824" returned: 0 in 0.086s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:38.730258 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "127c36dabf8439920213bfe1bcc2c078a9d400e3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:38.730666 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/127c36dabf8439920213bfe1bcc2c078a9d400e3 --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:38.843556 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/127c36dabf8439920213bfe1bcc2c078a9d400e3 --force-share --output=json" returned: 0 in 0.111s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:38.843556 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:08:38.843556 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Ensure instance console log exists: /opt/stack/data/nova/instances/254dc58c-6b2f-4350-bea3-5c74d571ed2c/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:08:38.843864 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:38.844218 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:38.844867 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:38.852282 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Updating instance_info_cache with network_info: [{"id": "d31da235-bc6a-4a71-b77d-7e4645764be5", "address": "fa:16:3e:31:74:b7", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd31da235-bc", "ovs_interfaceid": "d31da235-bc6a-4a71-b77d-7e4645764be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:08:39.057253 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:39.355798 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Releasing lock "refresh_cache-254dc58c-6b2f-4350-bea3-5c74d571ed2c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:08:39.356438 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Instance network_info: |[{"id": "d31da235-bc6a-4a71-b77d-7e4645764be5", "address": "fa:16:3e:31:74:b7", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd31da235-bc", "ovs_interfaceid": "d31da235-bc6a-4a71-b77d-7e4645764be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:08:39.359293 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Start _get_guest_xml network_info=[{"id": "d31da235-bc6a-4a71-b77d-7e4645764be5", "address": "fa:16:3e:31:74:b7", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd31da235-bc", "ovs_interfaceid": "d31da235-bc6a-4a71-b77d-7e4645764be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='8b9dfed35bca024d8847303feedbfda1',container_format='bare',created_at=2026-05-27T03:08:20Z,direct_url=<?>,disk_format='qcow2',id=1c8f099b-d986-47ab-85c0-6df840da8cd1,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1039452088',owner='78ed6c288e2642cfa4fbb3761274cc4e',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-27T03:08:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': '1c8f099b-d986-47ab-85c0-6df840da8cd1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:08:39.365999 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:08:39.369538 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-430111061', uuid='254dc58c-6b2f-4350-bea3-5c74d571ed2c'), owner=OwnerMeta(userid='7fe58d4cae1c4693adb1e227daa9706d', username='tempest-TestStampPattern-1535526847-project-member', projectid='78ed6c288e2642cfa4fbb3761274cc4e', projectname='tempest-TestStampPattern-1535526847'), image=ImageMeta(id='1c8f099b-d986-47ab-85c0-6df840da8cd1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_owner_id': '78ed6c288e2642cfa4fbb3761274cc4e'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d31da235-bc6a-4a71-b77d-7e4645764be5", "address": "fa:16:3e:31:74:b7", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd31da235-bc", "ovs_interfaceid": "d31da235-bc6a-4a71-b77d-7e4645764be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851319.3673267) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:08:39.374857 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:08:39.375966 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:08:39.379333 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:08:39.379597 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:08:39.380931 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:08:39.381611 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8b9dfed35bca024d8847303feedbfda1',container_format='bare',created_at=2026-05-27T03:08:20Z,direct_url=<?>,disk_format='qcow2',id=1c8f099b-d986-47ab-85c0-6df840da8cd1,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1039452088',owner='78ed6c288e2642cfa4fbb3761274cc4e',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-27T03:08:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:08:39.381775 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:08:39.381825 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:08:39.381985 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:08:39.382498 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:08:39.382498 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:08:39.382498 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:08:39.382498 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:08:39.382634 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:08:39.382634 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:08:39.383284 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:08:39.397446 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:08:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-430111061',display_name='tempest-TestStampPattern-server-430111061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-teststamppattern-server-430111061',id=55,image_ref='1c8f099b-d986-47ab-85c0-6df840da8cd1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDZto3UEnSkHw1ZHyfMviV7eTmAwKMkc0vbfI2ZmPSYaEGZx8JCGyVLm9M3ISeDAEJ6PAcHMeO78i6xhagI2+NfgSC+XdyYyiXOSKNWg+tsw2p97Ky1ahauWZw+akj0Fg==',key_name='tempest-TestStampPattern-2046987046',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78ed6c288e2642cfa4fbb3761274cc4e',ramdisk_id='',reservation_id='r-kpo9fxdo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa',image_min_disk='1',image_min_ram='0',image_owner_id='78ed6c288e2642cfa4fbb3761274cc4e',image_owner_project_name='tempest-TestStampPattern-1535526847',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1535526847-project-member',image_user_id='7fe58d4cae1c4693adb1e227daa9706d',network_allocated='True',owner_project_name='tempest-TestStampPattern-1535526847',owner_user_name='tempest-TestStampPattern-1535526847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:08:36Z,user_data=None,user_id='7fe58d4cae1c4693adb1e227daa9706d',uuid=254dc58c-6b2f-4350-bea3-5c74d571ed2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d31da235-bc6a-4a71-b77d-7e4645764be5", "address": "fa:16:3e:31:74:b7", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd31da235-bc", "ovs_interfaceid": "d31da235-bc6a-4a71-b77d-7e4645764be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:08:39.397446 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Converting VIF {"id": "d31da235-bc6a-4a71-b77d-7e4645764be5", "address": "fa:16:3e:31:74:b7", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd31da235-bc", "ovs_interfaceid": "d31da235-bc6a-4a71-b77d-7e4645764be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:08:39.398285 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=d31da235-bc6a-4a71-b77d-7e4645764be5,network=Network(ae8febf4-ab96-4db6-bfef-62abb6610b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd31da235-bc') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:08:39.399859 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lazy-loading 'pci_devices' on Instance uuid 254dc58c-6b2f-4350-bea3-5c74d571ed2c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:08:39.912703 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] End _get_guest_xml xml=<domain type="qemu">
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:   <uuid>254dc58c-6b2f-4350-bea3-5c74d571ed2c</uuid>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:   <name>instance-00000037</name>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestStampPattern-server-430111061</nova:name>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:08:39</nova:creationTime>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:           <nova:property name="img_owner_id">78ed6c288e2642cfa4fbb3761274cc4e</nova:property>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:         <nova:user uuid="7fe58d4cae1c4693adb1e227daa9706d">tempest-TestStampPattern-1535526847-project-member</nova:user>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:         <nova:project uuid="78ed6c288e2642cfa4fbb3761274cc4e">tempest-TestStampPattern-1535526847</nova:project>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:         <nova:port uuid="d31da235-bc6a-4a71-b77d-7e4645764be5">
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     <system>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <entry name="serial">254dc58c-6b2f-4350-bea3-5c74d571ed2c</entry>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <entry name="uuid">254dc58c-6b2f-4350-bea3-5c74d571ed2c</entry>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     </system>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:   <os>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:   </os>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:   <features>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:   </features>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:   <devices>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/254dc58c-6b2f-4350-bea3-5c74d571ed2c/disk"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     </disk>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/254dc58c-6b2f-4350-bea3-5c74d571ed2c/disk.config"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     </disk>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:31:74:b7"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <target dev="tapd31da235-bc"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     </interface>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/254dc58c-6b2f-4350-bea3-5c74d571ed2c/console.log" append="off"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     </serial>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     <video>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     </video>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     </rng>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:   </devices>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]: </domain>
May 27 03:08:39.912703 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:08:39.916405 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Preparing to wait for external event network-vif-plugged-d31da235-bc6a-4a71-b77d-7e4645764be5 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:08:39.916405 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:39.916405 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:39.916405 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:39.916405 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:08:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-430111061',display_name='tempest-TestStampPattern-server-430111061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-teststamppattern-server-430111061',id=55,image_ref='1c8f099b-d986-47ab-85c0-6df840da8cd1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDZto3UEnSkHw1ZHyfMviV7eTmAwKMkc0vbfI2ZmPSYaEGZx8JCGyVLm9M3ISeDAEJ6PAcHMeO78i6xhagI2+NfgSC+XdyYyiXOSKNWg+tsw2p97Ky1ahauWZw+akj0Fg==',key_name='tempest-TestStampPattern-2046987046',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78ed6c288e2642cfa4fbb3761274cc4e',ramdisk_id='',reservation_id='r-kpo9fxdo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa',image_min_disk='1',image_min_ram='0',image_owner_id='78ed6c288e2642cfa4fbb3761274cc4e',image_owner_project_name='tempest-TestStampPattern-1535526847',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1535526847-project-member',image_user_id='7fe58d4cae1c4693adb1e227daa9706d',network_allocated='True',owner_project_name='tempest-TestStampPattern-1535526847',owner_user_name='tempest-TestStampPattern-1535526847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:08:36Z,user_data=None,user_id='7fe58d4cae1c4693adb1e227daa9706d',uuid=254dc58c-6b2f-4350-bea3-5c74d571ed2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d31da235-bc6a-4a71-b77d-7e4645764be5", "address": "fa:16:3e:31:74:b7", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd31da235-bc", "ovs_interfaceid": "d31da235-bc6a-4a71-b77d-7e4645764be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:08:39.916405 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Converting VIF {"id": "d31da235-bc6a-4a71-b77d-7e4645764be5", "address": "fa:16:3e:31:74:b7", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd31da235-bc", "ovs_interfaceid": "d31da235-bc6a-4a71-b77d-7e4645764be5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:08:39.916405 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=d31da235-bc6a-4a71-b77d-7e4645764be5,network=Network(ae8febf4-ab96-4db6-bfef-62abb6610b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd31da235-bc') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:08:39.916405 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=d31da235-bc6a-4a71-b77d-7e4645764be5,network=Network(ae8febf4-ab96-4db6-bfef-62abb6610b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd31da235-bc') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:08:39.917370 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:39.917708 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:39.918241 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:08:39.919437 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:39.919645 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad65743a-5058-59ae-9c90-d91466ca1adf', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:39.920599 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:39.921836 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:08:39.925205 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:39.926504 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd31da235-bc, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:39.926998 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd31da235-bc, col_values=(('qos', UUID('97c2fad9-f1b2-41cb-bcc3-b1ea660f4790')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:39.927543 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd31da235-bc, col_values=(('external_ids', {'iface-id': 'd31da235-bc6a-4a71-b77d-7e4645764be5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:74:b7', 'vm-uuid': '254dc58c-6b2f-4350-bea3-5c74d571ed2c'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:39.929916 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:39.930719 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:08:39.939492 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:39.941049 np0000001475 nova-compute[98471]: INFO os_vif [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=d31da235-bc6a-4a71-b77d-7e4645764be5,network=Network(ae8febf4-ab96-4db6-bfef-62abb6610b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd31da235-bc')
May 27 03:08:41.355132 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:41.469813 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:08:41.470029 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:08:41.470122 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] No VIF found with MAC fa:16:3e:31:74:b7, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:08:41.470697 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Using config drive
May 27 03:08:41.980384 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:42.164568 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Creating config drive at /opt/stack/data/nova/instances/254dc58c-6b2f-4350-bea3-5c74d571ed2c/disk.config
May 27 03:08:42.169708 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/254dc58c-6b2f-4350-bea3-5c74d571ed2c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwsncm0za {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:42.248172 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/254dc58c-6b2f-4350-bea3-5c74d571ed2c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwsncm0za" returned: 0 in 0.079s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:42.682317 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Acquiring lock "bfade827-2998-4fe5-b4d4-3397233e8c14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:42.683047 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "bfade827-2998-4fe5-b4d4-3397233e8c14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:42.879904 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:42.919389 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:43.029322 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:43.097730 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:43.098963 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:43.140008 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0c03a699-5ad0-43f2-8e1b-357b5710d611 req-553ac5b1-899c-427c-9b53-d6b8154d2bb3 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Received event network-vif-plugged-d31da235-bc6a-4a71-b77d-7e4645764be5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:43.140301 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0c03a699-5ad0-43f2-8e1b-357b5710d611 req-553ac5b1-899c-427c-9b53-d6b8154d2bb3 service nova] Acquiring lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:43.143772 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0c03a699-5ad0-43f2-8e1b-357b5710d611 req-553ac5b1-899c-427c-9b53-d6b8154d2bb3 service nova] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:43.143772 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0c03a699-5ad0-43f2-8e1b-357b5710d611 req-553ac5b1-899c-427c-9b53-d6b8154d2bb3 service nova] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:43.143772 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0c03a699-5ad0-43f2-8e1b-357b5710d611 req-553ac5b1-899c-427c-9b53-d6b8154d2bb3 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Processing event network-vif-plugged-d31da235-bc6a-4a71-b77d-7e4645764be5 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:08:43.192658 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:08:43.796315 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:43.796781 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:43.802359 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:08:43.802522 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Claim successful on node np0000001475
May 27 03:08:44.133031 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:08:44.134112 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851324.1336403, 254dc58c-6b2f-4350-bea3-5c74d571ed2c => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:08:44.134337 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] VM Started (Lifecycle Event)
May 27 03:08:44.138119 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:08:44.156549 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Instance spawned successfully.
May 27 03:08:44.157047 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:08:44.161042 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:08:44.161438 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:08:44.637987 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:44.642152 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:08:44.670629 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Took 8.00 seconds to spawn the instance on the hypervisor.
May 27 03:08:44.672011 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:44.929909 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:45.145303 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:08:45.145954 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851325.145522, 254dc58c-6b2f-4350-bea3-5c74d571ed2c => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:08:45.146104 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] VM Paused (Lifecycle Event)
May 27 03:08:45.191036 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Took 13.60 seconds to build instance.
May 27 03:08:45.230011 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5089b99b-2f6f-404f-b661-d93a7c77a0e5 req-2e90e895-d9d4-4dbe-841e-120edda154e7 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Received event network-vif-plugged-d31da235-bc6a-4a71-b77d-7e4645764be5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:45.230011 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5089b99b-2f6f-404f-b661-d93a7c77a0e5 req-2e90e895-d9d4-4dbe-841e-120edda154e7 service nova] Acquiring lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:45.233771 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5089b99b-2f6f-404f-b661-d93a7c77a0e5 req-2e90e895-d9d4-4dbe-841e-120edda154e7 service nova] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:45.233771 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5089b99b-2f6f-404f-b661-d93a7c77a0e5 req-2e90e895-d9d4-4dbe-841e-120edda154e7 service nova] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:45.233771 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5089b99b-2f6f-404f-b661-d93a7c77a0e5 req-2e90e895-d9d4-4dbe-841e-120edda154e7 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] No waiting events found dispatching network-vif-plugged-d31da235-bc6a-4a71-b77d-7e4645764be5 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:08:45.233771 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-5089b99b-2f6f-404f-b661-d93a7c77a0e5 req-2e90e895-d9d4-4dbe-841e-120edda154e7 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Received unexpected event network-vif-plugged-d31da235-bc6a-4a71-b77d-7e4645764be5 for instance with vm_state active and task_state None.
May 27 03:08:45.461753 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:08:45.462289 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:08:45.651760 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:45.654221 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851325.6539643, 254dc58c-6b2f-4350-bea3-5c74d571ed2c => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:08:45.654393 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] VM Resumed (Lifecycle Event)
May 27 03:08:45.695841 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.124s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:45.964996 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:08:46.162769 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:46.169124 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:08:46.356571 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:46.474963 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.678s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:46.475708 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:08:46.822487 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:46.822640 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:46.990185 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:08:46.993925 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:08:46.996574 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:46.998379 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:47.101288 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'adc7af487f214a868d6e7c52ade24c03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748efbae1003491896ee411bd9398482', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:08:47.324891 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:08:47.487362 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:08:47.733366 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Successfully created port: a8d4448e-38f4-4feb-a8b9-fce7844af010 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:08:47.884511 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-59cf03d9-96e5-423e-b09c-1ca5c7c14bda req-3d814b70-54b1-4c4d-b011-01236c838c14 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Received event network-changed-d31da235-bc6a-4a71-b77d-7e4645764be5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:47.885373 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-59cf03d9-96e5-423e-b09c-1ca5c7c14bda req-3d814b70-54b1-4c4d-b011-01236c838c14 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Refreshing instance network info cache due to event network-changed-d31da235-bc6a-4a71-b77d-7e4645764be5. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:08:47.885608 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-59cf03d9-96e5-423e-b09c-1ca5c7c14bda req-3d814b70-54b1-4c4d-b011-01236c838c14 service nova] Acquiring lock "refresh_cache-254dc58c-6b2f-4350-bea3-5c74d571ed2c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:08:47.885859 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-59cf03d9-96e5-423e-b09c-1ca5c7c14bda req-3d814b70-54b1-4c4d-b011-01236c838c14 service nova] Acquired lock "refresh_cache-254dc58c-6b2f-4350-bea3-5c74d571ed2c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:08:47.886078 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-59cf03d9-96e5-423e-b09c-1ca5c7c14bda req-3d814b70-54b1-4c4d-b011-01236c838c14 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Refreshing network info cache for port d31da235-bc6a-4a71-b77d-7e4645764be5 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:08:47.918362 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:47.918579 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:47.926974 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:08:47.927152 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Claim successful on node np0000001475
May 27 03:08:47.992423 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:08:48.217652 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:08:48.218088 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:08:48.218419 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:08:48.218806 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:08:48.219127 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:08:48.219521 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.98 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:08:48.394825 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-59cf03d9-96e5-423e-b09c-1ca5c7c14bda req-3d814b70-54b1-4c4d-b011-01236c838c14 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:48.437051 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Successfully updated port: a8d4448e-38f4-4feb-a8b9-fce7844af010 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:08:48.505439 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3a5c5e9d-ebcc-4b76-b5c5-e56ced5ed8c8 req-a43deede-e6a7-4a7c-874e-9eb1446713f6 service nova] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Received event network-changed-a8d4448e-38f4-4feb-a8b9-fce7844af010 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:48.505919 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3a5c5e9d-ebcc-4b76-b5c5-e56ced5ed8c8 req-a43deede-e6a7-4a7c-874e-9eb1446713f6 service nova] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Refreshing instance network info cache due to event network-changed-a8d4448e-38f4-4feb-a8b9-fce7844af010. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:08:48.506206 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3a5c5e9d-ebcc-4b76-b5c5-e56ced5ed8c8 req-a43deede-e6a7-4a7c-874e-9eb1446713f6 service nova] Acquiring lock "refresh_cache-bfade827-2998-4fe5-b4d4-3397233e8c14" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:08:48.509959 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3a5c5e9d-ebcc-4b76-b5c5-e56ced5ed8c8 req-a43deede-e6a7-4a7c-874e-9eb1446713f6 service nova] Acquired lock "refresh_cache-bfade827-2998-4fe5-b4d4-3397233e8c14" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:08:48.511035 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-3a5c5e9d-ebcc-4b76-b5c5-e56ced5ed8c8 req-a43deede-e6a7-4a7c-874e-9eb1446713f6 service nova] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Refreshing network info cache for port a8d4448e-38f4-4feb-a8b9-fce7844af010 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:08:48.858819 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-59cf03d9-96e5-423e-b09c-1ca5c7c14bda req-3d814b70-54b1-4c4d-b011-01236c838c14 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:48.942048 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Acquiring lock "refresh_cache-bfade827-2998-4fe5-b4d4-3397233e8c14" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:08:49.003753 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:08:49.004859 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:08:49.005144 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Creating image(s)
May 27 03:08:49.006283 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Acquiring lock "/opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:49.006509 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "/opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:49.008895 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "/opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:49.010812 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:08:49.013757 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-3a5c5e9d-ebcc-4b76-b5c5-e56ced5ed8c8 req-a43deede-e6a7-4a7c-874e-9eb1446713f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:49.034203 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:08:49.038811 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:49.081767 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-59cf03d9-96e5-423e-b09c-1ca5c7c14bda req-3d814b70-54b1-4c4d-b011-01236c838c14 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Updated VIF entry in instance network info cache for port d31da235-bc6a-4a71-b77d-7e4645764be5. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:08:49.081931 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-59cf03d9-96e5-423e-b09c-1ca5c7c14bda req-3d814b70-54b1-4c4d-b011-01236c838c14 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Updating instance_info_cache with network_info: [{"id": "d31da235-bc6a-4a71-b77d-7e4645764be5", "address": "fa:16:3e:31:74:b7", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd31da235-bc", "ovs_interfaceid": "d31da235-bc6a-4a71-b77d-7e4645764be5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:08:49.168077 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-3a5c5e9d-ebcc-4b76-b5c5-e56ced5ed8c8 req-a43deede-e6a7-4a7c-874e-9eb1446713f6 service nova] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:08:49.172504 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.133s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:49.172504 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:49.172504 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:49.172504 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:08:49.176855 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:08:49.177765 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:49.200725 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:08:49.202491 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:08:49.297860 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.119s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:49.299160 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:49.380327 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14/disk 1073741824" returned: 0 in 0.081s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:49.382153 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:49.382531 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:49.486767 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-3a5c5e9d-ebcc-4b76-b5c5-e56ced5ed8c8 req-a43deede-e6a7-4a7c-874e-9eb1446713f6 service nova] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:08:49.495118 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.112s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:49.496333 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:08:49.496333 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:49.588470 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-59cf03d9-96e5-423e-b09c-1ca5c7c14bda req-3d814b70-54b1-4c4d-b011-01236c838c14 service nova] Releasing lock "refresh_cache-254dc58c-6b2f-4350-bea3-5c74d571ed2c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:08:49.606861 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:49.608102 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Cannot resize image /opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:08:49.608587 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:08:49.609075 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Ensure instance console log exists: /opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:08:49.609075 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:49.609355 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:49.609481 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:49.680015 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:08:49.680701 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:08:49.931076 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:49.989361 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3a5c5e9d-ebcc-4b76-b5c5-e56ced5ed8c8 req-a43deede-e6a7-4a7c-874e-9eb1446713f6 service nova] Releasing lock "refresh_cache-bfade827-2998-4fe5-b4d4-3397233e8c14" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:08:49.989878 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Acquired lock "refresh_cache-bfade827-2998-4fe5-b4d4-3397233e8c14" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:08:49.990044 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:08:50.187954 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:08:50.200231 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:08:50.201204 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:08:50.569029 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:08:50.694898 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.776s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:50.695402 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:08:50.790259 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:50.974974 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Updating instance_info_cache with network_info: [{"id": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "address": "fa:16:3e:0b:55:49", "network": {"id": "0798c75b-db23-4d1c-b81f-ce540122d2bf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-379877127-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "748efbae1003491896ee411bd9398482", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d4448e-38", "ovs_interfaceid": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:08:51.200041 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:08:51.203688 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:08:51.204360 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:08:51.204542 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:08:51.204916 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:51.205184 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:51.310334 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32837382cff144e5b70de0a400386d11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc9c3d1d60841349d551f2d9874c730', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:08:51.357828 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:51.478668 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Releasing lock "refresh_cache-bfade827-2998-4fe5-b4d4-3397233e8c14" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:08:51.480797 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Instance network_info: |[{"id": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "address": "fa:16:3e:0b:55:49", "network": {"id": "0798c75b-db23-4d1c-b81f-ce540122d2bf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-379877127-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "748efbae1003491896ee411bd9398482", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d4448e-38", "ovs_interfaceid": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:08:51.481131 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Start _get_guest_xml network_info=[{"id": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "address": "fa:16:3e:0b:55:49", "network": {"id": "0798c75b-db23-4d1c-b81f-ce540122d2bf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-379877127-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "748efbae1003491896ee411bd9398482", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d4448e-38", "ovs_interfaceid": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:08:51.486281 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:08:51.487488 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1997629097', uuid='bfade827-2998-4fe5-b4d4-3397233e8c14'), owner=OwnerMeta(userid='adc7af487f214a868d6e7c52ade24c03', username='tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member', projectid='748efbae1003491896ee411bd9398482', projectname='tempest-TestServerVolumeAttachScenarioOldVersion-791402382'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "address": "fa:16:3e:0b:55:49", "network": {"id": "0798c75b-db23-4d1c-b81f-ce540122d2bf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-379877127-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "748efbae1003491896ee411bd9398482", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d4448e-38", "ovs_interfaceid": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851331.487127) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:08:51.490665 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:08:51.491102 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:08:51.492575 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:08:51.492637 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:08:51.493824 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:08:51.494263 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:08:51.494445 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:08:51.494587 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:08:51.494779 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:08:51.494925 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:08:51.495073 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:08:51.495277 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:08:51.495422 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:08:51.495583 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:08:51.495732 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:08:51.495988 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:08:51.515761 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:08:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1997629097',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1997629097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testservervolumeattachscenariooldversion-server-1997629',id=56,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0mXxE/PwQv49DfAMZahtTGYHepmBZ73mAUABVSsKnA2xcw/jV5WeaDF5mRJnUJKHPH4MlW6x7pHGVnZK7ZYAPrTw+I6EbUW6wciVNxV9NgxoKHz8jSTkuGVE22hLxgHg==',key_name='tempest-keypair-2076153316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='748efbae1003491896ee411bd9398482',ramdisk_id='',reservation_id='r-t4par2ie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-791402382',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:08:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adc7af487f214a868d6e7c52ade24c03',uuid=bfade827-2998-4fe5-b4d4-3397233e8c14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "address": "fa:16:3e:0b:55:49", "network": {"id": "0798c75b-db23-4d1c-b81f-ce540122d2bf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-379877127-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "748efbae1003491896ee411bd9398482", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d4448e-38", "ovs_interfaceid": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:08:51.516454 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Converting VIF {"id": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "address": "fa:16:3e:0b:55:49", "network": {"id": "0798c75b-db23-4d1c-b81f-ce540122d2bf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-379877127-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "748efbae1003491896ee411bd9398482", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d4448e-38", "ovs_interfaceid": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:08:51.516702 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:55:49,bridge_name='br-int',has_traffic_filtering=True,id=a8d4448e-38f4-4feb-a8b9-fce7844af010,network=Network(0798c75b-db23-4d1c-b81f-ce540122d2bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d4448e-38') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:08:51.518389 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lazy-loading 'pci_devices' on Instance uuid bfade827-2998-4fe5-b4d4-3397233e8c14 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:08:51.712761 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:08:52.022599 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] End _get_guest_xml xml=<domain type="qemu">
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:   <uuid>bfade827-2998-4fe5-b4d4-3397233e8c14</uuid>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:   <name>instance-00000038</name>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1997629097</nova:name>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:08:51</nova:creationTime>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:         <nova:user uuid="adc7af487f214a868d6e7c52ade24c03">tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member</nova:user>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:         <nova:project uuid="748efbae1003491896ee411bd9398482">tempest-TestServerVolumeAttachScenarioOldVersion-791402382</nova:project>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:         <nova:port uuid="a8d4448e-38f4-4feb-a8b9-fce7844af010">
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     <system>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <entry name="serial">bfade827-2998-4fe5-b4d4-3397233e8c14</entry>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <entry name="uuid">bfade827-2998-4fe5-b4d4-3397233e8c14</entry>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     </system>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:   <os>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:   </os>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:   <features>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:   </features>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:   <devices>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14/disk"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     </disk>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14/disk.config"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     </disk>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:0b:55:49"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <target dev="tapa8d4448e-38"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     </interface>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14/console.log" append="off"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     </serial>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     <video>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     </video>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     </rng>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:   </devices>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]: </domain>
May 27 03:08:52.022599 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:08:52.025106 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Preparing to wait for external event network-vif-plugged-a8d4448e-38f4-4feb-a8b9-fce7844af010 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:08:52.025106 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Acquiring lock "bfade827-2998-4fe5-b4d4-3397233e8c14-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:52.025106 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "bfade827-2998-4fe5-b4d4-3397233e8c14-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:52.025106 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "bfade827-2998-4fe5-b4d4-3397233e8c14-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:52.025806 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:08:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1997629097',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1997629097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testservervolumeattachscenariooldversion-server-1997629',id=56,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0mXxE/PwQv49DfAMZahtTGYHepmBZ73mAUABVSsKnA2xcw/jV5WeaDF5mRJnUJKHPH4MlW6x7pHGVnZK7ZYAPrTw+I6EbUW6wciVNxV9NgxoKHz8jSTkuGVE22hLxgHg==',key_name='tempest-keypair-2076153316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='748efbae1003491896ee411bd9398482',ramdisk_id='',reservation_id='r-t4par2ie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-791402382',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:08:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adc7af487f214a868d6e7c52ade24c03',uuid=bfade827-2998-4fe5-b4d4-3397233e8c14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "address": "fa:16:3e:0b:55:49", "network": {"id": "0798c75b-db23-4d1c-b81f-ce540122d2bf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-379877127-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "748efbae1003491896ee411bd9398482", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d4448e-38", "ovs_interfaceid": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:08:52.026374 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Converting VIF {"id": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "address": "fa:16:3e:0b:55:49", "network": {"id": "0798c75b-db23-4d1c-b81f-ce540122d2bf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-379877127-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "748efbae1003491896ee411bd9398482", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d4448e-38", "ovs_interfaceid": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:08:52.028363 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:55:49,bridge_name='br-int',has_traffic_filtering=True,id=a8d4448e-38f4-4feb-a8b9-fce7844af010,network=Network(0798c75b-db23-4d1c-b81f-ce540122d2bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d4448e-38') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:08:52.028888 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:55:49,bridge_name='br-int',has_traffic_filtering=True,id=a8d4448e-38f4-4feb-a8b9-fce7844af010,network=Network(0798c75b-db23-4d1c-b81f-ce540122d2bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d4448e-38') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:08:52.029258 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:52.031546 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:52.031546 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:08:52.032557 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:52.032723 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5621405d-e1a6-5f71-995c-97e99c28e50f', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:52.034839 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:52.036770 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:08:52.040079 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Successfully created port: 8953edaf-1fde-421e-abaf-16020ef206c4 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:08:52.042545 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:52.043075 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8d4448e-38, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:52.044360 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8d4448e-38, col_values=(('qos', UUID('72ee2cbe-7e8e-4e47-bfab-5b1b6c8e51e1')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:52.044487 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8d4448e-38, col_values=(('external_ids', {'iface-id': 'a8d4448e-38f4-4feb-a8b9-fce7844af010', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:55:49', 'vm-uuid': 'bfade827-2998-4fe5-b4d4-3397233e8c14'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:52.046529 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:52.049488 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:08:52.061360 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:52.062282 np0000001475 nova-compute[98471]: INFO os_vif [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:55:49,bridge_name='br-int',has_traffic_filtering=True,id=a8d4448e-38f4-4feb-a8b9-fce7844af010,network=Network(0798c75b-db23-4d1c-b81f-ce540122d2bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d4448e-38')
May 27 03:08:52.215800 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:08:52.664963 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Successfully updated port: 8953edaf-1fde-421e-abaf-16020ef206c4 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:08:52.723707 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Booting with volume 9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 at /dev/vda
May 27 03:08:52.749232 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c1536ae4-7c11-4ff7-91a7-1009a775f690 req-fb6ea785-3940-4cb5-a098-d90663715db0 service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Received event network-changed-8953edaf-1fde-421e-abaf-16020ef206c4 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:52.749232 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c1536ae4-7c11-4ff7-91a7-1009a775f690 req-fb6ea785-3940-4cb5-a098-d90663715db0 service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Refreshing instance network info cache due to event network-changed-8953edaf-1fde-421e-abaf-16020ef206c4. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:08:52.749232 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c1536ae4-7c11-4ff7-91a7-1009a775f690 req-fb6ea785-3940-4cb5-a098-d90663715db0 service nova] Acquiring lock "refresh_cache-e1f8d19a-7577-47af-9b2f-fdda2576dbe4" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:08:52.749487 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c1536ae4-7c11-4ff7-91a7-1009a775f690 req-fb6ea785-3940-4cb5-a098-d90663715db0 service nova] Acquired lock "refresh_cache-e1f8d19a-7577-47af-9b2f-fdda2576dbe4" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:08:52.750995 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c1536ae4-7c11-4ff7-91a7-1009a775f690 req-fb6ea785-3940-4cb5-a098-d90663715db0 service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Refreshing network info cache for port 8953edaf-1fde-421e-abaf-16020ef206c4 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:08:52.791429 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:08:52.808217 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:08:52.846415 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:52.899123 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:08:52.899445 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:08:52.910999 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:08:52.913078 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fedf:3ab8', 'fe80::7427:32ff:fe97:df09', 'fe80::fc16:3eff:fe21:cfcf', 'fe80::58d4:6eff:fe81:c6fc', 'fe80::fc16:3eff:fe43:6208', 'fe80::fc16:3eff:feed:691b', 'fe80::d018:f2ff:feb0:9e2b', 'fe80::fc16:3eff:febf:9a7a', 'fe80::b80a:ccff:fec0:b891', 'fe80::fc16:3eff:fe31:74b7'] 
May 27 03:08:52.913240 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:08:52.913382 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:08:52.913645 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:08:52.913961 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Updating existing volume attachment record: 75e385d4-31cb-4b09-bbe9-9f3119734a7c {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:08:53.169519 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "refresh_cache-e1f8d19a-7577-47af-9b2f-fdda2576dbe4" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:08:53.256890 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c1536ae4-7c11-4ff7-91a7-1009a775f690 req-fb6ea785-3940-4cb5-a098-d90663715db0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:53.336169 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c1536ae4-7c11-4ff7-91a7-1009a775f690 req-fb6ea785-3940-4cb5-a098-d90663715db0 service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:08:53.537318 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c1536ae4-7c11-4ff7-91a7-1009a775f690 req-fb6ea785-3940-4cb5-a098-d90663715db0 service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:08:53.592431 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:08:53.592558 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:08:53.592736 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] No VIF found with MAC fa:16:3e:0b:55:49, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:08:53.593350 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Using config drive
May 27 03:08:54.041437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c1536ae4-7c11-4ff7-91a7-1009a775f690 req-fb6ea785-3940-4cb5-a098-d90663715db0 service nova] Releasing lock "refresh_cache-e1f8d19a-7577-47af-9b2f-fdda2576dbe4" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:08:54.042150 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquired lock "refresh_cache-e1f8d19a-7577-47af-9b2f-fdda2576dbe4" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:08:54.042414 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:08:54.103437 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:54.262441 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Creating config drive at /opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14/disk.config
May 27 03:08:54.266756 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5ms89jq0 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:54.338760 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5ms89jq0" returned: 0 in 0.070s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:54.641786 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:08:54.815312 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:54.847279 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:54.855232 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:54.857986 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:54.949693 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:55.037063 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:08:55.038706 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:08:55.039346 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Creating image(s)
May 27 03:08:55.039774 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:08:55.041088 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Ensure instance console log exists: /opt/stack/data/nova/instances/e1f8d19a-7577-47af-9b2f-fdda2576dbe4/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:08:55.041274 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:55.041659 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:55.041820 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:55.107452 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-88f121bc-da69-4d69-927b-d903a98f8f15 req-991dedf5-68a8-4312-8211-94570e6e5cb6 service nova] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Received event network-vif-plugged-a8d4448e-38f4-4feb-a8b9-fce7844af010 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:55.109208 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-88f121bc-da69-4d69-927b-d903a98f8f15 req-991dedf5-68a8-4312-8211-94570e6e5cb6 service nova] Acquiring lock "bfade827-2998-4fe5-b4d4-3397233e8c14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:55.109368 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-88f121bc-da69-4d69-927b-d903a98f8f15 req-991dedf5-68a8-4312-8211-94570e6e5cb6 service nova] Lock "bfade827-2998-4fe5-b4d4-3397233e8c14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:55.109559 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-88f121bc-da69-4d69-927b-d903a98f8f15 req-991dedf5-68a8-4312-8211-94570e6e5cb6 service nova] Lock "bfade827-2998-4fe5-b4d4-3397233e8c14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:55.110984 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-88f121bc-da69-4d69-927b-d903a98f8f15 req-991dedf5-68a8-4312-8211-94570e6e5cb6 service nova] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Processing event network-vif-plugged-a8d4448e-38f4-4feb-a8b9-fce7844af010 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:08:55.122133 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Updating instance_info_cache with network_info: [{"id": "8953edaf-1fde-421e-abaf-16020ef206c4", "address": "fa:16:3e:4e:eb:e1", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953edaf-1f", "ovs_interfaceid": "8953edaf-1fde-421e-abaf-16020ef206c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:08:55.241171 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:55.247176 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:55.277689 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:55.624728 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Releasing lock "refresh_cache-e1f8d19a-7577-47af-9b2f-fdda2576dbe4" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:08:55.625062 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Instance network_info: |[{"id": "8953edaf-1fde-421e-abaf-16020ef206c4", "address": "fa:16:3e:4e:eb:e1", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953edaf-1f", "ovs_interfaceid": "8953edaf-1fde-421e-abaf-16020ef206c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:08:55.625819 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Start _get_guest_xml network_info=[{"id": "8953edaf-1fde-421e-abaf-16020ef206c4", "address": "fa:16:3e:4e:eb:e1", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953edaf-1f", "ovs_interfaceid": "8953edaf-1fde-421e-abaf-16020ef206c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e1f8d19a-7577-47af-9b2f-fdda2576dbe4', 'attached_at': '', 'detached_at': '', 'volume_id': '9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 'serial': '9685c4d3-b54b-4cfd-bf57-a20fa4d6e684'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '75e385d4-31cb-4b09-bbe9-9f3119734a7c', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:08:55.629638 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:08:55.630945 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-914506265', uuid='e1f8d19a-7577-47af-9b2f-fdda2576dbe4'), owner=OwnerMeta(userid='32837382cff144e5b70de0a400386d11', username='tempest-TestVolumeBootPatternV346-1509575509-project-member', projectid='bfc9c3d1d60841349d551f2d9874c730', projectname='tempest-TestVolumeBootPatternV346-1509575509'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8953edaf-1fde-421e-abaf-16020ef206c4", "address": "fa:16:3e:4e:eb:e1", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953edaf-1f", "ovs_interfaceid": "8953edaf-1fde-421e-abaf-16020ef206c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851335.6304998) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:08:55.632674 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:08:55.633179 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:08:55.634192 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:08:55.634367 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:08:55.635395 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:08:55.636558 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:08:55.636558 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:08:55.637519 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:08:55.638299 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:08:55.639024 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:08:55.640264 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:08:55.640614 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:08:55.640988 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:08:55.641061 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:08:55.641293 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:08:55.641392 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:08:55.657579 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:08:55.658040 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:08:55.658356 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:08:55.658759 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:08:55.659027 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:08:55.673852 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:08:55.674667 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:08:55.678006 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:08:55.678006 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:08:55.681860 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:08:55.681860 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:08:55.695492 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:08:55.695492 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:55.701989 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:08:55.701989 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:55.711461 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684] added
May 27 03:08:55.711461 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:08:55.711461 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:08:55.711461 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:08:55.711461 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:08:55.711461 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:08:55.711461 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:55.712650 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:08:55.712650 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0351(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:08:55.712650 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:08:55.716863 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684] added
May 27 03:08:55.716863 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:08:55.716863 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:08:55.716863 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:08:55.716863 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:08:55.716863 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:08:55.716863 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:55.717183 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:08:55.717425 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:08:55.717599 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:08:55.830774 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:08:55.833340 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851335.8328924, bfade827-2998-4fe5-b4d4-3397233e8c14 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:08:55.833544 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] VM Started (Lifecycle Event)
May 27 03:08:55.837251 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:08:55.843670 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Instance spawned successfully.
May 27 03:08:55.844065 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:08:56.201277 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:08:56.204324 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:08:56.337604 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:56.340148 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:08:56.354194 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:08:56.354194 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:08:56.354194 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:08:56.354194 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:08:56.354194 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:08:56.354194 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:08:56.368232 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:56.713150 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:08:56.718166 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:08:56.733279 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:08:56.733279 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:08:56.741682 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:08:56.741682 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:56.751057 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:56.770456 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:56.784456 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:56.784456 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:56.784456 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:56.784456 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:56.784456 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:56.784456 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:56.784456 np0000001475 nova-compute[98471]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:56.784456 np0000001475 nova-compute[98471]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:56.784456 np0000001475 nova-compute[98471]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc7329bb-a916-4c5f-80ef-d3a610d0b42e (non-flash)
May 27 03:08:56.784456 np0000001475 nova-compute[98471]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afa28c83-8c9a-42df-b77c-26e8df316e1d (non-flash)
May 27 03:08:56.784456 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:08:56.784923 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:56.784923 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:56.784923 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:56.784923 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:56.784923 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:56.784923 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:56.784923 np0000001475 nova-compute[98471]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:56.784923 np0000001475 nova-compute[98471]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:56.784923 np0000001475 nova-compute[98471]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc7329bb-a916-4c5f-80ef-d3a610d0b42e (non-flash)
May 27 03:08:56.784923 np0000001475 nova-compute[98471]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afa28c83-8c9a-42df-b77c-26e8df316e1d (non-flash)
May 27 03:08:56.784923 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:08:56.793548 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:56.793548 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:56.793548 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:56.793548 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:56.793548 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:56.793548 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:56.793548 np0000001475 nova-compute[98471]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:56.793548 np0000001475 nova-compute[98471]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:56.793548 np0000001475 nova-compute[98471]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc7329bb-a916-4c5f-80ef-d3a610d0b42e (non-flash)
May 27 03:08:56.793548 np0000001475 nova-compute[98471]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afa28c83-8c9a-42df-b77c-26e8df316e1d (non-flash)
May 27 03:08:56.793548 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:08:56.793548 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:56.793548 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:56.793548 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:56.793548 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:56.793548 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:56.793548 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:56.793548 np0000001475 nova-compute[98471]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:56.793548 np0000001475 nova-compute[98471]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:56.793548 np0000001475 nova-compute[98471]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc7329bb-a916-4c5f-80ef-d3a610d0b42e (non-flash)
May 27 03:08:56.793548 np0000001475 nova-compute[98471]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afa28c83-8c9a-42df-b77c-26e8df316e1d (non-flash)
May 27 03:08:56.793548 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:08:56.843659 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:08:56.843834 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851336.84363, bfade827-2998-4fe5-b4d4-3397233e8c14 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:08:56.844917 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] VM Paused (Lifecycle Event)
May 27 03:08:56.847258 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684, portal: 192.168.40.100,3260]
May 27 03:08:56.847258 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684, portal: 192.168.40.100,3260] successful.
May 27 03:08:56.847258 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:56.857706 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684, portal: 192.168.50.100,3260]
May 27 03:08:56.857706 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684, portal: 192.168.50.100,3260] successful.
May 27 03:08:56.857706 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:56.864444 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:56.873072 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Took 7.87 seconds to spawn the instance on the hypervisor.
May 27 03:08:56.873911 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:08:56.874331 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc7329bb-a916-4c5f-80ef-d3a610d0b42e (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afa28c83-8c9a-42df-b77c-26e8df316e1d (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc7329bb-a916-4c5f-80ef-d3a610d0b42e (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afa28c83-8c9a-42df-b77c-26e8df316e1d (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:08:56.889534 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:08:56.890429 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.213s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:08:56.890429 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:08:56.891237 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] HCTL ('16', '-', '-', 0) found on session 131 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:08:56.891386 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:08:56.898491 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:56.898491 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:56.898491 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:56.898491 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:56.898491 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:56.898491 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:56.898491 np0000001475 nova-compute[98471]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:56.898491 np0000001475 nova-compute[98471]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:56.898491 np0000001475 nova-compute[98471]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc7329bb-a916-4c5f-80ef-d3a610d0b42e (non-flash)
May 27 03:08:56.898491 np0000001475 nova-compute[98471]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afa28c83-8c9a-42df-b77c-26e8df316e1d (non-flash)
May 27 03:08:56.898491 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:08:56.898491 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:08:56.898491 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:08:56.899018 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:56.899018 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:08:56.899018 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:56.899018 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:08:56.899018 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:56.899018 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:08:56.899018 np0000001475 nova-compute[98471]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:56.899018 np0000001475 nova-compute[98471]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:08:56.899018 np0000001475 nova-compute[98471]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc7329bb-a916-4c5f-80ef-d3a610d0b42e (non-flash)
May 27 03:08:56.899018 np0000001475 nova-compute[98471]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-afa28c83-8c9a-42df-b77c-26e8df316e1d (non-flash)
May 27 03:08:56.899018 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:08:56.899018 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:08:56.899018 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:08:56.899018 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.219s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:08:56.899466 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:08:56.900478 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] HCTL ('18', '-', '-', 0) found on session 132 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:08:56.900606 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:08:56.910215 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Searching for a device in session 131 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:08:56.910699 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:08:56.922172 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Searching for a device in session 132 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:08:56.922342 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:08:57.048518 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:57.182773 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-861ce092-1646-4214-8d96-34f7259d7ce0 req-9898e41d-6993-451f-a067-55c10f1ca9a1 service nova] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Received event network-vif-plugged-a8d4448e-38f4-4feb-a8b9-fce7844af010 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:57.183051 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-861ce092-1646-4214-8d96-34f7259d7ce0 req-9898e41d-6993-451f-a067-55c10f1ca9a1 service nova] Acquiring lock "bfade827-2998-4fe5-b4d4-3397233e8c14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:57.183296 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-861ce092-1646-4214-8d96-34f7259d7ce0 req-9898e41d-6993-451f-a067-55c10f1ca9a1 service nova] Lock "bfade827-2998-4fe5-b4d4-3397233e8c14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:57.183487 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-861ce092-1646-4214-8d96-34f7259d7ce0 req-9898e41d-6993-451f-a067-55c10f1ca9a1 service nova] Lock "bfade827-2998-4fe5-b4d4-3397233e8c14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:57.183676 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-861ce092-1646-4214-8d96-34f7259d7ce0 req-9898e41d-6993-451f-a067-55c10f1ca9a1 service nova] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] No waiting events found dispatching network-vif-plugged-a8d4448e-38f4-4feb-a8b9-fce7844af010 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:08:57.184047 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-861ce092-1646-4214-8d96-34f7259d7ce0 req-9898e41d-6993-451f-a067-55c10f1ca9a1 service nova] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Received unexpected event network-vif-plugged-a8d4448e-38f4-4feb-a8b9-fce7844af010 for instance with vm_state active and task_state None.
May 27 03:08:57.349219 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:57.352445 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851337.3521547, bfade827-2998-4fe5-b4d4-3397233e8c14 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:08:57.352575 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] VM Resumed (Lifecycle Event)
May 27 03:08:57.386626 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Took 13.68 seconds to build instance.
May 27 03:08:57.676379 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:08:57.855676 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:08:57.857658 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:08:57.889912 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "bfade827-2998-4fe5-b4d4-3397233e8c14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.207s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:58.200579 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:08:58.696448 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Found WWN 3300000001f1717d9 for multipath device dm-8 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:08:58.696998 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:08:58.697351 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '3300000001f1717d9', 'path': '/dev/dm-8', 'multipath_id': '3300000001f1717d9'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:08:58.699204 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001f1717d9', 'path': '/dev/dm-8', 'multipath_id': '3300000001f1717d9'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:08:58.709694 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:58.709694 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:58.709694 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:58.709694 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:08:58.969128 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5443b59a-8d44-49d3-879c-96e982301349 req-471d56bb-d92f-4361-bed5-00963aa855b7 service nova] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Received event network-changed-a8d4448e-38f4-4feb-a8b9-fce7844af010 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:08:58.969128 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5443b59a-8d44-49d3-879c-96e982301349 req-471d56bb-d92f-4361-bed5-00963aa855b7 service nova] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Refreshing instance network info cache due to event network-changed-a8d4448e-38f4-4feb-a8b9-fce7844af010. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:08:58.969128 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5443b59a-8d44-49d3-879c-96e982301349 req-471d56bb-d92f-4361-bed5-00963aa855b7 service nova] Acquiring lock "refresh_cache-bfade827-2998-4fe5-b4d4-3397233e8c14" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:08:58.969128 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5443b59a-8d44-49d3-879c-96e982301349 req-471d56bb-d92f-4361-bed5-00963aa855b7 service nova] Acquired lock "refresh_cache-bfade827-2998-4fe5-b4d4-3397233e8c14" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:08:58.969128 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-5443b59a-8d44-49d3-879c-96e982301349 req-471d56bb-d92f-4361-bed5-00963aa855b7 service nova] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Refreshing network info cache for port a8d4448e-38f4-4feb-a8b9-fce7844af010 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:08:59.205604 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:08:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-914506265',display_name='tempest-TestVolumeBootPatternV346-server-914506265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpatternv346-server-914506265',id=57,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwQYd4dc+QV+tewapUIxZ/cUxR0crlcfoYJ4KuC8EVaUI5Sr4ggmKi0tpu5ijwAg/4Xtq0BRDxjuHxhxn0a0SBPRFh8ErpvWBUZbpNhLCwuwOBeuJBPB2bXCPV0NbBzdg==',key_name='tempest-keypair-653561079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfc9c3d1d60841349d551f2d9874c730',ramdisk_id='',reservation_id='r-b0qh09m9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1509575509',owner_user_name='tempest-TestVolumeBootPatternV346-1509575509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:08:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32837382cff144e5b70de0a400386d11',uuid=e1f8d19a-7577-47af-9b2f-fdda2576dbe4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8953edaf-1fde-421e-abaf-16020ef206c4", "address": "fa:16:3e:4e:eb:e1", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953edaf-1f", "ovs_interfaceid": "8953edaf-1fde-421e-abaf-16020ef206c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:08:59.205921 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Converting VIF {"id": "8953edaf-1fde-421e-abaf-16020ef206c4", "address": "fa:16:3e:4e:eb:e1", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953edaf-1f", "ovs_interfaceid": "8953edaf-1fde-421e-abaf-16020ef206c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:08:59.206418 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:eb:e1,bridge_name='br-int',has_traffic_filtering=True,id=8953edaf-1fde-421e-abaf-16020ef206c4,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8953edaf-1f') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:08:59.207047 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lazy-loading 'pci_devices' on Instance uuid e1f8d19a-7577-47af-9b2f-fdda2576dbe4 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:08:59.471259 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-5443b59a-8d44-49d3-879c-96e982301349 req-471d56bb-d92f-4361-bed5-00963aa855b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:59.710089 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] End _get_guest_xml xml=<domain type="qemu">
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:   <uuid>e1f8d19a-7577-47af-9b2f-fdda2576dbe4</uuid>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:   <name>instance-00000039</name>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestVolumeBootPatternV346-server-914506265</nova:name>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:08:55</nova:creationTime>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:         <nova:user uuid="32837382cff144e5b70de0a400386d11">tempest-TestVolumeBootPatternV346-1509575509-project-member</nova:user>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:         <nova:project uuid="bfc9c3d1d60841349d551f2d9874c730">tempest-TestVolumeBootPatternV346-1509575509</nova:project>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:         <nova:port uuid="8953edaf-1fde-421e-abaf-16020ef206c4">
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     <system>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <entry name="serial">e1f8d19a-7577-47af-9b2f-fdda2576dbe4</entry>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <entry name="uuid">e1f8d19a-7577-47af-9b2f-fdda2576dbe4</entry>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     </system>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:   <os>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:   </os>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:   <features>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:   </features>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:   <devices>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/e1f8d19a-7577-47af-9b2f-fdda2576dbe4/disk.config"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     </disk>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <alias name="ua-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-8"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <serial>9685c4d3-b54b-4cfd-bf57-a20fa4d6e684</serial>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     </disk>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:4e:eb:e1"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <target dev="tap8953edaf-1f"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     </interface>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/e1f8d19a-7577-47af-9b2f-fdda2576dbe4/console.log" append="off"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     </serial>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     <video>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     </video>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     </rng>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:   </devices>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]: </domain>
May 27 03:08:59.710089 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:08:59.712672 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Preparing to wait for external event network-vif-plugged-8953edaf-1fde-421e-abaf-16020ef206c4 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:08:59.712672 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:08:59.712672 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:08:59.712672 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:08:59.712672 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:08:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-914506265',display_name='tempest-TestVolumeBootPatternV346-server-914506265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpatternv346-server-914506265',id=57,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwQYd4dc+QV+tewapUIxZ/cUxR0crlcfoYJ4KuC8EVaUI5Sr4ggmKi0tpu5ijwAg/4Xtq0BRDxjuHxhxn0a0SBPRFh8ErpvWBUZbpNhLCwuwOBeuJBPB2bXCPV0NbBzdg==',key_name='tempest-keypair-653561079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfc9c3d1d60841349d551f2d9874c730',ramdisk_id='',reservation_id='r-b0qh09m9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1509575509',owner_user_name='tempest-TestVolumeBootPatternV346-1509575509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:08:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32837382cff144e5b70de0a400386d11',uuid=e1f8d19a-7577-47af-9b2f-fdda2576dbe4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8953edaf-1fde-421e-abaf-16020ef206c4", "address": "fa:16:3e:4e:eb:e1", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953edaf-1f", "ovs_interfaceid": "8953edaf-1fde-421e-abaf-16020ef206c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:08:59.715768 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Converting VIF {"id": "8953edaf-1fde-421e-abaf-16020ef206c4", "address": "fa:16:3e:4e:eb:e1", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953edaf-1f", "ovs_interfaceid": "8953edaf-1fde-421e-abaf-16020ef206c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:08:59.716987 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:eb:e1,bridge_name='br-int',has_traffic_filtering=True,id=8953edaf-1fde-421e-abaf-16020ef206c4,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8953edaf-1f') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:08:59.720053 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:eb:e1,bridge_name='br-int',has_traffic_filtering=True,id=8953edaf-1fde-421e-abaf-16020ef206c4,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8953edaf-1f') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:08:59.720611 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:59.720972 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:59.721215 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:08:59.722284 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:59.722457 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16d18bb6-0caf-5fb9-b2aa-b2f861c9203a', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:59.723263 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:59.724062 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:08:59.724801 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:59.727934 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:59.728115 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8953edaf-1f, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:59.728550 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8953edaf-1f, col_values=(('qos', UUID('34bf9102-19d4-4f4d-b9ab-dbc0da684c2d')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:59.728812 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8953edaf-1f, col_values=(('external_ids', {'iface-id': '8953edaf-1fde-421e-abaf-16020ef206c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:eb:e1', 'vm-uuid': 'e1f8d19a-7577-47af-9b2f-fdda2576dbe4'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:08:59.729660 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:59.731127 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:08:59.737240 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:08:59.738907 np0000001475 nova-compute[98471]: INFO os_vif [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:eb:e1,bridge_name='br-int',has_traffic_filtering=True,id=8953edaf-1fde-421e-abaf-16020ef206c4,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8953edaf-1f')
May 27 03:08:59.765316 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:59.871775 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:59.872817 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:08:59.938250 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-5443b59a-8d44-49d3-879c-96e982301349 req-471d56bb-d92f-4361-bed5-00963aa855b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:08:59.977315 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:08:59.980216 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-7 (vdc) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:08:59.987468 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:00.083080 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:00.084364 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:00.148287 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-5443b59a-8d44-49d3-879c-96e982301349 req-471d56bb-d92f-4361-bed5-00963aa855b7 service nova] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Updated VIF entry in instance network info cache for port a8d4448e-38f4-4feb-a8b9-fce7844af010. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:09:00.148878 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-5443b59a-8d44-49d3-879c-96e982301349 req-471d56bb-d92f-4361-bed5-00963aa855b7 service nova] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Updating instance_info_cache with network_info: [{"id": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "address": "fa:16:3e:0b:55:49", "network": {"id": "0798c75b-db23-4d1c-b81f-ce540122d2bf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-379877127-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "748efbae1003491896ee411bd9398482", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d4448e-38", "ovs_interfaceid": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:00.196396 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:00.202244 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-3 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:09:00.204226 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254dc58c-6b2f-4350-bea3-5c74d571ed2c/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:00.311407 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254dc58c-6b2f-4350-bea3-5c74d571ed2c/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:00.313856 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254dc58c-6b2f-4350-bea3-5c74d571ed2c/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:00.409506 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254dc58c-6b2f-4350-bea3-5c74d571ed2c/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:00.415294 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:09:00.417821 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:00.522514 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:00.524232 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:00.641390 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:00.649658 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:09:00.652695 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5443b59a-8d44-49d3-879c-96e982301349 req-471d56bb-d92f-4361-bed5-00963aa855b7 service nova] Releasing lock "refresh_cache-bfade827-2998-4fe5-b4d4-3397233e8c14" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:09:00.654399 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:09:00.655216 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:00.717526 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.062s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:00.718047 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=11558MB free_disk=72.86069107055664GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:09:00.718261 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:00.718558 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:01.206104 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:09:01.273682 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:09:01.273682 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:09:01.273682 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] No VIF found with MAC fa:16:3e:4e:eb:e1, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:09:01.273682 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Using config drive
May 27 03:09:01.357023 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "a3d1d581-aaf0-4e14-99ae-5db434215c60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:01.357272 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:01.370527 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:01.787179 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:01.817989 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 5fe4c21d-3de1-479a-ad36-e4377e7cea11 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:09:01.817989 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:09:01.817989 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance dbecddfd-649b-4343-a5d2-bbbbf0c67de5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:09:01.817989 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance a3d1d581-aaf0-4e14-99ae-5db434215c60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:09:01.817989 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:09:01.817989 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 254dc58c-6b2f-4350-bea3-5c74d571ed2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:09:01.817989 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance bfade827-2998-4fe5-b4d4-3397233e8c14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:09:01.817989 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance e1f8d19a-7577-47af-9b2f-fdda2576dbe4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:09:01.817989 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:09:01.817989 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:09:00 up 40 min,  2 users,  load average: 6.85, 7.78, 5.27\n', 'num_instances': '8', 'num_vm_active': '7', 'num_task_None': '7', 'num_os_type_None': '8', 'num_proj_bfc9c3d1d60841349d551f2d9874c730': '3', 'io_workload': '1', 'num_proj_c547b519adf248728dfd0b2232bfc118': '1', 'num_proj_78ed6c288e2642cfa4fbb3761274cc4e': '2', 'num_proj_0810d45b82c0476db38b1cabf8579ae1': '1', 'num_proj_748efbae1003491896ee411bd9398482': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:09:01.860261 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Detaching volume 116ba0ab-e23e-4afb-af0d-8a4c566cbab7
May 27 03:09:01.927790 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Attempting to driver detach volume 116ba0ab-e23e-4afb-af0d-8a4c566cbab7 from mountpoint /dev/vdc
May 27 03:09:01.936767 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Found disk vdc by alias ua-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:09:01.938417 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Found disk vdc by alias ua-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:09:01.938658 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Attempting to detach device vdc from instance a3d1d581-aaf0-4e14-99ae-5db434215c60 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:09:01.939044 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:09:01.939044 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:09:01.939044 np0000001475 nova-compute[98471]:   <alias name="ua-116ba0ab-e23e-4afb-af0d-8a4c566cbab7"/>
May 27 03:09:01.939044 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-7"/>
May 27 03:09:01.939044 np0000001475 nova-compute[98471]:   <target dev="vdc" bus="virtio"/>
May 27 03:09:01.939044 np0000001475 nova-compute[98471]:   <serial>116ba0ab-e23e-4afb-af0d-8a4c566cbab7</serial>
May 27 03:09:01.939044 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 03:09:01.939044 np0000001475 nova-compute[98471]: </disk>
May 27 03:09:01.939044 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:09:01.951625 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Successfully detached device vdc from instance a3d1d581-aaf0-4e14-99ae-5db434215c60 from the persistent domain config.
May 27 03:09:01.951985 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] (1/8): Attempting to detach device vdc with device alias ua-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 from instance a3d1d581-aaf0-4e14-99ae-5db434215c60 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:09:01.952367 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:09:01.952367 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:09:01.952367 np0000001475 nova-compute[98471]:   <alias name="ua-116ba0ab-e23e-4afb-af0d-8a4c566cbab7"/>
May 27 03:09:01.952367 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-7"/>
May 27 03:09:01.952367 np0000001475 nova-compute[98471]:   <target dev="vdc" bus="virtio"/>
May 27 03:09:01.952367 np0000001475 nova-compute[98471]:   <serial>116ba0ab-e23e-4afb-af0d-8a4c566cbab7</serial>
May 27 03:09:01.952367 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 03:09:01.952367 np0000001475 nova-compute[98471]: </disk>
May 27 03:09:01.952367 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:09:02.007668 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Creating config drive at /opt/stack/data/nova/instances/e1f8d19a-7577-47af-9b2f-fdda2576dbe4/disk.config
May 27 03:09:02.011857 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e1f8d19a-7577-47af-9b2f-fdda2576dbe4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpflzsm5b_ {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:02.092465 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e1f8d19a-7577-47af-9b2f-fdda2576dbe4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpflzsm5b_" returned: 0 in 0.080s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:02.419472 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:09:02.419775 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:09:02.730787 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851342.7303429, a3d1d581-aaf0-4e14-99ae-5db434215c60 => ua-116ba0ab-e23e-4afb-af0d-8a4c566cbab7> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:09:02.738891 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 for instance a3d1d581-aaf0-4e14-99ae-5db434215c60 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:09:02.742330 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:02.754517 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Successfully detached device vdc from instance a3d1d581-aaf0-4e14-99ae-5db434215c60 from the live domain config.
May 27 03:09:02.759096 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:09:02.762047 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:09:02.762511 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:09:02.779057 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:02.785712 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:02.892442 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:02.923846 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:09:02.962321 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:02.964792 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:02.973898 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.211s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:09:02.974405 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:09:02.974597 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:09:02.987413 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-accf5d7d-05fc-442c-aba9-facf7d9f76f8 req-7ef66fd6-7858-4d82-944e-ebafed8329f4 service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Received event network-vif-plugged-8953edaf-1fde-421e-abaf-16020ef206c4 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:02.987800 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-accf5d7d-05fc-442c-aba9-facf7d9f76f8 req-7ef66fd6-7858-4d82-944e-ebafed8329f4 service nova] Acquiring lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:02.990774 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-accf5d7d-05fc-442c-aba9-facf7d9f76f8 req-7ef66fd6-7858-4d82-944e-ebafed8329f4 service nova] Lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:02.990774 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-accf5d7d-05fc-442c-aba9-facf7d9f76f8 req-7ef66fd6-7858-4d82-944e-ebafed8329f4 service nova] Lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:02.990774 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-accf5d7d-05fc-442c-aba9-facf7d9f76f8 req-7ef66fd6-7858-4d82-944e-ebafed8329f4 service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Processing event network-vif-plugged-8953edaf-1fde-421e-abaf-16020ef206c4 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:09:03.011963 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:03.011963 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:03.011963 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:03.011963 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:03.011963 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:09:03.011963 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:09:03.011963 np0000001475 nova-compute[98471]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:09:03.011963 np0000001475 nova-compute[98471]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:09:03.011963 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:03.011963 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:03.011963 np0000001475 nova-compute[98471]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434d55e4-4ab5-44e2-a481-eb0351dd1e25 (non-flash)
May 27 03:09:03.011963 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:09:03.012442 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:03.012442 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:03.012442 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:03.012442 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:03.012442 np0000001475 nova-compute[98471]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:09:03.012442 np0000001475 nova-compute[98471]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7 (non-flash)
May 27 03:09:03.012442 np0000001475 nova-compute[98471]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:09:03.012442 np0000001475 nova-compute[98471]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:09:03.012442 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:03.012442 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:03.012442 np0000001475 nova-compute[98471]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434d55e4-4ab5-44e2-a481-eb0351dd1e25 (non-flash)
May 27 03:09:03.012442 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:09:03.013809 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7', '124'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', '131'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-434d55e4-4ab5-44e2-a481-eb0351dd1e25', '133')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:09:03.013809 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7', '123')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:09:03.015709 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7', '124')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:09:03.015709 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7557046f2660>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7'): ({'sdj'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:09:03.015929 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Removing multipathed devices sdj, sdi {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:09:03.016180 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Flush multipath device 3300000009fb16a5c {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:09:03.049680 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:09:03.092942 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:09:03.145506 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Checking to see if SCSI volumes sdj, sdi have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:09:03.145506 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] SCSI volumes sdj, sdi have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:09:03.146916 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Checking to see if device paths {'sdj', 'sdi'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:09:03.162117 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Device paths {'sdj', 'sdi'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:09:03.162117 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:09:03.173659 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:03.215310 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 123, target: iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7, portal: 192.168.40.100,3260]
May 27 03:09:03.215310 np0000001475 nova-compute[98471]: Logout of [sid: 123, target: iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7, portal: 192.168.40.100,3260] successful.
May 27 03:09:03.215310 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:03.238201 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:03.250693 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:03.284588 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 124, target: iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7, portal: 192.168.50.100,3260]
May 27 03:09:03.284588 np0000001475 nova-compute[98471]: Logout of [sid: 124, target: iqn.2023-03.storpool.com:os--volume-116ba0ab-e23e-4afb-af0d-8a4c566cbab7, portal: 192.168.50.100,3260] successful.
May 27 03:09:03.284588 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:03.307509 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:03.307962 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:09:03.308133 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] <== disconnect_volume: return (545ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:09:03.308293 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:09:03.436957 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:09:03.436957 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.718s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:03.439431 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 35.76 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:09:03.744311 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851343.7438993, e1f8d19a-7577-47af-9b2f-fdda2576dbe4 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:09:03.744536 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] VM Started (Lifecycle Event)
May 27 03:09:03.746312 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:09:03.756766 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:09:03.758027 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Instance spawned successfully.
May 27 03:09:03.758374 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:09:03.883799 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'flavor' on Instance uuid a3d1d581-aaf0-4e14-99ae-5db434215c60 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:09:04.250820 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:09:04.252750 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:09:04.269145 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:04.269285 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:04.269696 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:04.269999 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:04.270314 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:04.270623 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:04.730403 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:04.755327 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:09:04.755594 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851344.7554045, e1f8d19a-7577-47af-9b2f-fdda2576dbe4 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:09:04.755724 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] VM Paused (Lifecycle Event)
May 27 03:09:04.778310 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Took 9.74 seconds to spawn the instance on the hypervisor.
May 27 03:09:04.778623 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:09:04.890149 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5efb8c57-7961-40ff-8aeb-1125066b6477 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.533s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:05.048192 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-89cb6d64-507f-46bd-b790-e3e58ee48ada req-9542be81-faee-4d0a-92bf-501cc573bc7e service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Received event network-vif-plugged-8953edaf-1fde-421e-abaf-16020ef206c4 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:05.048388 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-89cb6d64-507f-46bd-b790-e3e58ee48ada req-9542be81-faee-4d0a-92bf-501cc573bc7e service nova] Acquiring lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:05.048595 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-89cb6d64-507f-46bd-b790-e3e58ee48ada req-9542be81-faee-4d0a-92bf-501cc573bc7e service nova] Lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:05.048751 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-89cb6d64-507f-46bd-b790-e3e58ee48ada req-9542be81-faee-4d0a-92bf-501cc573bc7e service nova] Lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:05.048953 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-89cb6d64-507f-46bd-b790-e3e58ee48ada req-9542be81-faee-4d0a-92bf-501cc573bc7e service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] No waiting events found dispatching network-vif-plugged-8953edaf-1fde-421e-abaf-16020ef206c4 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:09:05.049105 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-89cb6d64-507f-46bd-b790-e3e58ee48ada req-9542be81-faee-4d0a-92bf-501cc573bc7e service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Received unexpected event network-vif-plugged-8953edaf-1fde-421e-abaf-16020ef206c4 for instance with vm_state active and task_state None.
May 27 03:09:05.258281 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:09:05.261286 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851345.2602508, e1f8d19a-7577-47af-9b2f-fdda2576dbe4 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:09:05.261286 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] VM Resumed (Lifecycle Event)
May 27 03:09:05.297221 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Took 17.46 seconds to build instance.
May 27 03:09:05.743657 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "a3d1d581-aaf0-4e14-99ae-5db434215c60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:05.743963 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:05.744216 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:05.744395 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:05.744539 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:05.747033 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Terminating instance
May 27 03:09:05.764102 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:09:05.767413 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:09:05.802736 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-027931de-e133-45e8-9bd1-0c90ccafcf1c tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.980s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:06.253125 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:09:06.278706 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:06.281268 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:06.307554 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:06.314493 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:06.345332 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:06.372907 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:06.498650 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-925f24e7-ae45-4b0b-8f1e-94ffc6456d36 req-329e791e-a2c6-4433-ae3f-fe34d2ed3cb0 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Received event network-vif-unplugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:06.504023 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-925f24e7-ae45-4b0b-8f1e-94ffc6456d36 req-329e791e-a2c6-4433-ae3f-fe34d2ed3cb0 service nova] Acquiring lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:06.504023 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-925f24e7-ae45-4b0b-8f1e-94ffc6456d36 req-329e791e-a2c6-4433-ae3f-fe34d2ed3cb0 service nova] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:06.504023 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-925f24e7-ae45-4b0b-8f1e-94ffc6456d36 req-329e791e-a2c6-4433-ae3f-fe34d2ed3cb0 service nova] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:06.504023 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-925f24e7-ae45-4b0b-8f1e-94ffc6456d36 req-329e791e-a2c6-4433-ae3f-fe34d2ed3cb0 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] No waiting events found dispatching network-vif-unplugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:09:06.504023 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-925f24e7-ae45-4b0b-8f1e-94ffc6456d36 req-329e791e-a2c6-4433-ae3f-fe34d2ed3cb0 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Received event network-vif-unplugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:09:06.607835 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999706654999954 future=<Future at 0x7557047cdc70 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:09:06.608099 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99940862099993 future=<Future at 0x7557047cdc70 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:09:06.608244 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999318672999834 future=<Future at 0x7557047cdc70 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:09:06.609487 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Instance destroyed successfully.
May 27 03:09:06.609930 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'resources' on Instance uuid a3d1d581-aaf0-4e14-99ae-5db434215c60 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:09:07.107296 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c0fc8dfe-5fa9-4002-987d-1bc86b3290b8 req-33f89e0c-098c-4932-a61d-38f61da192fd service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Received event network-changed-8953edaf-1fde-421e-abaf-16020ef206c4 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:07.108069 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c0fc8dfe-5fa9-4002-987d-1bc86b3290b8 req-33f89e0c-098c-4932-a61d-38f61da192fd service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Refreshing instance network info cache due to event network-changed-8953edaf-1fde-421e-abaf-16020ef206c4. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:09:07.108290 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c0fc8dfe-5fa9-4002-987d-1bc86b3290b8 req-33f89e0c-098c-4932-a61d-38f61da192fd service nova] Acquiring lock "refresh_cache-e1f8d19a-7577-47af-9b2f-fdda2576dbe4" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:09:07.108430 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c0fc8dfe-5fa9-4002-987d-1bc86b3290b8 req-33f89e0c-098c-4932-a61d-38f61da192fd service nova] Acquired lock "refresh_cache-e1f8d19a-7577-47af-9b2f-fdda2576dbe4" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:09:07.108601 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c0fc8dfe-5fa9-4002-987d-1bc86b3290b8 req-33f89e0c-098c-4932-a61d-38f61da192fd service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Refreshing network info cache for port 8953edaf-1fde-421e-abaf-16020ef206c4 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:09:07.113477 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T03:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1049303833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumeshelvetestjson-server-1049303833',id=50,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC74kMXXtTfu96CEeSeXm7lbe6InTg7PC6KekpYZjJWXgE8Ih1WDS9gVb82OCiOe6f4FJGyPwkR1yGy8I2MF96YLBrCB0ElxJLAhExDMR2s1v9S7JeN28lwHkG0A1+84GA==',key_name='tempest-keypair-951893173',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:08:22Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c547b519adf248728dfd0b2232bfc118',ramdisk_id='',reservation_id='r-4h7euvrh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1364873533',owner_user_name='tempest-AttachVolumeShelveTestJSON-1364873533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:08:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c72d670892e44d88e674c9b584bc718',uuid=a3d1d581-aaf0-4e14-99ae-5db434215c60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:09:07.113656 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converting VIF {"id": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "address": "fa:16:3e:ed:69:1b", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad4ac3f9-a2", "ovs_interfaceid": "ad4ac3f9-a243-42a4-9e61-fb161205ae0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:09:07.114295 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:69:1b,bridge_name='br-int',has_traffic_filtering=True,id=ad4ac3f9-a243-42a4-9e61-fb161205ae0a,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4ac3f9-a2') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:09:07.114575 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:69:1b,bridge_name='br-int',has_traffic_filtering=True,id=ad4ac3f9-a243-42a4-9e61-fb161205ae0a,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4ac3f9-a2') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:09:07.116209 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:07.116467 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad4ac3f9-a2, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:07.118325 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:07.119388 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:09:07.120853 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:07.121037 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5c8266a-ad63-426f-b41c-b2adcf60bba6) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:07.121755 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:07.122430 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:09:07.123002 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:07.125191 np0000001475 nova-compute[98471]: INFO os_vif [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:69:1b,bridge_name='br-int',has_traffic_filtering=True,id=ad4ac3f9-a243-42a4-9e61-fb161205ae0a,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad4ac3f9-a2')
May 27 03:09:07.125681 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Deleting instance files /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60_del
May 27 03:09:07.136763 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Deletion of /opt/stack/data/nova/instances/a3d1d581-aaf0-4e14-99ae-5db434215c60_del complete
May 27 03:09:07.612462 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c0fc8dfe-5fa9-4002-987d-1bc86b3290b8 req-33f89e0c-098c-4932-a61d-38f61da192fd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:07.644966 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Took 1.39 seconds to destroy the instance on the hypervisor.
May 27 03:09:07.645897 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:09:07.646204 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:09:07.646515 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:09:07.646515 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:07.798318 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:07.986797 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:07.987332 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:07.987597 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:07.988054 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:07.988399 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:07.993289 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Terminating instance
May 27 03:09:08.046130 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c0fc8dfe-5fa9-4002-987d-1bc86b3290b8 req-33f89e0c-098c-4932-a61d-38f61da192fd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:08.242442 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c0fc8dfe-5fa9-4002-987d-1bc86b3290b8 req-33f89e0c-098c-4932-a61d-38f61da192fd service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Updated VIF entry in instance network info cache for port 8953edaf-1fde-421e-abaf-16020ef206c4. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:09:08.243170 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c0fc8dfe-5fa9-4002-987d-1bc86b3290b8 req-33f89e0c-098c-4932-a61d-38f61da192fd service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Updating instance_info_cache with network_info: [{"id": "8953edaf-1fde-421e-abaf-16020ef206c4", "address": "fa:16:3e:4e:eb:e1", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953edaf-1f", "ovs_interfaceid": "8953edaf-1fde-421e-abaf-16020ef206c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:08.272176 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:08.381891 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-32c42251-03b9-49bd-bad0-50b0249b3f17 req-a9066b87-c9b6-41b3-ad6e-694c10f033ed service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Received event network-vif-deleted-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:08.382456 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-32c42251-03b9-49bd-bad0-50b0249b3f17 req-a9066b87-c9b6-41b3-ad6e-694c10f033ed service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Neutron deleted interface ad4ac3f9-a243-42a4-9e61-fb161205ae0a; detaching it from the instance and deleting it from the info cache
May 27 03:09:08.382677 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-32c42251-03b9-49bd-bad0-50b0249b3f17 req-a9066b87-c9b6-41b3-ad6e-694c10f033ed service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:08.495515 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:09:08.523339 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:08.530421 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:08.557790 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:08.575349 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-cc8ffc3b-1e31-49ba-bd25-7b103a3def10 req-f20ac573-6ec7-4aa2-99a2-e677f1babd80 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Received event network-vif-unplugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:08.575349 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:08.575349 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cc8ffc3b-1e31-49ba-bd25-7b103a3def10 req-f20ac573-6ec7-4aa2-99a2-e677f1babd80 service nova] Acquiring lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:08.575349 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cc8ffc3b-1e31-49ba-bd25-7b103a3def10 req-f20ac573-6ec7-4aa2-99a2-e677f1babd80 service nova] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:08.575349 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cc8ffc3b-1e31-49ba-bd25-7b103a3def10 req-f20ac573-6ec7-4aa2-99a2-e677f1babd80 service nova] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:08.575349 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-cc8ffc3b-1e31-49ba-bd25-7b103a3def10 req-f20ac573-6ec7-4aa2-99a2-e677f1babd80 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] No waiting events found dispatching network-vif-unplugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:09:08.575349 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-cc8ffc3b-1e31-49ba-bd25-7b103a3def10 req-f20ac573-6ec7-4aa2-99a2-e677f1babd80 service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Received event network-vif-unplugged-ad4ac3f9-a243-42a4-9e61-fb161205ae0a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:09:08.600593 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:08.603164 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:08.748667 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c0fc8dfe-5fa9-4002-987d-1bc86b3290b8 req-33f89e0c-098c-4932-a61d-38f61da192fd service nova] Releasing lock "refresh_cache-e1f8d19a-7577-47af-9b2f-fdda2576dbe4" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:09:08.824116 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:08.857608 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999641041999894 future=<Future at 0x7557241caf60 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:09:08.871195 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Instance destroyed successfully.
May 27 03:09:08.871622 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lazy-loading 'resources' on Instance uuid 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:09:08.886807 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-32c42251-03b9-49bd-bad0-50b0249b3f17 req-a9066b87-c9b6-41b3-ad6e-694c10f033ed service nova] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Detach interface failed, port_id=ad4ac3f9-a243-42a4-9e61-fb161205ae0a, reason: Instance a3d1d581-aaf0-4e14-99ae-5db434215c60 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:09:09.171507 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-805b9bea-493b-4013-a516-98391d6f084b req-17493914-9e6d-468b-937b-89c375e281da service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Received event network-vif-unplugged-07d47fc5-99ae-4875-8336-7244d0678fa7 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:09.171691 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-805b9bea-493b-4013-a516-98391d6f084b req-17493914-9e6d-468b-937b-89c375e281da service nova] Acquiring lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:09.171903 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-805b9bea-493b-4013-a516-98391d6f084b req-17493914-9e6d-468b-937b-89c375e281da service nova] Lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:09.172065 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-805b9bea-493b-4013-a516-98391d6f084b req-17493914-9e6d-468b-937b-89c375e281da service nova] Lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:09.172126 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-805b9bea-493b-4013-a516-98391d6f084b req-17493914-9e6d-468b-937b-89c375e281da service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] No waiting events found dispatching network-vif-unplugged-07d47fc5-99ae-4875-8336-7244d0678fa7 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:09:09.172281 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-805b9bea-493b-4013-a516-98391d6f084b req-17493914-9e6d-468b-937b-89c375e281da service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Received event network-vif-unplugged-07d47fc5-99ae-4875-8336-7244d0678fa7 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:09:09.172332 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-805b9bea-493b-4013-a516-98391d6f084b req-17493914-9e6d-468b-937b-89c375e281da service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Received event network-vif-unplugged-07d47fc5-99ae-4875-8336-7244d0678fa7 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:09.172637 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-805b9bea-493b-4013-a516-98391d6f084b req-17493914-9e6d-468b-937b-89c375e281da service nova] Acquiring lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:09.172637 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-805b9bea-493b-4013-a516-98391d6f084b req-17493914-9e6d-468b-937b-89c375e281da service nova] Lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:09.172637 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-805b9bea-493b-4013-a516-98391d6f084b req-17493914-9e6d-468b-937b-89c375e281da service nova] Lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:09.172812 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-805b9bea-493b-4013-a516-98391d6f084b req-17493914-9e6d-468b-937b-89c375e281da service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] No waiting events found dispatching network-vif-unplugged-07d47fc5-99ae-4875-8336-7244d0678fa7 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:09:09.173865 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-805b9bea-493b-4013-a516-98391d6f084b req-17493914-9e6d-468b-937b-89c375e281da service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Received event network-vif-unplugged-07d47fc5-99ae-4875-8336-7244d0678fa7 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:09:09.326676 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Took 1.68 seconds to deallocate network for instance.
May 27 03:09:09.374804 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:08:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1902338634',display_name='tempest-TestEncryptedCinderVolumes-server-1902338634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testencryptedcindervolumes-server-1902338634',id=54,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsKE8mApOuH6pQpMeoaM1711p44BdU5w63deegp3kTmD9SDXsbd+S4T7tQJxMwMSGixch3LkbnnDZXpLGGTHeoe63rCS6XTN2kyvsWQlISndr8KsTd/l4xT3HCDOGuK4Q==',key_name='tempest-TestEncryptedCinderVolumes-1532145403',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:08:27Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0810d45b82c0476db38b1cabf8579ae1',ramdisk_id='',reservation_id='r-x9a5rz94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-913342494',owner_user_name='tempest-TestEncryptedCinderVolumes-913342494-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:08:28Z,user_data=None,user_id='358594214f7a4c71a13200be75c799cc',uuid=6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07d47fc5-99ae-4875-8336-7244d0678fa7", "address": "fa:16:3e:bf:9a:7a", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d47fc5-99", "ovs_interfaceid": "07d47fc5-99ae-4875-8336-7244d0678fa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:09:09.374804 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Converting VIF {"id": "07d47fc5-99ae-4875-8336-7244d0678fa7", "address": "fa:16:3e:bf:9a:7a", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d47fc5-99", "ovs_interfaceid": "07d47fc5-99ae-4875-8336-7244d0678fa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:09:09.376073 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:9a:7a,bridge_name='br-int',has_traffic_filtering=True,id=07d47fc5-99ae-4875-8336-7244d0678fa7,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d47fc5-99') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:09:09.377686 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:9a:7a,bridge_name='br-int',has_traffic_filtering=True,id=07d47fc5-99ae-4875-8336-7244d0678fa7,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d47fc5-99') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:09:09.377963 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:09.378096 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07d47fc5-99, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:09.379196 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:09.380647 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:09:09.381397 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:09.381620 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33e7b3fb-b2b2-4be3-bd6d-70b0e1cae658) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:09.382124 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:09.382724 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:09:09.383036 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:09.386921 np0000001475 nova-compute[98471]: INFO os_vif [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:9a:7a,bridge_name='br-int',has_traffic_filtering=True,id=07d47fc5-99ae-4875-8336-7244d0678fa7,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d47fc5-99')
May 27 03:09:09.389105 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:09:09.389630 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d6ae676-a143-4096-8131-416697041c3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:09:09.390050 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:09:09.390550 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:09:09.391039 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9d6ae676-a143-4096-8131-416697041c3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:09:09.391328 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:09:09.419987 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:09.419987 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:09.419987 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:09.419987 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:09.419987 np0000001475 nova-compute[98471]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:09:09.419987 np0000001475 nova-compute[98471]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:09:09.419987 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:09.419987 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:09.419987 np0000001475 nova-compute[98471]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434d55e4-4ab5-44e2-a481-eb0351dd1e25 (non-flash)
May 27 03:09:09.419987 np0000001475 nova-compute[98471]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b17ecae-515a-4880-a021-bf152ce81257 (non-flash)
May 27 03:09:09.419987 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:09:09.420677 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:09.420677 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:09.420677 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:09.420677 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:09.420677 np0000001475 nova-compute[98471]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:09:09.420677 np0000001475 nova-compute[98471]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d (non-flash)
May 27 03:09:09.420677 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:09.420677 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:09.420677 np0000001475 nova-compute[98471]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434d55e4-4ab5-44e2-a481-eb0351dd1e25 (non-flash)
May 27 03:09:09.420677 np0000001475 nova-compute[98471]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5b17ecae-515a-4880-a021-bf152ce81257 (non-flash)
May 27 03:09:09.420677 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:09:09.421315 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', '131'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-434d55e4-4ab5-44e2-a481-eb0351dd1e25', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5b17ecae-515a-4880-a021-bf152ce81257', '134')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:09:09.423760 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', '125')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:09:09.423760 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d', '126')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:09:09.424199 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c590040>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d'): ({'sdf'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:09:09.424788 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Removing multipathed devices sdf, sde {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:09:09.425291 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Flush multipath device 3300000002de82d32 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:09:09.461218 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:09:09.510384 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:09:09.569535 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:09:09.569535 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:09:09.569535 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:09:09.583682 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:09:09.583682 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:09:09.595524 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:09.633708 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 125, target: iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d, portal: 192.168.40.100,3260]
May 27 03:09:09.633708 np0000001475 nova-compute[98471]: Logout of [sid: 125, target: iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d, portal: 192.168.40.100,3260] successful.
May 27 03:09:09.633708 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:09.662699 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:09.678326 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:09.726693 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 126, target: iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d, portal: 192.168.50.100,3260]
May 27 03:09:09.726693 np0000001475 nova-compute[98471]: Logout of [sid: 126, target: iqn.2023-03.storpool.com:os--volume-9d6ae676-a143-4096-8131-416697041c3d, portal: 192.168.50.100,3260] successful.
May 27 03:09:09.726693 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:09.755357 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:09.756815 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:09:09.756815 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] <== disconnect_volume: return (366ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:09:09.757685 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:09:09.758069 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Deleting instance files /opt/stack/data/nova/instances/6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef_del
May 27 03:09:09.758990 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Deletion of /opt/stack/data/nova/instances/6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef_del complete
May 27 03:09:09.833021 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:09.833185 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:10.266672 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:09:10.267029 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:09:10.270569 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Took 1.77 seconds to destroy the instance on the hypervisor.
May 27 03:09:10.271192 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:09:10.271431 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:09:10.271538 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:09:10.271834 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:10.340128 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:10.771760 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:09:10.987488 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d8d7f182-e25c-4cad-907c-e51c45b2d7d3 req-3039aaaa-734d-4446-8e6a-d3c62ffbe027 service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Received event network-vif-deleted-07d47fc5-99ae-4875-8336-7244d0678fa7 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:10.987545 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-d8d7f182-e25c-4cad-907c-e51c45b2d7d3 req-3039aaaa-734d-4446-8e6a-d3c62ffbe027 service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Neutron deleted interface 07d47fc5-99ae-4875-8336-7244d0678fa7; detaching it from the instance and deleting it from the info cache
May 27 03:09:10.987719 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-d8d7f182-e25c-4cad-907c-e51c45b2d7d3 req-3039aaaa-734d-4446-8e6a-d3c62ffbe027 service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:11.282960 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.450s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:11.357299 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Deleted allocations for instance a3d1d581-aaf0-4e14-99ae-5db434215c60
May 27 03:09:11.382043 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:11.431604 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:11.494992 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d8d7f182-e25c-4cad-907c-e51c45b2d7d3 req-3039aaaa-734d-4446-8e6a-d3c62ffbe027 service nova] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Detach interface failed, port_id=07d47fc5-99ae-4875-8336-7244d0678fa7, reason: Instance 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:09:11.933648 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Took 1.66 seconds to deallocate network for instance.
May 27 03:09:12.367659 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9614c271-4219-40b3-9979-19e2d3c7af4e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "a3d1d581-aaf0-4e14-99ae-5db434215c60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.623s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:12.490919 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Took 0.56 seconds to detach 1 volumes for instance.
May 27 03:09:12.770622 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:12.770622 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:12.997168 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:12.997653 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:13.275168 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:09:13.557850 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:09:13.558165 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:09:13.855550 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:14.061111 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:09:14.383300 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:14.567755 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.570s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:14.570140 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.715s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:14.575001 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:09:14.576063 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Claim successful on node np0000001475
May 27 03:09:14.647432 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Deleted allocations for instance 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef
May 27 03:09:15.661497 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-984a4495-1fa1-4bac-81e5-ca61e58ff5ec tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.674s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:15.852901 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "408047d8-a3ab-415c-a667-204e70271bed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:15.853117 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "408047d8-a3ab-415c-a667-204e70271bed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:16.024951 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:09:16.025178 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:09:16.356633 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:09:16.384827 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:16.527557 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:09:16.930935 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:17.035141 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.465s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:17.036079 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.105s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:17.036079 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:09:17.042536 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:09:17.044180 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Claim successful on node np0000001475
May 27 03:09:17.546117 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:09:17.546983 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:09:17.547376 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:17.547732 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:17.669337 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c925bec6c37b4489b122eeff91a1f59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428862460731458481e46d92e7e023cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:09:18.049942 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:09:18.173466 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Successfully created port: 40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:09:18.518372 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:09:18.518656 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:09:18.556837 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:09:18.805390 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Successfully updated port: 40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:09:18.901036 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f1c301da-6372-42e4-a091-9bdeb206b235 req-4fcd5c9f-4667-4ed1-b091-cb98740d1130 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Received event network-changed-40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:18.901247 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f1c301da-6372-42e4-a091-9bdeb206b235 req-4fcd5c9f-4667-4ed1-b091-cb98740d1130 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Refreshing instance network info cache due to event network-changed-40e38c63-6edf-4ebd-bd43-48e853f0c67a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:09:18.901454 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f1c301da-6372-42e4-a091-9bdeb206b235 req-4fcd5c9f-4667-4ed1-b091-cb98740d1130 service nova] Acquiring lock "refresh_cache-eb7ae482-4f6f-4b54-9923-3657c90de9fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:09:18.901584 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f1c301da-6372-42e4-a091-9bdeb206b235 req-4fcd5c9f-4667-4ed1-b091-cb98740d1130 service nova] Acquired lock "refresh_cache-eb7ae482-4f6f-4b54-9923-3657c90de9fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:09:18.901781 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f1c301da-6372-42e4-a091-9bdeb206b235 req-4fcd5c9f-4667-4ed1-b091-cb98740d1130 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Refreshing network info cache for port 40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:09:19.024430 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:09:19.306681 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "refresh_cache-eb7ae482-4f6f-4b54-9923-3657c90de9fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:09:19.401273 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:19.405770 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f1c301da-6372-42e4-a091-9bdeb206b235 req-4fcd5c9f-4667-4ed1-b091-cb98740d1130 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:19.474987 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f1c301da-6372-42e4-a091-9bdeb206b235 req-4fcd5c9f-4667-4ed1-b091-cb98740d1130 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:09:19.533649 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.498s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:19.534030 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:09:19.568419 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:09:19.570068 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:09:19.570332 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Creating image(s)
May 27 03:09:19.570907 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:19.571103 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "/opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:19.571422 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "/opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:19.571948 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:09:19.575672 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:09:19.579516 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:19.668318 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.088s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:19.671462 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:19.671462 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:19.671462 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:09:19.674795 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:09:19.675555 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:19.706376 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f1c301da-6372-42e4-a091-9bdeb206b235 req-4fcd5c9f-4667-4ed1-b091-cb98740d1130 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:19.786141 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.110s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:19.786614 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:19.854524 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk 1073741824" returned: 0 in 0.068s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:19.855067 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:19.855453 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:19.952825 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.097s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:19.953386 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:09:19.953706 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:20.044627 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:09:20.044627 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:09:20.045248 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:20.045499 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:20.094948 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:20.094948 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Cannot resize image /opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:09:20.094948 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:09:20.094948 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Ensure instance console log exists: /opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:09:20.095252 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:20.095466 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:20.095643 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:20.158615 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c72d670892e44d88e674c9b584bc718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c547b519adf248728dfd0b2232bfc118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:09:20.216636 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f1c301da-6372-42e4-a091-9bdeb206b235 req-4fcd5c9f-4667-4ed1-b091-cb98740d1130 service nova] Releasing lock "refresh_cache-eb7ae482-4f6f-4b54-9923-3657c90de9fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:09:20.217356 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquired lock "refresh_cache-eb7ae482-4f6f-4b54-9923-3657c90de9fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:09:20.217634 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:09:20.553129 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:09:20.678044 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Successfully created port: 9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:09:20.817691 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:09:20.999291 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:21.060808 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:09:21.155293 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Updating instance_info_cache with network_info: [{"id": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "address": "fa:16:3e:a9:da:0b", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e38c63-6e", "ovs_interfaceid": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:21.296990 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Successfully updated port: 9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:09:21.349451 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-31f4aa24-448c-4e92-b879-4e0bb13aae13 req-b8b0f8d5-04e2-465b-a410-7fb516c45f06 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-changed-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:21.349451 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-31f4aa24-448c-4e92-b879-4e0bb13aae13 req-b8b0f8d5-04e2-465b-a410-7fb516c45f06 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Refreshing instance network info cache due to event network-changed-9b975543-7a67-4aef-a074-e8748cdcbc87. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:09:21.349451 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-31f4aa24-448c-4e92-b879-4e0bb13aae13 req-b8b0f8d5-04e2-465b-a410-7fb516c45f06 service nova] Acquiring lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:09:21.349451 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-31f4aa24-448c-4e92-b879-4e0bb13aae13 req-b8b0f8d5-04e2-465b-a410-7fb516c45f06 service nova] Acquired lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:09:21.350179 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-31f4aa24-448c-4e92-b879-4e0bb13aae13 req-b8b0f8d5-04e2-465b-a410-7fb516c45f06 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Refreshing network info cache for port 9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:09:21.386777 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:21.608045 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0004598579998855712 future=<Future at 0x7557047cdc70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:09:21.608458 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:09:21.611770 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Emitting event <LifecycleEvent: 1779851346.6073945, a3d1d581-aaf0-4e14-99ae-5db434215c60 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:09:21.611770 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=2.2475741299999754 future=<Future at 0x7557241caf60 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:09:21.611770 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] VM Stopped (Lifecycle Event)
May 27 03:09:21.611770 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=2.2458691309998358 future=<Future at 0x7557241caf60 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:09:21.663552 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Releasing lock "refresh_cache-eb7ae482-4f6f-4b54-9923-3657c90de9fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:09:21.663552 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Instance network_info: |[{"id": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "address": "fa:16:3e:a9:da:0b", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e38c63-6e", "ovs_interfaceid": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:09:21.665214 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Start _get_guest_xml network_info=[{"id": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "address": "fa:16:3e:a9:da:0b", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e38c63-6e", "ovs_interfaceid": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:09:21.671853 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:09:21.671853 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-1482447493', uuid='eb7ae482-4f6f-4b54-9923-3657c90de9fa'), owner=OwnerMeta(userid='c925bec6c37b4489b122eeff91a1f59f', username='tempest-VolumesBackupsTest-655006446-project-member', projectid='428862460731458481e46d92e7e023cf', projectname='tempest-VolumesBackupsTest-655006446'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "address": "fa:16:3e:a9:da:0b", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e38c63-6e", "ovs_interfaceid": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851361.6702366) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:09:21.671853 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:09:21.672138 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:09:21.673561 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:09:21.673824 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:09:21.675003 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:09:21.675529 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:09:21.675682 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:09:21.675845 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:09:21.676008 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:09:21.676132 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:09:21.676332 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:09:21.676452 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:09:21.676583 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:09:21.676725 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:09:21.676881 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:09:21.677026 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:09:21.696003 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1482447493',display_name='tempest-VolumesBackupsTest-instance-1482447493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesbackupstest-instance-1482447493',id=58,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkuue+WJjnfaVeXYqvytm9UKZy+pXgju4LHY5uoAjZYPPWewwlmo5fadbRRZOFzLLVVCOi2nfK8yAo/YHfS8mhG6Oy4joQ1WuJAO3chh3RdZkC+kcumY4G4cyzvNK6taA==',key_name='tempest-keypair-1825246971',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='428862460731458481e46d92e7e023cf',ramdisk_id='',reservation_id='r-q1bg6k30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-655006446',owner_user_name='tempest-VolumesBackupsTest-655006446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:09:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c925bec6c37b4489b122eeff91a1f59f',uuid=eb7ae482-4f6f-4b54-9923-3657c90de9fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "address": "fa:16:3e:a9:da:0b", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e38c63-6e", "ovs_interfaceid": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:09:21.696235 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Converting VIF {"id": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "address": "fa:16:3e:a9:da:0b", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e38c63-6e", "ovs_interfaceid": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:09:21.696910 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:da:0b,bridge_name='br-int',has_traffic_filtering=True,id=40e38c63-6edf-4ebd-bd43-48e853f0c67a,network=Network(735ff26b-dab6-49dc-a6ef-ed11180803a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e38c63-6e') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:09:21.698430 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lazy-loading 'pci_devices' on Instance uuid eb7ae482-4f6f-4b54-9923-3657c90de9fa {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:09:21.800385 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:09:21.853689 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-31f4aa24-448c-4e92-b879-4e0bb13aae13 req-b8b0f8d5-04e2-465b-a410-7fb516c45f06 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:21.913536 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-31f4aa24-448c-4e92-b879-4e0bb13aae13 req-b8b0f8d5-04e2-465b-a410-7fb516c45f06 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:09:22.050706 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-31f4aa24-448c-4e92-b879-4e0bb13aae13 req-b8b0f8d5-04e2-465b-a410-7fb516c45f06 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:22.068929 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:09:22.069883 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:09:22.070141 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Creating image(s)
May 27 03:09:22.070571 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "/opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:22.070703 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "/opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:22.071192 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "/opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:22.071678 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:09:22.074532 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:09:22.075555 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:22.115167 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: a3d1d581-aaf0-4e14-99ae-5db434215c60] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:09:22.201699 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] End _get_guest_xml xml=<domain type="qemu">
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:   <uuid>eb7ae482-4f6f-4b54-9923-3657c90de9fa</uuid>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:   <name>instance-0000003a</name>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <nova:name>tempest-VolumesBackupsTest-instance-1482447493</nova:name>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:09:21</nova:creationTime>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:         <nova:user uuid="c925bec6c37b4489b122eeff91a1f59f">tempest-VolumesBackupsTest-655006446-project-member</nova:user>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:         <nova:project uuid="428862460731458481e46d92e7e023cf">tempest-VolumesBackupsTest-655006446</nova:project>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:         <nova:port uuid="40e38c63-6edf-4ebd-bd43-48e853f0c67a">
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     <system>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <entry name="serial">eb7ae482-4f6f-4b54-9923-3657c90de9fa</entry>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <entry name="uuid">eb7ae482-4f6f-4b54-9923-3657c90de9fa</entry>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     </system>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:   <os>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:   </os>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:   <features>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:   </features>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:   <devices>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     </disk>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk.config"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     </disk>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:a9:da:0b"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <target dev="tap40e38c63-6e"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     </interface>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/console.log" append="off"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     </serial>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     <video>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     </video>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     </rng>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:   </devices>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]: </domain>
May 27 03:09:22.201699 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:09:22.205081 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Preparing to wait for external event network-vif-plugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:09:22.205081 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:22.205081 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:22.205081 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:22.205081 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1482447493',display_name='tempest-VolumesBackupsTest-instance-1482447493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesbackupstest-instance-1482447493',id=58,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkuue+WJjnfaVeXYqvytm9UKZy+pXgju4LHY5uoAjZYPPWewwlmo5fadbRRZOFzLLVVCOi2nfK8yAo/YHfS8mhG6Oy4joQ1WuJAO3chh3RdZkC+kcumY4G4cyzvNK6taA==',key_name='tempest-keypair-1825246971',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='428862460731458481e46d92e7e023cf',ramdisk_id='',reservation_id='r-q1bg6k30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-655006446',owner_user_name='tempest-VolumesBackupsTest-655006446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:09:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c925bec6c37b4489b122eeff91a1f59f',uuid=eb7ae482-4f6f-4b54-9923-3657c90de9fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "address": "fa:16:3e:a9:da:0b", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e38c63-6e", "ovs_interfaceid": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:09:22.205081 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Converting VIF {"id": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "address": "fa:16:3e:a9:da:0b", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e38c63-6e", "ovs_interfaceid": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:09:22.208485 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:da:0b,bridge_name='br-int',has_traffic_filtering=True,id=40e38c63-6edf-4ebd-bd43-48e853f0c67a,network=Network(735ff26b-dab6-49dc-a6ef-ed11180803a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e38c63-6e') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:09:22.208485 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:da:0b,bridge_name='br-int',has_traffic_filtering=True,id=40e38c63-6edf-4ebd-bd43-48e853f0c67a,network=Network(735ff26b-dab6-49dc-a6ef-ed11180803a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e38c63-6e') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:09:22.208485 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.131s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:22.208485 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:22.208485 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:22.208485 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:09:22.210842 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:22.210842 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:22.210842 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:09:22.212368 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:22.212368 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9749d85-5888-55dc-94bc-f0ee81a029f4', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:22.213337 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:22.217105 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:09:22.220160 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:09:22.220582 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:22.233902 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:22.241724 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:22.242176 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40e38c63-6e, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:22.243121 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40e38c63-6e, col_values=(('qos', UUID('192ae621-8ee0-4ac8-a37c-197a7d8f52bc')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:22.243436 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40e38c63-6e, col_values=(('external_ids', {'iface-id': '40e38c63-6edf-4ebd-bd43-48e853f0c67a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:da:0b', 'vm-uuid': 'eb7ae482-4f6f-4b54-9923-3657c90de9fa'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:22.244989 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:22.247565 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:09:22.251221 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:22.252932 np0000001475 nova-compute[98471]: INFO os_vif [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:da:0b,bridge_name='br-int',has_traffic_filtering=True,id=40e38c63-6edf-4ebd-bd43-48e853f0c67a,network=Network(735ff26b-dab6-49dc-a6ef-ed11180803a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e38c63-6e')
May 27 03:09:22.326286 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.105s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:22.326512 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:22.417097 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk 1073741824" returned: 0 in 0.084s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:22.417097 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:22.417097 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:22.519862 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.107s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:22.520328 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:09:22.520597 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:22.555612 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-31f4aa24-448c-4e92-b879-4e0bb13aae13 req-b8b0f8d5-04e2-465b-a410-7fb516c45f06 service nova] Releasing lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:09:22.556826 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquired lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:09:22.556826 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:09:22.620214 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:22.620736 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Cannot resize image /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:09:22.621105 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:09:22.621297 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Ensure instance console log exists: /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:09:22.621594 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:22.621875 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:22.622056 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:23.129687 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:09:23.298775 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:23.443384 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Updating instance_info_cache with network_info: [{"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:23.790354 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:09:23.790819 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:09:23.790819 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] No VIF found with MAC fa:16:3e:a9:da:0b, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:09:23.791405 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Using config drive
May 27 03:09:23.857731 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0005309680000209482 future=<Future at 0x7557241caf60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:09:23.858183 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:09:23.859210 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Emitting event <LifecycleEvent: 1779851348.8570752, 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:09:23.859502 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] VM Stopped (Lifecycle Event)
May 27 03:09:23.949120 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Releasing lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:09:23.949120 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Instance network_info: |[{"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:09:23.949120 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Start _get_guest_xml network_info=[{"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:09:23.951872 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:09:23.953675 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-2112501231', uuid='408047d8-a3ab-415c-a667-204e70271bed'), owner=OwnerMeta(userid='1c72d670892e44d88e674c9b584bc718', username='tempest-AttachVolumeShelveTestJSON-1364873533-project-member', projectid='c547b519adf248728dfd0b2232bfc118', projectname='tempest-AttachVolumeShelveTestJSON-1364873533'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851363.9527094) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:09:23.954927 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:09:23.955341 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:09:23.956618 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:09:23.956910 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:09:23.957977 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:09:23.958311 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:09:23.958514 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:09:23.958666 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:09:23.958968 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:09:23.958968 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:09:23.958968 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:09:23.959119 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:09:23.959218 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:09:23.959362 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:09:23.959489 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:09:23.959635 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:09:23.978257 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:09:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2112501231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumeshelvetestjson-server-2112501231',id=59,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFU7vN92ZF7VnROzhJNF86Ad9eDOUXP7NQOeW8Q3Nkb8EhsbNJ0sXFrodZbo2Slzc36KeZpxVAsNnnRCiblv7iLv8OuH7fL7sux63j2sKxs7j6cMBNVGXPF7Mni6bSHLsw==',key_name='tempest-keypair-495903838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c547b519adf248728dfd0b2232bfc118',ramdisk_id='',reservation_id='r-yz7ee0f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1364873533',owner_user_name='tempest-AttachVolumeShelveTestJSON-1364873533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:09:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c72d670892e44d88e674c9b584bc718',uuid=408047d8-a3ab-415c-a667-204e70271bed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:09:23.978412 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converting VIF {"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:09:23.979045 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=9b975543-7a67-4aef-a074-e8748cdcbc87,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b975543-7a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:09:23.979589 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'pci_devices' on Instance uuid 408047d8-a3ab-415c-a667-204e70271bed {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:09:24.299353 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:24.364210 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 6d2aaee0-abaa-4fd0-9ff8-9ad427cdb4ef] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:09:24.480887 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Creating config drive at /opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk.config
May 27 03:09:24.483000 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] End _get_guest_xml xml=<domain type="qemu">
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:   <uuid>408047d8-a3ab-415c-a667-204e70271bed</uuid>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:   <name>instance-0000003b</name>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2112501231</nova:name>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:09:23</nova:creationTime>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:         <nova:user uuid="1c72d670892e44d88e674c9b584bc718">tempest-AttachVolumeShelveTestJSON-1364873533-project-member</nova:user>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:         <nova:project uuid="c547b519adf248728dfd0b2232bfc118">tempest-AttachVolumeShelveTestJSON-1364873533</nova:project>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:         <nova:port uuid="9b975543-7a67-4aef-a074-e8748cdcbc87">
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     <system>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <entry name="serial">408047d8-a3ab-415c-a667-204e70271bed</entry>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <entry name="uuid">408047d8-a3ab-415c-a667-204e70271bed</entry>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     </system>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:   <os>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:   </os>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:   <features>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:   </features>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:   <devices>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     </disk>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk.config"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     </disk>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:be:ae:e3"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <target dev="tap9b975543-7a"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     </interface>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/console.log" append="off"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     </serial>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     <video>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     </video>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     </rng>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:   </devices>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]: </domain>
May 27 03:09:24.483000 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:09:24.485627 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Preparing to wait for external event network-vif-plugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:09:24.485627 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "408047d8-a3ab-415c-a667-204e70271bed-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:24.485627 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:24.485627 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:24.485627 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:09:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2112501231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumeshelvetestjson-server-2112501231',id=59,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFU7vN92ZF7VnROzhJNF86Ad9eDOUXP7NQOeW8Q3Nkb8EhsbNJ0sXFrodZbo2Slzc36KeZpxVAsNnnRCiblv7iLv8OuH7fL7sux63j2sKxs7j6cMBNVGXPF7Mni6bSHLsw==',key_name='tempest-keypair-495903838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c547b519adf248728dfd0b2232bfc118',ramdisk_id='',reservation_id='r-yz7ee0f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1364873533',owner_user_name='tempest-AttachVolumeShelveTestJSON-1364873533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:09:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c72d670892e44d88e674c9b584bc718',uuid=408047d8-a3ab-415c-a667-204e70271bed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:09:24.485627 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converting VIF {"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:09:24.485627 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=9b975543-7a67-4aef-a074-e8748cdcbc87,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b975543-7a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:09:24.485627 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=9b975543-7a67-4aef-a074-e8748cdcbc87,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b975543-7a') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:09:24.486095 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:24.486140 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:24.486425 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:09:24.487497 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:24.487667 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d076507-624b-52ab-9e58-610d337a3281', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:24.491054 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:09:24.496537 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:24.502818 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:24.502818 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b975543-7a, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:24.502818 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b975543-7a, col_values=(('qos', UUID('62a31c30-29d5-4bc8-9c69-cf807978cf13')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:24.502818 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b975543-7a, col_values=(('external_ids', {'iface-id': '9b975543-7a67-4aef-a074-e8748cdcbc87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:ae:e3', 'vm-uuid': '408047d8-a3ab-415c-a667-204e70271bed'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:24.503716 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:09:24.504960 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn2nzjsdq {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:24.521377 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:24.525961 np0000001475 nova-compute[98471]: INFO os_vif [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=9b975543-7a67-4aef-a074-e8748cdcbc87,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b975543-7a')
May 27 03:09:24.590278 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn2nzjsdq" returned: 0 in 0.085s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:25.104581 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:25.148974 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:25.258903 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:25.347448 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b5dda4ee-5c76-4d8c-a5a6-83e554437a8d req-67d638e9-bcc1-4c2e-84ed-0d9a45623d4f service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Received event network-vif-plugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:25.347448 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b5dda4ee-5c76-4d8c-a5a6-83e554437a8d req-67d638e9-bcc1-4c2e-84ed-0d9a45623d4f service nova] Acquiring lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:25.349441 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b5dda4ee-5c76-4d8c-a5a6-83e554437a8d req-67d638e9-bcc1-4c2e-84ed-0d9a45623d4f service nova] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:25.350343 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b5dda4ee-5c76-4d8c-a5a6-83e554437a8d req-67d638e9-bcc1-4c2e-84ed-0d9a45623d4f service nova] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:25.351191 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b5dda4ee-5c76-4d8c-a5a6-83e554437a8d req-67d638e9-bcc1-4c2e-84ed-0d9a45623d4f service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Processing event network-vif-plugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:09:25.556136 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:25.563948 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:25.567878 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:25.596281 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:25.607767 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:26.065261 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:09:26.065261 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:09:26.066498 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] No VIF found with MAC fa:16:3e:be:ae:e3, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:09:26.066498 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Using config drive
May 27 03:09:26.106440 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:09:26.107046 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851366.1057234, eb7ae482-4f6f-4b54-9923-3657c90de9fa => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:09:26.107046 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] VM Started (Lifecycle Event)
May 27 03:09:26.115023 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:09:26.115023 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Instance spawned successfully.
May 27 03:09:26.115565 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:09:26.389722 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:26.573428 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:26.609707 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:09:26.614086 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:09:26.622369 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:26.622524 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:26.622852 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:26.623115 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:26.623419 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:26.623754 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:26.770025 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Creating config drive at /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk.config
May 27 03:09:26.774783 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg3refsw2 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:26.854393 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpg3refsw2" returned: 0 in 0.079s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:27.116846 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:09:27.117433 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851367.1169775, eb7ae482-4f6f-4b54-9923-3657c90de9fa => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:09:27.117433 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] VM Paused (Lifecycle Event)
May 27 03:09:27.129523 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Took 7.56 seconds to spawn the instance on the hypervisor.
May 27 03:09:27.131065 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:09:27.368767 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:27.402943 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:27.480365 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-aa272315-0e61-46ff-af78-de17b6f87707 req-2ead9f70-abf7-4ede-960e-25eba95197fe service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Received event network-vif-plugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:27.480682 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa272315-0e61-46ff-af78-de17b6f87707 req-2ead9f70-abf7-4ede-960e-25eba95197fe service nova] Acquiring lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:27.480941 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa272315-0e61-46ff-af78-de17b6f87707 req-2ead9f70-abf7-4ede-960e-25eba95197fe service nova] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:27.482834 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa272315-0e61-46ff-af78-de17b6f87707 req-2ead9f70-abf7-4ede-960e-25eba95197fe service nova] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:27.482834 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-aa272315-0e61-46ff-af78-de17b6f87707 req-2ead9f70-abf7-4ede-960e-25eba95197fe service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] No waiting events found dispatching network-vif-plugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:09:27.482834 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-aa272315-0e61-46ff-af78-de17b6f87707 req-2ead9f70-abf7-4ede-960e-25eba95197fe service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Received unexpected event network-vif-plugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a for instance with vm_state active and task_state None.
May 27 03:09:27.527781 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:27.620593 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:09:27.625245 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851367.6249862, eb7ae482-4f6f-4b54-9923-3657c90de9fa => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:09:27.625409 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] VM Resumed (Lifecycle Event)
May 27 03:09:27.643265 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Took 13.86 seconds to build instance.
May 27 03:09:27.842348 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:27.846628 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:27.848092 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:27.879613 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:28.129809 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:09:28.134325 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:09:28.145984 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92365850-5b2c-41e7-9bab-a51e79d248b0 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.375s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:28.640696 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851368.6402123, 408047d8-a3ab-415c-a667-204e70271bed => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:09:28.640873 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 408047d8-a3ab-415c-a667-204e70271bed] VM Started (Lifecycle Event)
May 27 03:09:29.014949 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-82fde2aa-61f7-4092-b76a-8d1d6b688a40 req-7bf041e8-9379-4d36-85d8-927209245979 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Received event network-changed-40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:29.017114 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-82fde2aa-61f7-4092-b76a-8d1d6b688a40 req-7bf041e8-9379-4d36-85d8-927209245979 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Refreshing instance network info cache due to event network-changed-40e38c63-6edf-4ebd-bd43-48e853f0c67a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:09:29.017114 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-82fde2aa-61f7-4092-b76a-8d1d6b688a40 req-7bf041e8-9379-4d36-85d8-927209245979 service nova] Acquiring lock "refresh_cache-eb7ae482-4f6f-4b54-9923-3657c90de9fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:09:29.017114 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-82fde2aa-61f7-4092-b76a-8d1d6b688a40 req-7bf041e8-9379-4d36-85d8-927209245979 service nova] Acquired lock "refresh_cache-eb7ae482-4f6f-4b54-9923-3657c90de9fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:09:29.017114 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-82fde2aa-61f7-4092-b76a-8d1d6b688a40 req-7bf041e8-9379-4d36-85d8-927209245979 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Refreshing network info cache for port 40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:09:29.143767 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:09:29.147222 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851369.1469069, 408047d8-a3ab-415c-a667-204e70271bed => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:09:29.147447 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 408047d8-a3ab-415c-a667-204e70271bed] VM Paused (Lifecycle Event)
May 27 03:09:29.501492 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:29.519782 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-82fde2aa-61f7-4092-b76a-8d1d6b688a40 req-7bf041e8-9379-4d36-85d8-927209245979 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:29.582418 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-cc171aa0-9c0e-40a1-94c7-4ebb3b8917f8 req-09501375-2c6b-4ee5-8092-93b9e73c7b40 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-vif-plugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:29.582648 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cc171aa0-9c0e-40a1-94c7-4ebb3b8917f8 req-09501375-2c6b-4ee5-8092-93b9e73c7b40 service nova] Acquiring lock "408047d8-a3ab-415c-a667-204e70271bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:29.582901 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cc171aa0-9c0e-40a1-94c7-4ebb3b8917f8 req-09501375-2c6b-4ee5-8092-93b9e73c7b40 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:29.583072 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cc171aa0-9c0e-40a1-94c7-4ebb3b8917f8 req-09501375-2c6b-4ee5-8092-93b9e73c7b40 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:29.583243 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-cc171aa0-9c0e-40a1-94c7-4ebb3b8917f8 req-09501375-2c6b-4ee5-8092-93b9e73c7b40 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Processing event network-vif-plugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:09:29.583548 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-cc171aa0-9c0e-40a1-94c7-4ebb3b8917f8 req-09501375-2c6b-4ee5-8092-93b9e73c7b40 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-vif-plugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:29.583750 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cc171aa0-9c0e-40a1-94c7-4ebb3b8917f8 req-09501375-2c6b-4ee5-8092-93b9e73c7b40 service nova] Acquiring lock "408047d8-a3ab-415c-a667-204e70271bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:29.583936 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cc171aa0-9c0e-40a1-94c7-4ebb3b8917f8 req-09501375-2c6b-4ee5-8092-93b9e73c7b40 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:29.584073 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cc171aa0-9c0e-40a1-94c7-4ebb3b8917f8 req-09501375-2c6b-4ee5-8092-93b9e73c7b40 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:29.584216 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-cc171aa0-9c0e-40a1-94c7-4ebb3b8917f8 req-09501375-2c6b-4ee5-8092-93b9e73c7b40 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] No waiting events found dispatching network-vif-plugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:09:29.584357 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-cc171aa0-9c0e-40a1-94c7-4ebb3b8917f8 req-09501375-2c6b-4ee5-8092-93b9e73c7b40 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received unexpected event network-vif-plugged-9b975543-7a67-4aef-a074-e8748cdcbc87 for instance with vm_state building and task_state spawning.
May 27 03:09:29.586150 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:09:29.592364 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:09:29.595372 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Instance spawned successfully.
May 27 03:09:29.595672 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:09:29.650552 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:09:29.658463 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851369.6561277, 408047d8-a3ab-415c-a667-204e70271bed => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:09:29.658463 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 408047d8-a3ab-415c-a667-204e70271bed] VM Resumed (Lifecycle Event)
May 27 03:09:29.930596 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-82fde2aa-61f7-4092-b76a-8d1d6b688a40 req-7bf041e8-9379-4d36-85d8-927209245979 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:30.112936 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:30.112936 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:30.112936 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:30.112936 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:30.112936 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:30.112936 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:30.149086 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-82fde2aa-61f7-4092-b76a-8d1d6b688a40 req-7bf041e8-9379-4d36-85d8-927209245979 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Updated VIF entry in instance network info cache for port 40e38c63-6edf-4ebd-bd43-48e853f0c67a. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:09:30.149988 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-82fde2aa-61f7-4092-b76a-8d1d6b688a40 req-7bf041e8-9379-4d36-85d8-927209245979 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Updating instance_info_cache with network_info: [{"id": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "address": "fa:16:3e:a9:da:0b", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e38c63-6e", "ovs_interfaceid": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:30.160457 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:09:30.166277 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:09:30.621531 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Took 8.55 seconds to spawn the instance on the hypervisor.
May 27 03:09:30.621821 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:09:30.654751 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-82fde2aa-61f7-4092-b76a-8d1d6b688a40 req-7bf041e8-9379-4d36-85d8-927209245979 service nova] Releasing lock "refresh_cache-eb7ae482-4f6f-4b54-9923-3657c90de9fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:09:30.674883 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 408047d8-a3ab-415c-a667-204e70271bed] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:09:30.691034 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:30.691639 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:31.138561 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Took 14.27 seconds to build instance.
May 27 03:09:31.199100 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lazy-loading 'flavor' on Instance uuid 254dc58c-6b2f-4350-bea3-5c74d571ed2c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:09:31.394977 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:31.546047 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "828da6e6-d3a5-4f1b-bc96-683db4633520" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:31.546263 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "828da6e6-d3a5-4f1b-bc96-683db4633520" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:31.639657 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7090df44-6b2c-4256-81f0-a884100aa591 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "408047d8-a3ab-415c-a667-204e70271bed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.786s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:32.050047 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:09:32.205627 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:32.461093 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-90a7bd54-572b-47a0-b507-28e4c0d1f812 req-9a64b426-f4a7-464a-8f70-57e7b778b5a3 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-changed-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:32.461265 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-90a7bd54-572b-47a0-b507-28e4c0d1f812 req-9a64b426-f4a7-464a-8f70-57e7b778b5a3 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Refreshing instance network info cache due to event network-changed-9b975543-7a67-4aef-a074-e8748cdcbc87. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:09:32.461570 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-90a7bd54-572b-47a0-b507-28e4c0d1f812 req-9a64b426-f4a7-464a-8f70-57e7b778b5a3 service nova] Acquiring lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:09:32.461755 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-90a7bd54-572b-47a0-b507-28e4c0d1f812 req-9a64b426-f4a7-464a-8f70-57e7b778b5a3 service nova] Acquired lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:09:32.461913 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-90a7bd54-572b-47a0-b507-28e4c0d1f812 req-9a64b426-f4a7-464a-8f70-57e7b778b5a3 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Refreshing network info cache for port 9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:09:32.618128 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:32.619623 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:32.624668 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:09:32.624668 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Claim successful on node np0000001475
May 27 03:09:32.964137 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-90a7bd54-572b-47a0-b507-28e4c0d1f812 req-9a64b426-f4a7-464a-8f70-57e7b778b5a3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:33.386768 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:33.386768 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:33.386768 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Attaching volume 70c1fb03-3450-4fb8-90f6-348981e1c7a6 to /dev/vdb
May 27 03:09:33.390405 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-90a7bd54-572b-47a0-b507-28e4c0d1f812 req-9a64b426-f4a7-464a-8f70-57e7b778b5a3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:33.471770 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:09:33.485589 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:09:33.516785 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:33.571837 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:09:33.572816 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:09:33.585765 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:09:33.587782 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fedf:3ab8', 'fe80::7427:32ff:fe97:df09', 'fe80::fc16:3eff:fe21:cfcf', 'fe80::58d4:6eff:fe81:c6fc', 'fe80::fc16:3eff:fe43:6208', 'fe80::fc16:3eff:fe31:74b7', 'fe80::fc16:3eff:fe0b:5549', 'fe80::406:77ff:fe4a:f4f9', 'fe80::fc16:3eff:fe4e:ebe1', 'fe80::fc16:3eff:fea9:da0b', 'fe80::bc95:85ff:fe5a:dff6', 'fe80::fc16:3eff:febe:aee3', 'fe80::d018:f2ff:feb0:9e2b'] 
May 27 03:09:33.588020 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:09:33.588185 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:09:33.588629 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:09:33.588976 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Updating existing volume attachment record: ee4576d3-7fa4-4293-ba97-6edd217822c6 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:09:33.608184 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-90a7bd54-572b-47a0-b507-28e4c0d1f812 req-9a64b426-f4a7-464a-8f70-57e7b778b5a3 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Updated VIF entry in instance network info cache for port 9b975543-7a67-4aef-a074-e8748cdcbc87. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:09:33.608474 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-90a7bd54-572b-47a0-b507-28e4c0d1f812 req-9a64b426-f4a7-464a-8f70-57e7b778b5a3 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Updating instance_info_cache with network_info: [{"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:34.111394 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-90a7bd54-572b-47a0-b507-28e4c0d1f812 req-9a64b426-f4a7-464a-8f70-57e7b778b5a3 service nova] Releasing lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:09:34.144993 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:09:34.145492 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6', 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70c1fb03-3450-4fb8-90f6-348981e1c7a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:09:34.145823 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:09:34.146350 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:09:34.146708 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6', 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70c1fb03-3450-4fb8-90f6-348981e1c7a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:09:34.161914 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:09:34.163457 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:09:34.163669 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:09:34.164974 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:09:34.165593 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:09:34.166098 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:09:34.183481 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:09:34.183481 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:34.191838 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:09:34.192320 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:09:34.197550 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:09:34.197550 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:34.208312 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6] added
May 27 03:09:34.208312 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:09:34.208312 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:09:34.208312 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:09:34.208312 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:09:34.208312 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:09:34.208312 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:34.208735 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:09:34.209053 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0454(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:09:34.209372 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:09:34.214609 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6] added
May 27 03:09:34.214609 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:09:34.214609 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:09:34.214609 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:09:34.214609 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:09:34.214609 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:09:34.214609 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:34.214973 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:09:34.215015 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0492(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:09:34.215124 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:09:34.505769 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:34.698936 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:09:35.211115 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:09:35.211568 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.593s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:35.212021 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:09:35.217201 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:09:35.222948 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:09:35.222948 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:09:35.242287 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:09:35.242287 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:35.252075 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:35.262054 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:35.276348 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:35.276348 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:35.276348 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:35.276348 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:35.276348 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:35.276348 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:35.276348 np0000001475 nova-compute[98471]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcbb7e8f-6e9e-49f1-b89e-f3369250dfb2 (non-flash)
May 27 03:09:35.276348 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:35.276348 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:09:35.276784 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:35.276784 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:35.276784 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:35.276784 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:35.276784 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:35.276784 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:35.276784 np0000001475 nova-compute[98471]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcbb7e8f-6e9e-49f1-b89e-f3369250dfb2 (non-flash)
May 27 03:09:35.276784 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:35.276784 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:09:35.289329 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:35.289329 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:35.289329 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:35.289329 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:35.289329 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:35.289329 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:35.289329 np0000001475 nova-compute[98471]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcbb7e8f-6e9e-49f1-b89e-f3369250dfb2 (non-flash)
May 27 03:09:35.289329 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:35.289329 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:09:35.289782 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:35.289782 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:35.289782 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:35.289782 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:35.289782 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:35.289782 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:35.289782 np0000001475 nova-compute[98471]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcbb7e8f-6e9e-49f1-b89e-f3369250dfb2 (non-flash)
May 27 03:09:35.289782 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:35.289782 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:09:35.343200 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6, portal: 192.168.50.100,3260]
May 27 03:09:35.343200 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6, portal: 192.168.50.100,3260] successful.
May 27 03:09:35.343200 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:35.361451 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6, portal: 192.168.40.100,3260]
May 27 03:09:35.361451 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6, portal: 192.168.40.100,3260] successful.
May 27 03:09:35.361451 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:35.368295 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:35.380611 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:35.392542 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:35.392542 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:35.392542 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:35.392542 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:35.392542 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:35.392542 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:35.392542 np0000001475 nova-compute[98471]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcbb7e8f-6e9e-49f1-b89e-f3369250dfb2 (non-flash)
May 27 03:09:35.392542 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:35.392542 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:35.392542 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:35.392542 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:09:35.392975 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:35.392975 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:35.392975 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:35.392975 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:35.392975 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:35.392975 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:35.392975 np0000001475 nova-compute[98471]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcbb7e8f-6e9e-49f1-b89e-f3369250dfb2 (non-flash)
May 27 03:09:35.392975 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:35.392975 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:35.392975 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:35.392975 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:09:35.393329 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.228s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:09:35.393329 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:09:35.394767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] HCTL ('10', '-', '-', 0) found on session 139 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:09:35.394943 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcbb7e8f-6e9e-49f1-b89e-f3369250dfb2 (non-flash)
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:35.405442 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcbb7e8f-6e9e-49f1-b89e-f3369250dfb2 (non-flash)
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:35.405442 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.242s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:09:35.405442 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:09:35.408591 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] HCTL ('11', '-', '-', 0) found on session 140 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:09:35.408591 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:09:35.435948 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Searching for a device in session 140 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:09:35.435948 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70c1fb03-3450-4fb8-90f6-348981e1c7a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:09:35.437306 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Searching for a device in session 139 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:09:35.438179 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '70c1fb03-3450-4fb8-90f6-348981e1c7a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:09:35.719782 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:09:35.720397 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:09:35.720765 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:35.721116 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:35.832767 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '358594214f7a4c71a13200be75c799cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0810d45b82c0476db38b1cabf8579ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:09:36.166271 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:09:36.228577 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:09:36.340203 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Successfully created port: 15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:09:36.392323 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:36.730648 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:09:36.969472 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Successfully updated port: 15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:09:37.015372 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2a59a66f-e505-4a2a-ae37-c8a485fa1ecd req-ce8af682-516b-4106-bc5a-5ccf16cb62ef service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Received event network-changed-15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:37.015515 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2a59a66f-e505-4a2a-ae37-c8a485fa1ecd req-ce8af682-516b-4106-bc5a-5ccf16cb62ef service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Refreshing instance network info cache due to event network-changed-15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:09:37.015660 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2a59a66f-e505-4a2a-ae37-c8a485fa1ecd req-ce8af682-516b-4106-bc5a-5ccf16cb62ef service nova] Acquiring lock "refresh_cache-828da6e6-d3a5-4f1b-bc96-683db4633520" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:09:37.015791 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2a59a66f-e505-4a2a-ae37-c8a485fa1ecd req-ce8af682-516b-4106-bc5a-5ccf16cb62ef service nova] Acquired lock "refresh_cache-828da6e6-d3a5-4f1b-bc96-683db4633520" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:09:37.015961 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-2a59a66f-e505-4a2a-ae37-c8a485fa1ecd req-ce8af682-516b-4106-bc5a-5ccf16cb62ef service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Refreshing network info cache for port 15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:09:37.183095 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Found WWN 33000000062a9dc45 for multipath device dm-3 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:09:37.184203 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:09:37.184203 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '33000000062a9dc45', 'path': '/dev/dm-3', 'multipath_id': '33000000062a9dc45'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:09:37.184203 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000062a9dc45', 'path': '/dev/dm-3', 'multipath_id': '33000000062a9dc45'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:09:37.186694 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lazy-loading 'flavor' on Instance uuid 254dc58c-6b2f-4350-bea3-5c74d571ed2c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:09:37.237053 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Booting with volume 59f2d7b6-b715-4513-85ca-6003f024560c at /dev/vda
May 27 03:09:37.307559 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:09:37.322851 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:09:37.353558 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:37.413149 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:09:37.413508 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:09:37.425845 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:09:37.427573 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fedf:3ab8', 'fe80::7427:32ff:fe97:df09', 'fe80::fc16:3eff:fe21:cfcf', 'fe80::58d4:6eff:fe81:c6fc', 'fe80::fc16:3eff:fe43:6208', 'fe80::fc16:3eff:fe31:74b7', 'fe80::fc16:3eff:fe0b:5549', 'fe80::406:77ff:fe4a:f4f9', 'fe80::fc16:3eff:fe4e:ebe1', 'fe80::fc16:3eff:fea9:da0b', 'fe80::bc95:85ff:fe5a:dff6', 'fe80::fc16:3eff:febe:aee3', 'fe80::d018:f2ff:feb0:9e2b'] 
May 27 03:09:37.427757 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:09:37.428057 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:09:37.428398 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:09:37.429155 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Updating existing volume attachment record: fb337e94-9b9d-4aea-b3c0-6fd1f77163f1 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:09:37.474019 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "refresh_cache-828da6e6-d3a5-4f1b-bc96-683db4633520" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:09:37.521036 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-2a59a66f-e505-4a2a-ae37-c8a485fa1ecd req-ce8af682-516b-4106-bc5a-5ccf16cb62ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:37.621412 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-2a59a66f-e505-4a2a-ae37-c8a485fa1ecd req-ce8af682-516b-4106-bc5a-5ccf16cb62ef service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:09:37.691406 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Attempting to attach volume 70c1fb03-3450-4fb8-90f6-348981e1c7a6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:09:37.701046 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:09:37.701046 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:09:37.701046 np0000001475 nova-compute[98471]:   <alias name="ua-70c1fb03-3450-4fb8-90f6-348981e1c7a6"/>
May 27 03:09:37.701046 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:09:37.701046 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:09:37.701046 np0000001475 nova-compute[98471]:   <serial>70c1fb03-3450-4fb8-90f6-348981e1c7a6</serial>
May 27 03:09:37.701046 np0000001475 nova-compute[98471]: </disk>
May 27 03:09:37.701046 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:09:37.900302 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-2a59a66f-e505-4a2a-ae37-c8a485fa1ecd req-ce8af682-516b-4106-bc5a-5ccf16cb62ef service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:38.403484 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2a59a66f-e505-4a2a-ae37-c8a485fa1ecd req-ce8af682-516b-4106-bc5a-5ccf16cb62ef service nova] Releasing lock "refresh_cache-828da6e6-d3a5-4f1b-bc96-683db4633520" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:09:38.406076 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquired lock "refresh_cache-828da6e6-d3a5-4f1b-bc96-683db4633520" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:09:38.406273 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:09:38.995078 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:09:39.202525 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:09:39.208202 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:39.329187 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Acquiring lock "bfade827-2998-4fe5-b4d4-3397233e8c14" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:39.329187 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "bfade827-2998-4fe5-b4d4-3397233e8c14" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:39.404572 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:09:39.404809 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:09:39.404970 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:09:39.405153 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] No VIF found with MAC fa:16:3e:31:74:b7, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:09:39.445684 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Updating instance_info_cache with network_info: [{"id": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "address": "fa:16:3e:fe:bf:f2", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a1a2c0-c4", "ovs_interfaceid": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:39.505249 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:39.582059 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:09:39.582059 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:09:39.582452 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Creating image(s)
May 27 03:09:39.582611 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:09:39.582806 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Ensure instance console log exists: /opt/stack/data/nova/instances/828da6e6-d3a5-4f1b-bc96-683db4633520/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:09:39.583027 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:39.583179 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:39.583335 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:39.714438 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:09:39.831901 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lazy-loading 'flavor' on Instance uuid bfade827-2998-4fe5-b4d4-3397233e8c14 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:09:39.949035 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Releasing lock "refresh_cache-828da6e6-d3a5-4f1b-bc96-683db4633520" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:09:39.949468 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Instance network_info: |[{"id": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "address": "fa:16:3e:fe:bf:f2", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a1a2c0-c4", "ovs_interfaceid": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:09:39.950338 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Start _get_guest_xml network_info=[{"id": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "address": "fa:16:3e:fe:bf:f2", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a1a2c0-c4", "ovs_interfaceid": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59f2d7b6-b715-4513-85ca-6003f024560c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '828da6e6-d3a5-4f1b-bc96-683db4633520', 'attached_at': '', 'detached_at': '', 'volume_id': '59f2d7b6-b715-4513-85ca-6003f024560c', 'serial': '59f2d7b6-b715-4513-85ca-6003f024560c'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'fb337e94-9b9d-4aea-b3c0-6fd1f77163f1', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:09:39.954140 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:09:39.956044 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-135318181', uuid='828da6e6-d3a5-4f1b-bc96-683db4633520'), owner=OwnerMeta(userid='358594214f7a4c71a13200be75c799cc', username='tempest-TestEncryptedCinderVolumes-913342494-project-member', projectid='0810d45b82c0476db38b1cabf8579ae1', projectname='tempest-TestEncryptedCinderVolumes-913342494'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "address": "fa:16:3e:fe:bf:f2", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a1a2c0-c4", "ovs_interfaceid": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851379.9555607) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:09:39.958686 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:09:39.959177 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:09:39.960554 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:09:39.960994 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:09:39.962351 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:09:39.962775 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:09:39.963516 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:09:39.963516 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:09:39.964273 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:09:39.964551 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:09:39.964709 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:09:39.965026 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:09:39.965182 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:09:39.965344 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:09:39.965497 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:09:39.965678 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:09:39.981152 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:09:39.982377 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59f2d7b6-b715-4513-85ca-6003f024560c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:09:39.982377 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:09:39.983761 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:09:39.983761 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59f2d7b6-b715-4513-85ca-6003f024560c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:09:40.002275 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:09:40.002923 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:09:40.003947 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:09:40.003947 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:09:40.004210 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:09:40.004510 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:09:40.019108 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:09:40.019108 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:40.026037 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:09:40.026037 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:40.034516 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c] added
May 27 03:09:40.034516 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:09:40.034516 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:09:40.034516 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:09:40.034516 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:09:40.034516 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:09:40.034516 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:40.034835 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:09:40.034939 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0304(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:09:40.035053 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:09:40.041785 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c] added
May 27 03:09:40.041785 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:09:40.041785 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:09:40.041785 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:09:40.041785 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:09:40.041785 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:09:40.041785 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:40.041785 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:09:40.041785 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0377(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:09:40.041785 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:09:40.837089 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "bfade827-2998-4fe5-b4d4-3397233e8c14" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:40.980532 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d5b633af-e6b4-469e-aea2-90424ae62fb0 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.595s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:41.035497 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:09:41.042125 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:09:41.052978 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:09:41.052978 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:09:41.062774 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:09:41.062774 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:41.076915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:41.081373 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:41.096765 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:41.096765 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:41.096765 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:41.096765 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:41.096765 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:41.096765 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:41.096765 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:41.096765 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:41.096765 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:41.096765 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:09:41.096765 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:41.096765 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:41.096765 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:41.096765 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:41.096765 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:41.096765 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:41.096765 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:41.096765 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:41.096765 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:41.096765 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:09:41.100817 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:41.100817 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:41.100817 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:41.100817 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:41.100817 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:41.100817 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:41.100817 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:41.100817 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:41.100817 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:41.100817 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:09:41.101249 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:41.101249 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:41.101249 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:41.101249 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:41.101249 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:41.101249 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:41.101249 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:41.101249 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:41.101249 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:41.101249 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:09:41.144240 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c, portal: 192.168.50.100,3260]
May 27 03:09:41.144240 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c, portal: 192.168.50.100,3260] successful.
May 27 03:09:41.144240 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:41.154005 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c, portal: 192.168.40.100,3260]
May 27 03:09:41.154005 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c, portal: 192.168.40.100,3260] successful.
May 27 03:09:41.154005 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:41.159865 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:41.167528 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:41.185044 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:41.185044 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:41.185044 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:41.185044 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:41.185044 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:41.185044 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:41.185044 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:41.185044 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:41.185044 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:41.185044 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:41.185044 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:41.185044 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:09:41.185425 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:41.185425 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:41.185425 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:41.185425 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:41.185425 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:41.185425 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:41.185425 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:41.185425 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:41.185425 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:41.185425 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:41.185425 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:41.185425 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:09:41.185855 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:09:41.186156 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:09:41.186439 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:41.186439 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:41.186439 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:41.186439 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:41.186439 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:41.186439 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:41.186439 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:41.186439 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:41.186439 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:41.186439 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:41.186439 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:41.186439 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:09:41.186666 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:41.186666 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:41.186666 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:41.186666 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:41.186666 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:41.186666 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:41.186666 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:41.186666 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:41.186666 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:41.186666 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:41.186666 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:41.186666 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:09:41.187262 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:09:41.187552 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:09:41.189026 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] HCTL ('14', '-', '-', 0) found on session 141 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:09:41.189157 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:09:41.190101 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] HCTL ('15', '-', '-', 0) found on session 142 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:09:41.190254 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:09:41.214906 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Searching for a device in session 142 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:09:41.214906 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59f2d7b6-b715-4513-85ca-6003f024560c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:09:41.219402 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Searching for a device in session 141 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:09:41.219402 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '59f2d7b6-b715-4513-85ca-6003f024560c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:09:41.396754 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:41.715770 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:09:41.715770 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:09:41.715770 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.49 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:09:41.944952 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Acquiring lock "bfade827-2998-4fe5-b4d4-3397233e8c14" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:41.945152 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "bfade827-2998-4fe5-b4d4-3397233e8c14" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:41.945378 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Attaching volume d727d4c1-a231-454f-9b40-1b16e92a9bc7 to /dev/vdb
May 27 03:09:41.996435 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:09:42.004236 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:09:42.008983 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:09:42.034541 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:42.093852 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:09:42.094374 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:09:42.105369 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:09:42.107423 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fedf:3ab8', 'fe80::7427:32ff:fe97:df09', 'fe80::fc16:3eff:fe21:cfcf', 'fe80::58d4:6eff:fe81:c6fc', 'fe80::fc16:3eff:fe43:6208', 'fe80::fc16:3eff:fe31:74b7', 'fe80::fc16:3eff:fe0b:5549', 'fe80::406:77ff:fe4a:f4f9', 'fe80::fc16:3eff:fe4e:ebe1', 'fe80::fc16:3eff:fea9:da0b', 'fe80::bc95:85ff:fe5a:dff6', 'fe80::fc16:3eff:febe:aee3', 'fe80::d018:f2ff:feb0:9e2b'] 
May 27 03:09:42.107594 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:09:42.109357 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:09:42.110791 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:09:42.111819 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Updating existing volume attachment record: 97dda035-b7ec-446d-897c-cf412d81bc29 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:09:42.703290 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:09:42.703796 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7', 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd727d4c1-a231-454f-9b40-1b16e92a9bc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:09:42.703972 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:09:43.022822 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Found WWN 330000000961065fe for multipath device dm-7 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:09:43.027702 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:09:43.030729 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.327s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:09:43.030963 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7', 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd727d4c1-a231-454f-9b40-1b16e92a9bc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:09:43.033864 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] <== connect_volume: return (3051ms) {'type': 'block', 'scsi_wwn': '330000000961065fe', 'path': '/dev/disk/by-id/os-brick+dev+dm-7', 'multipath_id': '330000000961065fe'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:09:43.033864 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000961065fe', 'path': '/dev/disk/by-id/os-brick+dev+dm-7', 'multipath_id': '330000000961065fe'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:09:43.051693 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:09:43.052365 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:09:43.053098 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:09:43.053529 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:09:43.054090 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:09:43.054328 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:09:43.067371 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:09:43.067371 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:43.077706 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:09:43.077706 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:43.081130 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59f2d7b6-b715-4513-85ca-6003f024560c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-7'}, 'status': 'reserved', 'instance': '828da6e6-d3a5-4f1b-bc96-683db4633520', 'attached_at': '', 'detached_at': '', 'volume_id': '59f2d7b6-b715-4513-85ca-6003f024560c', 'serial': '59f2d7b6-b715-4513-85ca-6003f024560c'} {{(pid=98471) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 03:09:43.081828 np0000001475 nova-compute[98471]: WARNING stevedore.named [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 03:09:43.081994 np0000001475 nova-compute[98471]: WARNING castellan.key_manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:09:43.082153 np0000001475 nova-compute[98471]: WARNING nova.keymgr.conf_key_mgr [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:09:43.090828 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7] added
May 27 03:09:43.090828 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:09:43.090828 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:09:43.090828 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:09:43.090828 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:09:43.090828 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:09:43.090828 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:43.091099 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:09:43.091266 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0369(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:09:43.091412 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:09:43.097950 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7] added
May 27 03:09:43.097950 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:09:43.097950 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:09:43.097950 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:09:43.097950 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:09:43.097950 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:09:43.097950 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:43.098509 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:09:43.099381 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0457(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:09:43.100634 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:09:43.107246 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Secret XML: <secret ephemeral="no" private="no">
May 27 03:09:43.107246 np0000001475 nova-compute[98471]:   <usage type="volume">
May 27 03:09:43.107246 np0000001475 nova-compute[98471]:     <volume>59f2d7b6-b715-4513-85ca-6003f024560c</volume>
May 27 03:09:43.107246 np0000001475 nova-compute[98471]:   </usage>
May 27 03:09:43.107246 np0000001475 nova-compute[98471]: </secret>
May 27 03:09:43.107246 np0000001475 nova-compute[98471]:  {{(pid=98471) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 27 03:09:43.629409 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:09:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-135318181',display_name='tempest-TestEncryptedCinderVolumes-server-135318181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testencryptedcindervolumes-server-135318181',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsKE8mApOuH6pQpMeoaM1711p44BdU5w63deegp3kTmD9SDXsbd+S4T7tQJxMwMSGixch3LkbnnDZXpLGGTHeoe63rCS6XTN2kyvsWQlISndr8KsTd/l4xT3HCDOGuK4Q==',key_name='tempest-TestEncryptedCinderVolumes-1532145403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0810d45b82c0476db38b1cabf8579ae1',ramdisk_id='',reservation_id='r-7s3znki8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-913342494',owner_user_name='tempest-TestEncryptedCinderVolumes-913342494-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:09:37Z,user_data=None,user_id='358594214f7a4c71a13200be75c799cc',uuid=828da6e6-d3a5-4f1b-bc96-683db4633520,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "address": "fa:16:3e:fe:bf:f2", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a1a2c0-c4", "ovs_interfaceid": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:09:43.629409 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Converting VIF {"id": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "address": "fa:16:3e:fe:bf:f2", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a1a2c0-c4", "ovs_interfaceid": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:09:43.629409 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:bf:f2,bridge_name='br-int',has_traffic_filtering=True,id=15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a1a2c0-c4') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:09:43.635246 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lazy-loading 'pci_devices' on Instance uuid 828da6e6-d3a5-4f1b-bc96-683db4633520 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:09:43.899058 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:43.899257 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:43.899436 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:43.899568 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:43.899710 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:43.902285 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Terminating instance
May 27 03:09:44.091887 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:09:44.101317 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:09:44.108227 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:09:44.108227 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:09:44.115557 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:09:44.115557 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:44.125113 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:44.132737 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:44.141318 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] End _get_guest_xml xml=<domain type="qemu">
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:   <uuid>828da6e6-d3a5-4f1b-bc96-683db4633520</uuid>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:   <name>instance-0000003c</name>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-135318181</nova:name>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:09:39</nova:creationTime>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:         <nova:user uuid="358594214f7a4c71a13200be75c799cc">tempest-TestEncryptedCinderVolumes-913342494-project-member</nova:user>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:         <nova:project uuid="0810d45b82c0476db38b1cabf8579ae1">tempest-TestEncryptedCinderVolumes-913342494</nova:project>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:         <nova:port uuid="15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c">
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     <system>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <entry name="serial">828da6e6-d3a5-4f1b-bc96-683db4633520</entry>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <entry name="uuid">828da6e6-d3a5-4f1b-bc96-683db4633520</entry>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     </system>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:   <os>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:   </os>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:   <features>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:   </features>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:   <devices>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/828da6e6-d3a5-4f1b-bc96-683db4633520/disk.config"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     </disk>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <alias name="ua-59f2d7b6-b715-4513-85ca-6003f024560c"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-7"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <serial>59f2d7b6-b715-4513-85ca-6003f024560c</serial>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <encryption format="luks">
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:         <secret type="passphrase" uuid="48a9621d-d181-4cf8-9da8-6394726fc9a8"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       </encryption>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     </disk>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:fe:bf:f2"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <target dev="tap15a1a2c0-c4"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     </interface>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/828da6e6-d3a5-4f1b-bc96-683db4633520/console.log" append="off"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     </serial>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     <video>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     </video>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     </rng>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:   </devices>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]: </domain>
May 27 03:09:44.141318 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:09:44.141318 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Preparing to wait for external event network-vif-plugged-15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:09:44.143644 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "828da6e6-d3a5-4f1b-bc96-683db4633520-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:44.143644 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "828da6e6-d3a5-4f1b-bc96-683db4633520-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:44.143644 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "828da6e6-d3a5-4f1b-bc96-683db4633520-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:44.143644 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:09:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-135318181',display_name='tempest-TestEncryptedCinderVolumes-server-135318181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testencryptedcindervolumes-server-135318181',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsKE8mApOuH6pQpMeoaM1711p44BdU5w63deegp3kTmD9SDXsbd+S4T7tQJxMwMSGixch3LkbnnDZXpLGGTHeoe63rCS6XTN2kyvsWQlISndr8KsTd/l4xT3HCDOGuK4Q==',key_name='tempest-TestEncryptedCinderVolumes-1532145403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0810d45b82c0476db38b1cabf8579ae1',ramdisk_id='',reservation_id='r-7s3znki8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-913342494',owner_user_name='tempest-TestEncryptedCinderVolumes-913342494-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:09:37Z,user_data=None,user_id='358594214f7a4c71a13200be75c799cc',uuid=828da6e6-d3a5-4f1b-bc96-683db4633520,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "address": "fa:16:3e:fe:bf:f2", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a1a2c0-c4", "ovs_interfaceid": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:09:44.143644 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Converting VIF {"id": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "address": "fa:16:3e:fe:bf:f2", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a1a2c0-c4", "ovs_interfaceid": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:09:44.143644 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:bf:f2,bridge_name='br-int',has_traffic_filtering=True,id=15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a1a2c0-c4') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:09:44.144104 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:bf:f2,bridge_name='br-int',has_traffic_filtering=True,id=15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a1a2c0-c4') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:09:44.144734 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:44.146244 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:44.146244 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:44.146838 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:09:44.149061 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:44.149061 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20d527e8-626e-5791-a99f-5e779252740e', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:44.150423 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:09:44.151117 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:44.153530 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:44.153894 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15a1a2c0-c4, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:44.154890 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15a1a2c0-c4, col_values=(('qos', UUID('e2bafe4a-9147-44b4-b094-ce344b718fb7')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:44.154890 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15a1a2c0-c4, col_values=(('external_ids', {'iface-id': '15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:bf:f2', 'vm-uuid': '828da6e6-d3a5-4f1b-bc96-683db4633520'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:44.156535 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:44.156535 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:09:44.162019 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:44.163856 np0000001475 nova-compute[98471]: INFO os_vif [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:bf:f2,bridge_name='br-int',has_traffic_filtering=True,id=15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a1a2c0-c4')
May 27 03:09:44.164439 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:44.164439 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:44.164439 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:44.164439 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:44.164439 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:44.164439 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:44.164439 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:44.164439 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:44.164439 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:44.164439 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:44.164439 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:44.164439 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:09:44.164858 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:44.164858 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:44.164858 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:44.164858 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:44.164858 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:44.164858 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:44.164858 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:44.164858 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:44.164858 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:44.164858 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:44.164858 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:44.164858 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:09:44.176389 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:44.176389 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:44.224310 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7, portal: 192.168.50.100,3260]
May 27 03:09:44.224310 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7, portal: 192.168.50.100,3260] successful.
May 27 03:09:44.224310 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:44.230886 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7, portal: 192.168.40.100,3260]
May 27 03:09:44.230886 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7, portal: 192.168.40.100,3260] successful.
May 27 03:09:44.230886 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:44.237248 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:44.247731 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:44.263954 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:44.263954 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:44.263954 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:44.263954 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:44.263954 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:44.263954 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:44.263954 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:44.263954 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:44.263954 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:44.263954 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:44.263954 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:44.263954 np0000001475 nova-compute[98471]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7 (non-flash)
May 27 03:09:44.263954 np0000001475 nova-compute[98471]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7 (non-flash)
May 27 03:09:44.263954 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:09:44.264268 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:44.264268 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:44.264268 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:44.264268 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:44.264268 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:44.264268 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:44.264268 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:44.264268 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:44.264268 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:44.264268 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:44.264268 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:44.264268 np0000001475 nova-compute[98471]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7 (non-flash)
May 27 03:09:44.264268 np0000001475 nova-compute[98471]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7 (non-flash)
May 27 03:09:44.264268 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:09:44.264549 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.211s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:09:44.264623 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:09:44.266232 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] HCTL ('17', '-', '-', 0) found on session 143 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:09:44.266368 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:09:44.276086 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:44.276086 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:44.276086 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:44.276086 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:44.276086 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:44.276086 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:44.276086 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:44.276086 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:44.276086 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:44.276086 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:44.276086 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:44.276086 np0000001475 nova-compute[98471]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7 (non-flash)
May 27 03:09:44.276086 np0000001475 nova-compute[98471]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7 (non-flash)
May 27 03:09:44.276086 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:09:44.276733 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:44.276733 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:44.276733 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:44.276733 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:44.276733 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:44.276733 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:44.276733 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:44.276733 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:44.276733 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:44.276733 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:44.276733 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:44.276733 np0000001475 nova-compute[98471]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7 (non-flash)
May 27 03:09:44.276733 np0000001475 nova-compute[98471]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7 (non-flash)
May 27 03:09:44.276733 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:09:44.277551 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.224s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:09:44.278400 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:09:44.286199 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] HCTL ('19', '-', '-', 0) found on session 144 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:09:44.286199 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:09:44.286199 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Searching for a device in session 143 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:09:44.286199 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd727d4c1-a231-454f-9b40-1b16e92a9bc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:09:44.301803 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Searching for a device in session 144 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:09:44.301881 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd727d4c1-a231-454f-9b40-1b16e92a9bc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:09:44.405913 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:09:44.455790 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:44.457817 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:44.484182 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:44.672906 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:44.680013 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-456efb85-cbb9-4fdc-a0af-ffdbfd537bb4 req-4c9e544d-771a-4cc7-8f11-f1ea3771b94f service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Received event network-vif-unplugged-8953edaf-1fde-421e-abaf-16020ef206c4 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:44.682464 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-456efb85-cbb9-4fdc-a0af-ffdbfd537bb4 req-4c9e544d-771a-4cc7-8f11-f1ea3771b94f service nova] Acquiring lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:44.682848 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-456efb85-cbb9-4fdc-a0af-ffdbfd537bb4 req-4c9e544d-771a-4cc7-8f11-f1ea3771b94f service nova] Lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:44.683002 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-456efb85-cbb9-4fdc-a0af-ffdbfd537bb4 req-4c9e544d-771a-4cc7-8f11-f1ea3771b94f service nova] Lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:44.683221 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-456efb85-cbb9-4fdc-a0af-ffdbfd537bb4 req-4c9e544d-771a-4cc7-8f11-f1ea3771b94f service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] No waiting events found dispatching network-vif-unplugged-8953edaf-1fde-421e-abaf-16020ef206c4 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:09:44.683379 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-456efb85-cbb9-4fdc-a0af-ffdbfd537bb4 req-4c9e544d-771a-4cc7-8f11-f1ea3771b94f service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Received event network-vif-unplugged-8953edaf-1fde-421e-abaf-16020ef206c4 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:09:44.683620 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Detaching volume 70c1fb03-3450-4fb8-90f6-348981e1c7a6
May 27 03:09:44.687263 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:44.760249 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999659356999928 future=<Future at 0x7557047e7800 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:09:44.765689 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99428107499989 future=<Future at 0x7557047e7800 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:09:44.765849 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.994031993000135 future=<Future at 0x7557047e7800 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:09:44.772289 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Attempting to driver detach volume 70c1fb03-3450-4fb8-90f6-348981e1c7a6 from mountpoint /dev/vdb
May 27 03:09:44.774009 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Instance destroyed successfully.
May 27 03:09:44.774619 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lazy-loading 'resources' on Instance uuid e1f8d19a-7577-47af-9b2f-fdda2576dbe4 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:09:44.786515 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Found disk vdb by alias ua-70c1fb03-3450-4fb8-90f6-348981e1c7a6 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:09:44.789639 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Found disk vdb by alias ua-70c1fb03-3450-4fb8-90f6-348981e1c7a6 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:09:44.789820 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Attempting to detach device vdb from instance 254dc58c-6b2f-4350-bea3-5c74d571ed2c from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:09:44.790234 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:09:44.790234 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:09:44.790234 np0000001475 nova-compute[98471]:   <alias name="ua-70c1fb03-3450-4fb8-90f6-348981e1c7a6"/>
May 27 03:09:44.790234 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:09:44.790234 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:09:44.790234 np0000001475 nova-compute[98471]:   <serial>70c1fb03-3450-4fb8-90f6-348981e1c7a6</serial>
May 27 03:09:44.790234 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:09:44.790234 np0000001475 nova-compute[98471]: </disk>
May 27 03:09:44.790234 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:09:44.801469 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Successfully detached device vdb from instance 254dc58c-6b2f-4350-bea3-5c74d571ed2c from the persistent domain config.
May 27 03:09:44.801912 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] (1/8): Attempting to detach device vdb with device alias ua-70c1fb03-3450-4fb8-90f6-348981e1c7a6 from instance 254dc58c-6b2f-4350-bea3-5c74d571ed2c from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:09:44.802265 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:09:44.802265 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:09:44.802265 np0000001475 nova-compute[98471]:   <alias name="ua-70c1fb03-3450-4fb8-90f6-348981e1c7a6"/>
May 27 03:09:44.802265 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:09:44.802265 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:09:44.802265 np0000001475 nova-compute[98471]:   <serial>70c1fb03-3450-4fb8-90f6-348981e1c7a6</serial>
May 27 03:09:44.802265 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:09:44.802265 np0000001475 nova-compute[98471]: </disk>
May 27 03:09:44.802265 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:09:45.053417 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:09:45.200583 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:09:45.201064 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:09:45.279955 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:08:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-914506265',display_name='tempest-TestVolumeBootPatternV346-server-914506265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpatternv346-server-914506265',id=57,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwQYd4dc+QV+tewapUIxZ/cUxR0crlcfoYJ4KuC8EVaUI5Sr4ggmKi0tpu5ijwAg/4Xtq0BRDxjuHxhxn0a0SBPRFh8ErpvWBUZbpNhLCwuwOBeuJBPB2bXCPV0NbBzdg==',key_name='tempest-keypair-653561079',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:09:04Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfc9c3d1d60841349d551f2d9874c730',ramdisk_id='',reservation_id='r-b0qh09m9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1509575509',owner_user_name='tempest-TestVolumeBootPatternV346-1509575509-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:09:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32837382cff144e5b70de0a400386d11',uuid=e1f8d19a-7577-47af-9b2f-fdda2576dbe4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8953edaf-1fde-421e-abaf-16020ef206c4", "address": "fa:16:3e:4e:eb:e1", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953edaf-1f", "ovs_interfaceid": "8953edaf-1fde-421e-abaf-16020ef206c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:09:45.280163 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Converting VIF {"id": "8953edaf-1fde-421e-abaf-16020ef206c4", "address": "fa:16:3e:4e:eb:e1", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953edaf-1f", "ovs_interfaceid": "8953edaf-1fde-421e-abaf-16020ef206c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:09:45.280663 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:eb:e1,bridge_name='br-int',has_traffic_filtering=True,id=8953edaf-1fde-421e-abaf-16020ef206c4,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8953edaf-1f') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:09:45.280922 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:eb:e1,bridge_name='br-int',has_traffic_filtering=True,id=8953edaf-1fde-421e-abaf-16020ef206c4,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8953edaf-1f') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:09:45.282272 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:45.282596 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8953edaf-1f, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:45.283718 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:45.284814 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:09:45.291527 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:45.292551 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:45.292822 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34bf9102-19d4-4f4d-b9ab-dbc0da684c2d) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:45.293405 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:45.294075 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:09:45.300298 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:45.302598 np0000001475 nova-compute[98471]: INFO os_vif [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:eb:e1,bridge_name='br-int',has_traffic_filtering=True,id=8953edaf-1fde-421e-abaf-16020ef206c4,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8953edaf-1f')
May 27 03:09:45.306332 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:09:45.306645 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:09:45.306932 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:09:45.585643 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851385.5852468, 254dc58c-6b2f-4350-bea3-5c74d571ed2c => ua-70c1fb03-3450-4fb8-90f6-348981e1c7a6> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:09:45.589132 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-70c1fb03-3450-4fb8-90f6-348981e1c7a6 for instance 254dc58c-6b2f-4350-bea3-5c74d571ed2c {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:09:45.595632 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Successfully detached device vdb from instance 254dc58c-6b2f-4350-bea3-5c74d571ed2c from the live domain config.
May 27 03:09:45.598074 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:09:45.598403 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6', 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70c1fb03-3450-4fb8-90f6-348981e1c7a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:09:45.598640 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:09:45.693918 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:09:45.694100 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:09:45.694259 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] No VIF found with MAC fa:16:3e:fe:bf:f2, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:09:45.694850 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Using config drive
May 27 03:09:46.071930 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Found WWN 330000000af59ba4f for multipath device dm-11 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:09:46.072174 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:09:46.072336 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] <== connect_volume: return (3368ms) {'type': 'block', 'scsi_wwn': '330000000af59ba4f', 'path': '/dev/dm-11', 'multipath_id': '330000000af59ba4f'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:09:46.072460 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000af59ba4f', 'path': '/dev/dm-11', 'multipath_id': '330000000af59ba4f'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:09:46.073121 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.766s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:09:46.073450 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:09:46.073609 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:09:46.077893 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lazy-loading 'flavor' on Instance uuid bfade827-2998-4fe5-b4d4-3397233e8c14 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:09:46.111959 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:46.111959 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:46.111959 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:46.111959 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:46.111959 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:46.111959 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:46.111959 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:46.111959 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:46.111959 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:46.111959 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:46.111959 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:46.111959 np0000001475 nova-compute[98471]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7 (non-flash)
May 27 03:09:46.111959 np0000001475 nova-compute[98471]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7 (non-flash)
May 27 03:09:46.111959 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:09:46.112568 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:46.112568 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:46.112568 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:46.112568 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:46.112568 np0000001475 nova-compute[98471]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:46.112568 np0000001475 nova-compute[98471]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684 (non-flash)
May 27 03:09:46.112568 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:46.112568 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:46.112568 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:46.112568 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:46.112568 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:46.112568 np0000001475 nova-compute[98471]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7 (non-flash)
May 27 03:09:46.112568 np0000001475 nova-compute[98471]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7 (non-flash)
May 27 03:09:46.112568 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:09:46.112568 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', '131'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948', '138'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7', '144')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:09:46.112568 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', '131')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:09:46.114368 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684', '132')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:09:46.115795 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755724686020>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684'): ({'sdm'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:09:46.116093 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Removing multipathed devices sdm, sdk {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:09:46.116497 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Flush multipath device 3300000001f1717d9 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:09:46.174533 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:09:46.205925 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:09:46.207311 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:46.208638 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98471) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 27 03:09:46.224258 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:09:46.276436 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Checking to see if SCSI volumes sdm, sdk have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:09:46.276692 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] SCSI volumes sdm, sdk have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:09:46.278045 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Checking to see if device paths {'sdm', 'sdk'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:09:46.293527 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Device paths {'sdm', 'sdk'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:09:46.293788 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:09:46.311707 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:46.358562 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Creating config drive at /opt/stack/data/nova/instances/828da6e6-d3a5-4f1b-bc96-683db4633520/disk.config
May 27 03:09:46.363695 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 131, target: iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684, portal: 192.168.40.100,3260]
May 27 03:09:46.363695 np0000001475 nova-compute[98471]: Logout of [sid: 131, target: iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684, portal: 192.168.40.100,3260] successful.
May 27 03:09:46.363695 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:46.366711 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/828da6e6-d3a5-4f1b-bc96-683db4633520/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6p1_xcb9 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:09:46.390458 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:46.396420 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:46.404316 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:46.432285 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/828da6e6-d3a5-4f1b-bc96-683db4633520/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6p1_xcb9" returned: 0 in 0.068s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:09:46.446157 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 132, target: iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684, portal: 192.168.50.100,3260]
May 27 03:09:46.446157 np0000001475 nova-compute[98471]: Logout of [sid: 132, target: iqn.2023-03.storpool.com:os--volume-9685c4d3-b54b-4cfd-bf57-a20fa4d6e684, portal: 192.168.50.100,3260] successful.
May 27 03:09:46.446157 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:46.474813 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:46.474813 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:09:46.474813 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] <== disconnect_volume: return (1167ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:09:46.474813 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:09:46.474813 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Deleting instance files /opt/stack/data/nova/instances/e1f8d19a-7577-47af-9b2f-fdda2576dbe4_del
May 27 03:09:46.475298 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Deletion of /opt/stack/data/nova/instances/e1f8d19a-7577-47af-9b2f-fdda2576dbe4_del complete
May 27 03:09:46.477371 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.876s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:09:46.477863 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6', 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '70c1fb03-3450-4fb8-90f6-348981e1c7a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:09:46.478093 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7 (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7 (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: tcp: [138] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: tcp: [139] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6 (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7 (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7 (non-flash)
May 27 03:09:46.520870 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:09:46.521525 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948', '138'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7', '144')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:09:46.521525 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6', '140')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:09:46.523020 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6', '139')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:09:46.523924 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75570462c2c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6'): ({'sde'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:09:46.523924 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Removing multipathed devices sdf, sde {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:09:46.525361 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Flush multipath device 33000000062a9dc45 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:09:46.561426 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:09:46.581870 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Attempting to attach volume d727d4c1-a231-454f-9b40-1b16e92a9bc7 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:09:46.584983 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:09:46.584983 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:09:46.584983 np0000001475 nova-compute[98471]:   <alias name="ua-d727d4c1-a231-454f-9b40-1b16e92a9bc7"/>
May 27 03:09:46.584983 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-11"/>
May 27 03:09:46.584983 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:09:46.584983 np0000001475 nova-compute[98471]:   <serial>d727d4c1-a231-454f-9b40-1b16e92a9bc7</serial>
May 27 03:09:46.584983 np0000001475 nova-compute[98471]: </disk>
May 27 03:09:46.584983 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:09:46.608669 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:09:46.652832 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:09:46.652832 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:09:46.655315 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:09:46.672512 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:09:46.672512 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:09:46.685695 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:46.712941 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:09:46.728525 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 140, target: iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6, portal: 192.168.40.100,3260]
May 27 03:09:46.728525 np0000001475 nova-compute[98471]: Logout of [sid: 140, target: iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6, portal: 192.168.40.100,3260] successful.
May 27 03:09:46.728525 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:46.746023 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6febddcf-2feb-47c1-8b22-a8322a8c80f7 req-c88fe38b-17d3-456a-a00f-56df8c340580 service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Received event network-vif-unplugged-8953edaf-1fde-421e-abaf-16020ef206c4 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:46.748569 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6febddcf-2feb-47c1-8b22-a8322a8c80f7 req-c88fe38b-17d3-456a-a00f-56df8c340580 service nova] Acquiring lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:46.748927 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6febddcf-2feb-47c1-8b22-a8322a8c80f7 req-c88fe38b-17d3-456a-a00f-56df8c340580 service nova] Lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:46.749648 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6febddcf-2feb-47c1-8b22-a8322a8c80f7 req-c88fe38b-17d3-456a-a00f-56df8c340580 service nova] Lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:46.749845 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6febddcf-2feb-47c1-8b22-a8322a8c80f7 req-c88fe38b-17d3-456a-a00f-56df8c340580 service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] No waiting events found dispatching network-vif-unplugged-8953edaf-1fde-421e-abaf-16020ef206c4 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:09:46.750181 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6febddcf-2feb-47c1-8b22-a8322a8c80f7 req-c88fe38b-17d3-456a-a00f-56df8c340580 service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Received event network-vif-unplugged-8953edaf-1fde-421e-abaf-16020ef206c4 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:09:46.750567 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:46.765366 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:46.811407 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 139, target: iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6, portal: 192.168.50.100,3260]
May 27 03:09:46.811407 np0000001475 nova-compute[98471]: Logout of [sid: 139, target: iqn.2023-03.storpool.com:os--volume-70c1fb03-3450-4fb8-90f6-348981e1c7a6, portal: 192.168.50.100,3260] successful.
May 27 03:09:46.811407 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:46.836767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:46.838482 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:09:46.838482 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] <== disconnect_volume: return (1238ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:09:46.838482 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:09:47.001615 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Took 2.60 seconds to destroy the instance on the hypervisor.
May 27 03:09:47.002418 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:09:47.002639 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:09:47.005377 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:09:47.005377 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:47.083062 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:47.086828 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:47.124789 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:47.235659 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:47.436180 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lazy-loading 'flavor' on Instance uuid 254dc58c-6b2f-4350-bea3-5c74d571ed2c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:09:47.490360 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e642680c-7d04-45e6-9cd4-8f9dbde781b4 req-5545457c-08e4-4d89-a1ef-db2e73225170 service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Received event network-vif-plugged-15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:47.490360 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e642680c-7d04-45e6-9cd4-8f9dbde781b4 req-5545457c-08e4-4d89-a1ef-db2e73225170 service nova] Acquiring lock "828da6e6-d3a5-4f1b-bc96-683db4633520-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:47.490360 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e642680c-7d04-45e6-9cd4-8f9dbde781b4 req-5545457c-08e4-4d89-a1ef-db2e73225170 service nova] Lock "828da6e6-d3a5-4f1b-bc96-683db4633520-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:47.490360 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e642680c-7d04-45e6-9cd4-8f9dbde781b4 req-5545457c-08e4-4d89-a1ef-db2e73225170 service nova] Lock "828da6e6-d3a5-4f1b-bc96-683db4633520-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:47.490915 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e642680c-7d04-45e6-9cd4-8f9dbde781b4 req-5545457c-08e4-4d89-a1ef-db2e73225170 service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Processing event network-vif-plugged-15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:09:47.530216 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:47.533696 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:47.537204 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:47.563609 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:47.707041 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:09:47.707404 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:09:47.753933 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f1fe0e83-7043-4388-975d-20a9f7f8f159 req-234a2124-62a0-4e04-8cae-3abb6ef5c492 service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Received event network-vif-deleted-8953edaf-1fde-421e-abaf-16020ef206c4 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:47.754173 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-f1fe0e83-7043-4388-975d-20a9f7f8f159 req-234a2124-62a0-4e04-8cae-3abb6ef5c492 service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Neutron deleted interface 8953edaf-1fde-421e-abaf-16020ef206c4; detaching it from the instance and deleting it from the info cache
May 27 03:09:47.755006 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f1fe0e83-7043-4388-975d-20a9f7f8f159 req-234a2124-62a0-4e04-8cae-3abb6ef5c492 service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:48.188210 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:48.200910 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:09:48.201307 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:09:48.259011 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f1fe0e83-7043-4388-975d-20a9f7f8f159 req-234a2124-62a0-4e04-8cae-3abb6ef5c492 service nova] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Detach interface failed, port_id=8953edaf-1fde-421e-abaf-16020ef206c4, reason: Instance e1f8d19a-7577-47af-9b2f-fdda2576dbe4 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:09:48.445220 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4c00d9bb-9622-4cd3-bb6e-25a4e209cdca tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.270s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:48.489574 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:09:48.489704 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:09:48.489780 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:09:48.489895 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] No VIF found with MAC fa:16:3e:0b:55:49, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:09:48.690995 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Took 1.69 seconds to deallocate network for instance.
May 27 03:09:48.731081 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:09:48.732070 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851388.7316349, 828da6e6-d3a5-4f1b-bc96-683db4633520 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:09:48.732379 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] VM Started (Lifecycle Event)
May 27 03:09:48.734546 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:09:48.741316 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Instance spawned successfully.
May 27 03:09:48.741705 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:09:49.030193 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:49.236000 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:09:49.240182 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:09:49.256407 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:49.256702 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:49.257214 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:49.257569 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:49.258058 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:49.258935 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:09:49.264788 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Took 0.57 seconds to detach 1 volumes for instance.
May 27 03:09:49.583329 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2165e56c-7b6d-4db1-a718-21b52d052326 req-833e72bf-287f-4639-91d0-66ce6270adb3 service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Received event network-vif-plugged-15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:49.584107 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2165e56c-7b6d-4db1-a718-21b52d052326 req-833e72bf-287f-4639-91d0-66ce6270adb3 service nova] Acquiring lock "828da6e6-d3a5-4f1b-bc96-683db4633520-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:49.584107 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2165e56c-7b6d-4db1-a718-21b52d052326 req-833e72bf-287f-4639-91d0-66ce6270adb3 service nova] Lock "828da6e6-d3a5-4f1b-bc96-683db4633520-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:49.584718 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2165e56c-7b6d-4db1-a718-21b52d052326 req-833e72bf-287f-4639-91d0-66ce6270adb3 service nova] Lock "828da6e6-d3a5-4f1b-bc96-683db4633520-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:49.588200 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2165e56c-7b6d-4db1-a718-21b52d052326 req-833e72bf-287f-4639-91d0-66ce6270adb3 service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] No waiting events found dispatching network-vif-plugged-15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:09:49.588200 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-2165e56c-7b6d-4db1-a718-21b52d052326 req-833e72bf-287f-4639-91d0-66ce6270adb3 service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Received unexpected event network-vif-plugged-15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c for instance with vm_state building and task_state spawning.
May 27 03:09:49.744609 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:09:49.745039 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851389.7446876, 828da6e6-d3a5-4f1b-bc96-683db4633520 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:09:49.745039 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] VM Paused (Lifecycle Event)
May 27 03:09:49.767060 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Took 10.19 seconds to spawn the instance on the hypervisor.
May 27 03:09:49.768510 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:09:49.777979 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:49.778260 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:49.847905 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-801c1bf3-8b0a-4b87-a329-f09b0859637e req-f3b08c29-fd84-4727-aace-c6a394abdd83 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Received event network-changed-d31da235-bc6a-4a71-b77d-7e4645764be5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:49.848083 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-801c1bf3-8b0a-4b87-a329-f09b0859637e req-f3b08c29-fd84-4727-aace-c6a394abdd83 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Refreshing instance network info cache due to event network-changed-d31da235-bc6a-4a71-b77d-7e4645764be5. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:09:49.848266 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-801c1bf3-8b0a-4b87-a329-f09b0859637e req-f3b08c29-fd84-4727-aace-c6a394abdd83 service nova] Acquiring lock "refresh_cache-254dc58c-6b2f-4350-bea3-5c74d571ed2c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:09:49.848418 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-801c1bf3-8b0a-4b87-a329-f09b0859637e req-f3b08c29-fd84-4727-aace-c6a394abdd83 service nova] Acquired lock "refresh_cache-254dc58c-6b2f-4350-bea3-5c74d571ed2c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:09:49.849390 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-801c1bf3-8b0a-4b87-a329-f09b0859637e req-f3b08c29-fd84-4727-aace-c6a394abdd83 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Refreshing network info cache for port d31da235-bc6a-4a71-b77d-7e4645764be5 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:09:50.052784 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:50.052954 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:50.053002 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:50.053110 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:50.053219 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:50.055496 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Terminating instance
May 27 03:09:50.087980 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d0272349-e605-475a-b997-3b35089d1851 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "bfade827-2998-4fe5-b4d4-3397233e8c14" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.143s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:50.200336 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:09:50.202066 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:09:50.248421 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:09:50.254790 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851390.2539294, 828da6e6-d3a5-4f1b-bc96-683db4633520 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:09:50.254790 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] VM Resumed (Lifecycle Event)
May 27 03:09:50.286305 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Took 17.73 seconds to build instance.
May 27 03:09:50.294530 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:50.341895 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:09:50.342113 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:09:50.354227 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-801c1bf3-8b0a-4b87-a329-f09b0859637e req-f3b08c29-fd84-4727-aace-c6a394abdd83 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:50.560255 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:09:50.590683 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:50.629618 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:50.760066 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-801c1bf3-8b0a-4b87-a329-f09b0859637e req-f3b08c29-fd84-4727-aace-c6a394abdd83 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:50.763386 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:09:50.778502 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:09:50.788141 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "828da6e6-d3a5-4f1b-bc96-683db4633520" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.242s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:50.801606 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:50.808137 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:50.845780 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:09:50.943851 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Instance destroyed successfully.
May 27 03:09:50.944529 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lazy-loading 'resources' on Instance uuid 254dc58c-6b2f-4350-bea3-5c74d571ed2c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:09:51.088665 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-801c1bf3-8b0a-4b87-a329-f09b0859637e req-f3b08c29-fd84-4727-aace-c6a394abdd83 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Updated VIF entry in instance network info cache for port d31da235-bc6a-4a71-b77d-7e4645764be5. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:09:51.089050 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-801c1bf3-8b0a-4b87-a329-f09b0859637e req-f3b08c29-fd84-4727-aace-c6a394abdd83 service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Updating instance_info_cache with network_info: [{"id": "d31da235-bc6a-4a71-b77d-7e4645764be5", "address": "fa:16:3e:31:74:b7", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd31da235-bc", "ovs_interfaceid": "d31da235-bc6a-4a71-b77d-7e4645764be5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:51.198364 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:09:51.199813 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:09:51.200143 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:09:51.201148 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Cleaning up deleted instances {{(pid=98471) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 27 03:09:51.283775 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999665789000119 future=<Future at 0x755704628b30 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:09:51.357286 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.579s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:51.399937 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:51.413772 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Deleted allocations for instance e1f8d19a-7577-47af-9b2f-fdda2576dbe4
May 27 03:09:51.448403 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:08:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-430111061',display_name='tempest-TestStampPattern-server-430111061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-teststamppattern-server-430111061',id=55,image_ref='1c8f099b-d986-47ab-85c0-6df840da8cd1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDZto3UEnSkHw1ZHyfMviV7eTmAwKMkc0vbfI2ZmPSYaEGZx8JCGyVLm9M3ISeDAEJ6PAcHMeO78i6xhagI2+NfgSC+XdyYyiXOSKNWg+tsw2p97Ky1ahauWZw+akj0Fg==',key_name='tempest-TestStampPattern-2046987046',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:08:44Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78ed6c288e2642cfa4fbb3761274cc4e',ramdisk_id='',reservation_id='r-kpo9fxdo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa',image_min_disk='1',image_min_ram='0',image_owner_id='78ed6c288e2642cfa4fbb3761274cc4e',image_owner_project_name='tempest-TestStampPattern-1535526847',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1535526847-project-member',image_user_id='7fe58d4cae1c4693adb1e227daa9706d',owner_project_name='tempest-TestStampPattern-1535526847',owner_user_name='tempest-TestStampPattern-1535526847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:08:45Z,user_data=None,user_id='7fe58d4cae1c4693adb1e227daa9706d',uuid=254dc58c-6b2f-4350-bea3-5c74d571ed2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d31da235-bc6a-4a71-b77d-7e4645764be5", "address": "fa:16:3e:31:74:b7", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd31da235-bc", "ovs_interfaceid": "d31da235-bc6a-4a71-b77d-7e4645764be5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:09:51.448698 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Converting VIF {"id": "d31da235-bc6a-4a71-b77d-7e4645764be5", "address": "fa:16:3e:31:74:b7", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd31da235-bc", "ovs_interfaceid": "d31da235-bc6a-4a71-b77d-7e4645764be5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:09:51.449403 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=d31da235-bc6a-4a71-b77d-7e4645764be5,network=Network(ae8febf4-ab96-4db6-bfef-62abb6610b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd31da235-bc') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:09:51.449642 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=d31da235-bc6a-4a71-b77d-7e4645764be5,network=Network(ae8febf4-ab96-4db6-bfef-62abb6610b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd31da235-bc') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:09:51.450638 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:51.450867 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd31da235-bc, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:51.465316 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:51.468211 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:09:51.468855 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:51.469020 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97c2fad9-f1b2-41cb-bcc3-b1ea660f4790) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:51.470457 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:51.472313 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:09:51.474146 np0000001475 nova-compute[98471]: INFO os_vif [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:74:b7,bridge_name='br-int',has_traffic_filtering=True,id=d31da235-bc6a-4a71-b77d-7e4645764be5,network=Network(ae8febf4-ab96-4db6-bfef-62abb6610b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd31da235-bc')
May 27 03:09:51.474449 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Deleting instance files /opt/stack/data/nova/instances/254dc58c-6b2f-4350-bea3-5c74d571ed2c_del
May 27 03:09:51.475212 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Deletion of /opt/stack/data/nova/instances/254dc58c-6b2f-4350-bea3-5c74d571ed2c_del complete
May 27 03:09:51.591010 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-801c1bf3-8b0a-4b87-a329-f09b0859637e req-f3b08c29-fd84-4727-aace-c6a394abdd83 service nova] Releasing lock "refresh_cache-254dc58c-6b2f-4350-bea3-5c74d571ed2c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:09:51.670427 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e6dc71c3-70ff-4327-9f29-86a2145a7e52 req-49c0697b-2673-48b1-ad67-062fc0de3dec service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Received event network-vif-unplugged-d31da235-bc6a-4a71-b77d-7e4645764be5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:51.673922 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e6dc71c3-70ff-4327-9f29-86a2145a7e52 req-49c0697b-2673-48b1-ad67-062fc0de3dec service nova] Acquiring lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:51.674168 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e6dc71c3-70ff-4327-9f29-86a2145a7e52 req-49c0697b-2673-48b1-ad67-062fc0de3dec service nova] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:51.674385 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e6dc71c3-70ff-4327-9f29-86a2145a7e52 req-49c0697b-2673-48b1-ad67-062fc0de3dec service nova] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:51.674537 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e6dc71c3-70ff-4327-9f29-86a2145a7e52 req-49c0697b-2673-48b1-ad67-062fc0de3dec service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] No waiting events found dispatching network-vif-unplugged-d31da235-bc6a-4a71-b77d-7e4645764be5 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:09:51.674710 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e6dc71c3-70ff-4327-9f29-86a2145a7e52 req-49c0697b-2673-48b1-ad67-062fc0de3dec service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Received event network-vif-unplugged-d31da235-bc6a-4a71-b77d-7e4645764be5 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:09:51.674910 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e6dc71c3-70ff-4327-9f29-86a2145a7e52 req-49c0697b-2673-48b1-ad67-062fc0de3dec service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Received event network-vif-unplugged-d31da235-bc6a-4a71-b77d-7e4645764be5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:51.675102 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e6dc71c3-70ff-4327-9f29-86a2145a7e52 req-49c0697b-2673-48b1-ad67-062fc0de3dec service nova] Acquiring lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:51.675266 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e6dc71c3-70ff-4327-9f29-86a2145a7e52 req-49c0697b-2673-48b1-ad67-062fc0de3dec service nova] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:51.675421 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e6dc71c3-70ff-4327-9f29-86a2145a7e52 req-49c0697b-2673-48b1-ad67-062fc0de3dec service nova] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:51.675580 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e6dc71c3-70ff-4327-9f29-86a2145a7e52 req-49c0697b-2673-48b1-ad67-062fc0de3dec service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] No waiting events found dispatching network-vif-unplugged-d31da235-bc6a-4a71-b77d-7e4645764be5 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:09:51.675750 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e6dc71c3-70ff-4327-9f29-86a2145a7e52 req-49c0697b-2673-48b1-ad67-062fc0de3dec service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Received event network-vif-unplugged-d31da235-bc6a-4a71-b77d-7e4645764be5 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:09:51.704934 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] There are 0 instances to clean {{(pid=98471) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 27 03:09:51.706385 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:09:51.783039 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Acquiring lock "bfade827-2998-4fe5-b4d4-3397233e8c14" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:51.783206 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "bfade827-2998-4fe5-b4d4-3397233e8c14" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:51.985641 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Took 1.43 seconds to destroy the instance on the hypervisor.
May 27 03:09:51.991775 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:09:51.991775 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:09:51.991775 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:09:51.991775 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:52.284191 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:52.286555 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Detaching volume d727d4c1-a231-454f-9b40-1b16e92a9bc7
May 27 03:09:52.347010 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Attempting to driver detach volume d727d4c1-a231-454f-9b40-1b16e92a9bc7 from mountpoint /dev/vdb
May 27 03:09:52.360100 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Found disk vdb by alias ua-d727d4c1-a231-454f-9b40-1b16e92a9bc7 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:09:52.362060 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Found disk vdb by alias ua-d727d4c1-a231-454f-9b40-1b16e92a9bc7 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:09:52.362398 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Attempting to detach device vdb from instance bfade827-2998-4fe5-b4d4-3397233e8c14 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:09:52.363156 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:09:52.363156 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:09:52.363156 np0000001475 nova-compute[98471]:   <alias name="ua-d727d4c1-a231-454f-9b40-1b16e92a9bc7"/>
May 27 03:09:52.363156 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-11"/>
May 27 03:09:52.363156 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:09:52.363156 np0000001475 nova-compute[98471]:   <serial>d727d4c1-a231-454f-9b40-1b16e92a9bc7</serial>
May 27 03:09:52.363156 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:09:52.363156 np0000001475 nova-compute[98471]: </disk>
May 27 03:09:52.363156 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:09:52.371887 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Successfully detached device vdb from instance bfade827-2998-4fe5-b4d4-3397233e8c14 from the persistent domain config.
May 27 03:09:52.372058 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] (1/8): Attempting to detach device vdb with device alias ua-d727d4c1-a231-454f-9b40-1b16e92a9bc7 from instance bfade827-2998-4fe5-b4d4-3397233e8c14 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:09:52.372380 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:09:52.372380 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:09:52.372380 np0000001475 nova-compute[98471]:   <alias name="ua-d727d4c1-a231-454f-9b40-1b16e92a9bc7"/>
May 27 03:09:52.372380 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-11"/>
May 27 03:09:52.372380 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:09:52.372380 np0000001475 nova-compute[98471]:   <serial>d727d4c1-a231-454f-9b40-1b16e92a9bc7</serial>
May 27 03:09:52.372380 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:09:52.372380 np0000001475 nova-compute[98471]: </disk>
May 27 03:09:52.372380 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:09:52.425821 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bbce350c-8a6d-4e95-adea-4c94ba896afc tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "e1f8d19a-7577-47af-9b2f-fdda2576dbe4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.526s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:52.455929 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4c59243e-2f93-4f54-a27c-0a79a1e78293 req-3475c550-8b76-4409-952c-49cb02286d74 service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Received event network-changed-15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:52.455929 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4c59243e-2f93-4f54-a27c-0a79a1e78293 req-3475c550-8b76-4409-952c-49cb02286d74 service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Refreshing instance network info cache due to event network-changed-15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:09:52.456871 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4c59243e-2f93-4f54-a27c-0a79a1e78293 req-3475c550-8b76-4409-952c-49cb02286d74 service nova] Acquiring lock "refresh_cache-828da6e6-d3a5-4f1b-bc96-683db4633520" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:09:52.456871 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4c59243e-2f93-4f54-a27c-0a79a1e78293 req-3475c550-8b76-4409-952c-49cb02286d74 service nova] Acquired lock "refresh_cache-828da6e6-d3a5-4f1b-bc96-683db4633520" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:09:52.459473 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4c59243e-2f93-4f54-a27c-0a79a1e78293 req-3475c550-8b76-4409-952c-49cb02286d74 service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Refreshing network info cache for port 15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:09:52.489773 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:52.967275 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-4c59243e-2f93-4f54-a27c-0a79a1e78293 req-3475c550-8b76-4409-952c-49cb02286d74 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:53.022629 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851393.0222027, bfade827-2998-4fe5-b4d4-3397233e8c14 => ua-d727d4c1-a231-454f-9b40-1b16e92a9bc7> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:09:53.024032 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d727d4c1-a231-454f-9b40-1b16e92a9bc7 for instance bfade827-2998-4fe5-b4d4-3397233e8c14 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:09:53.029792 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Successfully detached device vdb from instance bfade827-2998-4fe5-b4d4-3397233e8c14 from the live domain config.
May 27 03:09:53.034511 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:09:53.034817 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7', 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd727d4c1-a231-454f-9b40-1b16e92a9bc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:09:53.034992 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:09:53.035491 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:09:53.035758 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7', 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd727d4c1-a231-454f-9b40-1b16e92a9bc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:09:53.035853 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:09:53.073632 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:53.073632 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:53.073632 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:53.073632 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:53.073632 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:53.073632 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:53.073632 np0000001475 nova-compute[98471]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7 (non-flash)
May 27 03:09:53.073632 np0000001475 nova-compute[98471]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7 (non-flash)
May 27 03:09:53.073632 np0000001475 nova-compute[98471]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:53.073632 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:09:53.074066 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:53.074066 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:53.074066 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:53.074066 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:53.074066 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:53.074066 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:53.074066 np0000001475 nova-compute[98471]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7 (non-flash)
May 27 03:09:53.074066 np0000001475 nova-compute[98471]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7 (non-flash)
May 27 03:09:53.074066 np0000001475 nova-compute[98471]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:53.074066 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:09:53.074066 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948', '145')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:09:53.074491 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7', '144')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:09:53.076098 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7', '143')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:09:53.076969 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c286840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7'): ({'sdl'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:09:53.077187 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Removing multipathed devices sdn, sdl {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:09:53.077488 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Flush multipath device 330000000af59ba4f {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:09:53.113824 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:09:53.162091 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:09:53.210646 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Checking to see if SCSI volumes sdn, sdl have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:09:53.210883 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] SCSI volumes sdn, sdl have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:09:53.212591 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Checking to see if device paths {'sdn', 'sdl'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:09:53.231771 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Device paths {'sdn', 'sdl'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:09:53.232163 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:09:53.241266 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:53.249881 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:53.302575 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 144, target: iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7, portal: 192.168.40.100,3260]
May 27 03:09:53.302575 np0000001475 nova-compute[98471]: Logout of [sid: 144, target: iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7, portal: 192.168.40.100,3260] successful.
May 27 03:09:53.302575 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:53.325941 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:53.340623 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:53.378593 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 143, target: iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7, portal: 192.168.50.100,3260]
May 27 03:09:53.378593 np0000001475 nova-compute[98471]: Logout of [sid: 143, target: iqn.2023-03.storpool.com:os--volume-d727d4c1-a231-454f-9b40-1b16e92a9bc7, portal: 192.168.50.100,3260] successful.
May 27 03:09:53.378593 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:53.399466 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:53.399867 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:09:53.400053 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] <== disconnect_volume: return (365ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:09:53.400201 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:09:53.423153 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-4c59243e-2f93-4f54-a27c-0a79a1e78293 req-3475c550-8b76-4409-952c-49cb02286d74 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:53.588995 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4c59243e-2f93-4f54-a27c-0a79a1e78293 req-3475c550-8b76-4409-952c-49cb02286d74 service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Updated VIF entry in instance network info cache for port 15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:09:53.589273 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4c59243e-2f93-4f54-a27c-0a79a1e78293 req-3475c550-8b76-4409-952c-49cb02286d74 service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Updating instance_info_cache with network_info: [{"id": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "address": "fa:16:3e:fe:bf:f2", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a1a2c0-c4", "ovs_interfaceid": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:53.705793 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:09:53.706044 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.49 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:09:53.744165 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Took 1.75 seconds to deallocate network for instance.
May 27 03:09:53.981798 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lazy-loading 'flavor' on Instance uuid bfade827-2998-4fe5-b4d4-3397233e8c14 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:09:54.092117 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4c59243e-2f93-4f54-a27c-0a79a1e78293 req-3475c550-8b76-4409-952c-49cb02286d74 service nova] Releasing lock "refresh_cache-828da6e6-d3a5-4f1b-bc96-683db4633520" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:09:54.250286 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:54.250847 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:54.578232 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-95a8e9d1-e4c6-437b-bebb-be9b08e032c1 req-2cf2cbc0-7c8e-4e76-9a4b-6ce5bfa7548d service nova] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Received event network-vif-deleted-d31da235-bc6a-4a71-b77d-7e4645764be5 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:54.755955 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:09:54.756229 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:09:54.994552 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ce9d841b-5533-4bf1-a865-6bfa77e7c9eb tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "bfade827-2998-4fe5-b4d4-3397233e8c14" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.211s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:55.258932 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:09:55.766611 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.516s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:55.961188 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:55.961188 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:55.961188 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:55.961188 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:55.961188 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:55.962133 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Terminating instance
May 27 03:09:55.996549 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:56.050081 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Deleted allocations for instance 254dc58c-6b2f-4350-bea3-5c74d571ed2c
May 27 03:09:56.401231 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:56.466689 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:09:56.469848 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:56.514902 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:56.521694 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:56.545675 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:56.723188 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:56.729686 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:56.825147 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999581603000024 future=<Future at 0x755704784830 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:09:56.829190 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Instance destroyed successfully.
May 27 03:09:56.830201 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lazy-loading 'resources' on Instance uuid dbecddfd-649b-4343-a5d2-bbbbf0c67de5 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:09:57.065384 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b01440c7-c899-40f5-a7ca-a8ecb6ff15a2 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "254dc58c-6b2f-4350-bea3-5c74d571ed2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.012s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:57.300541 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Acquiring lock "bfade827-2998-4fe5-b4d4-3397233e8c14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:57.300716 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "bfade827-2998-4fe5-b4d4-3397233e8c14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:57.301018 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Acquiring lock "bfade827-2998-4fe5-b4d4-3397233e8c14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:57.301208 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "bfade827-2998-4fe5-b4d4-3397233e8c14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:57.301349 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "bfade827-2998-4fe5-b4d4-3397233e8c14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:57.303310 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Terminating instance
May 27 03:09:57.338808 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:07:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1304934566',display_name='tempest-TestVolumeBootPatternV346-server-1304934566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpatternv346-server-1304934566',id=53,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1Gm7TCHafFGWPx7+gaqf0KNgx04LjJJHz80sR0jW3/AHFgrWUjXPNzxapIHdT+cqlf2yxUegAPPSNbQx1dtysyxS49ctl/sMmw5fCSk05Z43MvSX2XdLQqhWHpEgk+fw==',key_name='tempest-keypair-375867860',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:08:00Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfc9c3d1d60841349d551f2d9874c730',ramdisk_id='',reservation_id='r-nz5hjzpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1509575509',owner_user_name='tempest-TestVolumeBootPatternV346-1509575509-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:08:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32837382cff144e5b70de0a400386d11',uuid=dbecddfd-649b-4343-a5d2-bbbbf0c67de5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "address": "fa:16:3e:43:62:08", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdd6bcb-2c", "ovs_interfaceid": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:09:57.338808 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Converting VIF {"id": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "address": "fa:16:3e:43:62:08", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefdd6bcb-2c", "ovs_interfaceid": "efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:09:57.338808 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:62:08,bridge_name='br-int',has_traffic_filtering=True,id=efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefdd6bcb-2c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:09:57.338808 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:62:08,bridge_name='br-int',has_traffic_filtering=True,id=efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefdd6bcb-2c') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:09:57.340329 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:57.340615 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefdd6bcb-2c, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:57.341806 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:57.342562 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:09:57.345046 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:57.345833 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:57.346035 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=164fd5cf-7929-4332-8d92-e8e1e2c3c740) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:57.346851 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:57.347343 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:09:57.348686 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:57.351029 np0000001475 nova-compute[98471]: INFO os_vif [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:62:08,bridge_name='br-int',has_traffic_filtering=True,id=efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefdd6bcb-2c')
May 27 03:09:57.354014 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:09:57.354014 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd53cd55-5bc9-4b04-899d-7f7004f0e613', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:09:57.354014 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:09:57.354014 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:09:57.354014 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd53cd55-5bc9-4b04-899d-7f7004f0e613', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:09:57.354014 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:09:57.382705 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:57.382705 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:57.382705 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:57.382705 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:57.382705 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:57.382705 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:57.382705 np0000001475 nova-compute[98471]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:57.382705 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:09:57.384114 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:57.384114 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:09:57.384114 np0000001475 nova-compute[98471]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:57.384114 np0000001475 nova-compute[98471]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613 (non-flash)
May 27 03:09:57.384114 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:57.384114 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:09:57.384114 np0000001475 nova-compute[98471]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:09:57.384114 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:09:57.384114 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948', '145')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:09:57.384114 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '114')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:09:57.384996 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613', '115')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:09:57.386024 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755724789d00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613'): ({'sdh'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:09:57.386336 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Removing multipathed devices sdh, sdg {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:09:57.386676 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Flush multipath device 330000000780b61cf {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:09:57.440729 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:09:57.487235 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:09:57.543512 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:09:57.543512 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:09:57.543512 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:09:57.557642 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:09:57.558249 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:09:57.572650 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:57.606476 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 114, target: iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613, portal: 192.168.40.100,3260]
May 27 03:09:57.606476 np0000001475 nova-compute[98471]: Logout of [sid: 114, target: iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613, portal: 192.168.40.100,3260] successful.
May 27 03:09:57.606476 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:57.626901 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:57.639890 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:57.671007 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 115, target: iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613, portal: 192.168.50.100,3260]
May 27 03:09:57.671007 np0000001475 nova-compute[98471]: Logout of [sid: 115, target: iqn.2023-03.storpool.com:os--volume-bd53cd55-5bc9-4b04-899d-7f7004f0e613, portal: 192.168.50.100,3260] successful.
May 27 03:09:57.671007 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:57.688798 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:09:57.688798 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:09:57.688798 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] <== disconnect_volume: return (334ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:09:57.688798 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:09:57.688798 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Deleting instance files /opt/stack/data/nova/instances/dbecddfd-649b-4343-a5d2-bbbbf0c67de5_del
May 27 03:09:57.689607 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Deletion of /opt/stack/data/nova/instances/dbecddfd-649b-4343-a5d2-bbbbf0c67de5_del complete
May 27 03:09:57.806921 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:09:57.834839 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:57.838826 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:57.861495 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:57.862603 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:57.891958 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:57.893249 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:58.042422 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:58.126507 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:58.164092 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:58.167999 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:58.167999 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999680465999973 future=<Future at 0x75570445bc80 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:09:58.173226 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Instance destroyed successfully.
May 27 03:09:58.173226 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lazy-loading 'resources' on Instance uuid bfade827-2998-4fe5-b4d4-3397233e8c14 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:09:58.189693 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:58.205280 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Took 1.74 seconds to destroy the instance on the hypervisor.
May 27 03:09:58.206877 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:09:58.207785 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:09:58.207785 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:09:58.207785 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:58.337854 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:58.577823 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:58.585141 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:58.589489 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:58.623801 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:58.629959 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:58.676859 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:08:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1997629097',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1997629097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testservervolumeattachscenariooldversion-server-1997629',id=56,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0mXxE/PwQv49DfAMZahtTGYHepmBZ73mAUABVSsKnA2xcw/jV5WeaDF5mRJnUJKHPH4MlW6x7pHGVnZK7ZYAPrTw+I6EbUW6wciVNxV9NgxoKHz8jSTkuGVE22hLxgHg==',key_name='tempest-keypair-2076153316',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:08:56Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='748efbae1003491896ee411bd9398482',ramdisk_id='',reservation_id='r-t4par2ie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-791402382',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:08:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adc7af487f214a868d6e7c52ade24c03',uuid=bfade827-2998-4fe5-b4d4-3397233e8c14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "address": "fa:16:3e:0b:55:49", "network": {"id": "0798c75b-db23-4d1c-b81f-ce540122d2bf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-379877127-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "748efbae1003491896ee411bd9398482", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d4448e-38", "ovs_interfaceid": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:09:58.677119 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Converting VIF {"id": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "address": "fa:16:3e:0b:55:49", "network": {"id": "0798c75b-db23-4d1c-b81f-ce540122d2bf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-379877127-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "748efbae1003491896ee411bd9398482", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d4448e-38", "ovs_interfaceid": "a8d4448e-38f4-4feb-a8b9-fce7844af010", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:09:58.677726 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:55:49,bridge_name='br-int',has_traffic_filtering=True,id=a8d4448e-38f4-4feb-a8b9-fce7844af010,network=Network(0798c75b-db23-4d1c-b81f-ce540122d2bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d4448e-38') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:09:58.677956 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:55:49,bridge_name='br-int',has_traffic_filtering=True,id=a8d4448e-38f4-4feb-a8b9-fce7844af010,network=Network(0798c75b-db23-4d1c-b81f-ce540122d2bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d4448e-38') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:09:58.681356 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:58.681356 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8d4448e-38, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:58.685017 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:58.685848 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:09:58.686627 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:58.686853 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72ee2cbe-7e8e-4e47-bfab-5b1b6c8e51e1) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:09:58.689887 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:58.689887 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:09:58.690872 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:58.694062 np0000001475 nova-compute[98471]: INFO os_vif [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:55:49,bridge_name='br-int',has_traffic_filtering=True,id=a8d4448e-38f4-4feb-a8b9-fce7844af010,network=Network(0798c75b-db23-4d1c-b81f-ce540122d2bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d4448e-38')
May 27 03:09:58.694330 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Deleting instance files /opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14_del
May 27 03:09:58.695240 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Deletion of /opt/stack/data/nova/instances/bfade827-2998-4fe5-b4d4-3397233e8c14_del complete
May 27 03:09:58.752473 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:58.782845 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:09:58.973721 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fe88da85-069f-40ec-9ca8-db3932ca48a4 req-0f3ac4e5-a69f-43a3-81ef-3aefb1997eb5 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Received event network-vif-unplugged-efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:58.974288 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fe88da85-069f-40ec-9ca8-db3932ca48a4 req-0f3ac4e5-a69f-43a3-81ef-3aefb1997eb5 service nova] Acquiring lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:58.974288 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fe88da85-069f-40ec-9ca8-db3932ca48a4 req-0f3ac4e5-a69f-43a3-81ef-3aefb1997eb5 service nova] Lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:58.974288 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fe88da85-069f-40ec-9ca8-db3932ca48a4 req-0f3ac4e5-a69f-43a3-81ef-3aefb1997eb5 service nova] Lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:58.974288 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fe88da85-069f-40ec-9ca8-db3932ca48a4 req-0f3ac4e5-a69f-43a3-81ef-3aefb1997eb5 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] No waiting events found dispatching network-vif-unplugged-efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:09:58.974941 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fe88da85-069f-40ec-9ca8-db3932ca48a4 req-0f3ac4e5-a69f-43a3-81ef-3aefb1997eb5 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Received event network-vif-unplugged-efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:09:59.073037 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5e106306-1db8-4362-a580-e476257f1d7b req-e9a2b449-66c2-45a0-aa9e-1771226fc740 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Received event network-vif-deleted-efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:59.073203 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-5e106306-1db8-4362-a580-e476257f1d7b req-e9a2b449-66c2-45a0-aa9e-1771226fc740 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Neutron deleted interface efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528; detaching it from the instance and deleting it from the info cache
May 27 03:09:59.073386 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-5e106306-1db8-4362-a580-e476257f1d7b req-e9a2b449-66c2-45a0-aa9e-1771226fc740 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:59.199817 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:09:59.208644 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Took 1.40 seconds to destroy the instance on the hypervisor.
May 27 03:09:59.209894 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:09:59.210157 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:09:59.210229 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:09:59.210433 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:59.270819 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:09:59.515632 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:09:59.582230 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5e106306-1db8-4362-a580-e476257f1d7b req-e9a2b449-66c2-45a0-aa9e-1771226fc740 service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Detach interface failed, port_id=efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528, reason: Instance dbecddfd-649b-4343-a5d2-bbbbf0c67de5 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:09:59.711284 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:09:59.712824 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:09:59.712824 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:09:59.712824 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:09:59.760223 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.00034940299974550726 future=<Future at 0x7557047e7800 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:09:59.760409 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:09:59.760409 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=6.52258971900028 future=<Future at 0x755704628b30 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:09:59.760506 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=6.522515711000324 future=<Future at 0x755704628b30 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:09:59.760932 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Emitting event <LifecycleEvent: 1779851384.759767, e1f8d19a-7577-47af-9b2f-fdda2576dbe4 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:09:59.761089 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] VM Stopped (Lifecycle Event)
May 27 03:09:59.792631 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-eff17e15-1803-4d96-8cfc-5ab034c2ac23 req-6c22d1ed-5cb7-4edc-a694-8020101f7b77 service nova] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Received event network-vif-deleted-a8d4448e-38f4-4feb-a8b9-fce7844af010 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:09:59.793135 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-eff17e15-1803-4d96-8cfc-5ab034c2ac23 req-6c22d1ed-5cb7-4edc-a694-8020101f7b77 service nova] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Neutron deleted interface a8d4448e-38f4-4feb-a8b9-fce7844af010; detaching it from the instance and deleting it from the info cache
May 27 03:09:59.793275 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-eff17e15-1803-4d96-8cfc-5ab034c2ac23 req-6c22d1ed-5cb7-4edc-a694-8020101f7b77 service nova] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:10:00.017928 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Took 1.81 seconds to deallocate network for instance.
May 27 03:10:00.232512 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:10:00.265536 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: e1f8d19a-7577-47af-9b2f-fdda2576dbe4] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:00.301250 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-eff17e15-1803-4d96-8cfc-5ab034c2ac23 req-6c22d1ed-5cb7-4edc-a694-8020101f7b77 service nova] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Detach interface failed, port_id=a8d4448e-38f4-4feb-a8b9-fce7844af010, reason: Instance bfade827-2998-4fe5-b4d4-3397233e8c14 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:10:00.596408 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Took 0.58 seconds to detach 1 volumes for instance.
May 27 03:10:00.737152 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Took 1.53 seconds to deallocate network for instance.
May 27 03:10:00.751832 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:00.868822 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:00.869420 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:00.935412 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:00.935729 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:00.936067 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:00.936197 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:00.936459 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:00.940939 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Terminating instance
May 27 03:10:00.968269 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:00.974062 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:01.060640 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ec4ae338-0a4f-4201-93d0-17b87bf4e606 req-52b18fff-21f2-4f28-9133-ad4422ab319d service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Received event network-vif-unplugged-efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:01.060640 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ec4ae338-0a4f-4201-93d0-17b87bf4e606 req-52b18fff-21f2-4f28-9133-ad4422ab319d service nova] Acquiring lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:01.060640 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ec4ae338-0a4f-4201-93d0-17b87bf4e606 req-52b18fff-21f2-4f28-9133-ad4422ab319d service nova] Lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:01.060640 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ec4ae338-0a4f-4201-93d0-17b87bf4e606 req-52b18fff-21f2-4f28-9133-ad4422ab319d service nova] Lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:01.060640 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ec4ae338-0a4f-4201-93d0-17b87bf4e606 req-52b18fff-21f2-4f28-9133-ad4422ab319d service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] No waiting events found dispatching network-vif-unplugged-efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:10:01.060640 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-ec4ae338-0a4f-4201-93d0-17b87bf4e606 req-52b18fff-21f2-4f28-9133-ad4422ab319d service nova] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Received unexpected event network-vif-unplugged-efdd6bcb-2ca2-4ebe-a3c8-4d9d7d7e9528 for instance with vm_state deleted and task_state None.
May 27 03:10:01.061788 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ec4ae338-0a4f-4201-93d0-17b87bf4e606 req-52b18fff-21f2-4f28-9133-ad4422ab319d service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Received event network-changed-faa68bc7-6703-419c-886a-7c71c19e32c2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:01.061788 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ec4ae338-0a4f-4201-93d0-17b87bf4e606 req-52b18fff-21f2-4f28-9133-ad4422ab319d service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Refreshing instance network info cache due to event network-changed-faa68bc7-6703-419c-886a-7c71c19e32c2. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:10:01.061788 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ec4ae338-0a4f-4201-93d0-17b87bf4e606 req-52b18fff-21f2-4f28-9133-ad4422ab319d service nova] Acquiring lock "refresh_cache-2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:10:01.061788 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ec4ae338-0a4f-4201-93d0-17b87bf4e606 req-52b18fff-21f2-4f28-9133-ad4422ab319d service nova] Acquired lock "refresh_cache-2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:10:01.061788 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ec4ae338-0a4f-4201-93d0-17b87bf4e606 req-52b18fff-21f2-4f28-9133-ad4422ab319d service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Refreshing network info cache for port faa68bc7-6703-419c-886a-7c71c19e32c2 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:10:01.071395 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:01.072003 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:01.104408 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:01.104715 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:01.183386 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:01.187556 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-7 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:10:01.190587 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:01.248294 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:01.314675 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:01.315207 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:01.409053 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:01.435996 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:01.445974 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:10:01.452088 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:10:01.472550 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:10:01.475120 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:01.500036 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:01.535700 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:01.538963 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:01.554073 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.078s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:01.555485 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=11883MB free_disk=72.85302352905273GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:10:01.555485 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:01.568725 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-ec4ae338-0a4f-4201-93d0-17b87bf4e606 req-52b18fff-21f2-4f28-9133-ad4422ab319d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:01.573760 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:01.811666 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999542389999988 future=<Future at 0x75572c1270e0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:01.816084 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:10:01.818559 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:10:01.823282 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Instance destroyed successfully.
May 27 03:10:01.824379 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lazy-loading 'resources' on Instance uuid 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:10:02.014103 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-ec4ae338-0a4f-4201-93d0-17b87bf4e606 req-52b18fff-21f2-4f28-9133-ad4422ab319d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:02.184258 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ec4ae338-0a4f-4201-93d0-17b87bf4e606 req-52b18fff-21f2-4f28-9133-ad4422ab319d service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Updated VIF entry in instance network info cache for port faa68bc7-6703-419c-886a-7c71c19e32c2. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:10:02.184763 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ec4ae338-0a4f-4201-93d0-17b87bf4e606 req-52b18fff-21f2-4f28-9133-ad4422ab319d service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Updating instance_info_cache with network_info: [{"id": "faa68bc7-6703-419c-886a-7c71c19e32c2", "address": "fa:16:3e:21:cf:cf", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa68bc7-67", "ovs_interfaceid": "faa68bc7-6703-419c-886a-7c71c19e32c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:10:02.324190 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:10:02.332934 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:07:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1180651749',display_name='tempest-TestStampPattern-server-1180651749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-teststamppattern-server-1180651749',id=52,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDZto3UEnSkHw1ZHyfMviV7eTmAwKMkc0vbfI2ZmPSYaEGZx8JCGyVLm9M3ISeDAEJ6PAcHMeO78i6xhagI2+NfgSC+XdyYyiXOSKNWg+tsw2p97Ky1ahauWZw+akj0Fg==',key_name='tempest-TestStampPattern-2046987046',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:07:18Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78ed6c288e2642cfa4fbb3761274cc4e',ramdisk_id='',reservation_id='r-my0ausfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1535526847',owner_user_name='tempest-TestStampPattern-1535526847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:08:28Z,user_data=None,user_id='7fe58d4cae1c4693adb1e227daa9706d',uuid=2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "faa68bc7-6703-419c-886a-7c71c19e32c2", "address": "fa:16:3e:21:cf:cf", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa68bc7-67", "ovs_interfaceid": "faa68bc7-6703-419c-886a-7c71c19e32c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:10:02.333180 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Converting VIF {"id": "faa68bc7-6703-419c-886a-7c71c19e32c2", "address": "fa:16:3e:21:cf:cf", "network": {"id": "ae8febf4-ab96-4db6-bfef-62abb6610b98", "bridge": "br-int", "label": "tempest-TestStampPattern-781749165-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "78ed6c288e2642cfa4fbb3761274cc4e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaa68bc7-67", "ovs_interfaceid": "faa68bc7-6703-419c-886a-7c71c19e32c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:10:02.333963 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:cf:cf,bridge_name='br-int',has_traffic_filtering=True,id=faa68bc7-6703-419c-886a-7c71c19e32c2,network=Network(ae8febf4-ab96-4db6-bfef-62abb6610b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaa68bc7-67') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:10:02.334258 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:cf:cf,bridge_name='br-int',has_traffic_filtering=True,id=faa68bc7-6703-419c-886a-7c71c19e32c2,network=Network(ae8febf4-ab96-4db6-bfef-62abb6610b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaa68bc7-67') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:10:02.337641 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:02.337922 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfaa68bc7-67, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:02.340674 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:02.343886 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:10:02.344627 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:02.345336 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a035417-e7f4-413e-bade-1e3d7c5ee263) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:02.349444 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:02.350086 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:10:02.350272 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:02.353059 np0000001475 nova-compute[98471]: INFO os_vif [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:cf:cf,bridge_name='br-int',has_traffic_filtering=True,id=faa68bc7-6703-419c-886a-7c71c19e32c2,network=Network(ae8febf4-ab96-4db6-bfef-62abb6610b98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfaa68bc7-67')
May 27 03:10:02.353350 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Deleting instance files /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa_del
May 27 03:10:02.354691 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Deletion of /opt/stack/data/nova/instances/2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa_del complete
May 27 03:10:02.687611 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ec4ae338-0a4f-4201-93d0-17b87bf4e606 req-52b18fff-21f2-4f28-9133-ad4422ab319d service nova] Releasing lock "refresh_cache-2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:10:02.842046 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.737s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:02.842884 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.595s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:02.864662 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Took 1.42 seconds to destroy the instance on the hypervisor.
May 27 03:10:02.865366 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:10:02.865661 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:10:02.865788 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:10:02.866066 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:02.938103 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Deleted allocations for instance dbecddfd-649b-4343-a5d2-bbbbf0c67de5
May 27 03:10:02.950191 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:02.950191 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:02.971394 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:03.146079 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0e25a85b-f97e-42fc-8ffa-1ee910c4b704 req-f469bca4-203b-4a2f-88ff-eb9490ab05b7 service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Received event network-vif-unplugged-faa68bc7-6703-419c-886a-7c71c19e32c2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:03.148759 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0e25a85b-f97e-42fc-8ffa-1ee910c4b704 req-f469bca4-203b-4a2f-88ff-eb9490ab05b7 service nova] Acquiring lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:03.148946 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0e25a85b-f97e-42fc-8ffa-1ee910c4b704 req-f469bca4-203b-4a2f-88ff-eb9490ab05b7 service nova] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:03.149129 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0e25a85b-f97e-42fc-8ffa-1ee910c4b704 req-f469bca4-203b-4a2f-88ff-eb9490ab05b7 service nova] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:03.149174 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0e25a85b-f97e-42fc-8ffa-1ee910c4b704 req-f469bca4-203b-4a2f-88ff-eb9490ab05b7 service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] No waiting events found dispatching network-vif-unplugged-faa68bc7-6703-419c-886a-7c71c19e32c2 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:10:03.149331 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0e25a85b-f97e-42fc-8ffa-1ee910c4b704 req-f469bca4-203b-4a2f-88ff-eb9490ab05b7 service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Received event network-vif-unplugged-faa68bc7-6703-419c-886a-7c71c19e32c2 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:10:03.149456 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0e25a85b-f97e-42fc-8ffa-1ee910c4b704 req-f469bca4-203b-4a2f-88ff-eb9490ab05b7 service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Received event network-vif-unplugged-faa68bc7-6703-419c-886a-7c71c19e32c2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:03.149869 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0e25a85b-f97e-42fc-8ffa-1ee910c4b704 req-f469bca4-203b-4a2f-88ff-eb9490ab05b7 service nova] Acquiring lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:03.150035 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0e25a85b-f97e-42fc-8ffa-1ee910c4b704 req-f469bca4-203b-4a2f-88ff-eb9490ab05b7 service nova] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:03.150220 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0e25a85b-f97e-42fc-8ffa-1ee910c4b704 req-f469bca4-203b-4a2f-88ff-eb9490ab05b7 service nova] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:03.150342 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0e25a85b-f97e-42fc-8ffa-1ee910c4b704 req-f469bca4-203b-4a2f-88ff-eb9490ab05b7 service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] No waiting events found dispatching network-vif-unplugged-faa68bc7-6703-419c-886a-7c71c19e32c2 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:10:03.150463 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0e25a85b-f97e-42fc-8ffa-1ee910c4b704 req-f469bca4-203b-4a2f-88ff-eb9490ab05b7 service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Received event network-vif-unplugged-faa68bc7-6703-419c-886a-7c71c19e32c2 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:10:03.389332 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:10:03.389845 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:10:03.456703 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:10:03.727073 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:10:03.892863 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:10:03.949356 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2acf0fa2-0d5d-4d09-a1ad-fbf4496fec7e tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "dbecddfd-649b-4343-a5d2-bbbbf0c67de5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.989s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:04.002462 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:04.229158 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Took 1.36 seconds to deallocate network for instance.
May 27 03:10:04.399047 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.556s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:04.401456 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 2.846s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:04.486035 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Deleted allocations for instance bfade827-2998-4fe5-b4d4-3397233e8c14
May 27 03:10:04.735234 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:05.113893 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:05.114394 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:05.222850 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9146e318-fc00-40c3-bc8f-9a66e6c37e93 req-9fcb6ff5-9ebe-4055-bb99-a677abdcdaf2 service nova] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Received event network-vif-deleted-faa68bc7-6703-419c-886a-7c71c19e32c2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:05.490564 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 5fe4c21d-3de1-479a-ad36-e4377e7cea11 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:10:05.490884 np0000001475 nova-compute[98471]: WARNING nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
May 27 03:10:05.490884 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance eb7ae482-4f6f-4b54-9923-3657c90de9fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:10:05.490884 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 408047d8-a3ab-415c-a667-204e70271bed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:10:05.490960 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 828da6e6-d3a5-4f1b-bc96-683db4633520 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:10:05.496818 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99b2edbe-4ef4-4517-84dd-cf8879200827 tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Lock "bfade827-2998-4fe5-b4d4-3397233e8c14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.196s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:05.617493 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lazy-loading 'flavor' on Instance uuid eb7ae482-4f6f-4b54-9923-3657c90de9fa {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:10:05.997427 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 4d78ea44-9e63-4671-91bc-ee77eb1885cc has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 27 03:10:05.997670 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:10:05.997878 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:10:01 up 41 min,  2 users,  load average: 8.91, 8.14, 5.55\n', 'num_instances': '4', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '4', 'num_proj_bfc9c3d1d60841349d551f2d9874c730': '1', 'io_workload': '0', 'num_proj_428862460731458481e46d92e7e023cf': '1', 'num_proj_c547b519adf248728dfd0b2232bfc118': '1', 'num_proj_0810d45b82c0476db38b1cabf8579ae1': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:10:06.120311 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Ignoring supplied device name: /dev/vdb
May 27 03:10:06.283418 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0003614529996411875 future=<Future at 0x755704628b30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:06.283862 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Emitting event <LifecycleEvent: 1779851391.2829404, 254dc58c-6b2f-4350-bea3-5c74d571ed2c => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:10:06.283992 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:06.284189 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] VM Stopped (Lifecycle Event)
May 27 03:10:06.286091 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=5.538831320000099 future=<Future at 0x755704784830 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:06.286091 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=5.538654241000131 future=<Future at 0x755704784830 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:06.334318 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:10:06.334574 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:10:06.415336 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:06.623764 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:06.787464 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ccc25dd7-43c1-4098-b4b2-004f134095e6 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 254dc58c-6b2f-4350-bea3-5c74d571ed2c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:06.836896 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:10:07.216836 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:07.217040 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:07.217297 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:07.217471 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:07.217642 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:07.223868 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Terminating instance
May 27 03:10:07.312628 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:07.343158 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:10:07.343406 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.942s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:07.343701 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.342s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:07.344042 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 42.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:10:07.346984 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:10:07.347114 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Claim successful on node np0000001475
May 27 03:10:07.350129 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:07.731807 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:10:07.761928 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:07.766832 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:07.779925 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:07.780176 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:07.780544 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Attaching volume dd3605ba-8b97-468b-963c-e6fb8c7c1135 to /dev/vdb
May 27 03:10:07.789714 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:07.794492 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:07.824328 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:07.846942 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:10:07.863198 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:10:07.891774 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:07.947439 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:10:07.950763 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:10:07.960276 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:10:07.961469 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fea9:da0b', 'fe80::bc95:85ff:fe5a:dff6', 'fe80::fc16:3eff:febe:aee3', 'fe80::d018:f2ff:feb0:9e2b', 'fe80::fc16:3eff:fefe:bff2', 'fe80::b80a:ccff:fec0:b891'] 
May 27 03:10:07.961607 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:10:07.961714 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:10:07.962077 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:10:07.964195 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Updating existing volume attachment record: 7ebf3869-9476-414a-95aa-30eb5fdbf1a4 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:10:08.007185 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b3afb240-29db-4d51-b225-cbc09489c441 req-816eebff-bb0a-4ba8-b010-790e68077dc4 service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Received event network-vif-unplugged-dd1d7aa2-c15c-43ce-a89e-db2233286368 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:08.007549 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b3afb240-29db-4d51-b225-cbc09489c441 req-816eebff-bb0a-4ba8-b010-790e68077dc4 service nova] Acquiring lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:08.007815 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b3afb240-29db-4d51-b225-cbc09489c441 req-816eebff-bb0a-4ba8-b010-790e68077dc4 service nova] Lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:08.008010 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b3afb240-29db-4d51-b225-cbc09489c441 req-816eebff-bb0a-4ba8-b010-790e68077dc4 service nova] Lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:08.008155 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b3afb240-29db-4d51-b225-cbc09489c441 req-816eebff-bb0a-4ba8-b010-790e68077dc4 service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] No waiting events found dispatching network-vif-unplugged-dd1d7aa2-c15c-43ce-a89e-db2233286368 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:10:08.008302 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b3afb240-29db-4d51-b225-cbc09489c441 req-816eebff-bb0a-4ba8-b010-790e68077dc4 service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Received event network-vif-unplugged-dd1d7aa2-c15c-43ce-a89e-db2233286368 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:10:08.089274 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99963700599983 future=<Future at 0x7557046d36e0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:08.094525 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Instance destroyed successfully.
May 27 03:10:08.095399 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lazy-loading 'resources' on Instance uuid 5fe4c21d-3de1-479a-ad36-e4377e7cea11 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:10:08.412766 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Refreshing inventories for resource provider 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 27 03:10:08.457484 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Updating ProviderTree inventory for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 27 03:10:08.457643 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Updating inventory in ProviderTree for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 27 03:10:08.501211 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Refreshing aggregate associations for resource provider 379b682a-2af7-4cd6-bb46-9d0c412d430a, aggregates: None {{(pid=98471) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 27 03:10:08.540808 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:10:08.540808 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:10:08.540808 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:10:08.549948 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Refreshing trait associations for resource provider 379b682a-2af7-4cd6-bb46-9d0c412d430a, traits: HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ARCH_X86_64,HW_CPU_X86_SSSE3,COMPUTE_ARCH_S390X,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NODE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ARCH_RISCV64,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ARCH_AARCH64,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_MIPSEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_ARCH_X86_64,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE {{(pid=98471) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 27 03:10:08.599528 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:06:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-215591698',display_name='tempest-TestVolumeBootPatternV346-server-215591698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpatternv346-server-215591698',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnWwof++ZwSJO1BO0i//TGiW5vGgg5M7q377hKaWb+cUT3r7s4xAaOPexCFtyayG/l0gG9lJdVAfvLChaH+kHd5gx/TtrNkAhVbzo13quU5e1rP12X6LQELwFvn/Wby0A==',key_name='tempest-keypair-525983288',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:06:56Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfc9c3d1d60841349d551f2d9874c730',ramdisk_id='',reservation_id='r-3ad0r3cr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1509575509',owner_user_name='tempest-TestVolumeBootPatternV346-1509575509-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:06:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32837382cff144e5b70de0a400386d11',uuid=5fe4c21d-3de1-479a-ad36-e4377e7cea11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "address": "fa:16:3e:df:3a:b8", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd1d7aa2-c1", "ovs_interfaceid": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:10:08.599728 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Converting VIF {"id": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "address": "fa:16:3e:df:3a:b8", "network": {"id": "a1d2c522-2d61-41b3-a15c-1b894966f957", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-814438179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bfc9c3d1d60841349d551f2d9874c730", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd1d7aa2-c1", "ovs_interfaceid": "dd1d7aa2-c15c-43ce-a89e-db2233286368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:10:08.600322 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:3a:b8,bridge_name='br-int',has_traffic_filtering=True,id=dd1d7aa2-c15c-43ce-a89e-db2233286368,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd1d7aa2-c1') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:10:08.600538 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:3a:b8,bridge_name='br-int',has_traffic_filtering=True,id=dd1d7aa2-c15c-43ce-a89e-db2233286368,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd1d7aa2-c1') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:10:08.604102 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:08.604493 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd1d7aa2-c1, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:08.608140 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:08.609667 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:10:08.610439 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:08.610610 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76ae80fb-46b3-480f-926f-1eb050873bd4) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:08.611174 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:08.612003 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:10:08.612003 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:08.613538 np0000001475 nova-compute[98471]: INFO os_vif [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:3a:b8,bridge_name='br-int',has_traffic_filtering=True,id=dd1d7aa2-c15c-43ce-a89e-db2233286368,network=Network(a1d2c522-2d61-41b3-a15c-1b894966f957),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd1d7aa2-c1')
May 27 03:10:08.614940 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:10:08.615211 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01f99269-975a-45fc-9a11-98dcfb62ab61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:10:08.615359 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:10:08.840459 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:10:08.840459 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:10:09.197943 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:09.341974 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:10:09.757241 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:09.848296 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.505s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:09.848843 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:10:09.851005 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 5.116s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:09.852721 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:09.904720 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Deleted allocations for instance 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa
May 27 03:10:10.062972 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-71c3c43b-6b53-4260-b58e-b00034881115 req-4aafbb2e-5dc8-41e6-9cd3-231be6e63e7a service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Received event network-vif-unplugged-dd1d7aa2-c15c-43ce-a89e-db2233286368 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:10.063087 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-71c3c43b-6b53-4260-b58e-b00034881115 req-4aafbb2e-5dc8-41e6-9cd3-231be6e63e7a service nova] Acquiring lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:10.063242 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-71c3c43b-6b53-4260-b58e-b00034881115 req-4aafbb2e-5dc8-41e6-9cd3-231be6e63e7a service nova] Lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:10.063316 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-71c3c43b-6b53-4260-b58e-b00034881115 req-4aafbb2e-5dc8-41e6-9cd3-231be6e63e7a service nova] Lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:10.063796 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-71c3c43b-6b53-4260-b58e-b00034881115 req-4aafbb2e-5dc8-41e6-9cd3-231be6e63e7a service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] No waiting events found dispatching network-vif-unplugged-dd1d7aa2-c15c-43ce-a89e-db2233286368 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:10:10.063796 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-71c3c43b-6b53-4260-b58e-b00034881115 req-4aafbb2e-5dc8-41e6-9cd3-231be6e63e7a service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Received event network-vif-unplugged-dd1d7aa2-c15c-43ce-a89e-db2233286368 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:10:10.360882 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:10:10.364775 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:10:10.364775 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:10.364775 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:10.426138 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba49dfb8c2c14ef89cdf87bd1bb65d7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4433f475a34911aac6a9ace35bbf5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:10:10.597132 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.056s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:10:10.597427 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:10:10.611894 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:10:10.612762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:10:10.613261 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:10:10.613467 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:10:10.614203 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:10:10.614203 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:10:10.626361 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:10:10.626361 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:10.631339 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:10:10.631339 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:10.638531 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135] added
May 27 03:10:10.638531 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:10:10.638531 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:10:10.638531 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:10:10.638531 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:10:10.638531 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:10:10.638531 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:10.638820 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:10:10.639508 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0247(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:10:10.639947 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:10:10.644474 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135] added
May 27 03:10:10.644474 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:10:10.644474 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:10:10.644474 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:10:10.644474 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:10:10.644474 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:10:10.644474 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:10.644656 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:10:10.645015 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0313(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:10:10.645015 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:10:10.866468 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:10:10.914725 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b33756b3-8495-4b4d-8633-38eb94d966f8 tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Lock "2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.979s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:10.996254 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Successfully created port: 6017d14a-ec81-49b8-899b-0f800b1c116a {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:10:11.375859 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:10:11.420117 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:11.486455 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "408047d8-a3ab-415c-a667-204e70271bed" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:11.486646 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "408047d8-a3ab-415c-a667-204e70271bed" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:11.486804 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Shelving
May 27 03:10:11.613758 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Successfully updated port: 6017d14a-ec81-49b8-899b-0f800b1c116a {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:10:11.640370 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:10:11.645914 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:10:11.654136 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:10:11.654136 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:10:11.660346 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:10:11.660346 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:11.667550 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:11.669564 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-27375fc8-3400-4251-96ba-c708ce5bffd0 req-4bce326d-846d-468e-81d2-b5144db85ed1 service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Received event network-changed-6017d14a-ec81-49b8-899b-0f800b1c116a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:11.670456 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-27375fc8-3400-4251-96ba-c708ce5bffd0 req-4bce326d-846d-468e-81d2-b5144db85ed1 service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Refreshing instance network info cache due to event network-changed-6017d14a-ec81-49b8-899b-0f800b1c116a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:10:11.671231 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-27375fc8-3400-4251-96ba-c708ce5bffd0 req-4bce326d-846d-468e-81d2-b5144db85ed1 service nova] Acquiring lock "refresh_cache-4d78ea44-9e63-4671-91bc-ee77eb1885cc" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:10:11.671764 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-27375fc8-3400-4251-96ba-c708ce5bffd0 req-4bce326d-846d-468e-81d2-b5144db85ed1 service nova] Acquired lock "refresh_cache-4d78ea44-9e63-4671-91bc-ee77eb1885cc" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:10:11.671764 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-27375fc8-3400-4251-96ba-c708ce5bffd0 req-4bce326d-846d-468e-81d2-b5144db85ed1 service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Refreshing network info cache for port 6017d14a-ec81-49b8-899b-0f800b1c116a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:10:11.675004 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:11.687269 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:10:11.687269 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:10:11.687269 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:11.687269 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:11.687269 np0000001475 nova-compute[98471]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:10:11.687269 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:10:11.688102 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:10:11.688102 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:10:11.688102 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:11.688102 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:11.688102 np0000001475 nova-compute[98471]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:10:11.688102 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:10:11.695515 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:10:11.695515 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:10:11.695515 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:11.695515 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:11.695515 np0000001475 nova-compute[98471]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:10:11.695515 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:10:11.695822 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:10:11.695822 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:10:11.695822 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:11.695822 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:11.695822 np0000001475 nova-compute[98471]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:10:11.695822 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:10:11.736955 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135, portal: 192.168.50.100,3260]
May 27 03:10:11.736955 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135, portal: 192.168.50.100,3260] successful.
May 27 03:10:11.736955 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:11.752934 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135, portal: 192.168.40.100,3260]
May 27 03:10:11.752934 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135, portal: 192.168.40.100,3260] successful.
May 27 03:10:11.752934 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:11.760406 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:11.769950 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:11.788485 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:10:11.788485 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:10:11.788485 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:11.788485 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:11.788485 np0000001475 nova-compute[98471]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:10:11.788485 np0000001475 nova-compute[98471]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:11.788485 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:11.788485 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:10:11.788798 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:10:11.788798 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:10:11.788798 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:11.788798 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:11.788798 np0000001475 nova-compute[98471]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:10:11.788798 np0000001475 nova-compute[98471]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:11.788798 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:11.788798 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:10:11.789025 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:10:11.789105 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:10:11.790152 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] HCTL ('10', '-', '-', 0) found on session 147 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:10:11.790288 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:10:11.811884 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:10:11.811884 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:10:11.811884 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:11.811884 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:11.811884 np0000001475 nova-compute[98471]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:10:11.811884 np0000001475 nova-compute[98471]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:11.811884 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:11.811884 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:10:11.811884 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:10:11.811884 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:10:11.811884 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:11.811884 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:11.811884 np0000001475 nova-compute[98471]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:10:11.811884 np0000001475 nova-compute[98471]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:11.811884 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:11.811884 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:10:11.811884 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.198s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:10:11.811884 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:10:11.811884 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] HCTL ('11', '-', '-', 0) found on session 148 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:10:11.812489 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:10:11.825876 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0003384120000191615 future=<Future at 0x755704784830 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:11.825876 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Emitting event <LifecycleEvent: 1779851396.8241282, dbecddfd-649b-4343-a5d2-bbbbf0c67de5 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:10:11.825876 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:11.825876 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=1.3421505809997143 future=<Future at 0x75570445bc80 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:11.825876 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=1.3420608050000737 future=<Future at 0x75570445bc80 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:11.826185 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Searching for a device in session 147 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:10:11.826429 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:10:11.826897 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] VM Stopped (Lifecycle Event)
May 27 03:10:11.836896 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Searching for a device in session 148 and hctl ['11', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:10:12.118035 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "refresh_cache-4d78ea44-9e63-4671-91bc-ee77eb1885cc" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:10:12.174817 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-27375fc8-3400-4251-96ba-c708ce5bffd0 req-4bce326d-846d-468e-81d2-b5144db85ed1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:12.232661 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-27375fc8-3400-4251-96ba-c708ce5bffd0 req-4bce326d-846d-468e-81d2-b5144db85ed1 service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:10:12.336331 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: dbecddfd-649b-4343-a5d2-bbbbf0c67de5] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:12.389024 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:10:12.390334 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:10:12.390664 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Creating image(s)
May 27 03:10:12.391194 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:12.391364 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "/opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:12.391870 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "/opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:12.392498 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:10:12.397039 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:10:12.398434 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:12.443432 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-27375fc8-3400-4251-96ba-c708ce5bffd0 req-4bce326d-846d-468e-81d2-b5144db85ed1 service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:10:12.505475 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.107s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:12.506249 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:12.507048 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:12.507161 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:10:12.514054 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:10:12.515349 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:12.529816 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:12.554359 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:12.557533 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:12.584723 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:12.626090 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.110s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:12.628313 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:12.735345 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc/disk 1073741824" returned: 0 in 0.107s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:12.736056 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:12.736821 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:12.837142 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Searching for a device in session 148 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:10:12.837994 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:10:12.838476 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.101s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:12.839007 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:10:12.839593 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:12.896449 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999349080999764 future=<Future at 0x75570472a7e0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:12.898030 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Instance destroyed successfully.
May 27 03:10:12.898772 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'numa_topology' on Instance uuid 408047d8-a3ab-415c-a667-204e70271bed {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:10:12.947260 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:12.947651 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Cannot resize image /opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:10:12.948249 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:10:12.948462 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Ensure instance console log exists: /opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:10:12.949095 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-27375fc8-3400-4251-96ba-c708ce5bffd0 req-4bce326d-846d-468e-81d2-b5144db85ed1 service nova] Releasing lock "refresh_cache-4d78ea44-9e63-4671-91bc-ee77eb1885cc" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:10:12.949645 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquired lock "refresh_cache-4d78ea44-9e63-4671-91bc-ee77eb1885cc" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:10:12.949645 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:10:12.950601 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:12.950830 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:12.950989 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:13.158389 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:13.169170 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0004596520002451143 future=<Future at 0x75570445bc80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:13.169377 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Emitting event <LifecycleEvent: 1779851398.167555, bfade827-2998-4fe5-b4d4-3397233e8c14 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:10:13.169601 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] VM Stopped (Lifecycle Event)
May 27 03:10:13.171091 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:13.171091 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=3.639558482999746 future=<Future at 0x75572c1270e0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:13.171091 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=3.6394320889999108 future=<Future at 0x75572c1270e0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:13.540040 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Beginning cold snapshot process
May 27 03:10:13.553251 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:10:13.612990 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:13.636823 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Found WWN 330000000f2216dc3 for multipath device dm-3 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:10:13.636823 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:10:13.636823 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] <== connect_volume: return (5094ms) {'type': 'block', 'scsi_wwn': '330000000f2216dc3', 'path': '/dev/dm-3', 'multipath_id': '330000000f2216dc3'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:10:13.636823 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f2216dc3', 'path': '/dev/dm-3', 'multipath_id': '330000000f2216dc3'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:10:13.640300 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 5.024s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:10:13.640300 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01f99269-975a-45fc-9a11-98dcfb62ab61', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:10:13.640300 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:10:13.645268 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lazy-loading 'flavor' on Instance uuid eb7ae482-4f6f-4b54-9923-3657c90de9fa {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:10:13.674479 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-39235c27-0c62-49b7-8531-20086ff3ae9d tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: bfade827-2998-4fe5-b4d4-3397233e8c14] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:13.683337 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:10:13.683337 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:10:13.683337 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:13.683337 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:13.683337 np0000001475 nova-compute[98471]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:10:13.683337 np0000001475 nova-compute[98471]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:13.683337 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:13.683337 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:10:13.683337 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:10:13.683337 np0000001475 nova-compute[98471]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61 (non-flash)
May 27 03:10:13.683337 np0000001475 nova-compute[98471]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:13.683337 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:13.683337 np0000001475 nova-compute[98471]: tcp: [146] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948 (non-flash)
May 27 03:10:13.683337 np0000001475 nova-compute[98471]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:13.683337 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:13.683337 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:10:13.683337 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', '142'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e47babf5-1b9a-4476-96ad-004459f48948', '146'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', '148')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:10:13.683337 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '100')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:10:13.683337 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61', '101')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:10:13.684715 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755724711300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61'): ({'sdc'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:10:13.685761 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Removing multipathed devices sdb, sdc {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:10:13.686170 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Flush multipath device 3300000005ed09b58 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:10:13.750878 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:10:13.797970 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:10:13.816219 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:13.861432 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:10:13.861432 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:10:13.862066 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:10:13.878538 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:10:13.878828 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:10:13.900623 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:13.904399 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-888cb452-07c0-4933-ab03-6d2ad0bdd00a req-fc69c856-9e7e-4ed2-8a65-983be2441e84 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-vif-unplugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:13.904775 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-888cb452-07c0-4933-ab03-6d2ad0bdd00a req-fc69c856-9e7e-4ed2-8a65-983be2441e84 service nova] Acquiring lock "408047d8-a3ab-415c-a667-204e70271bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:13.905004 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-888cb452-07c0-4933-ab03-6d2ad0bdd00a req-fc69c856-9e7e-4ed2-8a65-983be2441e84 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:13.909027 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-888cb452-07c0-4933-ab03-6d2ad0bdd00a req-fc69c856-9e7e-4ed2-8a65-983be2441e84 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:13.909254 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-888cb452-07c0-4933-ab03-6d2ad0bdd00a req-fc69c856-9e7e-4ed2-8a65-983be2441e84 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] No waiting events found dispatching network-vif-unplugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:10:13.909392 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-888cb452-07c0-4933-ab03-6d2ad0bdd00a req-fc69c856-9e7e-4ed2-8a65-983be2441e84 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received unexpected event network-vif-unplugged-9b975543-7a67-4aef-a074-e8748cdcbc87 for instance with vm_state active and task_state shelving_image_pending_upload.
May 27 03:10:13.909852 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-888cb452-07c0-4933-ab03-6d2ad0bdd00a req-fc69c856-9e7e-4ed2-8a65-983be2441e84 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-vif-unplugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:13.909852 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-888cb452-07c0-4933-ab03-6d2ad0bdd00a req-fc69c856-9e7e-4ed2-8a65-983be2441e84 service nova] Acquiring lock "408047d8-a3ab-415c-a667-204e70271bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:13.909852 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-888cb452-07c0-4933-ab03-6d2ad0bdd00a req-fc69c856-9e7e-4ed2-8a65-983be2441e84 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:13.909978 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-888cb452-07c0-4933-ab03-6d2ad0bdd00a req-fc69c856-9e7e-4ed2-8a65-983be2441e84 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:13.911073 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-888cb452-07c0-4933-ab03-6d2ad0bdd00a req-fc69c856-9e7e-4ed2-8a65-983be2441e84 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] No waiting events found dispatching network-vif-unplugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:10:13.911073 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-888cb452-07c0-4933-ab03-6d2ad0bdd00a req-fc69c856-9e7e-4ed2-8a65-983be2441e84 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received unexpected event network-vif-unplugged-9b975543-7a67-4aef-a074-e8748cdcbc87 for instance with vm_state active and task_state shelving_image_pending_upload.
May 27 03:10:13.933666 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 100, target: iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61, portal: 192.168.40.100,3260]
May 27 03:10:13.933666 np0000001475 nova-compute[98471]: Logout of [sid: 100, target: iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61, portal: 192.168.40.100,3260] successful.
May 27 03:10:13.933666 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:13.955638 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:13.971500 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:14.013843 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 101, target: iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61, portal: 192.168.50.100,3260]
May 27 03:10:14.013843 np0000001475 nova-compute[98471]: Logout of [sid: 101, target: iqn.2023-03.storpool.com:os--volume-01f99269-975a-45fc-9a11-98dcfb62ab61, portal: 192.168.50.100,3260] successful.
May 27 03:10:14.013843 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:14.031405 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:14.031573 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:10:14.031678 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] <== disconnect_volume: return (5416ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:10:14.031831 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:10:14.032074 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Deleting instance files /opt/stack/data/nova/instances/5fe4c21d-3de1-479a-ad36-e4377e7cea11_del
May 27 03:10:14.032620 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Deletion of /opt/stack/data/nova/instances/5fe4c21d-3de1-479a-ad36-e4377e7cea11_del complete
May 27 03:10:14.038607 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Updating instance_info_cache with network_info: [{"id": "6017d14a-ec81-49b8-899b-0f800b1c116a", "address": "fa:16:3e:3d:15:0b", "network": {"id": "efe3ae66-9047-4b8e-8231-b05da27e6387", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1240651520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5b4433f475a34911aac6a9ace35bbf5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6017d14a-ec", "ovs_interfaceid": "6017d14a-ec81-49b8-899b-0f800b1c116a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:10:14.153853 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Attempting to attach volume dd3605ba-8b97-468b-963c-e6fb8c7c1135 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:10:14.156413 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:10:14.156413 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:10:14.156413 np0000001475 nova-compute[98471]:   <alias name="ua-dd3605ba-8b97-468b-963c-e6fb8c7c1135"/>
May 27 03:10:14.156413 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:10:14.156413 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:10:14.156413 np0000001475 nova-compute[98471]:   <serial>dd3605ba-8b97-468b-963c-e6fb8c7c1135</serial>
May 27 03:10:14.156413 np0000001475 nova-compute[98471]: </disk>
May 27 03:10:14.156413 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:10:14.308658 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:14.543053 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Releasing lock "refresh_cache-4d78ea44-9e63-4671-91bc-ee77eb1885cc" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:10:14.543476 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Instance network_info: |[{"id": "6017d14a-ec81-49b8-899b-0f800b1c116a", "address": "fa:16:3e:3d:15:0b", "network": {"id": "efe3ae66-9047-4b8e-8231-b05da27e6387", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1240651520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5b4433f475a34911aac6a9ace35bbf5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6017d14a-ec", "ovs_interfaceid": "6017d14a-ec81-49b8-899b-0f800b1c116a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:10:14.546567 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Start _get_guest_xml network_info=[{"id": "6017d14a-ec81-49b8-899b-0f800b1c116a", "address": "fa:16:3e:3d:15:0b", "network": {"id": "efe3ae66-9047-4b8e-8231-b05da27e6387", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1240651520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5b4433f475a34911aac6a9ace35bbf5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6017d14a-ec", "ovs_interfaceid": "6017d14a-ec81-49b8-899b-0f800b1c116a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:10:14.549321 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Took 6.82 seconds to destroy the instance on the hypervisor.
May 27 03:10:14.555118 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:10:14.560352 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:10:14.561203 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:10:14.561203 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:14.563013 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:10:14.565198 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachmentScenario-server-1408500227', uuid='4d78ea44-9e63-4671-91bc-ee77eb1885cc'), owner=OwnerMeta(userid='ba49dfb8c2c14ef89cdf87bd1bb65d7f', username='tempest-TestServerVolumeAttachmentScenario-1304406302-project-member', projectid='5b4433f475a34911aac6a9ace35bbf5e', projectname='tempest-TestServerVolumeAttachmentScenario-1304406302'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6017d14a-ec81-49b8-899b-0f800b1c116a", "address": "fa:16:3e:3d:15:0b", "network": {"id": "efe3ae66-9047-4b8e-8231-b05da27e6387", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1240651520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5b4433f475a34911aac6a9ace35bbf5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6017d14a-ec", "ovs_interfaceid": "6017d14a-ec81-49b8-899b-0f800b1c116a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851414.5645282) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:10:14.569166 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:10:14.569166 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:10:14.571498 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:10:14.571812 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:10:14.573854 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:10:14.575543 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:10:14.575543 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:10:14.575543 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:10:14.575543 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:10:14.575543 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:10:14.575543 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:10:14.575543 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:10:14.575543 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:10:14.575543 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:10:14.575543 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:10:14.577426 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:10:14.623071 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:10:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1408500227',display_name='tempest-TestServerVolumeAttachmentScenario-server-1408500227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testservervolumeattachmentscenario-server-1408500227',id=61,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp8RtsSZDV+8La8Qmajk5ZExJctpNSdH+dBNBO9slAKTbJYsNHF115VoN+gdbbxvY8Yv+iZdpFP8OApEPgm47Or+jaEez0PbKKZBeJfTJIHsGXqSXaHlJuIwVcFVCsoWg==',key_name='tempest-keypair-412725153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b4433f475a34911aac6a9ace35bbf5e',ramdisk_id='',reservation_id='r-f667na45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1304406302',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1304406302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:10:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba49dfb8c2c14ef89cdf87bd1bb65d7f',uuid=4d78ea44-9e63-4671-91bc-ee77eb1885cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6017d14a-ec81-49b8-899b-0f800b1c116a", "address": "fa:16:3e:3d:15:0b", "network": {"id": "efe3ae66-9047-4b8e-8231-b05da27e6387", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1240651520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5b4433f475a34911aac6a9ace35bbf5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6017d14a-ec", "ovs_interfaceid": "6017d14a-ec81-49b8-899b-0f800b1c116a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:10:14.623264 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Converting VIF {"id": "6017d14a-ec81-49b8-899b-0f800b1c116a", "address": "fa:16:3e:3d:15:0b", "network": {"id": "efe3ae66-9047-4b8e-8231-b05da27e6387", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1240651520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5b4433f475a34911aac6a9ace35bbf5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6017d14a-ec", "ovs_interfaceid": "6017d14a-ec81-49b8-899b-0f800b1c116a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:10:14.623947 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:15:0b,bridge_name='br-int',has_traffic_filtering=True,id=6017d14a-ec81-49b8-899b-0f800b1c116a,network=Network(efe3ae66-9047-4b8e-8231-b05da27e6387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6017d14a-ec') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:10:14.624878 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d78ea44-9e63-4671-91bc-ee77eb1885cc {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:10:14.661768 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:15.062531 np0000001475 nova-compute[98471]: DEBUG nova.privsep.utils [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98471) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 03:10:15.062826 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk /opt/stack/data/nova/instances/snapshots/tmpyzd9oj8n/10fb8d3ac377471db249ea6968585765 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:15.137297 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] End _get_guest_xml xml=<domain type="qemu">
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:   <uuid>4d78ea44-9e63-4671-91bc-ee77eb1885cc</uuid>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:   <name>instance-0000003d</name>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1408500227</nova:name>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:10:14</nova:creationTime>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:         <nova:user uuid="ba49dfb8c2c14ef89cdf87bd1bb65d7f">tempest-TestServerVolumeAttachmentScenario-1304406302-project-member</nova:user>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:         <nova:project uuid="5b4433f475a34911aac6a9ace35bbf5e">tempest-TestServerVolumeAttachmentScenario-1304406302</nova:project>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:         <nova:port uuid="6017d14a-ec81-49b8-899b-0f800b1c116a">
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     <system>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <entry name="serial">4d78ea44-9e63-4671-91bc-ee77eb1885cc</entry>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <entry name="uuid">4d78ea44-9e63-4671-91bc-ee77eb1885cc</entry>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     </system>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:   <os>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:   </os>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:   <features>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:   </features>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:   <devices>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc/disk"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     </disk>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc/disk.config"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     </disk>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:3d:15:0b"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <target dev="tap6017d14a-ec"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     </interface>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc/console.log" append="off"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     </serial>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     <video>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     </video>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     </rng>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:   </devices>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]: </domain>
May 27 03:10:15.137297 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:10:15.139819 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Preparing to wait for external event network-vif-plugged-6017d14a-ec81-49b8-899b-0f800b1c116a {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:10:15.139819 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:15.139819 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:15.139819 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:15.139819 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:10:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1408500227',display_name='tempest-TestServerVolumeAttachmentScenario-server-1408500227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testservervolumeattachmentscenario-server-1408500227',id=61,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp8RtsSZDV+8La8Qmajk5ZExJctpNSdH+dBNBO9slAKTbJYsNHF115VoN+gdbbxvY8Yv+iZdpFP8OApEPgm47Or+jaEez0PbKKZBeJfTJIHsGXqSXaHlJuIwVcFVCsoWg==',key_name='tempest-keypair-412725153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b4433f475a34911aac6a9ace35bbf5e',ramdisk_id='',reservation_id='r-f667na45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1304406302',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1304406302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:10:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba49dfb8c2c14ef89cdf87bd1bb65d7f',uuid=4d78ea44-9e63-4671-91bc-ee77eb1885cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6017d14a-ec81-49b8-899b-0f800b1c116a", "address": "fa:16:3e:3d:15:0b", "network": {"id": "efe3ae66-9047-4b8e-8231-b05da27e6387", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1240651520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5b4433f475a34911aac6a9ace35bbf5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6017d14a-ec", "ovs_interfaceid": "6017d14a-ec81-49b8-899b-0f800b1c116a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:10:15.140134 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Converting VIF {"id": "6017d14a-ec81-49b8-899b-0f800b1c116a", "address": "fa:16:3e:3d:15:0b", "network": {"id": "efe3ae66-9047-4b8e-8231-b05da27e6387", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1240651520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5b4433f475a34911aac6a9ace35bbf5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6017d14a-ec", "ovs_interfaceid": "6017d14a-ec81-49b8-899b-0f800b1c116a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:10:15.141289 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:15:0b,bridge_name='br-int',has_traffic_filtering=True,id=6017d14a-ec81-49b8-899b-0f800b1c116a,network=Network(efe3ae66-9047-4b8e-8231-b05da27e6387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6017d14a-ec') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:10:15.141896 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:15:0b,bridge_name='br-int',has_traffic_filtering=True,id=6017d14a-ec81-49b8-899b-0f800b1c116a,network=Network(efe3ae66-9047-4b8e-8231-b05da27e6387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6017d14a-ec') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:10:15.143728 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:15.145233 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4b7cfb0a-440c-4ff2-a7b0-58f9f58badd8 req-1b80d883-4a46-4f53-b919-f93b736bc99a service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Received event network-vif-deleted-dd1d7aa2-c15c-43ce-a89e-db2233286368 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:15.145583 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-4b7cfb0a-440c-4ff2-a7b0-58f9f58badd8 req-1b80d883-4a46-4f53-b919-f93b736bc99a service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Neutron deleted interface dd1d7aa2-c15c-43ce-a89e-db2233286368; detaching it from the instance and deleting it from the info cache
May 27 03:10:15.145767 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4b7cfb0a-440c-4ff2-a7b0-58f9f58badd8 req-1b80d883-4a46-4f53-b919-f93b736bc99a service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:10:15.147447 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:15.147524 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:10:15.149167 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:15.149167 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b1eafbf-32f9-5184-92a7-053bb5a1d9ba', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:15.150045 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:15.150900 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:10:15.161516 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:15.164104 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:15.164310 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6017d14a-ec, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:15.164647 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6017d14a-ec, col_values=(('qos', UUID('a2583bae-eda9-4e58-84b5-4f4a91841d47')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:15.164963 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6017d14a-ec, col_values=(('external_ids', {'iface-id': '6017d14a-ec81-49b8-899b-0f800b1c116a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:15:0b', 'vm-uuid': '4d78ea44-9e63-4671-91bc-ee77eb1885cc'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:15.165947 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:15.167252 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:10:15.175899 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:15.178354 np0000001475 nova-compute[98471]: INFO os_vif [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:15:0b,bridge_name='br-int',has_traffic_filtering=True,id=6017d14a-ec81-49b8-899b-0f800b1c116a,network=Network(efe3ae66-9047-4b8e-8231-b05da27e6387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6017d14a-ec')
May 27 03:10:15.351960 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk /opt/stack/data/nova/instances/snapshots/tmpyzd9oj8n/10fb8d3ac377471db249ea6968585765" returned: 0 in 0.289s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:15.353757 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Snapshot extracted, beginning image upload
May 27 03:10:15.587294 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:10:15.654826 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4b7cfb0a-440c-4ff2-a7b0-58f9f58badd8 req-1b80d883-4a46-4f53-b919-f93b736bc99a service nova] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Detach interface failed, port_id=dd1d7aa2-c15c-43ce-a89e-db2233286368, reason: Instance 5fe4c21d-3de1-479a-ad36-e4377e7cea11 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:10:15.886896 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:10:15.887078 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:10:15.887253 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:10:15.887402 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] No VIF found with MAC fa:16:3e:a9:da:0b, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:10:16.089447 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Took 1.53 seconds to deallocate network for instance.
May 27 03:10:16.492036 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:16.495115 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:16.664434 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Took 0.57 seconds to detach 1 volumes for instance.
May 27 03:10:16.705047 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:10:16.705047 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:10:16.705047 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] No VIF found with MAC fa:16:3e:3d:15:0b, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:10:16.705709 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Using config drive
May 27 03:10:16.811885 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0013232139999672654 future=<Future at 0x75572c1270e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:16.812394 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Emitting event <LifecycleEvent: 1779851401.8104212, 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:10:16.812614 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:16.812754 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] VM Stopped (Lifecycle Event)
May 27 03:10:16.813617 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=6.275256548000016 future=<Future at 0x7557046d36e0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:16.813719 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=6.275153145999866 future=<Future at 0x7557046d36e0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:16.986280 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:17.173113 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:17.173382 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:17.211053 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:17.316812 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 2fc5d5e8-838b-41a4-9a6a-1d51379dd7fa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:17.366927 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Creating config drive at /opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc/disk.config
May 27 03:10:17.370913 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptlxg06v5 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:17.444829 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptlxg06v5" returned: 0 in 0.074s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:17.446269 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9d7ecbbc-77a6-4ba7-9b59-6e2c8609fb22 tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.665s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:17.507875 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:10:17.508334 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:10:17.975646 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:18.009846 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:18.011431 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:10:18.019589 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:18.107409 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:18.231511 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-bf79f47e-990f-47a1-913a-1e9ee14c80d1 req-c18810f4-18e1-420d-93b6-3c347d168022 service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Received event network-vif-plugged-6017d14a-ec81-49b8-899b-0f800b1c116a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:18.232185 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bf79f47e-990f-47a1-913a-1e9ee14c80d1 req-c18810f4-18e1-420d-93b6-3c347d168022 service nova] Acquiring lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:18.232440 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bf79f47e-990f-47a1-913a-1e9ee14c80d1 req-c18810f4-18e1-420d-93b6-3c347d168022 service nova] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:18.232591 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bf79f47e-990f-47a1-913a-1e9ee14c80d1 req-c18810f4-18e1-420d-93b6-3c347d168022 service nova] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:18.232858 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-bf79f47e-990f-47a1-913a-1e9ee14c80d1 req-c18810f4-18e1-420d-93b6-3c347d168022 service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Processing event network-vif-plugged-6017d14a-ec81-49b8-899b-0f800b1c116a {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:10:18.274983 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Snapshot image upload complete
May 27 03:10:18.275452 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:18.376687 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:18.382884 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:18.385929 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:18.417409 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:18.520996 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.348s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:18.572409 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Deleted allocations for instance 5fe4c21d-3de1-479a-ad36-e4377e7cea11
May 27 03:10:18.786514 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Shelve offloading
May 27 03:10:18.828173 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:10:18.828754 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851418.8282537, 4d78ea44-9e63-4671-91bc-ee77eb1885cc => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:10:18.828929 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] VM Started (Lifecycle Event)
May 27 03:10:18.830573 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:10:18.833520 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Instance spawned successfully.
May 27 03:10:18.833956 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:10:19.303871 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Instance destroyed successfully.
May 27 03:10:19.304237 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:19.306382 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:10:19.306473 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquired lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:10:19.306605 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:10:19.333144 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:19.335153 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:10:19.342804 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:10:19.343005 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:10:19.343380 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:10:19.343607 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:10:19.343992 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:10:19.344365 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:10:19.581797 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4f7c73db-8d46-428c-b482-41b9d95df667 tempest-TestVolumeBootPatternV346-1509575509 tempest-TestVolumeBootPatternV346-1509575509-project-member] Lock "5fe4c21d-3de1-479a-ad36-e4377e7cea11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.365s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:19.808577 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:19.839047 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:10:19.839047 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851419.837695, 4d78ea44-9e63-4671-91bc-ee77eb1885cc => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:10:19.839047 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] VM Paused (Lifecycle Event)
May 27 03:10:19.849619 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Took 7.46 seconds to spawn the instance on the hypervisor.
May 27 03:10:19.850276 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:20.149149 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:20.166756 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:20.320688 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:20.327993 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a839a87f-37fb-484e-ab8d-120278f07ac3 req-efc19694-8132-476b-bd58-4523c540e3bb service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Received event network-vif-plugged-6017d14a-ec81-49b8-899b-0f800b1c116a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:20.328113 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a839a87f-37fb-484e-ab8d-120278f07ac3 req-efc19694-8132-476b-bd58-4523c540e3bb service nova] Acquiring lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:20.328246 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a839a87f-37fb-484e-ab8d-120278f07ac3 req-efc19694-8132-476b-bd58-4523c540e3bb service nova] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:20.329049 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a839a87f-37fb-484e-ab8d-120278f07ac3 req-efc19694-8132-476b-bd58-4523c540e3bb service nova] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:20.329049 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a839a87f-37fb-484e-ab8d-120278f07ac3 req-efc19694-8132-476b-bd58-4523c540e3bb service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] No waiting events found dispatching network-vif-plugged-6017d14a-ec81-49b8-899b-0f800b1c116a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:10:20.329049 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-a839a87f-37fb-484e-ab8d-120278f07ac3 req-efc19694-8132-476b-bd58-4523c540e3bb service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Received unexpected event network-vif-plugged-6017d14a-ec81-49b8-899b-0f800b1c116a for instance with vm_state active and task_state None.
May 27 03:10:20.341214 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:20.343839 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851420.3435876, 4d78ea44-9e63-4671-91bc-ee77eb1885cc => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:10:20.343976 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] VM Resumed (Lifecycle Event)
May 27 03:10:20.364816 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Took 16.40 seconds to build instance.
May 27 03:10:20.383693 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Updating instance_info_cache with network_info: [{"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:10:20.846794 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:20.851957 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:10:20.868967 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9c60cd0c-5799-4e2f-bb53-12742be798a8 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.919s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:20.886795 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Releasing lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:10:20.887249 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:20.887675 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:21.494639 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:21.691900 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Instance destroyed successfully.
May 27 03:10:21.692287 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'resources' on Instance uuid 408047d8-a3ab-415c-a667-204e70271bed {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:10:21.747229 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-aa49240d-24b0-4d61-90f1-c4ef0e3b029c req-d1876231-b6c9-495d-b136-2a3d1f6c3532 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-changed-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:21.748276 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-aa49240d-24b0-4d61-90f1-c4ef0e3b029c req-d1876231-b6c9-495d-b136-2a3d1f6c3532 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Refreshing instance network info cache due to event network-changed-9b975543-7a67-4aef-a074-e8748cdcbc87. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:10:21.748454 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa49240d-24b0-4d61-90f1-c4ef0e3b029c req-d1876231-b6c9-495d-b136-2a3d1f6c3532 service nova] Acquiring lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:10:21.748546 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa49240d-24b0-4d61-90f1-c4ef0e3b029c req-d1876231-b6c9-495d-b136-2a3d1f6c3532 service nova] Acquired lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:10:21.748658 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-aa49240d-24b0-4d61-90f1-c4ef0e3b029c req-d1876231-b6c9-495d-b136-2a3d1f6c3532 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Refreshing network info cache for port 9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:10:22.195986 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Object Instance<408047d8-a3ab-415c-a667-204e70271bed> lazy-loaded attributes: numa_topology,resources {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:10:22.197260 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:09:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2112501231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumeshelvetestjson-server-2112501231',id=59,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFU7vN92ZF7VnROzhJNF86Ad9eDOUXP7NQOeW8Q3Nkb8EhsbNJ0sXFrodZbo2Slzc36KeZpxVAsNnnRCiblv7iLv8OuH7fL7sux63j2sKxs7j6cMBNVGXPF7Mni6bSHLsw==',key_name='tempest-keypair-495903838',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:09:30Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c547b519adf248728dfd0b2232bfc118',ramdisk_id='',reservation_id='r-yz7ee0f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1364873533',owner_user_name='tempest-AttachVolumeShelveTestJSON-1364873533-project-member',shelved_at='2026-05-27T03:10:18.274921',shelved_host='np0000001475',shelved_image_id='cfbad153-fa79-4d75-b6d1-47c6c8c7536f'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:10:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c72d670892e44d88e674c9b584bc718',uuid=408047d8-a3ab-415c-a667-204e70271bed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:10:22.197857 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converting VIF {"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:10:22.198063 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=9b975543-7a67-4aef-a074-e8748cdcbc87,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b975543-7a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:10:22.198266 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=9b975543-7a67-4aef-a074-e8748cdcbc87,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b975543-7a') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:10:22.199481 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:22.199645 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b975543-7a, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:22.201474 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:22.203136 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:10:22.203467 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:22.204513 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:22.204674 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62a31c30-29d5-4bc8-9c69-cf807978cf13) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:22.205284 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:22.205908 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:10:22.210934 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:22.214815 np0000001475 nova-compute[98471]: INFO os_vif [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=9b975543-7a67-4aef-a074-e8748cdcbc87,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b975543-7a')
May 27 03:10:22.215105 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Deleting instance files /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed_del
May 27 03:10:22.221215 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Deletion of /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed_del complete
May 27 03:10:22.254096 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-aa49240d-24b0-4d61-90f1-c4ef0e3b029c req-d1876231-b6c9-495d-b136-2a3d1f6c3532 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:22.379138 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-29f444c0-8441-4be2-aebf-037a76e3e433 req-51dc1d69-b32d-494c-bfae-558886364f90 service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Received event network-changed-6017d14a-ec81-49b8-899b-0f800b1c116a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:22.379138 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-29f444c0-8441-4be2-aebf-037a76e3e433 req-51dc1d69-b32d-494c-bfae-558886364f90 service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Refreshing instance network info cache due to event network-changed-6017d14a-ec81-49b8-899b-0f800b1c116a. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:10:22.379138 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-29f444c0-8441-4be2-aebf-037a76e3e433 req-51dc1d69-b32d-494c-bfae-558886364f90 service nova] Acquiring lock "refresh_cache-4d78ea44-9e63-4671-91bc-ee77eb1885cc" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:10:22.379138 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-29f444c0-8441-4be2-aebf-037a76e3e433 req-51dc1d69-b32d-494c-bfae-558886364f90 service nova] Acquired lock "refresh_cache-4d78ea44-9e63-4671-91bc-ee77eb1885cc" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:10:22.379138 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-29f444c0-8441-4be2-aebf-037a76e3e433 req-51dc1d69-b32d-494c-bfae-558886364f90 service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Refreshing network info cache for port 6017d14a-ec81-49b8-899b-0f800b1c116a {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:10:22.652645 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:22.842755 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Deleted allocations for instance 408047d8-a3ab-415c-a667-204e70271bed
May 27 03:10:22.885550 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-29f444c0-8441-4be2-aebf-037a76e3e433 req-51dc1d69-b32d-494c-bfae-558886364f90 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:22.900357 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-aa49240d-24b0-4d61-90f1-c4ef0e3b029c req-d1876231-b6c9-495d-b136-2a3d1f6c3532 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:23.089400 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.00046280700007628184 future=<Future at 0x7557046d36e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:23.090212 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Emitting event <LifecycleEvent: 1779851408.0887847, 5fe4c21d-3de1-479a-ad36-e4377e7cea11 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:10:23.090455 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:23.090455 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=4.805214176999925 future=<Future at 0x75570472a7e0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:23.090586 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=4.805114711999977 future=<Future at 0x75570472a7e0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:23.095201 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] VM Stopped (Lifecycle Event)
May 27 03:10:23.102515 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-aa49240d-24b0-4d61-90f1-c4ef0e3b029c req-d1876231-b6c9-495d-b136-2a3d1f6c3532 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Updated VIF entry in instance network info cache for port 9b975543-7a67-4aef-a074-e8748cdcbc87. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:10:23.102936 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-aa49240d-24b0-4d61-90f1-c4ef0e3b029c req-d1876231-b6c9-495d-b136-2a3d1f6c3532 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Updating instance_info_cache with network_info: [{"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9b975543-7a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:10:23.334924 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-29f444c0-8441-4be2-aebf-037a76e3e433 req-51dc1d69-b32d-494c-bfae-558886364f90 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:23.353191 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:23.353191 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:23.540034 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-29f444c0-8441-4be2-aebf-037a76e3e433 req-51dc1d69-b32d-494c-bfae-558886364f90 service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Updated VIF entry in instance network info cache for port 6017d14a-ec81-49b8-899b-0f800b1c116a. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:10:23.540034 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-29f444c0-8441-4be2-aebf-037a76e3e433 req-51dc1d69-b32d-494c-bfae-558886364f90 service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Updating instance_info_cache with network_info: [{"id": "6017d14a-ec81-49b8-899b-0f800b1c116a", "address": "fa:16:3e:3d:15:0b", "network": {"id": "efe3ae66-9047-4b8e-8231-b05da27e6387", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1240651520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5b4433f475a34911aac6a9ace35bbf5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6017d14a-ec", "ovs_interfaceid": "6017d14a-ec81-49b8-899b-0f800b1c116a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:10:23.604423 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 5fe4c21d-3de1-479a-ad36-e4377e7cea11] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:23.606510 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa49240d-24b0-4d61-90f1-c4ef0e3b029c req-d1876231-b6c9-495d-b136-2a3d1f6c3532 service nova] Releasing lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:10:23.655453 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:10:23.655652 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:10:24.044356 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-29f444c0-8441-4be2-aebf-037a76e3e433 req-51dc1d69-b32d-494c-bfae-558886364f90 service nova] Releasing lock "refresh_cache-4d78ea44-9e63-4671-91bc-ee77eb1885cc" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:10:24.160910 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:10:24.674020 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.321s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:24.816354 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:25.182528 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-11bbf012-8488-42bd-a245-8b8da186c60f tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "408047d8-a3ab-415c-a667-204e70271bed" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 13.695s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:26.497187 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:27.209570 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:27.588661 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:27.896043 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0003372930000296037 future=<Future at 0x75570472a7e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:27.896205 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:27.898275 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] Emitting event <LifecycleEvent: 1779851412.895582, 408047d8-a3ab-415c-a667-204e70271bed => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:10:27.898275 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] VM Stopped (Lifecycle Event)
May 27 03:10:28.061031 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "408047d8-a3ab-415c-a667-204e70271bed" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:28.061031 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "408047d8-a3ab-415c-a667-204e70271bed" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:28.061031 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Unshelving
May 27 03:10:28.331994 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:28.331994 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:28.407570 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e6b86271-7fcf-46d7-a9f0-3d4935ac2376 tempest-VolumesSnapshotTestJSON-189213940 tempest-VolumesSnapshotTestJSON-189213940-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:28.836537 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:10:29.137435 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:29.137625 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:29.150974 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'pci_requests' on Instance uuid 408047d8-a3ab-415c-a667-204e70271bed {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:10:29.392928 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:29.654379 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'numa_topology' on Instance uuid 408047d8-a3ab-415c-a667-204e70271bed {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:10:29.673315 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "828da6e6-d3a5-4f1b-bc96-683db4633520" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:29.673514 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "828da6e6-d3a5-4f1b-bc96-683db4633520" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:29.673713 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "828da6e6-d3a5-4f1b-bc96-683db4633520-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:29.673892 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "828da6e6-d3a5-4f1b-bc96-683db4633520-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:29.674031 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "828da6e6-d3a5-4f1b-bc96-683db4633520-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:29.678549 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Terminating instance
May 27 03:10:30.156478 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:10:30.156949 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Claim successful on node np0000001475
May 27 03:10:30.181434 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:10:30.199018 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:30.207178 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:30.220711 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:30.223647 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:30.242983 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:30.250625 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:30.382905 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d5e43f36-7392-47df-bfaa-10bda8e320f0 req-6c86670e-159e-4f31-a8b2-10fd62870bc5 service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Received event network-vif-unplugged-15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:30.382905 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d5e43f36-7392-47df-bfaa-10bda8e320f0 req-6c86670e-159e-4f31-a8b2-10fd62870bc5 service nova] Acquiring lock "828da6e6-d3a5-4f1b-bc96-683db4633520-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:30.383055 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d5e43f36-7392-47df-bfaa-10bda8e320f0 req-6c86670e-159e-4f31-a8b2-10fd62870bc5 service nova] Lock "828da6e6-d3a5-4f1b-bc96-683db4633520-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:30.383713 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d5e43f36-7392-47df-bfaa-10bda8e320f0 req-6c86670e-159e-4f31-a8b2-10fd62870bc5 service nova] Lock "828da6e6-d3a5-4f1b-bc96-683db4633520-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:30.383713 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d5e43f36-7392-47df-bfaa-10bda8e320f0 req-6c86670e-159e-4f31-a8b2-10fd62870bc5 service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] No waiting events found dispatching network-vif-unplugged-15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:10:30.383713 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d5e43f36-7392-47df-bfaa-10bda8e320f0 req-6c86670e-159e-4f31-a8b2-10fd62870bc5 service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Received event network-vif-unplugged-15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:10:30.529390 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999636995999936 future=<Future at 0x7557043be030 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:30.529902 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999230990999877 future=<Future at 0x7557043be030 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:30.529902 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999088276999828 future=<Future at 0x7557043be030 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:30.534638 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Instance destroyed successfully.
May 27 03:10:30.534638 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lazy-loading 'resources' on Instance uuid 828da6e6-d3a5-4f1b-bc96-683db4633520 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:10:31.037256 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:09:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-135318181',display_name='tempest-TestEncryptedCinderVolumes-server-135318181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testencryptedcindervolumes-server-135318181',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsKE8mApOuH6pQpMeoaM1711p44BdU5w63deegp3kTmD9SDXsbd+S4T7tQJxMwMSGixch3LkbnnDZXpLGGTHeoe63rCS6XTN2kyvsWQlISndr8KsTd/l4xT3HCDOGuK4Q==',key_name='tempest-TestEncryptedCinderVolumes-1532145403',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:09:49Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0810d45b82c0476db38b1cabf8579ae1',ramdisk_id='',reservation_id='r-7s3znki8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-913342494',owner_user_name='tempest-TestEncryptedCinderVolumes-913342494-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:09:50Z,user_data=None,user_id='358594214f7a4c71a13200be75c799cc',uuid=828da6e6-d3a5-4f1b-bc96-683db4633520,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "address": "fa:16:3e:fe:bf:f2", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a1a2c0-c4", "ovs_interfaceid": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:10:31.037471 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Converting VIF {"id": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "address": "fa:16:3e:fe:bf:f2", "network": {"id": "bb624c7f-9def-46b8-b579-c4afe8f8831a", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-546156132-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0810d45b82c0476db38b1cabf8579ae1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap15a1a2c0-c4", "ovs_interfaceid": "15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:10:31.037984 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:bf:f2,bridge_name='br-int',has_traffic_filtering=True,id=15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a1a2c0-c4') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:10:31.038194 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:bf:f2,bridge_name='br-int',has_traffic_filtering=True,id=15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a1a2c0-c4') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:10:31.040281 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:31.040509 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15a1a2c0-c4, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:31.041907 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:31.042817 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:10:31.046196 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:31.046196 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:31.046196 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2bafe4a-9147-44b4-b094-ce344b718fb7) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:31.050481 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:31.050481 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:10:31.053278 np0000001475 nova-compute[98471]: INFO os_vif [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:bf:f2,bridge_name='br-int',has_traffic_filtering=True,id=15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c,network=Network(bb624c7f-9def-46b8-b579-c4afe8f8831a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15a1a2c0-c4')
May 27 03:10:31.056536 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:10:31.056989 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59f2d7b6-b715-4513-85ca-6003f024560c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:10:31.057163 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:10:31.057596 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:10:31.057970 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '59f2d7b6-b715-4513-85ca-6003f024560c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:10:31.058177 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:10:31.092127 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:31.092127 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:31.092127 np0000001475 nova-compute[98471]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:31.092127 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:31.092127 np0000001475 nova-compute[98471]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa821527-50c2-4892-889e-ac58b26b3c70 (non-flash)
May 27 03:10:31.092127 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:10:31.092447 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsi session list stdout=tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:31.092447 np0000001475 nova-compute[98471]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c (non-flash)
May 27 03:10:31.092447 np0000001475 nova-compute[98471]: tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:31.092447 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:31.092447 np0000001475 nova-compute[98471]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fa821527-50c2-4892-889e-ac58b26b3c70 (non-flash)
May 27 03:10:31.092447 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:10:31.092447 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', '148'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fa821527-50c2-4892-889e-ac58b26b3c70', '149')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:10:31.092447 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', '142')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:10:31.093587 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c', '141')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:10:31.094661 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75573588a2a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c'): ({'sdi'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:10:31.094661 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Removing multipathed devices sdj, sdi {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:10:31.094958 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Flush multipath device 330000000961065fe {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:10:31.138755 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:10:31.178498 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:10:31.225305 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Checking to see if SCSI volumes sdj, sdi have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:10:31.225305 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] SCSI volumes sdj, sdi have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:10:31.225305 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Checking to see if device paths {'sdj', 'sdi'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:10:31.237700 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Device paths {'sdj', 'sdi'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:10:31.238262 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:10:31.249527 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:31.280491 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 142, target: iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c, portal: 192.168.40.100,3260]
May 27 03:10:31.280491 np0000001475 nova-compute[98471]: Logout of [sid: 142, target: iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c, portal: 192.168.40.100,3260] successful.
May 27 03:10:31.280491 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:31.294608 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:31.312869 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:31.352423 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 141, target: iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c, portal: 192.168.50.100,3260]
May 27 03:10:31.352423 np0000001475 nova-compute[98471]: Logout of [sid: 141, target: iqn.2023-03.storpool.com:os--volume-59f2d7b6-b715-4513-85ca-6003f024560c, portal: 192.168.50.100,3260] successful.
May 27 03:10:31.352423 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:31.366670 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:31.367588 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:10:31.370781 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] <== disconnect_volume: return (311ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:10:31.370781 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:10:31.370781 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Deleting instance files /opt/stack/data/nova/instances/828da6e6-d3a5-4f1b-bc96-683db4633520_del
May 27 03:10:31.370781 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Deletion of /opt/stack/data/nova/instances/828da6e6-d3a5-4f1b-bc96-683db4633520_del complete
May 27 03:10:31.468572 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:10:31.468838 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:10:31.499363 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:31.878047 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Took 1.70 seconds to destroy the instance on the hypervisor.
May 27 03:10:31.878971 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:10:31.879340 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:10:31.879431 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:10:31.879643 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:31.934777 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:31.971212 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:10:32.444041 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e5a32627-7ef0-474d-8812-8498ec30f942 req-44d9a879-988a-409c-964d-cfc4e306c780 service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Received event network-vif-unplugged-15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:32.447186 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e5a32627-7ef0-474d-8812-8498ec30f942 req-44d9a879-988a-409c-964d-cfc4e306c780 service nova] Acquiring lock "828da6e6-d3a5-4f1b-bc96-683db4633520-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:32.447186 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e5a32627-7ef0-474d-8812-8498ec30f942 req-44d9a879-988a-409c-964d-cfc4e306c780 service nova] Lock "828da6e6-d3a5-4f1b-bc96-683db4633520-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:32.447186 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e5a32627-7ef0-474d-8812-8498ec30f942 req-44d9a879-988a-409c-964d-cfc4e306c780 service nova] Lock "828da6e6-d3a5-4f1b-bc96-683db4633520-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:32.447186 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e5a32627-7ef0-474d-8812-8498ec30f942 req-44d9a879-988a-409c-964d-cfc4e306c780 service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] No waiting events found dispatching network-vif-unplugged-15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:10:32.447186 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e5a32627-7ef0-474d-8812-8498ec30f942 req-44d9a879-988a-409c-964d-cfc4e306c780 service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Received event network-vif-unplugged-15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:10:32.447186 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e5a32627-7ef0-474d-8812-8498ec30f942 req-44d9a879-988a-409c-964d-cfc4e306c780 service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Received event network-vif-deleted-15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:32.447186 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-e5a32627-7ef0-474d-8812-8498ec30f942 req-44d9a879-988a-409c-964d-cfc4e306c780 service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Neutron deleted interface 15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c; detaching it from the instance and deleting it from the info cache
May 27 03:10:32.447186 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-e5a32627-7ef0-474d-8812-8498ec30f942 req-44d9a879-988a-409c-964d-cfc4e306c780 service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:10:32.478186 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.340s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:32.478757 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.086s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:32.479230 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:32.483685 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:10:32.483894 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Claim successful on node np0000001475
May 27 03:10:32.563342 np0000001475 nova-compute[98471]: INFO nova.network.neutron [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Updating port 9b975543-7a67-4aef-a074-e8748cdcbc87 with attributes {'binding:host_id': 'np0000001475', 'device_owner': 'compute:nova'}
May 27 03:10:32.862443 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:10:32.956646 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e5a32627-7ef0-474d-8812-8498ec30f942 req-44d9a879-988a-409c-964d-cfc4e306c780 service nova] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Detach interface failed, port_id=15a1a2c0-c4da-4fdb-bc49-cb14dba0f61c, reason: Instance 828da6e6-d3a5-4f1b-bc96-683db4633520 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:10:33.167807 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:10:33.167905 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquired lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:10:33.168024 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:10:33.221591 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8f93b100-054f-4256-91bf-26979ef22d38 req-96e3e62b-1d2f-4fc2-8ee5-f777f17b9d81 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-changed-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:33.221902 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8f93b100-054f-4256-91bf-26979ef22d38 req-96e3e62b-1d2f-4fc2-8ee5-f777f17b9d81 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Refreshing instance network info cache due to event network-changed-9b975543-7a67-4aef-a074-e8748cdcbc87. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:10:33.222049 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8f93b100-054f-4256-91bf-26979ef22d38 req-96e3e62b-1d2f-4fc2-8ee5-f777f17b9d81 service nova] Acquiring lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:10:33.364524 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Took 1.48 seconds to deallocate network for instance.
May 27 03:10:33.669818 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:33.760054 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:10:33.760338 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:10:33.923919 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Took 0.56 seconds to detach 1 volumes for instance.
May 27 03:10:34.042861 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:34.200178 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Updating instance_info_cache with network_info: [{"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:10:34.264276 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:10:34.428833 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:34.702479 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Releasing lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:10:34.703772 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:10:34.704021 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8f93b100-054f-4256-91bf-26979ef22d38 req-96e3e62b-1d2f-4fc2-8ee5-f777f17b9d81 service nova] Acquired lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:10:34.704270 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-8f93b100-054f-4256-91bf-26979ef22d38 req-96e3e62b-1d2f-4fc2-8ee5-f777f17b9d81 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Refreshing network info cache for port 9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:10:34.705430 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Creating image(s)
May 27 03:10:34.706938 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "/opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:34.707181 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "/opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:34.707712 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "/opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:34.707903 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'trusted_certs' on Instance uuid 408047d8-a3ab-415c-a667-204e70271bed {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:10:34.771345 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.293s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:34.771905 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.343s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:34.772072 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:10:35.068879 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:10:35.069185 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:10:35.208118 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-8f93b100-054f-4256-91bf-26979ef22d38 req-96e3e62b-1d2f-4fc2-8ee5-f777f17b9d81 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:35.209889 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Object Instance<408047d8-a3ab-415c-a667-204e70271bed> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:10:35.210326 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "6e8b0d4eefd0361b5874d191d26e0807f95a0d38" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:35.210718 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "6e8b0d4eefd0361b5874d191d26e0807f95a0d38" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:35.279252 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:10:35.279807 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:10:35.280161 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:35.280454 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:35.383197 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5035972df2c34359880135aaa11b26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8836c8a171d34ccf9ea8e385160539ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:10:35.573569 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:10:35.629566 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-8f93b100-054f-4256-91bf-26979ef22d38 req-96e3e62b-1d2f-4fc2-8ee5-f777f17b9d81 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:35.782799 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:10:35.805835 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-8f93b100-054f-4256-91bf-26979ef22d38 req-96e3e62b-1d2f-4fc2-8ee5-f777f17b9d81 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Updated VIF entry in instance network info cache for port 9b975543-7a67-4aef-a074-e8748cdcbc87. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:10:35.806437 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-8f93b100-054f-4256-91bf-26979ef22d38 req-96e3e62b-1d2f-4fc2-8ee5-f777f17b9d81 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Updating instance_info_cache with network_info: [{"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:10:35.962241 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Successfully created port: 4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:10:36.049370 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:36.080158 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.309s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:36.143060 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Deleted allocations for instance 828da6e6-d3a5-4f1b-bc96-683db4633520
May 27 03:10:36.234556 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:10:36.237027 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:10:36.237369 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e8b0d4eefd0361b5874d191d26e0807f95a0d38.part --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:36.289409 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:10:36.310651 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8f93b100-054f-4256-91bf-26979ef22d38 req-96e3e62b-1d2f-4fc2-8ee5-f777f17b9d81 service nova] Releasing lock "refresh_cache-408047d8-a3ab-415c-a667-204e70271bed" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:10:36.330046 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e8b0d4eefd0361b5874d191d26e0807f95a0d38.part --force-share --output=json" returned: 0 in 0.093s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:36.330568 np0000001475 nova-compute[98471]: DEBUG nova.virt.images [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] cfbad153-fa79-4d75-b6d1-47c6c8c7536f was qcow2, converting to raw {{(pid=98471) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 03:10:36.331423 np0000001475 nova-compute[98471]: DEBUG nova.privsep.utils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98471) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 03:10:36.331830 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6e8b0d4eefd0361b5874d191d26e0807f95a0d38.part /opt/stack/data/nova/instances/_base/6e8b0d4eefd0361b5874d191d26e0807f95a0d38.converted {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:36.459820 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Successfully updated port: 4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:10:36.498473 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6e8b0d4eefd0361b5874d191d26e0807f95a0d38.part /opt/stack/data/nova/instances/_base/6e8b0d4eefd0361b5874d191d26e0807f95a0d38.converted" returned: 0 in 0.166s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:36.503827 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:36.514808 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ffe12728-3895-4e89-809a-31d29804504f req-09819b41-bc34-42a0-a7a2-fe7af07af9aa service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Received event network-changed-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:36.515377 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e8b0d4eefd0361b5874d191d26e0807f95a0d38.converted --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:36.515578 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ffe12728-3895-4e89-809a-31d29804504f req-09819b41-bc34-42a0-a7a2-fe7af07af9aa service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Refreshing instance network info cache due to event network-changed-4405512d-bcd7-42bc-b7c6-116269917f4f. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:10:36.516209 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ffe12728-3895-4e89-809a-31d29804504f req-09819b41-bc34-42a0-a7a2-fe7af07af9aa service nova] Acquiring lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:10:36.528933 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ffe12728-3895-4e89-809a-31d29804504f req-09819b41-bc34-42a0-a7a2-fe7af07af9aa service nova] Acquired lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:10:36.529508 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ffe12728-3895-4e89-809a-31d29804504f req-09819b41-bc34-42a0-a7a2-fe7af07af9aa service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Refreshing network info cache for port 4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:10:36.619364 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e8b0d4eefd0361b5874d191d26e0807f95a0d38.converted --force-share --output=json" returned: 0 in 0.104s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:36.619996 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "6e8b0d4eefd0361b5874d191d26e0807f95a0d38" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.409s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:36.620498 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:10:36.623260 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:10:36.624574 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e8b0d4eefd0361b5874d191d26e0807f95a0d38 --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:36.724653 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e8b0d4eefd0361b5874d191d26e0807f95a0d38 --force-share --output=json" returned: 0 in 0.100s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:36.725111 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "6e8b0d4eefd0361b5874d191d26e0807f95a0d38" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:36.725966 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "6e8b0d4eefd0361b5874d191d26e0807f95a0d38" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:36.727017 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:10:36.733004 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:10:36.733443 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e8b0d4eefd0361b5874d191d26e0807f95a0d38 --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:36.796578 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Booting with volume d3a1cb25-ef73-4b14-a2eb-13676b9030ec at /dev/vda
May 27 03:10:36.846811 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:10:36.851792 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e8b0d4eefd0361b5874d191d26e0807f95a0d38 --force-share --output=json" returned: 0 in 0.118s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:36.852149 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6e8b0d4eefd0361b5874d191d26e0807f95a0d38,backing_fmt=raw /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:36.875237 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:10:36.901704 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:36.919840 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6e8b0d4eefd0361b5874d191d26e0807f95a0d38,backing_fmt=raw /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk 1073741824" returned: 0 in 0.067s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:36.921270 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "6e8b0d4eefd0361b5874d191d26e0807f95a0d38" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:36.921395 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e8b0d4eefd0361b5874d191d26e0807f95a0d38 --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:36.953170 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:10:36.953652 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:10:36.965370 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:10:36.967769 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:10:36.968922 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fea9:da0b', 'fe80::bc95:85ff:fe5a:dff6', 'fe80::fc16:3eff:fe3d:150b', 'fe80::c8bd:deff:fefd:aeb3'] 
May 27 03:10:36.969092 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:10:36.969181 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:10:36.969476 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:10:36.969698 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Updating existing volume attachment record: 787b5367-02b4-48b4-b545-494b3f223ddc {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:10:37.020433 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e8b0d4eefd0361b5874d191d26e0807f95a0d38 --force-share --output=json" returned: 0 in 0.099s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:37.021086 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'migration_context' on Instance uuid 408047d8-a3ab-415c-a667-204e70271bed {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:10:37.034898 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-ffe12728-3895-4e89-809a-31d29804504f req-09819b41-bc34-42a0-a7a2-fe7af07af9aa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:37.098647 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ffe12728-3895-4e89-809a-31d29804504f req-09819b41-bc34-42a0-a7a2-fe7af07af9aa service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:10:37.156208 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a5a02e0c-0741-4c2b-bb9e-ebaa573db248 tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Lock "828da6e6-d3a5-4f1b-bc96-683db4633520" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.482s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:37.236244 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ffe12728-3895-4e89-809a-31d29804504f req-09819b41-bc34-42a0-a7a2-fe7af07af9aa service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:10:37.526577 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Object Instance<408047d8-a3ab-415c-a667-204e70271bed> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:10:37.526997 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Rebasing disk image.
May 27 03:10:37.527237 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:37.629666 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.102s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:37.630156 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c -F raw /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:37.738948 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ffe12728-3895-4e89-809a-31d29804504f req-09819b41-bc34-42a0-a7a2-fe7af07af9aa service nova] Releasing lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:10:37.739697 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquired lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:10:37.740009 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:10:38.325405 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:10:38.400791 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c -F raw /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk" returned: 0 in 0.770s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:38.401023 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:10:38.401369 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Ensure instance console log exists: /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:10:38.401761 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:38.402037 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:38.402591 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:38.405575 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Start _get_guest_xml network_info=[{"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b7646060be8efb5325632a4e28e818d5',container_format='bare',created_at=2026-05-27T03:10:11Z,direct_url=<?>,disk_format='qcow2',id=cfbad153-fa79-4d75-b6d1-47c6c8c7536f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2112501231-shelved',owner='c547b519adf248728dfd0b2232bfc118',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-27T03:10:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:10:38.410953 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:10:38.412415 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-2112501231', uuid='408047d8-a3ab-415c-a667-204e70271bed'), owner=OwnerMeta(userid='1c72d670892e44d88e674c9b584bc718', username='tempest-AttachVolumeShelveTestJSON-1364873533-project-member', projectid='c547b519adf248728dfd0b2232bfc118', projectname='tempest-AttachVolumeShelveTestJSON-1364873533'), image=ImageMeta(id='cfbad153-fa79-4d75-b6d1-47c6c8c7536f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851438.4120045) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:10:38.413706 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:10:38.414125 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:10:38.415126 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:10:38.415292 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:10:38.416362 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:10:38.416727 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b7646060be8efb5325632a4e28e818d5',container_format='bare',created_at=2026-05-27T03:10:11Z,direct_url=<?>,disk_format='qcow2',id=cfbad153-fa79-4d75-b6d1-47c6c8c7536f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2112501231-shelved',owner='c547b519adf248728dfd0b2232bfc118',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-27T03:10:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:10:38.416937 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:10:38.417079 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:10:38.417252 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:10:38.417369 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:10:38.417542 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:10:38.417763 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:10:38.417960 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:10:38.418139 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:10:38.418303 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:10:38.418469 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:10:38.418699 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'vcpu_model' on Instance uuid 408047d8-a3ab-415c-a667-204e70271bed {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:10:38.481601 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:38.641703 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Updating instance_info_cache with network_info: [{"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:10:38.920706 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Object Instance<408047d8-a3ab-415c-a667-204e70271bed> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:10:38.932056 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T03:09:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2112501231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumeshelvetestjson-server-2112501231',id=59,image_ref='cfbad153-fa79-4d75-b6d1-47c6c8c7536f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-495903838',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:09:30Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c547b519adf248728dfd0b2232bfc118',ramdisk_id='',reservation_id='r-yz7ee0f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1364873533',owner_user_name='tempest-AttachVolumeShelveTestJSON-1364873533-project-member',shelved_at='2026-05-27T03:10:18.274921',shelved_host='np0000001475',shelved_image_id='cfbad153-fa79-4d75-b6d1-47c6c8c7536f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:10:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c72d670892e44d88e674c9b584bc718',uuid=408047d8-a3ab-415c-a667-204e70271bed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:10:38.932348 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converting VIF {"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:10:38.932901 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=9b975543-7a67-4aef-a074-e8748cdcbc87,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b975543-7a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:10:38.933380 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'pci_devices' on Instance uuid 408047d8-a3ab-415c-a667-204e70271bed {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:10:39.077450 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:10:39.078323 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:10:39.078581 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Creating image(s)
May 27 03:10:39.078806 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:10:39.079416 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Ensure instance console log exists: /opt/stack/data/nova/instances/e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:10:39.079416 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:39.079416 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:39.079416 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:39.144585 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Releasing lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:10:39.144993 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Instance network_info: |[{"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:10:39.145975 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Start _get_guest_xml network_info=[{"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'serial': 'd3a1cb25-ef73-4b14-a2eb-13676b9030ec'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '787b5367-02b4-48b4-b545-494b3f223ddc', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:10:39.150971 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:10:39.152401 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-979759750', uuid='e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa'), owner=OwnerMeta(userid='5035972df2c34359880135aaa11b26ea', username='tempest-TestShelveInstance-195465897-project-member', projectid='8836c8a171d34ccf9ea8e385160539ae', projectname='tempest-TestShelveInstance-195465897'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851439.1519358) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:10:39.154212 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:10:39.154674 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:10:39.155968 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:10:39.156211 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:10:39.157142 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:10:39.157527 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:10:39.157790 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:10:39.157925 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:10:39.158127 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:10:39.158276 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:10:39.158429 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:10:39.158654 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:10:39.158826 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:10:39.158995 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:10:39.159180 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:10:39.159346 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:10:39.172476 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:10:39.172838 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:10:39.172989 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:10:39.435622 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Object Instance<408047d8-a3ab-415c-a667-204e70271bed> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:10:39.436543 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] End _get_guest_xml xml=<domain type="qemu">
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:   <uuid>408047d8-a3ab-415c-a667-204e70271bed</uuid>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:   <name>instance-0000003b</name>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2112501231</nova:name>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:10:38</nova:creationTime>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:         <nova:user uuid="1c72d670892e44d88e674c9b584bc718">tempest-AttachVolumeShelveTestJSON-1364873533-project-member</nova:user>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:         <nova:project uuid="c547b519adf248728dfd0b2232bfc118">tempest-AttachVolumeShelveTestJSON-1364873533</nova:project>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:         <nova:port uuid="9b975543-7a67-4aef-a074-e8748cdcbc87">
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     <system>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <entry name="serial">408047d8-a3ab-415c-a667-204e70271bed</entry>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <entry name="uuid">408047d8-a3ab-415c-a667-204e70271bed</entry>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     </system>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:   <os>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:   </os>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:   <features>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:   </features>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:   <devices>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     </disk>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk.config"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     </disk>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:be:ae:e3"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <target dev="tap9b975543-7a"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     </interface>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/console.log" append="off"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     </serial>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     <video>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     </video>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     </rng>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:   </devices>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]: </domain>
May 27 03:10:39.436543 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:10:39.438775 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Preparing to wait for external event network-vif-plugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:10:39.438775 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "408047d8-a3ab-415c-a667-204e70271bed-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:39.438775 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:39.438775 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:39.438775 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T03:09:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2112501231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumeshelvetestjson-server-2112501231',id=59,image_ref='cfbad153-fa79-4d75-b6d1-47c6c8c7536f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-495903838',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:09:30Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c547b519adf248728dfd0b2232bfc118',ramdisk_id='',reservation_id='r-yz7ee0f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1364873533',owner_user_name='tempest-AttachVolumeShelveTestJSON-1364873533-project-member',shelved_at='2026-05-27T03:10:18.274921',shelved_host='np0000001475',shelved_image_id='cfbad153-fa79-4d75-b6d1-47c6c8c7536f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:10:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c72d670892e44d88e674c9b584bc718',uuid=408047d8-a3ab-415c-a667-204e70271bed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:10:39.438775 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converting VIF {"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:10:39.439226 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=9b975543-7a67-4aef-a074-e8748cdcbc87,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b975543-7a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:10:39.439677 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=9b975543-7a67-4aef-a074-e8748cdcbc87,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b975543-7a') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:10:39.440802 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:39.440802 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:39.440802 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:10:39.441979 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:39.441979 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d076507-624b-52ab-9e58-610d337a3281', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:39.443525 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:39.444400 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:10:39.446447 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:39.446663 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b975543-7a, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:39.447141 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b975543-7a, col_values=(('qos', UUID('cfb997ab-5b2c-4ecc-88c9-95bd682d4d1d')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:39.447766 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b975543-7a, col_values=(('external_ids', {'iface-id': '9b975543-7a67-4aef-a074-e8748cdcbc87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:ae:e3', 'vm-uuid': '408047d8-a3ab-415c-a667-204e70271bed'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:39.448497 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:39.450009 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:10:39.454323 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:39.454861 np0000001475 nova-compute[98471]: INFO os_vif [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=9b975543-7a67-4aef-a074-e8748cdcbc87,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b975543-7a')
May 27 03:10:39.726147 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.553s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:10:39.726487 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:10:39.739897 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:10:39.740630 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:10:39.741156 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:10:39.741397 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:10:39.741706 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:10:39.741948 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:10:39.753494 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:10:39.753494 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:39.758395 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:10:39.758395 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:39.765664 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec] added
May 27 03:10:39.765664 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:10:39.765664 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:10:39.765664 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:10:39.765664 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:10:39.765664 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:10:39.765664 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:39.765925 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:10:39.765969 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0246(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:10:39.766157 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:10:39.769827 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec] added
May 27 03:10:39.769827 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:10:39.769827 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:10:39.769827 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:10:39.769827 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:10:39.769827 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:10:39.769827 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:39.769827 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:10:39.770135 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0281(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:10:39.770135 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:10:40.766807 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:10:40.770584 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:10:40.780800 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:10:40.780800 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:10:40.790591 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:10:40.790591 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:40.799389 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:40.800638 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:40.813627 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:40.813627 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:40.813627 np0000001475 nova-compute[98471]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8e13c4b-b8e1-4aa1-87b0-6d32066d435c (non-flash)
May 27 03:10:40.813627 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:10:40.813627 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsi session list stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:40.813627 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:40.813627 np0000001475 nova-compute[98471]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8e13c4b-b8e1-4aa1-87b0-6d32066d435c (non-flash)
May 27 03:10:40.813627 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:10:40.819815 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:40.819815 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:40.819815 np0000001475 nova-compute[98471]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8e13c4b-b8e1-4aa1-87b0-6d32066d435c (non-flash)
May 27 03:10:40.819815 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:10:40.820422 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsi session list stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:40.820422 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:40.820422 np0000001475 nova-compute[98471]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8e13c4b-b8e1-4aa1-87b0-6d32066d435c (non-flash)
May 27 03:10:40.820422 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:10:40.849501 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec, portal: 192.168.40.100,3260]
May 27 03:10:40.849501 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec, portal: 192.168.40.100,3260] successful.
May 27 03:10:40.849501 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:40.855342 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec, portal: 192.168.50.100,3260]
May 27 03:10:40.855342 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec, portal: 192.168.50.100,3260] successful.
May 27 03:10:40.855342 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:40.861384 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:40.867415 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:10:40.877894 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:40.877894 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:40.877894 np0000001475 nova-compute[98471]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8e13c4b-b8e1-4aa1-87b0-6d32066d435c (non-flash)
May 27 03:10:40.877894 np0000001475 nova-compute[98471]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:10:40.877894 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:10:40.877894 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:10:40.878267 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsi session list stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:40.878267 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:40.878267 np0000001475 nova-compute[98471]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8e13c4b-b8e1-4aa1-87b0-6d32066d435c (non-flash)
May 27 03:10:40.878267 np0000001475 nova-compute[98471]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:10:40.878267 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:10:40.878267 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:10:40.878437 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:10:40.878600 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:10:40.879529 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] HCTL ('8', '-', '-', 0) found on session 152 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:10:40.879687 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:10:40.890762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:40.890762 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:40.890762 np0000001475 nova-compute[98471]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8e13c4b-b8e1-4aa1-87b0-6d32066d435c (non-flash)
May 27 03:10:40.890762 np0000001475 nova-compute[98471]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:10:40.890762 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:10:40.890762 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:10:40.890762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsi session list stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:40.890762 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:10:40.890762 np0000001475 nova-compute[98471]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f8e13c4b-b8e1-4aa1-87b0-6d32066d435c (non-flash)
May 27 03:10:40.890762 np0000001475 nova-compute[98471]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:10:40.890762 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:10:40.890762 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:10:40.890762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:10:40.891336 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:10:40.893970 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] HCTL ('9', '-', '-', 0) found on session 153 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:10:40.893970 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:10:40.893970 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Searching for a device in session 152 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:10:40.894149 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:10:40.906896 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Searching for a device in session 153 and hctl ['9', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:10:40.982048 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:10:40.982233 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:10:40.982345 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] No VIF found with MAC fa:16:3e:be:ae:e3, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:10:40.982882 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Using config drive
May 27 03:10:41.485702 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'ec2_ids' on Instance uuid 408047d8-a3ab-415c-a667-204e70271bed {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:10:41.511307 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:41.906784 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Searching for a device in session 153 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:10:41.907214 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:10:41.988965 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Object Instance<408047d8-a3ab-415c-a667-204e70271bed> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:10:41.989129 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'keypairs' on Instance uuid 408047d8-a3ab-415c-a667-204e70271bed {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:10:42.425276 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:42.491783 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Object Instance<408047d8-a3ab-415c-a667-204e70271bed> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:10:42.495156 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:42.646926 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Creating config drive at /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk.config
May 27 03:10:42.650703 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps_6qfq0y {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:42.734515 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps_6qfq0y" returned: 0 in 0.084s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:42.763707 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Found WWN 33000000029397f0e for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:10:42.764318 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:10:42.764559 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] <== connect_volume: return (3591ms) {'type': 'block', 'scsi_wwn': '33000000029397f0e', 'path': '/dev/dm-0', 'multipath_id': '33000000029397f0e'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:10:42.764776 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000029397f0e', 'path': '/dev/dm-0', 'multipath_id': '33000000029397f0e'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:10:43.188637 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:43.217115 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:43.219029 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:43.279489 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-979759750',display_name='tempest-TestShelveInstance-server-979759750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testshelveinstance-server-979759750',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvHcPIdf5ySXrzW/Bta+JqMZYLfKoPdChUu67Gw6GkqzSVoJyKWlzBAqBOO70Xjx7BpBWor+/paVzDKNqocIgiXJfQmDZBYWmRgNg/YzGb56OtqGA7X5UZkasOniGoZaQ==',key_name='tempest-TestShelveInstance-1659380719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8836c8a171d34ccf9ea8e385160539ae',ramdisk_id='',reservation_id='r-u86gsxw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-195465897',owner_user_name='tempest-TestShelveInstance-195465897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:10:36Z,user_data=None,user_id='5035972df2c34359880135aaa11b26ea',uuid=e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:10:43.279489 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Converting VIF {"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:10:43.279958 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=4405512d-bcd7-42bc-b7c6-116269917f4f,network=Network(686c35f5-1a05-4704-bf14-198632c86a51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4405512d-bc') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:10:43.280642 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lazy-loading 'pci_devices' on Instance uuid e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:10:43.337935 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:43.393998 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ba773ca2-58f4-4804-975f-6aca66221a35 req-c215a9ca-456d-4f6d-a3d5-daaf94bf7744 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-vif-plugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:43.394475 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ba773ca2-58f4-4804-975f-6aca66221a35 req-c215a9ca-456d-4f6d-a3d5-daaf94bf7744 service nova] Acquiring lock "408047d8-a3ab-415c-a667-204e70271bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:43.394608 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ba773ca2-58f4-4804-975f-6aca66221a35 req-c215a9ca-456d-4f6d-a3d5-daaf94bf7744 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:43.394804 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ba773ca2-58f4-4804-975f-6aca66221a35 req-c215a9ca-456d-4f6d-a3d5-daaf94bf7744 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:43.395161 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ba773ca2-58f4-4804-975f-6aca66221a35 req-c215a9ca-456d-4f6d-a3d5-daaf94bf7744 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Processing event network-vif-plugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:10:43.542524 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:43.544567 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:43.545945 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:43.571447 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:43.784509 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] End _get_guest_xml xml=<domain type="qemu">
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:   <uuid>e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa</uuid>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:   <name>instance-0000003e</name>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestShelveInstance-server-979759750</nova:name>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:10:39</nova:creationTime>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:         <nova:user uuid="5035972df2c34359880135aaa11b26ea">tempest-TestShelveInstance-195465897-project-member</nova:user>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:         <nova:project uuid="8836c8a171d34ccf9ea8e385160539ae">tempest-TestShelveInstance-195465897</nova:project>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:         <nova:port uuid="4405512d-bcd7-42bc-b7c6-116269917f4f">
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     <system>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <entry name="serial">e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa</entry>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <entry name="uuid">e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa</entry>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     </system>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:   <os>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:   </os>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:   <features>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:   </features>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:   <devices>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa/disk.config"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     </disk>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <alias name="ua-d3a1cb25-ef73-4b14-a2eb-13676b9030ec"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-0"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <serial>d3a1cb25-ef73-4b14-a2eb-13676b9030ec</serial>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     </disk>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:8e:48:f0"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <target dev="tap4405512d-bc"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     </interface>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa/console.log" append="off"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     </serial>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     <video>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     </video>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     </rng>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:   </devices>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]: </domain>
May 27 03:10:43.784509 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:10:43.784509 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Preparing to wait for external event network-vif-plugged-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:10:43.784509 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:43.788169 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:43.788169 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:43.788169 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-979759750',display_name='tempest-TestShelveInstance-server-979759750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testshelveinstance-server-979759750',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvHcPIdf5ySXrzW/Bta+JqMZYLfKoPdChUu67Gw6GkqzSVoJyKWlzBAqBOO70Xjx7BpBWor+/paVzDKNqocIgiXJfQmDZBYWmRgNg/YzGb56OtqGA7X5UZkasOniGoZaQ==',key_name='tempest-TestShelveInstance-1659380719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8836c8a171d34ccf9ea8e385160539ae',ramdisk_id='',reservation_id='r-u86gsxw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-195465897',owner_user_name='tempest-TestShelveInstance-195465897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:10:36Z,user_data=None,user_id='5035972df2c34359880135aaa11b26ea',uuid=e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:10:43.788169 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Converting VIF {"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:10:43.788169 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=4405512d-bcd7-42bc-b7c6-116269917f4f,network=Network(686c35f5-1a05-4704-bf14-198632c86a51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4405512d-bc') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:10:43.788169 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=4405512d-bcd7-42bc-b7c6-116269917f4f,network=Network(686c35f5-1a05-4704-bf14-198632c86a51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4405512d-bc') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:10:43.788169 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:43.788169 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:43.788169 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:10:43.792123 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:43.792123 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77203a19-9b63-5636-8674-c1fc06d2222f', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:43.792123 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:43.792123 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:10:43.792123 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:43.792823 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:43.793003 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4405512d-bc, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:43.793406 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4405512d-bc, col_values=(('qos', UUID('78a6f66f-5e9f-4b20-88d4-41111488dafa')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:43.794135 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4405512d-bc, col_values=(('external_ids', {'iface-id': '4405512d-bcd7-42bc-b7c6-116269917f4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:48:f0', 'vm-uuid': 'e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:10:43.795408 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:43.796868 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:10:43.807006 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:43.809371 np0000001475 nova-compute[98471]: INFO os_vif [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=4405512d-bcd7-42bc-b7c6-116269917f4f,network=Network(686c35f5-1a05-4704-bf14-198632c86a51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4405512d-bc')
May 27 03:10:44.106042 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:10:44.107151 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851444.1066306, 408047d8-a3ab-415c-a667-204e70271bed => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:10:44.107396 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 408047d8-a3ab-415c-a667-204e70271bed] VM Started (Lifecycle Event)
May 27 03:10:44.109324 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:10:44.113401 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Instance spawned successfully.
May 27 03:10:44.433057 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:44.614414 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:44.616767 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:10:44.636589 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:45.120138 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 408047d8-a3ab-415c-a667-204e70271bed] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:10:45.121874 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851445.120245, 408047d8-a3ab-415c-a667-204e70271bed => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:10:45.121874 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 408047d8-a3ab-415c-a667-204e70271bed] VM Paused (Lifecycle Event)
May 27 03:10:45.153068 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9e963620-3868-42cf-b863-fd25f2e720c1 tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "408047d8-a3ab-415c-a667-204e70271bed" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.090s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:45.338473 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:10:45.338664 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:10:45.338854 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] No VIF found with MAC fa:16:3e:8e:48:f0, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:10:45.339399 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Using config drive
May 27 03:10:45.490829 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f7b6725c-c962-4545-a398-99436819df5b req-99d93f32-f837-422c-a889-6640c583a595 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-vif-plugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:45.491256 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f7b6725c-c962-4545-a398-99436819df5b req-99d93f32-f837-422c-a889-6640c583a595 service nova] Acquiring lock "408047d8-a3ab-415c-a667-204e70271bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:45.491256 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f7b6725c-c962-4545-a398-99436819df5b req-99d93f32-f837-422c-a889-6640c583a595 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:45.491256 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f7b6725c-c962-4545-a398-99436819df5b req-99d93f32-f837-422c-a889-6640c583a595 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:45.491383 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f7b6725c-c962-4545-a398-99436819df5b req-99d93f32-f837-422c-a889-6640c583a595 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] No waiting events found dispatching network-vif-plugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:10:45.491429 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-f7b6725c-c962-4545-a398-99436819df5b req-99d93f32-f837-422c-a889-6640c583a595 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received unexpected event network-vif-plugged-9b975543-7a67-4aef-a074-e8748cdcbc87 for instance with vm_state active and task_state None.
May 27 03:10:45.529591 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0005543460001717904 future=<Future at 0x7557043be030 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:45.530123 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Emitting event <LifecycleEvent: 1779851430.528922, 828da6e6-d3a5-4f1b-bc96-683db4633520 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:10:45.530298 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:10:45.530461 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] VM Stopped (Lifecycle Event)
May 27 03:10:45.623644 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:45.625809 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851445.6256132, 408047d8-a3ab-415c-a667-204e70271bed => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:10:45.625968 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 408047d8-a3ab-415c-a667-204e70271bed] VM Resumed (Lifecycle Event)
May 27 03:10:45.847993 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:46.016959 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Creating config drive at /opt/stack/data/nova/instances/e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa/disk.config
May 27 03:10:46.021391 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpir79799n {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:10:46.041589 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: 828da6e6-d3a5-4f1b-bc96-683db4633520] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:46.090848 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpir79799n" returned: 0 in 0.069s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:10:46.129806 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:46.133674 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:10:46.512763 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:46.536376 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:46.567832 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:46.666341 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:46.831341 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-45d6c207-8cae-4f81-8fd1-d722a56441de req-b90869ce-1a8b-48d6-b14c-0af5108250de service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Received event network-vif-plugged-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:46.833055 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-45d6c207-8cae-4f81-8fd1-d722a56441de req-b90869ce-1a8b-48d6-b14c-0af5108250de service nova] Acquiring lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:46.833055 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-45d6c207-8cae-4f81-8fd1-d722a56441de req-b90869ce-1a8b-48d6-b14c-0af5108250de service nova] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:46.833055 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-45d6c207-8cae-4f81-8fd1-d722a56441de req-b90869ce-1a8b-48d6-b14c-0af5108250de service nova] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:46.833055 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-45d6c207-8cae-4f81-8fd1-d722a56441de req-b90869ce-1a8b-48d6-b14c-0af5108250de service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Processing event network-vif-plugged-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:10:46.905601 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:46.907250 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:46.910532 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:46.914137 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:46.939484 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:47.446424 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:10:47.447492 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851447.4472077, e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:10:47.447683 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] VM Started (Lifecycle Event)
May 27 03:10:47.451197 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:10:47.460690 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Instance spawned successfully.
May 27 03:10:47.461138 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:10:47.955031 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:47.957895 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:10:47.968545 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:10:47.968545 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:10:47.968545 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:10:47.969040 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:10:47.969040 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:10:47.969278 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:10:48.460827 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:10:48.461180 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851448.460982, e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:10:48.461334 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] VM Paused (Lifecycle Event)
May 27 03:10:48.477535 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Took 9.40 seconds to spawn the instance on the hypervisor.
May 27 03:10:48.477718 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:48.795084 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:48.917028 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e295532f-03bb-4b13-859f-99796bd06240 req-1f0897c9-c966-4c14-b03a-bd39eb98c0e0 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Received event network-vif-plugged-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:48.917334 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e295532f-03bb-4b13-859f-99796bd06240 req-1f0897c9-c966-4c14-b03a-bd39eb98c0e0 service nova] Acquiring lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:48.917610 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e295532f-03bb-4b13-859f-99796bd06240 req-1f0897c9-c966-4c14-b03a-bd39eb98c0e0 service nova] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:48.917750 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e295532f-03bb-4b13-859f-99796bd06240 req-1f0897c9-c966-4c14-b03a-bd39eb98c0e0 service nova] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:48.917922 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e295532f-03bb-4b13-859f-99796bd06240 req-1f0897c9-c966-4c14-b03a-bd39eb98c0e0 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] No waiting events found dispatching network-vif-plugged-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:10:48.918354 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-e295532f-03bb-4b13-859f-99796bd06240 req-1f0897c9-c966-4c14-b03a-bd39eb98c0e0 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Received unexpected event network-vif-plugged-4405512d-bcd7-42bc-b7c6-116269917f4f for instance with vm_state active and task_state None.
May 27 03:10:48.963811 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:48.966309 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851448.9660509, e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:10:48.966482 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] VM Resumed (Lifecycle Event)
May 27 03:10:48.995181 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Took 19.65 seconds to build instance.
May 27 03:10:49.090177 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:49.344392 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:10:49.344759 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:10:49.345113 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:10:49.345337 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:10:49.345704 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.85 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:10:49.469028 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:10:49.472233 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:10:49.496799 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.166s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:10:50.200338 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:10:50.200868 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:10:50.200868 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.99 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:10:51.030713 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:51.514654 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:52.077879 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c86a5e8b-2fc7-4510-97cb-6686a3fa59b4 req-60c7ede4-2631-419b-9433-469566a7a716 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Received event network-changed-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:10:52.077879 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c86a5e8b-2fc7-4510-97cb-6686a3fa59b4 req-60c7ede4-2631-419b-9433-469566a7a716 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Refreshing instance network info cache due to event network-changed-4405512d-bcd7-42bc-b7c6-116269917f4f. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:10:52.077879 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c86a5e8b-2fc7-4510-97cb-6686a3fa59b4 req-60c7ede4-2631-419b-9433-469566a7a716 service nova] Acquiring lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:10:52.077879 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c86a5e8b-2fc7-4510-97cb-6686a3fa59b4 req-60c7ede4-2631-419b-9433-469566a7a716 service nova] Acquired lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:10:52.077879 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c86a5e8b-2fc7-4510-97cb-6686a3fa59b4 req-60c7ede4-2631-419b-9433-469566a7a716 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Refreshing network info cache for port 4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:10:52.579383 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c86a5e8b-2fc7-4510-97cb-6686a3fa59b4 req-60c7ede4-2631-419b-9433-469566a7a716 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:52.987920 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-c86a5e8b-2fc7-4510-97cb-6686a3fa59b4 req-60c7ede4-2631-419b-9433-469566a7a716 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:10:53.149929 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c86a5e8b-2fc7-4510-97cb-6686a3fa59b4 req-60c7ede4-2631-419b-9433-469566a7a716 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Updated VIF entry in instance network info cache for port 4405512d-bcd7-42bc-b7c6-116269917f4f. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:10:53.150176 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c86a5e8b-2fc7-4510-97cb-6686a3fa59b4 req-60c7ede4-2631-419b-9433-469566a7a716 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Updating instance_info_cache with network_info: [{"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:10:53.196464 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:10:53.196639 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:10:53.199491 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:10:53.199781 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:10:53.653726 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c86a5e8b-2fc7-4510-97cb-6686a3fa59b4 req-60c7ede4-2631-419b-9433-469566a7a716 service nova] Releasing lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:10:53.797321 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:54.218054 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:56.056415 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:56.195982 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:10:56.196264 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:10:56.518322 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:58.797802 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:58.798684 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:10:58.809756 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:10:59.312627 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lazy-loading 'flavor' on Instance uuid 4d78ea44-9e63-4671-91bc-ee77eb1885cc {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:10:59.870823 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:10:59.872025 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:00.317558 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.518s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:00.374381 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:11:00.935169 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:00.935527 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:00.938620 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:11:00.938759 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Claim successful on node np0000001475
May 27 03:11:01.198385 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:11:01.199832 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:11:01.387265 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:01.387477 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:01.387718 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Attaching volume f51fa28c-1a38-4316-bf4a-e09791a95cc9 to /dev/vdb
May 27 03:11:01.438460 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:11:01.457094 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:11:01.482584 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:11:01.518962 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:01.533123 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:11:01.533399 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:11:01.544289 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:11:01.545553 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::d018:f2ff:feb0:9e2b', 'fe80::fc16:3eff:fe8e:48f0', 'fe80::7441:51ff:fe02:437d', 'fe80::fc16:3eff:fea9:da0b', 'fe80::bc95:85ff:fe5a:dff6', 'fe80::fc16:3eff:fe3d:150b', 'fe80::c8bd:deff:fefd:aeb3', 'fe80::fc16:3eff:febe:aee3'] 
May 27 03:11:01.545710 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:11:01.545825 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:11:01.546058 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:11:01.546296 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Updating existing volume attachment record: d58b6d33-317b-432e-9fa3-4ef61e8a0e68 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:11:01.570821 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:01.571130 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:01.706805 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:02.077000 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Detaching volume dd3605ba-8b97-468b-963c-e6fb8c7c1135
May 27 03:11:02.105214 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:11:02.105657 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f51fa28c-1a38-4316-bf4a-e09791a95cc9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:11:02.106010 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:11:02.106286 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:11:02.106520 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f51fa28c-1a38-4316-bf4a-e09791a95cc9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:11:02.122014 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:11:02.123130 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:11:02.124258 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:11:02.124482 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:11:02.128955 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Attempting to driver detach volume dd3605ba-8b97-468b-963c-e6fb8c7c1135 from mountpoint /dev/vdb
May 27 03:11:02.132347 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.009s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:11:02.132710 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:11:02.140272 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:11:02.140272 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:02.143805 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Found disk vdb by alias ua-dd3605ba-8b97-468b-963c-e6fb8c7c1135 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:11:02.145050 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Found disk vdb by alias ua-dd3605ba-8b97-468b-963c-e6fb8c7c1135 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:11:02.145186 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Attempting to detach device vdb from instance eb7ae482-4f6f-4b54-9923-3657c90de9fa from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:11:02.145446 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:11:02.145446 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:11:02.145446 np0000001475 nova-compute[98471]:   <alias name="ua-dd3605ba-8b97-468b-963c-e6fb8c7c1135"/>
May 27 03:11:02.145446 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:11:02.145446 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:11:02.145446 np0000001475 nova-compute[98471]:   <serial>dd3605ba-8b97-468b-963c-e6fb8c7c1135</serial>
May 27 03:11:02.145446 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:11:02.145446 np0000001475 nova-compute[98471]: </disk>
May 27 03:11:02.145446 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:11:02.146731 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:11:02.146731 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:02.153755 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Successfully detached device vdb from instance eb7ae482-4f6f-4b54-9923-3657c90de9fa from the persistent domain config.
May 27 03:11:02.154237 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] (1/8): Attempting to detach device vdb with device alias ua-dd3605ba-8b97-468b-963c-e6fb8c7c1135 from instance eb7ae482-4f6f-4b54-9923-3657c90de9fa from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:11:02.154566 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:11:02.154566 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:11:02.154566 np0000001475 nova-compute[98471]:   <alias name="ua-dd3605ba-8b97-468b-963c-e6fb8c7c1135"/>
May 27 03:11:02.154566 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:11:02.154566 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:11:02.154566 np0000001475 nova-compute[98471]:   <serial>dd3605ba-8b97-468b-963c-e6fb8c7c1135</serial>
May 27 03:11:02.154566 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:11:02.154566 np0000001475 nova-compute[98471]: </disk>
May 27 03:11:02.154566 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:11:02.155219 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9] added
May 27 03:11:02.155219 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:11:02.155219 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:11:02.155219 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:11:02.155219 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:11:02.155219 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:11:02.155219 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:02.155451 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:11:02.156452 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:11:02.156452 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:11:02.160325 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9] added
May 27 03:11:02.160325 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:11:02.160325 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:11:02.160325 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:11:02.160325 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:11:02.160325 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:11:02.160325 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:02.160652 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:11:02.160652 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:11:02.160772 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:11:02.236979 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:11:02.237121 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:11:02.639304 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851462.6388721, eb7ae482-4f6f-4b54-9923-3657c90de9fa => ua-dd3605ba-8b97-468b-963c-e6fb8c7c1135> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:11:02.640634 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-dd3605ba-8b97-468b-963c-e6fb8c7c1135 for instance eb7ae482-4f6f-4b54-9923-3657c90de9fa {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:11:02.644955 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Successfully detached device vdb from instance eb7ae482-4f6f-4b54-9923-3657c90de9fa from the live domain config.
May 27 03:11:02.646323 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:11:02.646675 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:11:02.646866 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:11:02.739879 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:11:03.156351 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:11:03.161114 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:11:03.169785 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:11:03.169785 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:11:03.176342 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:11:03.176342 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:03.182328 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:03.188775 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:03.196648 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:11:03.196648 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:11:03.196648 np0000001475 nova-compute[98471]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:03.196648 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:03.196648 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:11:03.197015 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsi session list stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:11:03.197015 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:11:03.197015 np0000001475 nova-compute[98471]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:03.197015 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:03.197015 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:11:03.203940 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:11:03.203940 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:11:03.203940 np0000001475 nova-compute[98471]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:03.203940 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:03.203940 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:11:03.204118 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsi session list stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:11:03.204118 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:11:03.204118 np0000001475 nova-compute[98471]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:03.204118 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:03.204118 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:11:03.234343 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9, portal: 192.168.40.100,3260]
May 27 03:11:03.234343 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9, portal: 192.168.40.100,3260] successful.
May 27 03:11:03.234343 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:03.246037 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.311s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:03.246821 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:11:03.249372 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.542s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:03.249955 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:03.251701 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:03.251904 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:11:03.258796 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9, portal: 192.168.50.100,3260]
May 27 03:11:03.258796 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9, portal: 192.168.50.100,3260] successful.
May 27 03:11:03.258796 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:03.266108 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:11:03.266108 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:11:03.266108 np0000001475 nova-compute[98471]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:03.266108 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:03.266108 np0000001475 nova-compute[98471]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:03.266108 np0000001475 nova-compute[98471]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:03.266108 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:11:03.266353 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsi session list stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:11:03.266353 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:11:03.266353 np0000001475 nova-compute[98471]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:03.266353 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:03.266353 np0000001475 nova-compute[98471]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:03.266353 np0000001475 nova-compute[98471]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:03.266353 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:11:03.266474 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:11:03.266547 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:11:03.267579 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] HCTL ('7', '-', '-', 0) found on session 155 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:11:03.267688 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:11:03.273252 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:03.291302 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Searching for a device in session 155 and hctl ['7', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:11:03.294707 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:11:03.294707 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:11:03.294707 np0000001475 nova-compute[98471]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:03.294707 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:03.294707 np0000001475 nova-compute[98471]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:03.294707 np0000001475 nova-compute[98471]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:03.294707 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:11:03.295152 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsi session list stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:11:03.295152 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:11:03.295152 np0000001475 nova-compute[98471]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:03.295152 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:03.295152 np0000001475 nova-compute[98471]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:03.295152 np0000001475 nova-compute[98471]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:03.295152 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:11:03.295462 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:11:03.295559 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:11:03.296306 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] HCTL ('12', '-', '-', 0) found on session 156 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:11:03.296405 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:11:03.317045 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Searching for a device in session 156 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:11:03.317045 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f51fa28c-1a38-4316-bf4a-e09791a95cc9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:11:03.756162 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:11:03.756434 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:11:03.757090 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:03.757266 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:03.812439 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:03.834765 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '568dd12813254325bb16fac607894d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256f2c4e067c46a3a4ea5e9d934b1d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:11:04.254662 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:11:04.280449 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:11:04.299336 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Searching for a device in session 155 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:11:04.299666 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f51fa28c-1a38-4316-bf4a-e09791a95cc9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:11:04.323649 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Successfully created port: 800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:11:04.408981 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:11:04.412102 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:11:04.532274 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:11:04.537208 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:11:04.539034 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:11:04.649817 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:11:04.651438 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:11:04.758338 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:11:04.776061 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:11:04.786081 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:11:04.884372 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:11:04.885774 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:11:04.925062 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Successfully updated port: 800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:11:04.971883 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-93d33a0a-fdcc-4281-9464-ed0a7c8a7df5 req-1b87dedc-4afa-4e0a-b2b9-02061781049f service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Received event network-changed-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:04.972092 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-93d33a0a-fdcc-4281-9464-ed0a7c8a7df5 req-1b87dedc-4afa-4e0a-b2b9-02061781049f service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Refreshing instance network info cache due to event network-changed-800cb186-9c81-4bac-a72a-6a6fd06ce1f4. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:11:04.972711 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-93d33a0a-fdcc-4281-9464-ed0a7c8a7df5 req-1b87dedc-4afa-4e0a-b2b9-02061781049f service nova] Acquiring lock "refresh_cache-79df2202-e3ff-44de-8dee-d13a3a8304d5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:11:04.972711 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-93d33a0a-fdcc-4281-9464-ed0a7c8a7df5 req-1b87dedc-4afa-4e0a-b2b9-02061781049f service nova] Acquired lock "refresh_cache-79df2202-e3ff-44de-8dee-d13a3a8304d5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:11:04.972711 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-93d33a0a-fdcc-4281-9464-ed0a7c8a7df5 req-1b87dedc-4afa-4e0a-b2b9-02061781049f service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Refreshing network info cache for port 800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:11:04.980166 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:11:04.985474 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:11:04.986439 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:11:05.032035 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:11:05.032475 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=12462MB free_disk=72.76605987548828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:11:05.032676 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:05.033023 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:05.140353 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Found WWN 33000000087b9d829 for multipath device dm-4 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:11:05.141225 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:11:05.141620 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '33000000087b9d829', 'path': '/dev/dm-4', 'multipath_id': '33000000087b9d829'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:11:05.141826 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000087b9d829', 'path': '/dev/dm-4', 'multipath_id': '33000000087b9d829'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:11:05.142373 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.495s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:11:05.142894 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:11:05.143150 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:11:05.146865 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lazy-loading 'flavor' on Instance uuid 4d78ea44-9e63-4671-91bc-ee77eb1885cc {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:11:05.171009 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:11:05.171009 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:11:05.171009 np0000001475 nova-compute[98471]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:05.171009 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:05.171009 np0000001475 nova-compute[98471]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:05.171009 np0000001475 nova-compute[98471]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:05.171009 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:11:05.171437 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsi session list stdout=tcp: [147] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:11:05.171437 np0000001475 nova-compute[98471]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135 (non-flash)
May 27 03:11:05.171437 np0000001475 nova-compute[98471]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:05.171437 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:05.171437 np0000001475 nova-compute[98471]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:05.171437 np0000001475 nova-compute[98471]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:05.171437 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:11:05.171437 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', '148'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', '152'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', '153'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', '156')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:11:05.171437 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', '148')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:11:05.172972 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', '147')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:11:05.173658 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7557046e2980>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135'): ({'sde'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:11:05.173887 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Removing multipathed devices sdf, sde {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:11:05.174135 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Flush multipath device 330000000f2216dc3 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:11:05.208447 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:11:05.254316 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:11:05.294275 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:11:05.294758 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:11:05.295353 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:11:05.308283 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:11:05.308554 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:11:05.319628 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:05.353261 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 148, target: iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135, portal: 192.168.40.100,3260]
May 27 03:11:05.353261 np0000001475 nova-compute[98471]: Logout of [sid: 148, target: iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135, portal: 192.168.40.100,3260] successful.
May 27 03:11:05.353261 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:05.373868 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:05.385471 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:05.418768 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 147, target: iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135, portal: 192.168.50.100,3260]
May 27 03:11:05.418768 np0000001475 nova-compute[98471]: Logout of [sid: 147, target: iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135, portal: 192.168.50.100,3260] successful.
May 27 03:11:05.418768 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:05.430461 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "refresh_cache-79df2202-e3ff-44de-8dee-d13a3a8304d5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:11:05.433285 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:05.433547 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:11:05.433693 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] <== disconnect_volume: return (2787ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:11:05.433870 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:11:05.474852 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-93d33a0a-fdcc-4281-9464-ed0a7c8a7df5 req-1b87dedc-4afa-4e0a-b2b9-02061781049f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:05.542326 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-93d33a0a-fdcc-4281-9464-ed0a7c8a7df5 req-1b87dedc-4afa-4e0a-b2b9-02061781049f service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:11:05.649735 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Attempting to attach volume f51fa28c-1a38-4316-bf4a-e09791a95cc9 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:11:05.651616 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:11:05.651616 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:11:05.651616 np0000001475 nova-compute[98471]:   <alias name="ua-f51fa28c-1a38-4316-bf4a-e09791a95cc9"/>
May 27 03:11:05.651616 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-4"/>
May 27 03:11:05.651616 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:11:05.651616 np0000001475 nova-compute[98471]:   <serial>f51fa28c-1a38-4316-bf4a-e09791a95cc9</serial>
May 27 03:11:05.651616 np0000001475 nova-compute[98471]: </disk>
May 27 03:11:05.651616 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:11:05.680781 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-93d33a0a-fdcc-4281-9464-ed0a7c8a7df5 req-1b87dedc-4afa-4e0a-b2b9-02061781049f service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:11:05.769762 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:11:05.770883 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:11:05.771137 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Creating image(s)
May 27 03:11:05.771636 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "/opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:05.773963 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "/opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:05.774758 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "/opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:05.775421 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:11:05.780952 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:11:05.782163 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:11:05.889177 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.106s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:11:05.889177 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:05.889369 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:05.889963 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:11:05.893835 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:11:05.894622 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:11:05.984817 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.090s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:11:05.985424 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:11:06.008600 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lazy-loading 'flavor' on Instance uuid eb7ae482-4f6f-4b54-9923-3657c90de9fa {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:11:06.047530 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk 1073741824" returned: 0 in 0.062s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:11:06.051289 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.162s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:06.051560 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:11:06.111437 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance eb7ae482-4f6f-4b54-9923-3657c90de9fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:11:06.111662 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 4d78ea44-9e63-4671-91bc-ee77eb1885cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:11:06.111866 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 408047d8-a3ab-415c-a667-204e70271bed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:11:06.112004 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:11:06.112091 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:11:06.112312 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:11:06.112476 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:11:05 up 42 min,  2 users,  load average: 6.68, 7.72, 5.58\n', 'num_instances': '5', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '5', 'num_proj_428862460731458481e46d92e7e023cf': '1', 'io_workload': '1', 'num_proj_c547b519adf248728dfd0b2232bfc118': '1', 'num_proj_5b4433f475a34911aac6a9ace35bbf5e': '1', 'num_proj_8836c8a171d34ccf9ea8e385160539ae': '1', 'num_vm_building': '1', 'num_task_block_device_mapping': '1', 'num_proj_256f2c4e067c46a3a4ea5e9d934b1d4b': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:11:06.137773 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.086s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:11:06.138086 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:11:06.138296 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:11:06.186977 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-93d33a0a-fdcc-4281-9464-ed0a7c8a7df5 req-1b87dedc-4afa-4e0a-b2b9-02061781049f service nova] Releasing lock "refresh_cache-79df2202-e3ff-44de-8dee-d13a3a8304d5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:11:06.187897 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquired lock "refresh_cache-79df2202-e3ff-44de-8dee-d13a3a8304d5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:11:06.188243 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:11:06.228430 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:11:06.228716 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Cannot resize image /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:11:06.229051 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:11:06.229196 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Ensure instance console log exists: /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:11:06.229419 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:06.229606 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:06.229722 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:06.385713 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:11:06.386179 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:11:06.520634 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:06.747411 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:11:06.875540 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:06.888420 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:11:06.986999 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Updating instance_info_cache with network_info: [{"id": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "address": "fa:16:3e:66:18:6f", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap800cb186-9c", "ovs_interfaceid": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:11:07.004606 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:07.019703 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4d82a382-246d-43f4-939f-2bcb560aacbf tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.448s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:07.020654 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.015s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:07.020885 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:07.021492 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:07.021492 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:07.023019 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Terminating instance
May 27 03:11:07.325466 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:11:07.325587 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:11:07.325650 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:11:07.325803 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] No VIF found with MAC fa:16:3e:3d:15:0b, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:11:07.395610 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:11:07.396134 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.363s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:07.396134 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 41.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:11:07.489170 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Releasing lock "refresh_cache-79df2202-e3ff-44de-8dee-d13a3a8304d5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:11:07.489977 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Instance network_info: |[{"id": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "address": "fa:16:3e:66:18:6f", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap800cb186-9c", "ovs_interfaceid": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:11:07.491808 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Start _get_guest_xml network_info=[{"id": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "address": "fa:16:3e:66:18:6f", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap800cb186-9c", "ovs_interfaceid": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:11:07.496077 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:11:07.497620 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-762538925', uuid='79df2202-e3ff-44de-8dee-d13a3a8304d5'), owner=OwnerMeta(userid='568dd12813254325bb16fac607894d49', username='tempest-VolumeMultiattachTests-1876764595-project-member', projectid='256f2c4e067c46a3a4ea5e9d934b1d4b', projectname='tempest-VolumeMultiattachTests-1876764595'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "address": "fa:16:3e:66:18:6f", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap800cb186-9c", "ovs_interfaceid": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851467.4971757) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:11:07.499191 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:11:07.499564 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:11:07.500811 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:11:07.501059 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:11:07.502169 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:11:07.502544 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:11:07.502822 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:11:07.502942 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:11:07.503097 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:11:07.503198 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:11:07.503319 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:11:07.503507 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:11:07.503624 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:11:07.503900 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:11:07.504027 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:11:07.504168 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:11:07.518434 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:10:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-762538925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumemultiattachtests-server-762538925',id=63,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVI54RH2pdxhdx+NBQ2XGN7tNsXMkNRRM659CteSsS0ZmLSyoDiSuXTzB/DhppFfYk9ouWLVqam92P3d8MUEqPLedL5zCvpkb49Y3GdLSs3nNQ1gwwpZDY5VEnqdrskPA==',key_name='tempest-keypair-695410050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='256f2c4e067c46a3a4ea5e9d934b1d4b',ramdisk_id='',reservation_id='r-kp3hy32l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1876764595',owner_user_name='tempest-VolumeMultiattachTests-1876764595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:11:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='568dd12813254325bb16fac607894d49',uuid=79df2202-e3ff-44de-8dee-d13a3a8304d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "address": "fa:16:3e:66:18:6f", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap800cb186-9c", "ovs_interfaceid": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:11:07.518641 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Converting VIF {"id": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "address": "fa:16:3e:66:18:6f", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap800cb186-9c", "ovs_interfaceid": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:11:07.520450 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:18:6f,bridge_name='br-int',has_traffic_filtering=True,id=800cb186-9c81-4bac-a72a-6a6fd06ce1f4,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap800cb186-9c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:11:07.521111 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'pci_devices' on Instance uuid 79df2202-e3ff-44de-8dee-d13a3a8304d5 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:11:07.527953 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:11:07.548988 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:07.550884 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:07.568983 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:07.574896 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:07.597066 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:07.602305 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:07.678262 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e012f65e-eebf-4a8d-bc3b-cd6c08feeeec req-4cd5eba6-2842-41ee-a99a-bbae58d7c972 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Received event network-vif-unplugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:07.678523 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e012f65e-eebf-4a8d-bc3b-cd6c08feeeec req-4cd5eba6-2842-41ee-a99a-bbae58d7c972 service nova] Acquiring lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:07.678704 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e012f65e-eebf-4a8d-bc3b-cd6c08feeeec req-4cd5eba6-2842-41ee-a99a-bbae58d7c972 service nova] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:07.678866 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e012f65e-eebf-4a8d-bc3b-cd6c08feeeec req-4cd5eba6-2842-41ee-a99a-bbae58d7c972 service nova] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:07.679039 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e012f65e-eebf-4a8d-bc3b-cd6c08feeeec req-4cd5eba6-2842-41ee-a99a-bbae58d7c972 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] No waiting events found dispatching network-vif-unplugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:11:07.679175 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e012f65e-eebf-4a8d-bc3b-cd6c08feeeec req-4cd5eba6-2842-41ee-a99a-bbae58d7c972 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Received event network-vif-unplugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:11:07.841824 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:07.871716 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:07.875410 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:07.884543 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999713877999966 future=<Future at 0x755724408f20 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:11:07.885293 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999411126000268 future=<Future at 0x755724408f20 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:11:07.885478 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99866053200003 future=<Future at 0x755724408f20 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:11:07.887806 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Instance destroyed successfully.
May 27 03:11:07.888244 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lazy-loading 'resources' on Instance uuid eb7ae482-4f6f-4b54-9923-3657c90de9fa {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:11:07.893266 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.027991 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] End _get_guest_xml xml=<domain type="qemu">
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:   <uuid>79df2202-e3ff-44de-8dee-d13a3a8304d5</uuid>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:   <name>instance-0000003f</name>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <nova:name>tempest-VolumeMultiattachTests-server-762538925</nova:name>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:11:07</nova:creationTime>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:         <nova:user uuid="568dd12813254325bb16fac607894d49">tempest-VolumeMultiattachTests-1876764595-project-member</nova:user>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:         <nova:project uuid="256f2c4e067c46a3a4ea5e9d934b1d4b">tempest-VolumeMultiattachTests-1876764595</nova:project>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:         <nova:port uuid="800cb186-9c81-4bac-a72a-6a6fd06ce1f4">
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     <system>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <entry name="serial">79df2202-e3ff-44de-8dee-d13a3a8304d5</entry>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <entry name="uuid">79df2202-e3ff-44de-8dee-d13a3a8304d5</entry>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     </system>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:   <os>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:   </os>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:   <features>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:   </features>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:   <devices>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     </disk>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk.config"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     </disk>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:66:18:6f"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <target dev="tap800cb186-9c"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     </interface>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/console.log" append="off"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     </serial>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     <video>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     </video>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     </rng>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:   </devices>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]: </domain>
May 27 03:11:08.027991 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:11:08.027991 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Preparing to wait for external event network-vif-plugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:11:08.027991 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:08.027991 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:08.027991 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:08.027991 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:10:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-762538925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumemultiattachtests-server-762538925',id=63,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVI54RH2pdxhdx+NBQ2XGN7tNsXMkNRRM659CteSsS0ZmLSyoDiSuXTzB/DhppFfYk9ouWLVqam92P3d8MUEqPLedL5zCvpkb49Y3GdLSs3nNQ1gwwpZDY5VEnqdrskPA==',key_name='tempest-keypair-695410050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='256f2c4e067c46a3a4ea5e9d934b1d4b',ramdisk_id='',reservation_id='r-kp3hy32l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1876764595',owner_user_name='tempest-VolumeMultiattachTests-1876764595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:11:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='568dd12813254325bb16fac607894d49',uuid=79df2202-e3ff-44de-8dee-d13a3a8304d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "address": "fa:16:3e:66:18:6f", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap800cb186-9c", "ovs_interfaceid": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:11:08.027991 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Converting VIF {"id": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "address": "fa:16:3e:66:18:6f", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap800cb186-9c", "ovs_interfaceid": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:11:08.027991 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:18:6f,bridge_name='br-int',has_traffic_filtering=True,id=800cb186-9c81-4bac-a72a-6a6fd06ce1f4,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap800cb186-9c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:11:08.027991 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:18:6f,bridge_name='br-int',has_traffic_filtering=True,id=800cb186-9c81-4bac-a72a-6a6fd06ce1f4,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap800cb186-9c') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:11:08.027991 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.027991 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:11:08.031469 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:11:08.031469 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.031469 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7486c804-c626-5281-8836-44cd74cbc7da', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:11:08.032497 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.033256 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:11:08.044297 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.047548 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.047716 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap800cb186-9c, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:11:08.048084 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap800cb186-9c, col_values=(('qos', UUID('d877891c-fe2b-4875-8c21-a81c035566cb')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:11:08.048258 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap800cb186-9c, col_values=(('external_ids', {'iface-id': '800cb186-9c81-4bac-a72a-6a6fd06ce1f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:18:6f', 'vm-uuid': '79df2202-e3ff-44de-8dee-d13a3a8304d5'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:11:08.049158 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.050302 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:11:08.062558 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.064381 np0000001475 nova-compute[98471]: INFO os_vif [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:18:6f,bridge_name='br-int',has_traffic_filtering=True,id=800cb186-9c81-4bac-a72a-6a6fd06ce1f4,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap800cb186-9c')
May 27 03:11:08.178142 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.187271 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.191479 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.210658 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.223004 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.319006 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.350756 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.392980 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:09:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1482447493',display_name='tempest-VolumesBackupsTest-instance-1482447493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesbackupstest-instance-1482447493',id=58,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkuue+WJjnfaVeXYqvytm9UKZy+pXgju4LHY5uoAjZYPPWewwlmo5fadbRRZOFzLLVVCOi2nfK8yAo/YHfS8mhG6Oy4joQ1WuJAO3chh3RdZkC+kcumY4G4cyzvNK6taA==',key_name='tempest-keypair-1825246971',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:09:27Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='428862460731458481e46d92e7e023cf',ramdisk_id='',reservation_id='r-q1bg6k30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-655006446',owner_user_name='tempest-VolumesBackupsTest-655006446-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:09:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c925bec6c37b4489b122eeff91a1f59f',uuid=eb7ae482-4f6f-4b54-9923-3657c90de9fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "address": "fa:16:3e:a9:da:0b", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e38c63-6e", "ovs_interfaceid": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:11:08.392980 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Converting VIF {"id": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "address": "fa:16:3e:a9:da:0b", "network": {"id": "735ff26b-dab6-49dc-a6ef-ed11180803a8", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-390843057-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "428862460731458481e46d92e7e023cf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e38c63-6e", "ovs_interfaceid": "40e38c63-6edf-4ebd-bd43-48e853f0c67a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:11:08.392980 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:da:0b,bridge_name='br-int',has_traffic_filtering=True,id=40e38c63-6edf-4ebd-bd43-48e853f0c67a,network=Network(735ff26b-dab6-49dc-a6ef-ed11180803a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e38c63-6e') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:11:08.392980 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:da:0b,bridge_name='br-int',has_traffic_filtering=True,id=40e38c63-6edf-4ebd-bd43-48e853f0c67a,network=Network(735ff26b-dab6-49dc-a6ef-ed11180803a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e38c63-6e') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:11:08.393413 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.393593 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40e38c63-6e, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:11:08.395650 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.398041 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:11:08.401133 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.401809 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.401969 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=192ae621-8ee0-4ac8-a37c-197a7d8f52bc) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:11:08.403280 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.404496 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:11:08.408830 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:08.410539 np0000001475 nova-compute[98471]: INFO os_vif [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:da:0b,bridge_name='br-int',has_traffic_filtering=True,id=40e38c63-6edf-4ebd-bd43-48e853f0c67a,network=Network(735ff26b-dab6-49dc-a6ef-ed11180803a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e38c63-6e')
May 27 03:11:08.413211 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:11:08.413541 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:11:08.413761 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:11:08.415152 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:11:08.415152 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dd3605ba-8b97-468b-963c-e6fb8c7c1135', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:11:08.415152 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:11:08.441997 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:08.441997 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:08.441997 np0000001475 nova-compute[98471]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:08.441997 np0000001475 nova-compute[98471]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:08.441997 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:11:08.442229 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] iscsi session list stdout=tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:08.442229 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:08.442229 np0000001475 nova-compute[98471]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:08.442229 np0000001475 nova-compute[98471]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:08.442229 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:11:08.442229 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', '152'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', '153'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', '156')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:11:08.442408 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135, 0): [] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:11:08.442408 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135') {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 03:11:08.442480 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135, 0): [] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:11:08.442602 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dd3605ba-8b97-468b-963c-e6fb8c7c1135') {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 03:11:08.442712 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c285300>, {}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:11:08.442784 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Disconnecting from: [] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:11:08.442961 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.029s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:11:08.443064 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] <== disconnect_volume: return (29ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:11:08.443154 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:11:08.443387 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Deleting instance files /opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa_del
May 27 03:11:08.444087 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Deletion of /opt/stack/data/nova/instances/eb7ae482-4f6f-4b54-9923-3657c90de9fa_del complete
May 27 03:11:08.889648 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99e6c728-d597-47a4-b886-c1ab27650857 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.500s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:08.952849 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Took 1.42 seconds to destroy the instance on the hypervisor.
May 27 03:11:08.954278 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:11:08.954468 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:11:08.954603 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:11:08.954851 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:09.066859 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:09.583683 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:11:09.584127 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:11:09.584127 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No VIF found with MAC fa:16:3e:66:18:6f, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:11:09.584290 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Using config drive
May 27 03:11:09.742934 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Received event network-vif-unplugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:09.743172 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] Acquiring lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:09.743401 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:09.743592 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:09.744105 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] No waiting events found dispatching network-vif-unplugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:11:09.744346 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Received event network-vif-unplugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:11:09.744734 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Received event network-vif-plugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:09.745059 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] Acquiring lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:09.745248 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:09.745534 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:09.745790 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] No waiting events found dispatching network-vif-plugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:11:09.745970 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Received unexpected event network-vif-plugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a for instance with vm_state active and task_state deleting.
May 27 03:11:09.746401 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Received event network-vif-plugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:09.746577 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] Acquiring lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:09.746787 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:09.746962 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:09.747105 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] No waiting events found dispatching network-vif-plugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:11:09.747248 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Received unexpected event network-vif-plugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a for instance with vm_state active and task_state deleting.
May 27 03:11:09.747386 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Received event network-vif-unplugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:09.747537 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] Acquiring lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:09.747703 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:09.747869 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:09.748013 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] No waiting events found dispatching network-vif-unplugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:11:09.748549 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Received event network-vif-unplugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:11:09.748549 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Received event network-vif-unplugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:09.748549 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] Acquiring lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:09.748549 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:09.748636 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:09.748790 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] No waiting events found dispatching network-vif-unplugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:11:09.748941 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Received event network-vif-unplugged-40e38c63-6edf-4ebd-bd43-48e853f0c67a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:11:09.749073 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Received event network-vif-deleted-40e38c63-6edf-4ebd-bd43-48e853f0c67a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:09.749222 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Neutron deleted interface 40e38c63-6edf-4ebd-bd43-48e853f0c67a; detaching it from the instance and deleting it from the info cache
May 27 03:11:09.749362 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:11:09.949438 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:11:10.040923 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:10.041241 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:10.088825 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:10.198265 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Creating config drive at /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk.config
May 27 03:11:10.201959 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp45evff95 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:11:10.254929 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp45evff95" returned: 0 in 0.053s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:11:10.255381 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8919c155-5069-4a37-8a91-2ff6d51f5975 req-af4154dd-c4de-429a-a055-49fb1be60f97 service nova] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Detach interface failed, port_id=40e38c63-6edf-4ebd-bd43-48e853f0c67a, reason: Instance eb7ae482-4f6f-4b54-9923-3657c90de9fa could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:11:10.452132 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Took 1.50 seconds to deallocate network for instance.
May 27 03:11:10.468293 np0000001475 nova-compute[98471]: WARNING nova.volume.cinder [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Attachment 7ebf3869-9476-414a-95aa-30eb5fdbf1a4 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7ebf3869-9476-414a-95aa-30eb5fdbf1a4. (HTTP 404) (Request-ID: req-361a9f0d-b20c-4b0a-8f98-66801b5456bd)
May 27 03:11:10.468610 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Took 0.02 seconds to detach 1 volumes for instance.
May 27 03:11:10.545026 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lazy-loading 'flavor' on Instance uuid 4d78ea44-9e63-4671-91bc-ee77eb1885cc {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:11:10.668614 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:10.701403 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:10.706205 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:10.810170 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:10.870575 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0d4afa67-5228-4ffd-8073-d2c4b70203a6 req-93d7d654-3517-4dd8-b687-d38ca5e7f365 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Received event network-vif-plugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:10.871129 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0d4afa67-5228-4ffd-8073-d2c4b70203a6 req-93d7d654-3517-4dd8-b687-d38ca5e7f365 service nova] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:10.871736 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0d4afa67-5228-4ffd-8073-d2c4b70203a6 req-93d7d654-3517-4dd8-b687-d38ca5e7f365 service nova] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:10.872676 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0d4afa67-5228-4ffd-8073-d2c4b70203a6 req-93d7d654-3517-4dd8-b687-d38ca5e7f365 service nova] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:10.872676 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0d4afa67-5228-4ffd-8073-d2c4b70203a6 req-93d7d654-3517-4dd8-b687-d38ca5e7f365 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Processing event network-vif-plugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:11:10.976757 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:10.977280 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:11.028430 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:11.029840 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:11.034356 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:11.055585 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:11.325270 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:11:11.325540 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:11:11.490583 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851471.4901533, 79df2202-e3ff-44de-8dee-d13a3a8304d5 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:11:11.491077 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:11:11.491251 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] VM Started (Lifecycle Event)
May 27 03:11:11.493160 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:11:11.495719 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Instance spawned successfully.
May 27 03:11:11.496094 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:11:11.522790 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:11.553296 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:11.828520 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:11:11.993648 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:11:11.996991 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:11:12.003399 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:11:12.003504 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:11:12.003776 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:11:12.004019 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:11:12.004340 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:11:12.004653 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:11:12.335736 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.358s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:12.385039 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Deleted allocations for instance eb7ae482-4f6f-4b54-9923-3657c90de9fa
May 27 03:11:12.501149 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:11:12.501604 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851472.5013273, 79df2202-e3ff-44de-8dee-d13a3a8304d5 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:11:12.501822 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] VM Paused (Lifecycle Event)
May 27 03:11:12.510710 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Took 6.74 seconds to spawn the instance on the hypervisor.
May 27 03:11:12.512302 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:11:12.633370 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:12.633572 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:12.634098 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Attaching volume a405be28-9401-4702-89ff-0f37c55aa1fb to /dev/vdc
May 27 03:11:12.675796 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:11:12.687606 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:11:12.712759 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:11:12.759673 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:11:12.761465 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:11:12.769336 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:11:12.771379 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::d018:f2ff:feb0:9e2b', 'fe80::fc16:3eff:fe8e:48f0', 'fe80::7441:51ff:fe02:437d', 'fe80::fc16:3eff:fe66:186f', 'fe80::f9:d2ff:fead:2ab6', 'fe80::fc16:3eff:fe3d:150b', 'fe80::c8bd:deff:fefd:aeb3', 'fe80::fc16:3eff:febe:aee3'] 
May 27 03:11:12.771545 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:11:12.771634 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:11:12.771886 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:11:12.772131 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Updating existing volume attachment record: a872f755-ad32-4a98-a882-62018901df68 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:11:12.952607 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e561b3f6-0e06-41a3-a6de-65f86386f4be req-692cbf6a-0d7f-4739-8c05-6913fd1ca278 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Received event network-vif-plugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:12.953169 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e561b3f6-0e06-41a3-a6de-65f86386f4be req-692cbf6a-0d7f-4739-8c05-6913fd1ca278 service nova] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:12.953367 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e561b3f6-0e06-41a3-a6de-65f86386f4be req-692cbf6a-0d7f-4739-8c05-6913fd1ca278 service nova] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:12.953470 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e561b3f6-0e06-41a3-a6de-65f86386f4be req-692cbf6a-0d7f-4739-8c05-6913fd1ca278 service nova] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:12.953580 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e561b3f6-0e06-41a3-a6de-65f86386f4be req-692cbf6a-0d7f-4739-8c05-6913fd1ca278 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] No waiting events found dispatching network-vif-plugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:11:12.954254 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-e561b3f6-0e06-41a3-a6de-65f86386f4be req-692cbf6a-0d7f-4739-8c05-6913fd1ca278 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Received unexpected event network-vif-plugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 for instance with vm_state active and task_state None.
May 27 03:11:13.004514 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:11:13.008270 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851473.0079904, 79df2202-e3ff-44de-8dee-d13a3a8304d5 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:11:13.008389 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] VM Resumed (Lifecycle Event)
May 27 03:11:13.020969 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Took 12.14 seconds to build instance.
May 27 03:11:13.320847 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:11:13.321217 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb', 'iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a405be28-9401-4702-89ff-0f37c55aa1fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:11:13.321370 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:11:13.321751 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:11:13.321997 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb', 'iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a405be28-9401-4702-89ff-0f37c55aa1fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:11:13.336059 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:11:13.336655 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:11:13.337295 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:11:13.337522 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:11:13.338340 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:11:13.338549 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:11:13.349138 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:11:13.349138 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:13.354543 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:11:13.354543 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:13.361653 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb] added
May 27 03:11:13.361653 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:11:13.361653 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:11:13.361653 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:11:13.361653 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:11:13.361653 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:11:13.361653 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:13.362033 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:11:13.362033 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0245(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:11:13.362170 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:11:13.366835 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb] added
May 27 03:11:13.366835 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:11:13.366835 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:11:13.366835 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:11:13.366835 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:11:13.366835 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:11:13.366835 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:13.367120 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:11:13.367258 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:11:13.367393 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:11:13.393316 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7bdf12f9-c6d4-439d-87d2-0bb0f1f8758b tempest-VolumesBackupsTest-655006446 tempest-VolumesBackupsTest-655006446-project-member] Lock "eb7ae482-4f6f-4b54-9923-3657c90de9fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.373s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:13.403390 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:13.510926 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:11:13.514119 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:11:13.522412 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ba60665e-21e6-4d9d-a790-9b0417767a37 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.650s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:14.363174 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:11:14.367792 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:11:14.374816 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:11:14.374816 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:11:14.384762 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:11:14.384762 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:14.390812 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:14.396385 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:14.403839 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:14.403839 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:14.403839 np0000001475 nova-compute[98471]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:14.403839 np0000001475 nova-compute[98471]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:14.403839 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:11:14.404043 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsi session list stdout=tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:14.404043 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:14.404043 np0000001475 nova-compute[98471]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:14.404043 np0000001475 nova-compute[98471]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:14.404043 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:11:14.409537 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:14.409537 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:14.409537 np0000001475 nova-compute[98471]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:14.409537 np0000001475 nova-compute[98471]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:14.409537 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:11:14.409696 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsi session list stdout=tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:14.409696 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:14.409696 np0000001475 nova-compute[98471]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:14.409696 np0000001475 nova-compute[98471]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:14.409696 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:11:14.448478 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb, portal: 192.168.40.100,3260]
May 27 03:11:14.448478 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb, portal: 192.168.40.100,3260] successful.
May 27 03:11:14.448478 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:14.448811 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb, portal: 192.168.50.100,3260]
May 27 03:11:14.448811 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb, portal: 192.168.50.100,3260] successful.
May 27 03:11:14.448811 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:14.460088 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:14.467765 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:14.475451 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:14.475451 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:14.475451 np0000001475 nova-compute[98471]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:14.475451 np0000001475 nova-compute[98471]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:14.475451 np0000001475 nova-compute[98471]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb (non-flash)
May 27 03:11:14.475451 np0000001475 nova-compute[98471]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb (non-flash)
May 27 03:11:14.475451 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:11:14.475679 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsi session list stdout=tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:14.475679 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:14.475679 np0000001475 nova-compute[98471]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:14.475679 np0000001475 nova-compute[98471]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:14.475679 np0000001475 nova-compute[98471]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb (non-flash)
May 27 03:11:14.475679 np0000001475 nova-compute[98471]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb (non-flash)
May 27 03:11:14.475679 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:11:14.475935 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:11:14.476035 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:11:14.476958 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] HCTL ('11', '-', '-', 0) found on session 158 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:11:14.477057 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:11:14.481532 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:14.481532 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:14.481532 np0000001475 nova-compute[98471]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:14.481532 np0000001475 nova-compute[98471]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:14.481532 np0000001475 nova-compute[98471]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb (non-flash)
May 27 03:11:14.481532 np0000001475 nova-compute[98471]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb (non-flash)
May 27 03:11:14.481532 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:11:14.482137 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsi session list stdout=tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:14.482137 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:14.482137 np0000001475 nova-compute[98471]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:14.482137 np0000001475 nova-compute[98471]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:14.482137 np0000001475 nova-compute[98471]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb (non-flash)
May 27 03:11:14.482137 np0000001475 nova-compute[98471]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb (non-flash)
May 27 03:11:14.482137 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:11:14.482137 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:11:14.482137 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:11:14.482615 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] HCTL ('10', '-', '-', 0) found on session 157 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:11:14.482713 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:11:14.492476 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Searching for a device in session 158 and hctl ['11', '*', '*', 0] yield: sde {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:11:14.493833 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a405be28-9401-4702-89ff-0f37c55aa1fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:11:14.502784 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Searching for a device in session 157 and hctl ['10', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:11:14.502784 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a405be28-9401-4702-89ff-0f37c55aa1fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:11:14.962648 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8052a922-3de6-4ee3-b402-b926c8ae82af req-c076adc8-53e0-4c84-b7cb-1bd26891734b service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Received event network-changed-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:14.962776 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8052a922-3de6-4ee3-b402-b926c8ae82af req-c076adc8-53e0-4c84-b7cb-1bd26891734b service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Refreshing instance network info cache due to event network-changed-800cb186-9c81-4bac-a72a-6a6fd06ce1f4. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:11:14.962936 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8052a922-3de6-4ee3-b402-b926c8ae82af req-c076adc8-53e0-4c84-b7cb-1bd26891734b service nova] Acquiring lock "refresh_cache-79df2202-e3ff-44de-8dee-d13a3a8304d5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:11:14.963051 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8052a922-3de6-4ee3-b402-b926c8ae82af req-c076adc8-53e0-4c84-b7cb-1bd26891734b service nova] Acquired lock "refresh_cache-79df2202-e3ff-44de-8dee-d13a3a8304d5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:11:14.963351 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-8052a922-3de6-4ee3-b402-b926c8ae82af req-c076adc8-53e0-4c84-b7cb-1bd26891734b service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Refreshing network info cache for port 800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:11:15.338037 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:11:15.460769 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:15.465799 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-8052a922-3de6-4ee3-b402-b926c8ae82af req-c076adc8-53e0-4c84-b7cb-1bd26891734b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:15.793794 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-8052a922-3de6-4ee3-b402-b926c8ae82af req-c076adc8-53e0-4c84-b7cb-1bd26891734b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:15.958769 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-8052a922-3de6-4ee3-b402-b926c8ae82af req-c076adc8-53e0-4c84-b7cb-1bd26891734b service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Updated VIF entry in instance network info cache for port 800cb186-9c81-4bac-a72a-6a6fd06ce1f4. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:11:15.960025 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-8052a922-3de6-4ee3-b402-b926c8ae82af req-c076adc8-53e0-4c84-b7cb-1bd26891734b service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Updating instance_info_cache with network_info: [{"id": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "address": "fa:16:3e:66:18:6f", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap800cb186-9c", "ovs_interfaceid": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:11:16.361605 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Found WWN 3300000005888df38 for multipath device dm-3 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:11:16.362098 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:11:16.362254 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '3300000005888df38', 'path': '/dev/dm-3', 'multipath_id': '3300000005888df38'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:11:16.362431 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005888df38', 'path': '/dev/dm-3', 'multipath_id': '3300000005888df38'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:11:16.366802 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lazy-loading 'flavor' on Instance uuid 4d78ea44-9e63-4671-91bc-ee77eb1885cc {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:11:16.462555 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8052a922-3de6-4ee3-b402-b926c8ae82af req-c076adc8-53e0-4c84-b7cb-1bd26891734b service nova] Releasing lock "refresh_cache-79df2202-e3ff-44de-8dee-d13a3a8304d5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:11:16.523352 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:16.655552 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:16.870065 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Attempting to attach volume a405be28-9401-4702-89ff-0f37c55aa1fb with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:11:16.871696 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:11:16.871696 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:11:16.871696 np0000001475 nova-compute[98471]:   <alias name="ua-a405be28-9401-4702-89ff-0f37c55aa1fb"/>
May 27 03:11:16.871696 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:11:16.871696 np0000001475 nova-compute[98471]:   <target dev="vdc" bus="virtio"/>
May 27 03:11:16.871696 np0000001475 nova-compute[98471]:   <serial>a405be28-9401-4702-89ff-0f37c55aa1fb</serial>
May 27 03:11:16.871696 np0000001475 nova-compute[98471]: </disk>
May 27 03:11:16.871696 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:11:18.404572 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:18.553043 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:11:18.553228 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:11:18.553228 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:11:18.553326 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:11:18.553437 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] No VIF found with MAC fa:16:3e:3d:15:0b, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:11:20.119288 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-79a874e0-d58d-46ee-a309-168362dd3749 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.485s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:20.555415 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:20.555604 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:21.058336 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Detaching volume a405be28-9401-4702-89ff-0f37c55aa1fb
May 27 03:11:21.112841 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Attempting to driver detach volume a405be28-9401-4702-89ff-0f37c55aa1fb from mountpoint /dev/vdc
May 27 03:11:21.119775 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Found disk vdc by alias ua-a405be28-9401-4702-89ff-0f37c55aa1fb {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:11:21.125329 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Found disk vdc by alias ua-a405be28-9401-4702-89ff-0f37c55aa1fb {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:11:21.125562 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Attempting to detach device vdc from instance 4d78ea44-9e63-4671-91bc-ee77eb1885cc from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:11:21.126044 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:11:21.126044 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:11:21.126044 np0000001475 nova-compute[98471]:   <alias name="ua-a405be28-9401-4702-89ff-0f37c55aa1fb"/>
May 27 03:11:21.126044 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:11:21.126044 np0000001475 nova-compute[98471]:   <target dev="vdc" bus="virtio"/>
May 27 03:11:21.126044 np0000001475 nova-compute[98471]:   <serial>a405be28-9401-4702-89ff-0f37c55aa1fb</serial>
May 27 03:11:21.126044 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 27 03:11:21.126044 np0000001475 nova-compute[98471]: </disk>
May 27 03:11:21.126044 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:11:21.136881 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Successfully detached device vdc from instance 4d78ea44-9e63-4671-91bc-ee77eb1885cc from the persistent domain config.
May 27 03:11:21.137001 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] (1/8): Attempting to detach device vdc with device alias ua-a405be28-9401-4702-89ff-0f37c55aa1fb from instance 4d78ea44-9e63-4671-91bc-ee77eb1885cc from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:11:21.137289 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:11:21.137289 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:11:21.137289 np0000001475 nova-compute[98471]:   <alias name="ua-a405be28-9401-4702-89ff-0f37c55aa1fb"/>
May 27 03:11:21.137289 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:11:21.137289 np0000001475 nova-compute[98471]:   <target dev="vdc" bus="virtio"/>
May 27 03:11:21.137289 np0000001475 nova-compute[98471]:   <serial>a405be28-9401-4702-89ff-0f37c55aa1fb</serial>
May 27 03:11:21.137289 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 27 03:11:21.137289 np0000001475 nova-compute[98471]: </disk>
May 27 03:11:21.137289 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:11:21.527341 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:21.699048 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851481.698455, 4d78ea44-9e63-4671-91bc-ee77eb1885cc => ua-a405be28-9401-4702-89ff-0f37c55aa1fb> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:11:21.701975 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-a405be28-9401-4702-89ff-0f37c55aa1fb for instance 4d78ea44-9e63-4671-91bc-ee77eb1885cc {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:11:21.705781 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Successfully detached device vdc from instance 4d78ea44-9e63-4671-91bc-ee77eb1885cc from the live domain config.
May 27 03:11:21.709110 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:11:21.709110 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb', 'iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a405be28-9401-4702-89ff-0f37c55aa1fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:11:21.709388 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:11:21.717543 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:22.164472 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.452s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:11:22.164472 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb', 'iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a405be28-9401-4702-89ff-0f37c55aa1fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:11:22.164472 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:11:22.189206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:22.189206 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:22.189206 np0000001475 nova-compute[98471]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:22.189206 np0000001475 nova-compute[98471]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:22.189206 np0000001475 nova-compute[98471]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb (non-flash)
May 27 03:11:22.189206 np0000001475 nova-compute[98471]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb (non-flash)
May 27 03:11:22.189206 np0000001475 nova-compute[98471]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-934d0e71-0610-4aa4-aa37-7b9f28829d7c (non-flash)
May 27 03:11:22.189206 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:11:22.189206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsi session list stdout=tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:22.189206 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:22.189206 np0000001475 nova-compute[98471]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:22.189206 np0000001475 nova-compute[98471]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:22.189206 np0000001475 nova-compute[98471]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb (non-flash)
May 27 03:11:22.189206 np0000001475 nova-compute[98471]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb (non-flash)
May 27 03:11:22.189206 np0000001475 nova-compute[98471]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-934d0e71-0610-4aa4-aa37-7b9f28829d7c (non-flash)
May 27 03:11:22.189206 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:11:22.189206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', '152'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', '153'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-934d0e71-0610-4aa4-aa37-7b9f28829d7c', '159')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:11:22.189206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb', '157')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:11:22.190243 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb', '158')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:11:22.190768 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755724647ec0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb'): ({'sde'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:11:22.191039 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Removing multipathed devices sdf, sde {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:11:22.191144 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Flush multipath device 3300000005888df38 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:11:22.225594 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:11:22.271380 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:11:22.312946 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:11:22.313184 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:11:22.314252 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:11:22.325247 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "408047d8-a3ab-415c-a667-204e70271bed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:22.325497 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "408047d8-a3ab-415c-a667-204e70271bed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:22.325725 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "408047d8-a3ab-415c-a667-204e70271bed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:22.325982 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:22.326122 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:22.328524 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Terminating instance
May 27 03:11:22.332916 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:11:22.333194 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:11:22.347802 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:22.380573 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 157, target: iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb, portal: 192.168.40.100,3260]
May 27 03:11:22.380573 np0000001475 nova-compute[98471]: Logout of [sid: 157, target: iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb, portal: 192.168.40.100,3260] successful.
May 27 03:11:22.380573 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:22.398797 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:22.412651 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:22.448497 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 158, target: iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb, portal: 192.168.50.100,3260]
May 27 03:11:22.448497 np0000001475 nova-compute[98471]: Logout of [sid: 158, target: iqn.2023-03.storpool.com:os--volume-a405be28-9401-4702-89ff-0f37c55aa1fb, portal: 192.168.50.100,3260] successful.
May 27 03:11:22.448497 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:22.465944 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:22.466217 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:11:22.466363 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] <== disconnect_volume: return (756ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:11:22.466591 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:11:22.832048 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:11:22.856788 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:22.867447 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:22.886810 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0018558879996817268 future=<Future at 0x755724408f20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:11:22.887286 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:11:22.887526 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Emitting event <LifecycleEvent: 1779851467.884082, eb7ae482-4f6f-4b54-9923-3657c90de9fa => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:11:22.887684 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] VM Stopped (Lifecycle Event)
May 27 03:11:22.889473 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:22.889977 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:22.917911 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:22.919529 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:23.022988 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lazy-loading 'flavor' on Instance uuid 4d78ea44-9e63-4671-91bc-ee77eb1885cc {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:11:23.165093 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:23.192529 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99976102699975 future=<Future at 0x75572c4c1a00 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:11:23.192977 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999254375999953 future=<Future at 0x75572c4c1a00 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:11:23.193088 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999120777999906 future=<Future at 0x75572c4c1a00 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:11:23.194757 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Instance destroyed successfully.
May 27 03:11:23.195148 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lazy-loading 'resources' on Instance uuid 408047d8-a3ab-415c-a667-204e70271bed {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:11:23.206081 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:23.214110 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:23.233330 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:23.274335 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e9b22557-7622-4844-a0ba-46ac6a7f1c22 req-cc863904-9312-476b-89db-5e1f5a1813a0 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-vif-unplugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:23.274572 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e9b22557-7622-4844-a0ba-46ac6a7f1c22 req-cc863904-9312-476b-89db-5e1f5a1813a0 service nova] Acquiring lock "408047d8-a3ab-415c-a667-204e70271bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:23.274868 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e9b22557-7622-4844-a0ba-46ac6a7f1c22 req-cc863904-9312-476b-89db-5e1f5a1813a0 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:23.275059 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e9b22557-7622-4844-a0ba-46ac6a7f1c22 req-cc863904-9312-476b-89db-5e1f5a1813a0 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:23.275487 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e9b22557-7622-4844-a0ba-46ac6a7f1c22 req-cc863904-9312-476b-89db-5e1f5a1813a0 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] No waiting events found dispatching network-vif-unplugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:11:23.276050 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e9b22557-7622-4844-a0ba-46ac6a7f1c22 req-cc863904-9312-476b-89db-5e1f5a1813a0 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-vif-unplugged-9b975543-7a67-4aef-a074-e8748cdcbc87 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:11:23.393574 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: eb7ae482-4f6f-4b54-9923-3657c90de9fa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:11:23.407013 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:23.549234 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:23.557366 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:23.560969 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:23.589356 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:23.595481 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:23.685692 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:23.698689 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T03:09:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2112501231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-attachvolumeshelvetestjson-server-2112501231',id=59,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFU7vN92ZF7VnROzhJNF86Ad9eDOUXP7NQOeW8Q3Nkb8EhsbNJ0sXFrodZbo2Slzc36KeZpxVAsNnnRCiblv7iLv8OuH7fL7sux63j2sKxs7j6cMBNVGXPF7Mni6bSHLsw==',key_name='tempest-keypair-495903838',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:10:44Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c547b519adf248728dfd0b2232bfc118',ramdisk_id='',reservation_id='r-yz7ee0f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1364873533',owner_user_name='tempest-AttachVolumeShelveTestJSON-1364873533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:10:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c72d670892e44d88e674c9b584bc718',uuid=408047d8-a3ab-415c-a667-204e70271bed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:11:23.698987 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converting VIF {"id": "9b975543-7a67-4aef-a074-e8748cdcbc87", "address": "fa:16:3e:be:ae:e3", "network": {"id": "12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2100377688-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c547b519adf248728dfd0b2232bfc118", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b975543-7a", "ovs_interfaceid": "9b975543-7a67-4aef-a074-e8748cdcbc87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:11:23.699779 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=9b975543-7a67-4aef-a074-e8748cdcbc87,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b975543-7a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:11:23.700203 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=9b975543-7a67-4aef-a074-e8748cdcbc87,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b975543-7a') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:11:23.701601 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:23.701868 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b975543-7a, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:11:23.704421 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:11:23.714420 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:23.716260 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:23.717243 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:23.717390 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfb997ab-5b2c-4ecc-88c9-95bd682d4d1d) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:11:23.717804 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:23.718602 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:11:23.722565 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:23.727244 np0000001475 nova-compute[98471]: INFO os_vif [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ae:e3,bridge_name='br-int',has_traffic_filtering=True,id=9b975543-7a67-4aef-a074-e8748cdcbc87,network=Network(12c03bd4-37a7-4c0f-a15c-8f2a9dbc6b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b975543-7a')
May 27 03:11:23.727501 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Deleting instance files /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed_del
May 27 03:11:23.740913 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Deletion of /opt/stack/data/nova/instances/408047d8-a3ab-415c-a667-204e70271bed_del complete
May 27 03:11:23.925276 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:24.035405 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6315cd30-9439-4753-8500-ea9091bc85bd tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.480s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:24.251571 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Took 1.42 seconds to destroy the instance on the hypervisor.
May 27 03:11:24.253734 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:11:24.254381 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:11:24.254440 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 408047d8-a3ab-415c-a667-204e70271bed] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:11:24.254628 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:24.364660 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:25.023390 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:25.023604 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:25.346053 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-vif-unplugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:25.346838 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] Acquiring lock "408047d8-a3ab-415c-a667-204e70271bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:25.347049 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:25.347214 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:25.347403 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] No waiting events found dispatching network-vif-unplugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:11:25.347668 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-vif-unplugged-9b975543-7a67-4aef-a074-e8748cdcbc87 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:11:25.347884 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-vif-plugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:25.348052 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] Acquiring lock "408047d8-a3ab-415c-a667-204e70271bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:25.348247 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:25.348431 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:25.348590 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] No waiting events found dispatching network-vif-plugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:11:25.348767 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received unexpected event network-vif-plugged-9b975543-7a67-4aef-a074-e8748cdcbc87 for instance with vm_state active and task_state deleting.
May 27 03:11:25.349032 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-vif-plugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:25.349360 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] Acquiring lock "408047d8-a3ab-415c-a667-204e70271bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:25.349544 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:25.350208 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:25.350351 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] No waiting events found dispatching network-vif-plugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:11:25.350459 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received unexpected event network-vif-plugged-9b975543-7a67-4aef-a074-e8748cdcbc87 for instance with vm_state active and task_state deleting.
May 27 03:11:25.350565 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-vif-unplugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:25.350678 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] Acquiring lock "408047d8-a3ab-415c-a667-204e70271bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:25.350865 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:25.350998 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:25.351140 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] No waiting events found dispatching network-vif-unplugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:11:25.351278 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-vif-unplugged-9b975543-7a67-4aef-a074-e8748cdcbc87 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:11:25.351370 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-vif-unplugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:25.351495 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] Acquiring lock "408047d8-a3ab-415c-a667-204e70271bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:25.351605 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:25.351749 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] Lock "408047d8-a3ab-415c-a667-204e70271bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:25.351898 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] No waiting events found dispatching network-vif-unplugged-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:11:25.352034 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-vif-unplugged-9b975543-7a67-4aef-a074-e8748cdcbc87 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:11:25.352149 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Received event network-vif-deleted-9b975543-7a67-4aef-a074-e8748cdcbc87 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:25.352263 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Neutron deleted interface 9b975543-7a67-4aef-a074-e8748cdcbc87; detaching it from the instance and deleting it from the info cache
May 27 03:11:25.352383 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:11:25.387844 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:11:25.526032 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Detaching volume f51fa28c-1a38-4316-bf4a-e09791a95cc9
May 27 03:11:25.565768 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Attempting to driver detach volume f51fa28c-1a38-4316-bf4a-e09791a95cc9 from mountpoint /dev/vdb
May 27 03:11:25.570479 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Found disk vdb by alias ua-f51fa28c-1a38-4316-bf4a-e09791a95cc9 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:11:25.571817 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Found disk vdb by alias ua-f51fa28c-1a38-4316-bf4a-e09791a95cc9 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:11:25.571944 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Attempting to detach device vdb from instance 4d78ea44-9e63-4671-91bc-ee77eb1885cc from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:11:25.572244 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:11:25.572244 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:11:25.572244 np0000001475 nova-compute[98471]:   <alias name="ua-f51fa28c-1a38-4316-bf4a-e09791a95cc9"/>
May 27 03:11:25.572244 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-4"/>
May 27 03:11:25.572244 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:11:25.572244 np0000001475 nova-compute[98471]:   <serial>f51fa28c-1a38-4316-bf4a-e09791a95cc9</serial>
May 27 03:11:25.572244 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:11:25.572244 np0000001475 nova-compute[98471]: </disk>
May 27 03:11:25.572244 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:11:25.578698 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Successfully detached device vdb from instance 4d78ea44-9e63-4671-91bc-ee77eb1885cc from the persistent domain config.
May 27 03:11:25.578898 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] (1/8): Attempting to detach device vdb with device alias ua-f51fa28c-1a38-4316-bf4a-e09791a95cc9 from instance 4d78ea44-9e63-4671-91bc-ee77eb1885cc from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:11:25.579155 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:11:25.579155 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:11:25.579155 np0000001475 nova-compute[98471]:   <alias name="ua-f51fa28c-1a38-4316-bf4a-e09791a95cc9"/>
May 27 03:11:25.579155 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-4"/>
May 27 03:11:25.579155 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:11:25.579155 np0000001475 nova-compute[98471]:   <serial>f51fa28c-1a38-4316-bf4a-e09791a95cc9</serial>
May 27 03:11:25.579155 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:11:25.579155 np0000001475 nova-compute[98471]: </disk>
May 27 03:11:25.579155 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:11:25.858689 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3927cdf4-d15a-4abf-834c-30927c05ed75 req-6a037b75-8100-4d84-9822-eeb373c1ad41 service nova] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Detach interface failed, port_id=9b975543-7a67-4aef-a074-e8748cdcbc87, reason: Instance 408047d8-a3ab-415c-a667-204e70271bed could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:11:25.889716 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Took 1.64 seconds to deallocate network for instance.
May 27 03:11:26.082952 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851486.0825987, 4d78ea44-9e63-4671-91bc-ee77eb1885cc => ua-f51fa28c-1a38-4316-bf4a-e09791a95cc9> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:11:26.083456 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f51fa28c-1a38-4316-bf4a-e09791a95cc9 for instance 4d78ea44-9e63-4671-91bc-ee77eb1885cc {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:11:26.086162 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Successfully detached device vdb from instance 4d78ea44-9e63-4671-91bc-ee77eb1885cc from the live domain config.
May 27 03:11:26.087478 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:11:26.087824 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f51fa28c-1a38-4316-bf4a-e09791a95cc9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:11:26.087983 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:11:26.088330 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:11:26.088652 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f51fa28c-1a38-4316-bf4a-e09791a95cc9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:11:26.088829 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:11:26.113720 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:26.113720 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:26.113720 np0000001475 nova-compute[98471]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:26.113720 np0000001475 nova-compute[98471]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:26.113720 np0000001475 nova-compute[98471]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-934d0e71-0610-4aa4-aa37-7b9f28829d7c (non-flash)
May 27 03:11:26.113720 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:11:26.114015 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsi session list stdout=tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:26.114015 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:26.114015 np0000001475 nova-compute[98471]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:26.114015 np0000001475 nova-compute[98471]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9 (non-flash)
May 27 03:11:26.114015 np0000001475 nova-compute[98471]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-934d0e71-0610-4aa4-aa37-7b9f28829d7c (non-flash)
May 27 03:11:26.114015 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:11:26.114177 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', '152'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', '153'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-934d0e71-0610-4aa4-aa37-7b9f28829d7c', '159')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:11:26.114277 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', '155')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:11:26.115289 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9', '156')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:11:26.116231 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755724687b00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9'): ({'sdg'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:11:26.116439 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Removing multipathed devices sdb, sdg {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:11:26.116693 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Flush multipath device 33000000087b9d829 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:11:26.161514 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:11:26.223148 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:11:26.266214 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Checking to see if SCSI volumes sdb, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:11:26.266426 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] SCSI volumes sdb, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:11:26.267475 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Checking to see if device paths {'sdb', 'sdg'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:11:26.278934 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Device paths {'sdb', 'sdg'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:11:26.279135 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:11:26.290717 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:26.322605 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 155, target: iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9, portal: 192.168.40.100,3260]
May 27 03:11:26.322605 np0000001475 nova-compute[98471]: Logout of [sid: 155, target: iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9, portal: 192.168.40.100,3260] successful.
May 27 03:11:26.322605 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:26.337326 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:26.350440 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:26.382766 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 156, target: iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9, portal: 192.168.50.100,3260]
May 27 03:11:26.382766 np0000001475 nova-compute[98471]: Logout of [sid: 156, target: iqn.2023-03.storpool.com:os--volume-f51fa28c-1a38-4316-bf4a-e09791a95cc9, portal: 192.168.50.100,3260] successful.
May 27 03:11:26.382766 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:26.396923 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:26.397055 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:11:26.397705 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] <== disconnect_volume: return (309ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:11:26.397705 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:11:26.404141 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:26.404141 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:26.529292 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:26.647768 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:11:26.648070 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:11:26.847720 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:26.957605 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lazy-loading 'flavor' on Instance uuid 4d78ea44-9e63-4671-91bc-ee77eb1885cc {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:11:27.151626 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:11:27.664870 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.258s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:27.759456 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Deleted allocations for instance 408047d8-a3ab-415c-a667-204e70271bed
May 27 03:11:27.962156 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-539ac5a5-186b-430c-9dd4-29b937305364 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.938s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:28.410247 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:28.410472 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:28.410672 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:28.410921 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:28.411012 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:28.419826 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Terminating instance
May 27 03:11:28.719423 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:28.770017 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80a5d0ce-ed2c-4b67-ac3c-5ef67a41994e tempest-AttachVolumeShelveTestJSON-1364873533 tempest-AttachVolumeShelveTestJSON-1364873533-project-member] Lock "408047d8-a3ab-415c-a667-204e70271bed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.444s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:28.922808 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:11:28.959082 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:28.984623 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:29.003601 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:29.042619 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:29.046485 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:29.077367 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:29.238456 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:29.245768 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:29.271665 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999755577000087 future=<Future at 0x7557047c88f0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:11:29.273290 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Instance destroyed successfully.
May 27 03:11:29.273838 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lazy-loading 'resources' on Instance uuid 4d78ea44-9e63-4671-91bc-ee77eb1885cc {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:11:29.467380 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:29.467560 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:29.467712 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Shelve offloading
May 27 03:11:29.781050 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:10:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1408500227',display_name='tempest-TestServerVolumeAttachmentScenario-server-1408500227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testservervolumeattachmentscenario-server-1408500227',id=61,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp8RtsSZDV+8La8Qmajk5ZExJctpNSdH+dBNBO9slAKTbJYsNHF115VoN+gdbbxvY8Yv+iZdpFP8OApEPgm47Or+jaEez0PbKKZBeJfTJIHsGXqSXaHlJuIwVcFVCsoWg==',key_name='tempest-keypair-412725153',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:10:19Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b4433f475a34911aac6a9ace35bbf5e',ramdisk_id='',reservation_id='r-f667na45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1304406302',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1304406302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:10:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba49dfb8c2c14ef89cdf87bd1bb65d7f',uuid=4d78ea44-9e63-4671-91bc-ee77eb1885cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6017d14a-ec81-49b8-899b-0f800b1c116a", "address": "fa:16:3e:3d:15:0b", "network": {"id": "efe3ae66-9047-4b8e-8231-b05da27e6387", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1240651520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5b4433f475a34911aac6a9ace35bbf5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6017d14a-ec", "ovs_interfaceid": "6017d14a-ec81-49b8-899b-0f800b1c116a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:11:29.781613 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Converting VIF {"id": "6017d14a-ec81-49b8-899b-0f800b1c116a", "address": "fa:16:3e:3d:15:0b", "network": {"id": "efe3ae66-9047-4b8e-8231-b05da27e6387", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1240651520-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5b4433f475a34911aac6a9ace35bbf5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6017d14a-ec", "ovs_interfaceid": "6017d14a-ec81-49b8-899b-0f800b1c116a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:11:29.781783 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:15:0b,bridge_name='br-int',has_traffic_filtering=True,id=6017d14a-ec81-49b8-899b-0f800b1c116a,network=Network(efe3ae66-9047-4b8e-8231-b05da27e6387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6017d14a-ec') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:11:29.782082 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:15:0b,bridge_name='br-int',has_traffic_filtering=True,id=6017d14a-ec81-49b8-899b-0f800b1c116a,network=Network(efe3ae66-9047-4b8e-8231-b05da27e6387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6017d14a-ec') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:11:29.783958 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:29.784110 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6017d14a-ec, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:11:29.786027 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:29.787535 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:11:29.788333 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:29.788554 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2583bae-eda9-4e58-84b5-4f4a91841d47) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:11:29.789293 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:29.789977 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:11:29.790891 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:29.793316 np0000001475 nova-compute[98471]: INFO os_vif [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:15:0b,bridge_name='br-int',has_traffic_filtering=True,id=6017d14a-ec81-49b8-899b-0f800b1c116a,network=Network(efe3ae66-9047-4b8e-8231-b05da27e6387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6017d14a-ec')
May 27 03:11:29.793686 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Deleting instance files /opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc_del
May 27 03:11:29.794585 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Deletion of /opt/stack/data/nova/instances/4d78ea44-9e63-4671-91bc-ee77eb1885cc_del complete
May 27 03:11:30.301400 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Took 1.38 seconds to destroy the instance on the hypervisor.
May 27 03:11:30.302097 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:11:30.302353 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:11:30.302499 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:11:30.302812 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:30.385868 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:30.501175 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:30.505526 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:30.530615 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:30.536950 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:30.566264 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:30.567538 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:30.754322 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-02df80a0-c794-4b62-9638-cbbf73fc5ba5 req-861e8372-4d32-492e-8d1b-d96149189bf6 service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Received event network-vif-unplugged-6017d14a-ec81-49b8-899b-0f800b1c116a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:30.754933 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-02df80a0-c794-4b62-9638-cbbf73fc5ba5 req-861e8372-4d32-492e-8d1b-d96149189bf6 service nova] Acquiring lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:30.755197 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-02df80a0-c794-4b62-9638-cbbf73fc5ba5 req-861e8372-4d32-492e-8d1b-d96149189bf6 service nova] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:30.755286 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-02df80a0-c794-4b62-9638-cbbf73fc5ba5 req-861e8372-4d32-492e-8d1b-d96149189bf6 service nova] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:30.755440 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-02df80a0-c794-4b62-9638-cbbf73fc5ba5 req-861e8372-4d32-492e-8d1b-d96149189bf6 service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] No waiting events found dispatching network-vif-unplugged-6017d14a-ec81-49b8-899b-0f800b1c116a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:11:30.755582 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-02df80a0-c794-4b62-9638-cbbf73fc5ba5 req-861e8372-4d32-492e-8d1b-d96149189bf6 service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Received event network-vif-unplugged-6017d14a-ec81-49b8-899b-0f800b1c116a for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:11:30.784929 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:30.792892 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:30.808545 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99971182399986 future=<Future at 0x75572c0d5040 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:11:30.810709 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Instance destroyed successfully.
May 27 03:11:30.810983 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lazy-loading 'numa_topology' on Instance uuid e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:11:31.314019 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:11:31.316115 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:11:31.316280 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquired lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:11:31.316374 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:11:31.528665 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:31.602255 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:11:31.818373 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:32.104916 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Took 1.80 seconds to deallocate network for instance.
May 27 03:11:32.128569 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:32.280587 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Updating instance_info_cache with network_info: [{"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:11:32.610502 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:32.610502 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:32.783726 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Releasing lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:11:32.783940 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:32.784236 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:32.835654 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:11:32.836070 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:11:32.845884 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ecf92487-ba97-49cb-8c10-52696d62365f req-8b95af05-d37e-48ac-b3f3-bae29a6020d7 service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Received event network-vif-unplugged-6017d14a-ec81-49b8-899b-0f800b1c116a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:32.846192 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ecf92487-ba97-49cb-8c10-52696d62365f req-8b95af05-d37e-48ac-b3f3-bae29a6020d7 service nova] Acquiring lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:32.846437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ecf92487-ba97-49cb-8c10-52696d62365f req-8b95af05-d37e-48ac-b3f3-bae29a6020d7 service nova] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:32.846616 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ecf92487-ba97-49cb-8c10-52696d62365f req-8b95af05-d37e-48ac-b3f3-bae29a6020d7 service nova] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:32.846839 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ecf92487-ba97-49cb-8c10-52696d62365f req-8b95af05-d37e-48ac-b3f3-bae29a6020d7 service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] No waiting events found dispatching network-vif-unplugged-6017d14a-ec81-49b8-899b-0f800b1c116a {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:11:32.847026 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-ecf92487-ba97-49cb-8c10-52696d62365f req-8b95af05-d37e-48ac-b3f3-bae29a6020d7 service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Received unexpected event network-vif-unplugged-6017d14a-ec81-49b8-899b-0f800b1c116a for instance with vm_state deleted and task_state None.
May 27 03:11:32.847364 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ecf92487-ba97-49cb-8c10-52696d62365f req-8b95af05-d37e-48ac-b3f3-bae29a6020d7 service nova] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Received event network-vif-deleted-6017d14a-ec81-49b8-899b-0f800b1c116a {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:33.278859 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Instance destroyed successfully.
May 27 03:11:33.279362 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lazy-loading 'resources' on Instance uuid e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:11:33.339818 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:11:33.433550 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:33.781286 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Object Instance<e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa> lazy-loaded attributes: numa_topology,resources {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:11:33.782174 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-979759750',display_name='tempest-TestShelveInstance-server-979759750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testshelveinstance-server-979759750',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvHcPIdf5ySXrzW/Bta+JqMZYLfKoPdChUu67Gw6GkqzSVoJyKWlzBAqBOO70Xjx7BpBWor+/paVzDKNqocIgiXJfQmDZBYWmRgNg/YzGb56OtqGA7X5UZkasOniGoZaQ==',key_name='tempest-TestShelveInstance-1659380719',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:10:48Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8836c8a171d34ccf9ea8e385160539ae',ramdisk_id='',reservation_id='r-u86gsxw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-195465897',owner_user_name='tempest-TestShelveInstance-195465897-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:10:49Z,user_data=None,user_id='5035972df2c34359880135aaa11b26ea',uuid=e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:11:33.782728 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Converting VIF {"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:11:33.783577 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=4405512d-bcd7-42bc-b7c6-116269917f4f,network=Network(686c35f5-1a05-4704-bf14-198632c86a51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4405512d-bc') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:11:33.783577 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=4405512d-bcd7-42bc-b7c6-116269917f4f,network=Network(686c35f5-1a05-4704-bf14-198632c86a51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4405512d-bc') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:11:33.784343 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:33.784575 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4405512d-bc, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:11:33.785628 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:33.786530 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:11:33.787691 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:33.788628 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:33.788718 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78a6f66f-5e9f-4b20-88d4-41111488dafa) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:11:33.789379 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:33.789908 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:11:33.790352 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:33.792336 np0000001475 nova-compute[98471]: INFO os_vif [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=4405512d-bcd7-42bc-b7c6-116269917f4f,network=Network(686c35f5-1a05-4704-bf14-198632c86a51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4405512d-bc')
May 27 03:11:33.794463 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:11:33.794877 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:11:33.795074 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:11:33.795520 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:11:33.795923 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:11:33.796083 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:11:33.822630 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:33.822630 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:33.822630 np0000001475 nova-compute[98471]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-934d0e71-0610-4aa4-aa37-7b9f28829d7c (non-flash)
May 27 03:11:33.822630 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:11:33.822960 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsi session list stdout=tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:33.822960 np0000001475 nova-compute[98471]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:33.822960 np0000001475 nova-compute[98471]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-934d0e71-0610-4aa4-aa37-7b9f28829d7c (non-flash)
May 27 03:11:33.822960 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:11:33.823062 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', '152'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', '153'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-934d0e71-0610-4aa4-aa37-7b9f28829d7c', '159')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:11:33.823189 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', '152')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:11:33.824165 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', '153')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:11:33.824984 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572475a480>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec'): ({'sdd'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:11:33.825207 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Removing multipathed devices sdc, sdd {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:11:33.825449 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Flush multipath device 33000000029397f0e {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:11:33.848973 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.239s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:33.881986 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:11:33.913530 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Deleted allocations for instance 4d78ea44-9e63-4671-91bc-ee77eb1885cc
May 27 03:11:33.919046 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:11:33.983649 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:11:33.983833 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:11:33.984700 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:11:33.998418 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:11:33.998418 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:11:34.010098 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:34.043020 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 152, target: iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec, portal: 192.168.40.100,3260]
May 27 03:11:34.043020 np0000001475 nova-compute[98471]: Logout of [sid: 152, target: iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec, portal: 192.168.40.100,3260] successful.
May 27 03:11:34.043020 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:34.056436 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:34.068551 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:34.095334 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 153, target: iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec, portal: 192.168.50.100,3260]
May 27 03:11:34.095334 np0000001475 nova-compute[98471]: Logout of [sid: 153, target: iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec, portal: 192.168.50.100,3260] successful.
May 27 03:11:34.095334 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:34.107287 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:34.107498 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:11:34.107612 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] <== disconnect_volume: return (312ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:11:34.107723 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:11:34.108067 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Deleting instance files /opt/stack/data/nova/instances/e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa_del
May 27 03:11:34.108498 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Deletion of /opt/stack/data/nova/instances/e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa_del complete
May 27 03:11:34.215793 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b009eb59-d4aa-4b64-91ca-86273776007d req-5823ac97-e89e-4052-8baa-e2855037a8f4 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Received event network-vif-unplugged-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:34.215793 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b009eb59-d4aa-4b64-91ca-86273776007d req-5823ac97-e89e-4052-8baa-e2855037a8f4 service nova] Acquiring lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:34.215793 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b009eb59-d4aa-4b64-91ca-86273776007d req-5823ac97-e89e-4052-8baa-e2855037a8f4 service nova] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:34.215793 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b009eb59-d4aa-4b64-91ca-86273776007d req-5823ac97-e89e-4052-8baa-e2855037a8f4 service nova] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:34.215793 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b009eb59-d4aa-4b64-91ca-86273776007d req-5823ac97-e89e-4052-8baa-e2855037a8f4 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] No waiting events found dispatching network-vif-unplugged-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:11:34.215793 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-b009eb59-d4aa-4b64-91ca-86273776007d req-5823ac97-e89e-4052-8baa-e2855037a8f4 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Received unexpected event network-vif-unplugged-4405512d-bcd7-42bc-b7c6-116269917f4f for instance with vm_state active and task_state shelving.
May 27 03:11:34.909899 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6add11dd-87e5-4d80-a0bb-897e3b09127f req-2f4276fd-7cab-49f5-8bd0-511ed00d1d0b service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Received event network-vif-unplugged-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:34.909899 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6add11dd-87e5-4d80-a0bb-897e3b09127f req-2f4276fd-7cab-49f5-8bd0-511ed00d1d0b service nova] Acquiring lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:34.910417 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6add11dd-87e5-4d80-a0bb-897e3b09127f req-2f4276fd-7cab-49f5-8bd0-511ed00d1d0b service nova] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:34.910417 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6add11dd-87e5-4d80-a0bb-897e3b09127f req-2f4276fd-7cab-49f5-8bd0-511ed00d1d0b service nova] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:34.910417 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6add11dd-87e5-4d80-a0bb-897e3b09127f req-2f4276fd-7cab-49f5-8bd0-511ed00d1d0b service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] No waiting events found dispatching network-vif-unplugged-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:11:34.910530 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-6add11dd-87e5-4d80-a0bb-897e3b09127f req-2f4276fd-7cab-49f5-8bd0-511ed00d1d0b service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Received unexpected event network-vif-unplugged-4405512d-bcd7-42bc-b7c6-116269917f4f for instance with vm_state active and task_state shelving.
May 27 03:11:34.910590 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6add11dd-87e5-4d80-a0bb-897e3b09127f req-2f4276fd-7cab-49f5-8bd0-511ed00d1d0b service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Received event network-changed-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:34.910780 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6add11dd-87e5-4d80-a0bb-897e3b09127f req-2f4276fd-7cab-49f5-8bd0-511ed00d1d0b service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Refreshing instance network info cache due to event network-changed-4405512d-bcd7-42bc-b7c6-116269917f4f. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:11:34.910907 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6add11dd-87e5-4d80-a0bb-897e3b09127f req-2f4276fd-7cab-49f5-8bd0-511ed00d1d0b service nova] Acquiring lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:11:34.911228 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6add11dd-87e5-4d80-a0bb-897e3b09127f req-2f4276fd-7cab-49f5-8bd0-511ed00d1d0b service nova] Acquired lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:11:34.911228 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-6add11dd-87e5-4d80-a0bb-897e3b09127f req-2f4276fd-7cab-49f5-8bd0-511ed00d1d0b service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Refreshing network info cache for port 4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:11:34.924479 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-63ce8b53-0ded-4b94-8201-f741cfbbfb45 tempest-TestServerVolumeAttachmentScenario-1304406302 tempest-TestServerVolumeAttachmentScenario-1304406302-project-member] Lock "4d78ea44-9e63-4671-91bc-ee77eb1885cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.514s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:35.413260 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-6add11dd-87e5-4d80-a0bb-897e3b09127f req-2f4276fd-7cab-49f5-8bd0-511ed00d1d0b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:35.770804 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-6add11dd-87e5-4d80-a0bb-897e3b09127f req-2f4276fd-7cab-49f5-8bd0-511ed00d1d0b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:35.826025 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Deleted allocations for instance e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa
May 27 03:11:35.910539 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-6add11dd-87e5-4d80-a0bb-897e3b09127f req-2f4276fd-7cab-49f5-8bd0-511ed00d1d0b service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Updated VIF entry in instance network info cache for port 4405512d-bcd7-42bc-b7c6-116269917f4f. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:11:35.911135 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-6add11dd-87e5-4d80-a0bb-897e3b09127f req-2f4276fd-7cab-49f5-8bd0-511ed00d1d0b service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Updating instance_info_cache with network_info: [{"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": null, "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4405512d-bc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:11:36.331586 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:36.331923 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:36.413072 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6add11dd-87e5-4d80-a0bb-897e3b09127f req-2f4276fd-7cab-49f5-8bd0-511ed00d1d0b service nova] Releasing lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:11:36.439695 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:11:36.439936 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:11:36.530349 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:36.942633 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:11:37.454411 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.122s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:37.917863 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:37.965285 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-aba4559b-c8f5-4a21-9e79-e952daff3845 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 8.498s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:37.966554 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.048s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:37.966554 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Unshelving
May 27 03:11:38.192921 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0004561590003504534 future=<Future at 0x75572c4c1a00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:11:38.193993 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] Emitting event <LifecycleEvent: 1779851483.1921504, 408047d8-a3ab-415c-a667-204e70271bed => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:11:38.194055 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:11:38.194259 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] VM Stopped (Lifecycle Event)
May 27 03:11:38.196106 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=6.075348807999944 future=<Future at 0x7557047c88f0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:11:38.196212 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=6.075227783000173 future=<Future at 0x7557047c88f0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:11:38.454656 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:38.698141 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6e5dd2c3-cd11-446f-b6c7-50050c198e8f tempest-TestServerVolumeAttachScenarioOldVersion-791402382 tempest-TestServerVolumeAttachScenarioOldVersion-791402382-project-member] [instance: 408047d8-a3ab-415c-a667-204e70271bed] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:11:38.792495 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:38.981131 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Booting with volume d3a1cb25-ef73-4b14-a2eb-13676b9030ec at /dev/vda
May 27 03:11:39.021460 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:11:39.032008 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:11:39.053517 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:11:39.097387 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:11:39.098040 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:11:39.106252 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:11:39.109197 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe66:186f', 'fe80::f9:d2ff:fead:2ab6'] 
May 27 03:11:39.110045 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:11:39.110456 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:11:39.110682 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:11:39.110907 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Updating existing volume attachment record: 0ecc484e-454f-49b8-a629-b54f8b6b6674 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:11:39.638368 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:40.416123 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:40.812700 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:40.813098 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:40.817154 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lazy-loading 'pci_requests' on Instance uuid e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:11:41.320700 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lazy-loading 'numa_topology' on Instance uuid e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:11:41.533148 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:41.824866 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:11:41.824983 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Claim successful on node np0000001475
May 27 03:11:41.936332 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:42.972153 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:11:42.972621 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:11:43.475118 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:11:43.794423 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:43.981550 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.168s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:43.982033 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:44.079917 np0000001475 nova-compute[98471]: INFO nova.network.neutron [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Updating port 4405512d-bcd7-42bc-b7c6-116269917f4f with attributes {'binding:host_id': 'np0000001475', 'device_owner': 'compute:nova'}
May 27 03:11:44.272184 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0004914159999316325 future=<Future at 0x7557047c88f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:11:44.272184 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:11:44.272400 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=1.5360088030001862 future=<Future at 0x75572c0d5040 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:11:44.272400 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=1.5359053610000046 future=<Future at 0x75572c0d5040 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:11:44.272717 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] Emitting event <LifecycleEvent: 1779851489.271333, 4d78ea44-9e63-4671-91bc-ee77eb1885cc => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:11:44.273835 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] VM Stopped (Lifecycle Event)
May 27 03:11:44.648876 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:11:44.648976 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquired lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:11:44.649197 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:11:44.704274 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e9532347-4b0c-4ba6-8769-8ef84636fa91 req-e6da9779-4444-4c55-ac8e-eceed130c834 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Received event network-changed-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:44.704821 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e9532347-4b0c-4ba6-8769-8ef84636fa91 req-e6da9779-4444-4c55-ac8e-eceed130c834 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Refreshing instance network info cache due to event network-changed-4405512d-bcd7-42bc-b7c6-116269917f4f. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:11:44.705027 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e9532347-4b0c-4ba6-8769-8ef84636fa91 req-e6da9779-4444-4c55-ac8e-eceed130c834 service nova] Acquiring lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:11:44.776223 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c8ac8eef-5304-417c-acfe-217379fbe2d2 tempest-AttachVolumeNegativeTest-1854580419 tempest-AttachVolumeNegativeTest-1854580419-project-member] [instance: 4d78ea44-9e63-4671-91bc-ee77eb1885cc] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:11:45.151122 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:45.484643 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:45.632411 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Updating instance_info_cache with network_info: [{"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:11:45.809210 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0007507850000365579 future=<Future at 0x75572c0d5040 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:11:45.809210 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:11:45.810254 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Emitting event <LifecycleEvent: 1779851490.8081727, e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:11:45.810559 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] VM Stopped (Lifecycle Event)
May 27 03:11:45.979846 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:46.136136 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Releasing lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:11:46.136136 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:11:46.136316 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e9532347-4b0c-4ba6-8769-8ef84636fa91 req-e6da9779-4444-4c55-ac8e-eceed130c834 service nova] Acquired lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:11:46.136420 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-e9532347-4b0c-4ba6-8769-8ef84636fa91 req-e6da9779-4444-4c55-ac8e-eceed130c834 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Refreshing network info cache for port 4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:11:46.138725 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Creating image(s)
May 27 03:11:46.138725 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:11:46.138725 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Ensure instance console log exists: /opt/stack/data/nova/instances/e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:11:46.139415 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:46.139700 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:46.140057 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:46.140647 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Start _get_guest_xml network_info=[{"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'serial': 'd3a1cb25-ef73-4b14-a2eb-13676b9030ec'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '0ecc484e-454f-49b8-a629-b54f8b6b6674', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:11:46.143758 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:11:46.145933 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-979759750', uuid='e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa'), owner=OwnerMeta(userid='5035972df2c34359880135aaa11b26ea', username='tempest-TestShelveInstance-195465897-project-member', projectid='8836c8a171d34ccf9ea8e385160539ae', projectname='tempest-TestShelveInstance-195465897'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851506.1449218) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:11:46.147103 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:11:46.147517 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:11:46.148965 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:11:46.149236 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:11:46.150500 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:11:46.153346 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:11:46.153346 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:11:46.153346 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:11:46.153346 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:11:46.153346 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:11:46.153346 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:11:46.153346 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:11:46.153346 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:11:46.153346 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:11:46.153346 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:11:46.153346 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:11:46.153346 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lazy-loading 'vcpu_model' on Instance uuid e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:11:46.316171 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-32d500fa-115a-4da2-923f-9d151416644c tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:11:46.533893 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:46.639942 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-e9532347-4b0c-4ba6-8769-8ef84636fa91 req-e6da9779-4444-4c55-ac8e-eceed130c834 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:46.655899 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Object Instance<e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:11:46.667785 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:11:46.668176 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:11:46.668328 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:11:46.668724 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:11:46.668953 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:11:46.682011 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:11:46.682704 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:11:46.685112 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:11:46.685296 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:11:46.685666 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:11:46.686047 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:11:46.698490 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:11:46.698490 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:46.700017 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:11:46.700017 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:46.717392 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec] added
May 27 03:11:46.717392 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:11:46.717392 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:11:46.717392 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:11:46.717392 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:11:46.717392 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:11:46.717392 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:46.717965 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:11:46.720772 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:11:46.721038 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:11:46.721808 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec] added
May 27 03:11:46.721808 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:11:46.721808 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:11:46.721808 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:11:46.721808 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:11:46.721808 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:11:46.721808 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:46.722175 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:11:46.722175 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:11:46.722458 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:11:47.093912 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-e9532347-4b0c-4ba6-8769-8ef84636fa91 req-e6da9779-4444-4c55-ac8e-eceed130c834 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:47.258877 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-e9532347-4b0c-4ba6-8769-8ef84636fa91 req-e6da9779-4444-4c55-ac8e-eceed130c834 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Updated VIF entry in instance network info cache for port 4405512d-bcd7-42bc-b7c6-116269917f4f. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:11:47.259219 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-e9532347-4b0c-4ba6-8769-8ef84636fa91 req-e6da9779-4444-4c55-ac8e-eceed130c834 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Updating instance_info_cache with network_info: [{"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:11:47.721468 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:11:47.724420 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:11:47.734719 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:11:47.734719 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:11:47.741143 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:11:47.741143 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:47.748566 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:47.756031 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:47.761377 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e9532347-4b0c-4ba6-8769-8ef84636fa91 req-e6da9779-4444-4c55-ac8e-eceed130c834 service nova] Releasing lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:11:47.762097 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 03:11:47.762097 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:11:47.762274 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 03:11:47.762274 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:11:47.762431 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 03:11:47.762431 np0000001475 nova-compute[98471]: 
May 27 03:11:47.768303 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 03:11:47.768303 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:11:47.768478 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 03:11:47.768478 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:11:47.769092 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 03:11:47.769092 np0000001475 nova-compute[98471]: 
May 27 03:11:48.175249 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:48.396326 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:11:48.396813 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:11:48.396813 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:11:48.396899 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.80 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:11:48.796074 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec, portal: 192.168.40.100,3260]
May 27 03:11:48.796074 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec, portal: 192.168.40.100,3260] successful.
May 27 03:11:48.796074 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:48.796585 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:48.801369 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec, portal: 192.168.50.100,3260]
May 27 03:11:48.801369 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec, portal: 192.168.50.100,3260] successful.
May 27 03:11:48.801369 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:48.809185 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:48.814619 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:48.824140 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:48.824140 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:48.824140 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:11:48.824365 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:48.824365 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:48.824365 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:11:48.824684 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.139s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:11:48.824891 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:11:48.825414 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] HCTL ('7', '-', '-', 0) found on session 160 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:11:48.825560 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:11:48.831061 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:48.831061 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:48.831061 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:11:48.831229 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:48.831229 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:48.831229 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:11:48.831519 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.146s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:11:48.831968 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:11:48.832277 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] HCTL ('8', '-', '-', 0) found on session 161 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:11:48.832447 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:11:48.840472 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Searching for a device in session 160 and hctl ['7', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:11:48.849079 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Searching for a device in session 161 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:11:48.849079 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:11:49.200155 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:11:49.200423 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:11:49.840762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Searching for a device in session 160 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:11:49.841202 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:11:50.702205 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Found WWN 33000000029397f0e for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:11:50.702490 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.034s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:11:50.702695 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] <== connect_volume: return (4033ms) {'type': 'block', 'scsi_wwn': '33000000029397f0e', 'path': '/dev/dm-0', 'multipath_id': '33000000029397f0e'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:11:50.702880 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000029397f0e', 'path': '/dev/dm-0', 'multipath_id': '33000000029397f0e'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:11:50.992720 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:51.199574 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:11:51.199840 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:11:51.200166 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:11:51.209456 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T03:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-979759750',display_name='tempest-TestShelveInstance-server-979759750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testshelveinstance-server-979759750',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1659380719',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:10:48Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8836c8a171d34ccf9ea8e385160539ae',ramdisk_id='',reservation_id='r-u86gsxw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-195465897',owner_user_name='tempest-TestShelveInstance-195465897-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:11:39Z,user_data=None,user_id='5035972df2c34359880135aaa11b26ea',uuid=e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:11:51.209729 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Converting VIF {"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:11:51.210413 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=4405512d-bcd7-42bc-b7c6-116269917f4f,network=Network(686c35f5-1a05-4704-bf14-198632c86a51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4405512d-bc') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:11:51.210968 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lazy-loading 'pci_devices' on Instance uuid e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:11:51.535671 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:51.713387 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Object Instance<e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:11:51.715817 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] End _get_guest_xml xml=<domain type="qemu">
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:   <uuid>e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa</uuid>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:   <name>instance-0000003e</name>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestShelveInstance-server-979759750</nova:name>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:11:46</nova:creationTime>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:         <nova:user uuid="5035972df2c34359880135aaa11b26ea">tempest-TestShelveInstance-195465897-project-member</nova:user>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:         <nova:project uuid="8836c8a171d34ccf9ea8e385160539ae">tempest-TestShelveInstance-195465897</nova:project>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:         <nova:port uuid="4405512d-bcd7-42bc-b7c6-116269917f4f">
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     <system>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <entry name="serial">e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa</entry>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <entry name="uuid">e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa</entry>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     </system>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:   <os>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:   </os>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:   <features>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:   </features>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:   <devices>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa/disk.config"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     </disk>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <alias name="ua-d3a1cb25-ef73-4b14-a2eb-13676b9030ec"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-0"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <serial>d3a1cb25-ef73-4b14-a2eb-13676b9030ec</serial>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     </disk>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:8e:48:f0"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <target dev="tap4405512d-bc"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     </interface>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa/console.log" append="off"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     </serial>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     <video>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     </video>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     </rng>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:   </devices>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]: </domain>
May 27 03:11:51.715817 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:11:51.718777 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Preparing to wait for external event network-vif-plugged-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:11:51.718777 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:51.718777 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:51.718777 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:51.718994 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T03:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-979759750',display_name='tempest-TestShelveInstance-server-979759750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testshelveinstance-server-979759750',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1659380719',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:10:48Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8836c8a171d34ccf9ea8e385160539ae',ramdisk_id='',reservation_id='r-u86gsxw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-195465897',owner_user_name='tempest-TestShelveInstance-195465897-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:11:39Z,user_data=None,user_id='5035972df2c34359880135aaa11b26ea',uuid=e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:11:51.725076 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Converting VIF {"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:11:51.725076 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=4405512d-bcd7-42bc-b7c6-116269917f4f,network=Network(686c35f5-1a05-4704-bf14-198632c86a51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4405512d-bc') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:11:51.725076 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=4405512d-bcd7-42bc-b7c6-116269917f4f,network=Network(686c35f5-1a05-4704-bf14-198632c86a51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4405512d-bc') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:11:51.725076 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:51.725076 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:11:51.725076 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:11:51.725076 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:51.725076 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77203a19-9b63-5636-8674-c1fc06d2222f', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:11:51.725903 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:51.727311 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:11:51.727311 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:51.729029 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:51.729246 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4405512d-bc, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:11:51.729534 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4405512d-bc, col_values=(('qos', UUID('38d5b6de-de40-4d9c-881c-334b40b6e1dd')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:11:51.729685 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4405512d-bc, col_values=(('external_ids', {'iface-id': '4405512d-bcd7-42bc-b7c6-116269917f4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:48:f0', 'vm-uuid': 'e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:11:51.731078 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:51.732519 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:11:51.739063 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:51.740252 np0000001475 nova-compute[98471]: INFO os_vif [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=4405512d-bcd7-42bc-b7c6-116269917f4f,network=Network(686c35f5-1a05-4704-bf14-198632c86a51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4405512d-bc')
May 27 03:11:52.817302 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:53.196321 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:11:53.196626 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:11:53.199501 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:11:53.199885 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 9.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:11:53.262489 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:11:53.262654 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:11:53.262839 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] No VIF found with MAC fa:16:3e:8e:48:f0, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:11:53.263225 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Using config drive
May 27 03:11:53.766461 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lazy-loading 'ec2_ids' on Instance uuid e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:11:54.269323 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Object Instance<e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:11:54.269786 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lazy-loading 'keypairs' on Instance uuid e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:11:54.772484 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Object Instance<e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:11:54.774923 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:11:54.879090 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Creating config drive at /opt/stack/data/nova/instances/e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa/disk.config
May 27 03:11:54.882319 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0zbyejv_ {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:11:54.935526 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0zbyejv_" returned: 0 in 0.053s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:11:55.363830 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:55.385970 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:55.459541 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:55.537598 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:55.537977 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:55.705830 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:55.707919 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:55.710231 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:55.730467 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:56.042566 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'flavor' on Instance uuid 79df2202-e3ff-44de-8dee-d13a3a8304d5 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:11:56.102888 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851516.1023557, e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:11:56.103328 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] VM Started (Lifecycle Event)
May 27 03:11:56.536835 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:56.605946 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:11:56.609383 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851516.6091025, e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:11:56.609519 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] VM Paused (Lifecycle Event)
May 27 03:11:56.730593 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:11:57.048643 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:57.112788 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:11:57.114884 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 3 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:11:57.618299 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:11:58.126440 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:58.126646 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:58.126931 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Attaching volume 2b29ec93-8fbc-4216-a128-2e09120243ee to /dev/vdb
May 27 03:11:58.132932 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9ddd193b-09fb-423d-80f4-ff1aadabca98 req-68ff6b88-035f-45d1-8bbb-4c1e1a89f618 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Received event network-vif-plugged-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:11:58.136331 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ddd193b-09fb-423d-80f4-ff1aadabca98 req-68ff6b88-035f-45d1-8bbb-4c1e1a89f618 service nova] Acquiring lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:11:58.136331 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ddd193b-09fb-423d-80f4-ff1aadabca98 req-68ff6b88-035f-45d1-8bbb-4c1e1a89f618 service nova] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:11:58.136538 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ddd193b-09fb-423d-80f4-ff1aadabca98 req-68ff6b88-035f-45d1-8bbb-4c1e1a89f618 service nova] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:58.137058 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9ddd193b-09fb-423d-80f4-ff1aadabca98 req-68ff6b88-035f-45d1-8bbb-4c1e1a89f618 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Processing event network-vif-plugged-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:11:58.137509 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:11:58.140705 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851518.140427, e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:11:58.141125 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] VM Resumed (Lifecycle Event)
May 27 03:11:58.144373 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:11:58.150288 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Instance spawned successfully.
May 27 03:11:58.150810 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:11:58.186047 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:11:58.199516 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:11:58.227067 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:11:58.271786 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:11:58.272318 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:11:58.280934 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:11:58.282098 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe66:186f', 'fe80::f9:d2ff:fead:2ab6', 'fe80::fc16:3eff:fe8e:48f0', 'fe80::7441:51ff:fe02:437d'] 
May 27 03:11:58.282273 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:11:58.282405 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:11:58.282725 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:11:58.283010 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Updating existing volume attachment record: a17f4712-8aa2-44cf-8eda-9fb9ea88704a {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:11:58.646433 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:11:58.650167 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:11:58.663835 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8bb7526a-8a1b-4bc4-b87b-a59f9e609222 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 20.698s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:11:58.834441 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:11:58.834846 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b29ec93-8fbc-4216-a128-2e09120243ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:11:58.834995 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:11:58.835382 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:11:58.835563 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b29ec93-8fbc-4216-a128-2e09120243ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:11:58.847386 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:11:58.848055 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:11:58.848922 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:11:58.849170 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:11:58.849586 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:11:58.849833 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:11:58.862162 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:11:58.862162 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:58.867366 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:11:58.867366 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:58.874271 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee] added
May 27 03:11:58.874271 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:11:58.874271 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:11:58.874271 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:11:58.874271 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:11:58.874271 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:11:58.874271 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:58.874589 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:11:58.874788 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0255(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:11:58.874950 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:11:58.879459 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee] added
May 27 03:11:58.879459 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:11:58.879459 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:11:58.879459 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:11:58.879459 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:11:58.879459 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:11:58.879459 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:58.879723 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:11:58.880024 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0301(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:11:58.880251 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:11:59.876074 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:11:59.882387 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:11:59.893900 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:11:59.893900 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:11:59.901386 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:11:59.901386 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:59.912171 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:59.923283 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:59.928732 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:59.928732 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:59.928732 np0000001475 nova-compute[98471]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-962f6e43-90ed-47e9-b2b1-b40dc96ce60f (non-flash)
May 27 03:11:59.928732 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:11:59.928956 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:59.928956 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:59.928956 np0000001475 nova-compute[98471]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-962f6e43-90ed-47e9-b2b1-b40dc96ce60f (non-flash)
May 27 03:11:59.928956 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:11:59.936900 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:59.936900 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:59.936900 np0000001475 nova-compute[98471]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-962f6e43-90ed-47e9-b2b1-b40dc96ce60f (non-flash)
May 27 03:11:59.936900 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:11:59.937092 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:59.937092 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:59.937092 np0000001475 nova-compute[98471]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-962f6e43-90ed-47e9-b2b1-b40dc96ce60f (non-flash)
May 27 03:11:59.937092 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:11:59.959098 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee, portal: 192.168.40.100,3260]
May 27 03:11:59.959098 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee, portal: 192.168.40.100,3260] successful.
May 27 03:11:59.959098 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:59.973755 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:59.983689 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee, portal: 192.168.50.100,3260]
May 27 03:11:59.983689 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee, portal: 192.168.50.100,3260] successful.
May 27 03:11:59.983689 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:59.996855 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:59.996855 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:59.996855 np0000001475 nova-compute[98471]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-962f6e43-90ed-47e9-b2b1-b40dc96ce60f (non-flash)
May 27 03:11:59.996855 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:11:59.996855 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:11:59.996855 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:11:59.998109 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:11:59.998886 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:59.998886 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:11:59.998886 np0000001475 nova-compute[98471]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-962f6e43-90ed-47e9-b2b1-b40dc96ce60f (non-flash)
May 27 03:11:59.998886 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:11:59.998886 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:11:59.998886 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:11:59.999806 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:11:59.999958 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:12:00.000859 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] HCTL ('10', '-', '-', 0) found on session 163 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:12:00.000958 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:12:00.014761 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:00.014761 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:00.014761 np0000001475 nova-compute[98471]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-962f6e43-90ed-47e9-b2b1-b40dc96ce60f (non-flash)
May 27 03:12:00.014761 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:00.014761 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:00.014761 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:12:00.015059 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:00.015059 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:00.015059 np0000001475 nova-compute[98471]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-962f6e43-90ed-47e9-b2b1-b40dc96ce60f (non-flash)
May 27 03:12:00.015059 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:00.015059 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:00.015059 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:12:00.015226 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:12:00.015226 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:12:00.015845 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] HCTL ('11', '-', '-', 0) found on session 164 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:12:00.015940 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:12:00.025340 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Searching for a device in session 163 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:12:00.025540 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b29ec93-8fbc-4216-a128-2e09120243ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:12:00.035151 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Searching for a device in session 164 and hctl ['11', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:12:00.201483 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-02145611-840e-41a6-a5a3-c37b2bce0f57 req-97ac8f3f-e554-4b58-bf31-8de464c05a0a service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Received event network-vif-plugged-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:00.201483 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-02145611-840e-41a6-a5a3-c37b2bce0f57 req-97ac8f3f-e554-4b58-bf31-8de464c05a0a service nova] Acquiring lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:00.201483 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-02145611-840e-41a6-a5a3-c37b2bce0f57 req-97ac8f3f-e554-4b58-bf31-8de464c05a0a service nova] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:00.201483 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-02145611-840e-41a6-a5a3-c37b2bce0f57 req-97ac8f3f-e554-4b58-bf31-8de464c05a0a service nova] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:00.201483 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-02145611-840e-41a6-a5a3-c37b2bce0f57 req-97ac8f3f-e554-4b58-bf31-8de464c05a0a service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] No waiting events found dispatching network-vif-plugged-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:12:00.201483 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-02145611-840e-41a6-a5a3-c37b2bce0f57 req-97ac8f3f-e554-4b58-bf31-8de464c05a0a service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Received unexpected event network-vif-plugged-4405512d-bcd7-42bc-b7c6-116269917f4f for instance with vm_state active and task_state None.
May 27 03:12:01.035863 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Searching for a device in session 164 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:12:01.036398 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2b29ec93-8fbc-4216-a128-2e09120243ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:12:01.538410 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:01.732145 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:01.865889 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Found WWN 3300000007bd29158 for multipath device dm-3 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:12:01.866102 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:12:01.866235 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '3300000007bd29158', 'path': '/dev/dm-3', 'multipath_id': '3300000007bd29158'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:12:01.866377 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007bd29158', 'path': '/dev/dm-3', 'multipath_id': '3300000007bd29158'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:12:01.869072 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'flavor' on Instance uuid 79df2202-e3ff-44de-8dee-d13a3a8304d5 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:12:02.199941 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:12:02.372097 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Attempting to attach volume 2b29ec93-8fbc-4216-a128-2e09120243ee with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:12:02.373571 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:12:02.373571 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:12:02.373571 np0000001475 nova-compute[98471]:   <alias name="ua-2b29ec93-8fbc-4216-a128-2e09120243ee"/>
May 27 03:12:02.373571 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:12:02.373571 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:12:02.373571 np0000001475 nova-compute[98471]:   <serial>2b29ec93-8fbc-4216-a128-2e09120243ee</serial>
May 27 03:12:02.373571 np0000001475 nova-compute[98471]: </disk>
May 27 03:12:02.373571 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:12:02.706330 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:02.706672 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:02.706897 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:02.707093 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:12:03.732623 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:12:03.735634 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:12:03.840346 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:12:03.840996 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:12:03.940233 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:12:03.943758 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:12:03.945367 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:12:03.946725 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:12:04.004442 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.057s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:12:04.004953 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=13263MB free_disk=72.78994750976562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:12:04.005179 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:04.005465 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:04.020767 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:12:04.020889 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:12:04.020999 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:12:04.021099 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No VIF found with MAC fa:16:3e:66:18:6f, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:12:05.088697 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:12:05.089160 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:12:05.089160 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:12:05.089258 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:12:04 up 43 min,  2 users,  load average: 5.58, 7.24, 5.55\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_8836c8a171d34ccf9ea8e385160539ae': '1', 'io_workload': '0', 'num_proj_256f2c4e067c46a3a4ea5e9d934b1d4b': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:12:05.234901 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:12:05.235084 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:12:05.581002 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d7baf105-9edf-48ad-b5e7-9b8ee1aefbe5 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.454s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:05.585362 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:05.585531 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:05.737713 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:12:06.089451 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'flavor' on Instance uuid 79df2202-e3ff-44de-8dee-d13a3a8304d5 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:12:06.244197 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:12:06.244359 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.239s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:06.244851 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 42.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:12:06.539440 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:06.733016 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:07.096953 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:08.167219 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:08.167666 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:08.167666 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Attaching volume 2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b to /dev/vdc
May 27 03:12:08.221766 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:12:08.234043 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:12:08.255026 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:12:08.301325 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:12:08.301634 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:12:08.312272 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:12:08.313671 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe66:186f', 'fe80::f9:d2ff:fead:2ab6', 'fe80::fc16:3eff:fe8e:48f0', 'fe80::7441:51ff:fe02:437d'] 
May 27 03:12:08.313889 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:12:08.313957 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:12:08.314290 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:12:08.314639 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Updating existing volume attachment record: 53225305-86df-4c8b-828f-f33c707694d3 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:12:08.900963 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '79df2202-e3ff-44de-8dee-d13a3a8304d5', 'attached_at': '', 'detached_at': '', 'volume_id': '2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'serial': '2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b'} {{(pid=98471) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 03:12:08.904954 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:12:08.905296 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:12:08.905469 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:12:08.906043 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:12:08.906285 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:12:08.918446 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:12:08.919134 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:12:08.919604 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:12:08.919900 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:12:08.920466 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:12:08.920698 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:12:08.933764 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:12:08.933764 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:08.945109 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b] added
May 27 03:12:08.945109 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:12:08.945109 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:12:08.945109 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:12:08.945109 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:12:08.945109 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:12:08.945109 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:08.945501 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:12:08.945576 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0256(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:12:08.945768 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:12:08.957612 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:12:08.957612 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:08.975796 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b] added
May 27 03:12:08.975796 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:12:08.975796 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:12:08.975796 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:12:08.975796 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:12:08.975796 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:12:08.975796 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:08.976097 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:12:08.976243 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0555(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:12:08.976297 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:12:09.946229 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:12:09.960250 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:12:09.960250 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:09.975104 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:09.976754 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:12:09.989773 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:09.989773 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:09.989773 np0000001475 nova-compute[98471]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-962f6e43-90ed-47e9-b2b1-b40dc96ce60f (non-flash)
May 27 03:12:09.989773 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:09.989773 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:09.989773 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:12:09.991102 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:12:09.991102 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:09.994069 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:09.994069 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:09.994069 np0000001475 nova-compute[98471]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-962f6e43-90ed-47e9-b2b1-b40dc96ce60f (non-flash)
May 27 03:12:09.994069 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:09.994069 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:09.994069 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:12:10.007548 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:10.023378 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:10.023378 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:10.023378 np0000001475 nova-compute[98471]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-962f6e43-90ed-47e9-b2b1-b40dc96ce60f (non-flash)
May 27 03:12:10.023378 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:10.023378 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:10.023378 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:12:10.023659 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:10.023659 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:10.023659 np0000001475 nova-compute[98471]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-962f6e43-90ed-47e9-b2b1-b40dc96ce60f (non-flash)
May 27 03:12:10.023659 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:10.023659 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:10.023659 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:12:10.036842 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b, portal: 192.168.40.100,3260]
May 27 03:12:10.036842 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b, portal: 192.168.40.100,3260] successful.
May 27 03:12:10.036842 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:10.049885 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:10.070234 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b, portal: 192.168.50.100,3260]
May 27 03:12:10.070234 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b, portal: 192.168.50.100,3260] successful.
May 27 03:12:10.070234 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:10.070976 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:10.070976 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:10.070976 np0000001475 nova-compute[98471]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-962f6e43-90ed-47e9-b2b1-b40dc96ce60f (non-flash)
May 27 03:12:10.070976 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:10.070976 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:10.070976 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:10.070976 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:10.070976 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:12:10.071179 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:10.071179 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:10.071179 np0000001475 nova-compute[98471]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-962f6e43-90ed-47e9-b2b1-b40dc96ce60f (non-flash)
May 27 03:12:10.071179 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:10.071179 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:10.071179 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:10.071179 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:10.071179 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:12:10.071465 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:12:10.071602 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:12:10.072378 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] HCTL ('12', '-', '-', 0) found on session 165 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:12:10.072476 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:12:10.081203 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:10.086733 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Searching for a device in session 165 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:12:10.087312 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:12:10.097305 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:10.097305 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:10.097305 np0000001475 nova-compute[98471]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-962f6e43-90ed-47e9-b2b1-b40dc96ce60f (non-flash)
May 27 03:12:10.097305 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:10.097305 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:10.097305 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:10.097305 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:10.097305 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:12:10.097625 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:10.097625 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:10.097625 np0000001475 nova-compute[98471]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-962f6e43-90ed-47e9-b2b1-b40dc96ce60f (non-flash)
May 27 03:12:10.097625 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:10.097625 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:10.097625 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:10.097625 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:10.097625 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:12:10.097846 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:12:10.097930 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:12:10.098603 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] HCTL ('13', '-', '-', 0) found on session 166 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:12:10.098709 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:12:10.113115 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Searching for a device in session 166 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:12:10.113115 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:12:10.920070 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:12:11.540821 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:11.733546 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:11.938256 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Found WWN 3300000007fa8bdb9 for multipath device dm-4 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:12:11.938689 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:12:11.940009 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '3300000007fa8bdb9', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '3300000007fa8bdb9'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:12:11.940158 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007fa8bdb9', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '3300000007fa8bdb9'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:12:11.942479 np0000001475 nova-compute[98471]: WARNING stevedore.named [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 03:12:11.942812 np0000001475 nova-compute[98471]: WARNING castellan.key_manager [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:12:11.943028 np0000001475 nova-compute[98471]: WARNING nova.keymgr.conf_key_mgr [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:12:11.964321 np0000001475 nova-compute[98471]: WARNING os_brick.encryptors.luks [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 27 03:12:11.964921 np0000001475 nova-compute[98471]: WARNING stevedore.named [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 03:12:11.965164 np0000001475 nova-compute[98471]: WARNING castellan.key_manager [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:12:11.965372 np0000001475 nova-compute[98471]: WARNING nova.keymgr.conf_key_mgr [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:12:11.966042 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x75572c5b79b0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': '79df2202-e3ff-44de-8dee-d13a3a8304d5', 'attached_at': '', 'detached_at': '', 'volume_id': '2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'serial': '2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b'} {{(pid=98471) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 27 03:12:11.966217 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors.luks [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] formatting encrypted volume /dev/dm-4 {{(pid=98471) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 27 03:12:14.584910 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:15.798528 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Secret XML: <secret ephemeral="no" private="no">
May 27 03:12:15.798528 np0000001475 nova-compute[98471]:   <usage type="volume">
May 27 03:12:15.798528 np0000001475 nova-compute[98471]:     <volume>2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b</volume>
May 27 03:12:15.798528 np0000001475 nova-compute[98471]:   </usage>
May 27 03:12:15.798528 np0000001475 nova-compute[98471]: </secret>
May 27 03:12:15.798528 np0000001475 nova-compute[98471]:  {{(pid=98471) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 27 03:12:15.806139 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'flavor' on Instance uuid 79df2202-e3ff-44de-8dee-d13a3a8304d5 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:12:15.937665 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:16.309997 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Attempting to attach volume 2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:12:16.311375 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:12:16.311375 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:12:16.311375 np0000001475 nova-compute[98471]:   <alias name="ua-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b"/>
May 27 03:12:16.311375 np0000001475 nova-compute[98471]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 27 03:12:16.311375 np0000001475 nova-compute[98471]:   <target dev="vdc" bus="virtio"/>
May 27 03:12:16.311375 np0000001475 nova-compute[98471]:   <serial>2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b</serial>
May 27 03:12:16.311375 np0000001475 nova-compute[98471]:   <encryption format="luks">
May 27 03:12:16.311375 np0000001475 nova-compute[98471]:     <secret type="passphrase" uuid="a33829a8-0b64-4b75-8240-82c2c661d9c6"/>
May 27 03:12:16.311375 np0000001475 nova-compute[98471]:   </encryption>
May 27 03:12:16.311375 np0000001475 nova-compute[98471]: </disk>
May 27 03:12:16.311375 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:12:16.542453 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:16.735063 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:16.783950 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:18.866432 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:12:18.866876 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:12:18.866876 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:12:18.866876 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:12:18.866876 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No VIF found with MAC fa:16:3e:66:18:6f, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:12:19.791913 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:20.419981 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b0f8d262-034f-4d2e-8f9d-444d525e3e84 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.252s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:21.502903 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:21.503357 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:21.544103 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:21.740133 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:22.011688 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'flavor' on Instance uuid 79df2202-e3ff-44de-8dee-d13a3a8304d5 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:12:22.063056 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:23.018581 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:23.852406 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Acquiring lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:23.852632 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:24.083045 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:24.083382 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:24.083382 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Attaching volume 2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c to /dev/vdd
May 27 03:12:24.147652 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:12:24.158320 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:12:24.177205 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:12:24.220315 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:12:24.220573 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:12:24.229124 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:12:24.229946 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe66:186f', 'fe80::f9:d2ff:fead:2ab6', 'fe80::fc16:3eff:fe8e:48f0', 'fe80::7441:51ff:fe02:437d'] 
May 27 03:12:24.230064 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:12:24.230201 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:12:24.230376 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:12:24.230633 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Updating existing volume attachment record: 413d54f9-137e-450a-9432-6ab550f67324 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:12:24.354864 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:12:24.782377 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:12:24.782798 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:12:24.783060 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:12:24.783586 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:12:24.783847 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:12:24.795878 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:12:24.796669 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:12:24.797404 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:12:24.797554 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:12:24.797915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:12:24.798071 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:12:24.810717 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:12:24.810717 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:24.815543 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:12:24.815543 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:24.821813 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c] added
May 27 03:12:24.821813 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:12:24.821813 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:12:24.821813 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:12:24.821813 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:12:24.821813 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:12:24.821813 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:24.822151 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:12:24.822295 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0248(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:12:24.822428 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:12:24.828941 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c] added
May 27 03:12:24.828941 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:12:24.828941 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:12:24.828941 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:12:24.828941 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:12:24.828941 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:12:24.828941 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:24.829150 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:12:24.829324 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:12:24.829479 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:12:24.910723 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:24.910916 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:24.913987 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:12:24.914101 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Claim successful on node np0000001475
May 27 03:12:25.822865 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:12:25.829951 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:12:25.838123 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:12:25.838123 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:12:25.844194 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:12:25.844194 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:25.852047 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:25.857176 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:25.867592 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:25.867592 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:25.867592 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:25.867592 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:25.867592 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:25.867592 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:25.867592 np0000001475 nova-compute[98471]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:12:25.867592 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:12:25.868028 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:25.868028 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:25.868028 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:25.868028 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:25.868028 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:25.868028 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:25.868028 np0000001475 nova-compute[98471]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:12:25.868028 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:12:25.873573 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:25.873573 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:25.873573 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:25.873573 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:25.873573 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:25.873573 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:25.873573 np0000001475 nova-compute[98471]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:12:25.873573 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:12:25.873925 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:25.873925 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:25.873925 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:25.873925 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:25.873925 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:25.873925 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:25.873925 np0000001475 nova-compute[98471]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:12:25.873925 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:12:25.904452 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c, portal: 192.168.40.100,3260]
May 27 03:12:25.904452 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c, portal: 192.168.40.100,3260] successful.
May 27 03:12:25.904452 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:25.911680 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c, portal: 192.168.50.100,3260]
May 27 03:12:25.911680 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c, portal: 192.168.50.100,3260] successful.
May 27 03:12:25.911680 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:25.917639 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:25.923482 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:25.936045 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:25.936045 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:25.936045 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:25.936045 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:25.936045 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:25.936045 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:25.936045 np0000001475 nova-compute[98471]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:12:25.936045 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:25.936045 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:25.936045 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:12:25.936315 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:25.936315 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:25.936315 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:25.936315 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:25.936315 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:25.936315 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:25.936315 np0000001475 nova-compute[98471]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:12:25.936315 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:25.936315 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:25.936315 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:12:25.936568 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:12:25.936711 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:12:25.938041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] HCTL ('14', '-', '-', 0) found on session 168 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:12:25.938168 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:12:25.942311 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:25.942311 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:25.942311 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:25.942311 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:25.942311 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:25.942311 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:25.942311 np0000001475 nova-compute[98471]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:12:25.942311 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:25.942311 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:25.942311 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:12:25.942795 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:25.942795 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:25.942795 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:25.942795 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:25.942795 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:25.942795 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:25.942795 np0000001475 nova-compute[98471]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:12:25.942795 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:25.942795 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:25.942795 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:12:25.943293 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:12:25.943406 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:12:25.944221 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] HCTL ('15', '-', '-', 0) found on session 169 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:12:25.944406 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:12:25.952992 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Searching for a device in session 168 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:12:25.953233 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:12:25.963139 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Searching for a device in session 169 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:12:25.963278 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:12:26.128675 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:12:26.128968 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:12:26.545476 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:26.631618 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:12:26.741203 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:26.797380 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:12:27.139619 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.229s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:27.140243 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:12:27.646158 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:12:27.646438 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:12:27.646963 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:27.647200 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:27.715239 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0f48384818c4c0aa23d81044f9b46b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '862ed9cb3549457788596bc9e00c830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:12:27.812188 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Found WWN 330000000667f34e2 for multipath device dm-5 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:12:27.812572 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:12:27.812843 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '330000000667f34e2', 'path': '/dev/dm-5', 'multipath_id': '330000000667f34e2'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:12:27.813035 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000667f34e2', 'path': '/dev/dm-5', 'multipath_id': '330000000667f34e2'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:12:27.816246 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'flavor' on Instance uuid 79df2202-e3ff-44de-8dee-d13a3a8304d5 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:12:28.072134 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Successfully created port: b6f7f47c-373e-4f60-898a-db8116d5fb48 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:12:28.149537 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:12:28.319512 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Attempting to attach volume 2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:12:28.321351 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:12:28.321351 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:12:28.321351 np0000001475 nova-compute[98471]:   <alias name="ua-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c"/>
May 27 03:12:28.321351 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:12:28.321351 np0000001475 nova-compute[98471]:   <target dev="vdd" bus="virtio"/>
May 27 03:12:28.321351 np0000001475 nova-compute[98471]:   <serial>2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c</serial>
May 27 03:12:28.321351 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:12:28.321351 np0000001475 nova-compute[98471]: </disk>
May 27 03:12:28.321351 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:12:28.641760 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Successfully updated port: b6f7f47c-373e-4f60-898a-db8116d5fb48 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:12:28.652042 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:12:28.710623 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-58c328f2-5289-46bc-bcff-82fb3a422369 req-d9c32dae-4169-4253-8f68-4996f26d09b5 service nova] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Received event network-changed-b6f7f47c-373e-4f60-898a-db8116d5fb48 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:28.710748 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-58c328f2-5289-46bc-bcff-82fb3a422369 req-d9c32dae-4169-4253-8f68-4996f26d09b5 service nova] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Refreshing instance network info cache due to event network-changed-b6f7f47c-373e-4f60-898a-db8116d5fb48. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:12:28.711042 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-58c328f2-5289-46bc-bcff-82fb3a422369 req-d9c32dae-4169-4253-8f68-4996f26d09b5 service nova] Acquiring lock "refresh_cache-d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:12:28.711099 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-58c328f2-5289-46bc-bcff-82fb3a422369 req-d9c32dae-4169-4253-8f68-4996f26d09b5 service nova] Acquired lock "refresh_cache-d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:12:28.711810 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-58c328f2-5289-46bc-bcff-82fb3a422369 req-d9c32dae-4169-4253-8f68-4996f26d09b5 service nova] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Refreshing network info cache for port b6f7f47c-373e-4f60-898a-db8116d5fb48 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:12:29.144115 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Acquiring lock "refresh_cache-d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:12:29.213423 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-58c328f2-5289-46bc-bcff-82fb3a422369 req-d9c32dae-4169-4253-8f68-4996f26d09b5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:29.265123 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-58c328f2-5289-46bc-bcff-82fb3a422369 req-d9c32dae-4169-4253-8f68-4996f26d09b5 service nova] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:12:29.380138 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-58c328f2-5289-46bc-bcff-82fb3a422369 req-d9c32dae-4169-4253-8f68-4996f26d09b5 service nova] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:12:29.661891 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:12:29.663158 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:12:29.663158 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Creating image(s)
May 27 03:12:29.663632 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Acquiring lock "/opt/stack/data/nova/instances/d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:29.663787 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Lock "/opt/stack/data/nova/instances/d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:29.664205 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Lock "/opt/stack/data/nova/instances/d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:29.664871 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:12:29.667209 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:12:29.668270 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:12:29.767199 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.099s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:12:29.767958 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:29.768077 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:29.769272 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:12:29.771721 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:12:29.772087 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:12:29.867012 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.094s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:12:29.867750 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:12:29.883698 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-58c328f2-5289-46bc-bcff-82fb3a422369 req-d9c32dae-4169-4253-8f68-4996f26d09b5 service nova] Releasing lock "refresh_cache-d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:12:29.884884 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Acquired lock "refresh_cache-d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:12:29.885171 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:12:29.926697 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c/disk 1073741824" returned: 0 in 0.059s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:12:29.927571 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:29.927807 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:12:29.975134 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:12:29.975336 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:12:29.975490 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:12:29.975627 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name vdd, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:12:29.975840 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:12:29.975946 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No VIF found with MAC fa:16:3e:66:18:6f, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:12:30.018472 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.091s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:12:30.018815 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:12:30.019050 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:12:30.108403 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:12:30.108812 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Cannot resize image /opt/stack/data/nova/instances/d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:12:30.109335 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:12:30.109610 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Ensure instance console log exists: /opt/stack/data/nova/instances/d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:12:30.109781 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:30.109991 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:30.110132 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:30.465153 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:12:30.605552 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:30.722321 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Updating instance_info_cache with network_info: [{"id": "b6f7f47c-373e-4f60-898a-db8116d5fb48", "address": "fa:16:3e:8e:7b:94", "network": {"id": "068e39c9-6f62-4438-b419-57d3a831f21c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-329024817-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "862ed9cb3549457788596bc9e00c830c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f7f47c-37", "ovs_interfaceid": "b6f7f47c-373e-4f60-898a-db8116d5fb48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:12:31.224567 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Releasing lock "refresh_cache-d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:12:31.224879 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Instance network_info: |[{"id": "b6f7f47c-373e-4f60-898a-db8116d5fb48", "address": "fa:16:3e:8e:7b:94", "network": {"id": "068e39c9-6f62-4438-b419-57d3a831f21c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-329024817-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "862ed9cb3549457788596bc9e00c830c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f7f47c-37", "ovs_interfaceid": "b6f7f47c-373e-4f60-898a-db8116d5fb48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:12:31.226794 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Start _get_guest_xml network_info=[{"id": "b6f7f47c-373e-4f60-898a-db8116d5fb48", "address": "fa:16:3e:8e:7b:94", "network": {"id": "068e39c9-6f62-4438-b419-57d3a831f21c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-329024817-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "862ed9cb3549457788596bc9e00c830c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f7f47c-37", "ovs_interfaceid": "b6f7f47c-373e-4f60-898a-db8116d5fb48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:12:31.231880 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:12:31.233172 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-547609385', uuid='d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c'), owner=OwnerMeta(userid='a0f48384818c4c0aa23d81044f9b46b8', username='tempest-VolumesActionsTest-511303886-project-member', projectid='862ed9cb3549457788596bc9e00c830c', projectname='tempest-VolumesActionsTest-511303886'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b6f7f47c-373e-4f60-898a-db8116d5fb48", "address": "fa:16:3e:8e:7b:94", "network": {"id": "068e39c9-6f62-4438-b419-57d3a831f21c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-329024817-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "862ed9cb3549457788596bc9e00c830c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f7f47c-37", "ovs_interfaceid": "b6f7f47c-373e-4f60-898a-db8116d5fb48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851551.2327363) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:12:31.234519 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:12:31.234867 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:12:31.235866 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:12:31.236142 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:12:31.237491 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:12:31.237874 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:12:31.238065 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:12:31.238203 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:12:31.238389 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:12:31.239230 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:12:31.239230 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:12:31.239482 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:12:31.239482 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:12:31.239638 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:12:31.239710 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:12:31.239847 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:12:31.251519 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-547609385',display_name='tempest-VolumesActionsTest-instance-547609385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesactionstest-instance-547609385',id=64,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='862ed9cb3549457788596bc9e00c830c',ramdisk_id='',reservation_id='r-m24ambyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-511303886',owner_user_name='tempest-VolumesActionsTest-511303886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:12:29Z,user_data=None,user_id='a0f48384818c4c0aa23d81044f9b46b8',uuid=d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6f7f47c-373e-4f60-898a-db8116d5fb48", "address": "fa:16:3e:8e:7b:94", "network": {"id": "068e39c9-6f62-4438-b419-57d3a831f21c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-329024817-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "862ed9cb3549457788596bc9e00c830c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f7f47c-37", "ovs_interfaceid": "b6f7f47c-373e-4f60-898a-db8116d5fb48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:12:31.251765 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Converting VIF {"id": "b6f7f47c-373e-4f60-898a-db8116d5fb48", "address": "fa:16:3e:8e:7b:94", "network": {"id": "068e39c9-6f62-4438-b419-57d3a831f21c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-329024817-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "862ed9cb3549457788596bc9e00c830c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f7f47c-37", "ovs_interfaceid": "b6f7f47c-373e-4f60-898a-db8116d5fb48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:12:31.252379 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7b:94,bridge_name='br-int',has_traffic_filtering=True,id=b6f7f47c-373e-4f60-898a-db8116d5fb48,network=Network(068e39c9-6f62-4438-b419-57d3a831f21c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6f7f47c-37') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:12:31.253245 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Lazy-loading 'pci_devices' on Instance uuid d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:12:31.523673 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-57e4f2f4-417e-411d-9beb-6a240c7e4d6b tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.440s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:31.552559 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:31.742261 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:31.755972 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] End _get_guest_xml xml=<domain type="qemu">
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:   <uuid>d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c</uuid>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:   <name>instance-00000040</name>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <nova:name>tempest-VolumesActionsTest-instance-547609385</nova:name>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:12:31</nova:creationTime>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:         <nova:user uuid="a0f48384818c4c0aa23d81044f9b46b8">tempest-VolumesActionsTest-511303886-project-member</nova:user>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:         <nova:project uuid="862ed9cb3549457788596bc9e00c830c">tempest-VolumesActionsTest-511303886</nova:project>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:         <nova:port uuid="b6f7f47c-373e-4f60-898a-db8116d5fb48">
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     <system>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <entry name="serial">d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c</entry>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <entry name="uuid">d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c</entry>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     </system>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:   <os>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:   </os>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:   <features>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:   </features>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:   <devices>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c/disk"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     </disk>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c/disk.config"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     </disk>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:8e:7b:94"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <target dev="tapb6f7f47c-37"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     </interface>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c/console.log" append="off"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     </serial>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     <video>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     </video>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     </rng>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:   </devices>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]: </domain>
May 27 03:12:31.755972 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:12:31.758230 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Preparing to wait for external event network-vif-plugged-b6f7f47c-373e-4f60-898a-db8116d5fb48 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:12:31.758230 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Acquiring lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:31.758230 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:31.758230 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:31.758230 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-547609385',display_name='tempest-VolumesActionsTest-instance-547609385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesactionstest-instance-547609385',id=64,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='862ed9cb3549457788596bc9e00c830c',ramdisk_id='',reservation_id='r-m24ambyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-511303886',owner_user_name='tempest-VolumesActionsTest-511303886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:12:29Z,user_data=None,user_id='a0f48384818c4c0aa23d81044f9b46b8',uuid=d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6f7f47c-373e-4f60-898a-db8116d5fb48", "address": "fa:16:3e:8e:7b:94", "network": {"id": "068e39c9-6f62-4438-b419-57d3a831f21c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-329024817-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "862ed9cb3549457788596bc9e00c830c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f7f47c-37", "ovs_interfaceid": "b6f7f47c-373e-4f60-898a-db8116d5fb48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:12:31.758230 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Converting VIF {"id": "b6f7f47c-373e-4f60-898a-db8116d5fb48", "address": "fa:16:3e:8e:7b:94", "network": {"id": "068e39c9-6f62-4438-b419-57d3a831f21c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-329024817-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "862ed9cb3549457788596bc9e00c830c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f7f47c-37", "ovs_interfaceid": "b6f7f47c-373e-4f60-898a-db8116d5fb48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:12:31.758230 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7b:94,bridge_name='br-int',has_traffic_filtering=True,id=b6f7f47c-373e-4f60-898a-db8116d5fb48,network=Network(068e39c9-6f62-4438-b419-57d3a831f21c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6f7f47c-37') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:12:31.758230 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7b:94,bridge_name='br-int',has_traffic_filtering=True,id=b6f7f47c-373e-4f60-898a-db8116d5fb48,network=Network(068e39c9-6f62-4438-b419-57d3a831f21c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6f7f47c-37') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:12:31.758583 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:31.758633 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:12:31.758890 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:12:31.759628 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:31.759760 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f554b576-1585-5728-89e7-f4831b4b0e4f', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:12:31.760501 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:31.761167 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:12:31.761336 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:31.762947 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:31.763083 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6f7f47c-37, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:12:31.763377 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6f7f47c-37, col_values=(('qos', UUID('ee9d4efd-f358-4301-9918-426a73a3041c')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:12:31.763564 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6f7f47c-37, col_values=(('external_ids', {'iface-id': 'b6f7f47c-373e-4f60-898a-db8116d5fb48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:7b:94', 'vm-uuid': 'd37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:12:31.764258 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:31.765354 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:12:31.770189 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:31.771275 np0000001475 nova-compute[98471]: INFO os_vif [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7b:94,bridge_name='br-int',has_traffic_filtering=True,id=b6f7f47c-373e-4f60-898a-db8116d5fb48,network=Network(068e39c9-6f62-4438-b419-57d3a831f21c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6f7f47c-37')
May 27 03:12:31.918551 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Acquiring lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:31.918697 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:32.422107 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:12:32.966554 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:32.966900 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:32.970024 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:12:32.970293 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Claim successful on node np0000001475
May 27 03:12:33.289123 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:12:33.289257 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:12:33.289368 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] No VIF found with MAC fa:16:3e:8e:7b:94, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:12:33.289759 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Using config drive
May 27 03:12:33.794719 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:33.897417 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Creating config drive at /opt/stack/data/nova/instances/d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c/disk.config
May 27 03:12:33.900475 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdzhot9kh {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:12:33.947873 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "b4509577-bb0c-4555-85c2-9978c9f06ff6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:33.948123 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:33.951298 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdzhot9kh" returned: 0 in 0.051s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:12:34.213398 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:12:34.213792 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:12:34.320902 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:34.343218 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:34.345634 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:34.428632 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:34.450402 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:12:34.492576 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6d7d45f7-3305-498c-8730-84d3f3e3402e req-e7662748-5879-4b23-9573-41c18a85115b service nova] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Received event network-vif-plugged-b6f7f47c-373e-4f60-898a-db8116d5fb48 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:34.493024 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6d7d45f7-3305-498c-8730-84d3f3e3402e req-e7662748-5879-4b23-9573-41c18a85115b service nova] Acquiring lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:34.493213 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6d7d45f7-3305-498c-8730-84d3f3e3402e req-e7662748-5879-4b23-9573-41c18a85115b service nova] Lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:34.493352 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6d7d45f7-3305-498c-8730-84d3f3e3402e req-e7662748-5879-4b23-9573-41c18a85115b service nova] Lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:34.493511 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6d7d45f7-3305-498c-8730-84d3f3e3402e req-e7662748-5879-4b23-9573-41c18a85115b service nova] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Processing event network-vif-plugged-b6f7f47c-373e-4f60-898a-db8116d5fb48 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:12:34.645901 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:34.667888 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:34.716250 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:12:34.998153 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:35.031566 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851555.0312212, d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:12:35.031853 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] VM Started (Lifecycle Event)
May 27 03:12:35.032776 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:12:35.035672 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:12:35.037938 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Instance spawned successfully.
May 27 03:12:35.038171 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:12:35.222665 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.256s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:35.223102 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.225s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:35.223315 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:12:35.228215 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:12:35.228365 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Claim successful on node np0000001475
May 27 03:12:35.534648 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:12:35.536837 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:12:35.543463 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:12:35.543591 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:12:35.543832 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:12:35.544037 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:12:35.544279 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:12:35.544528 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:12:35.729229 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:12:35.729670 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:12:35.729987 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:35.730251 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:35.804651 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7154ada1d1aa4a0aa8b31710262b4b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5baf44af64da4cc89825082881a2f01f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:12:36.039011 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:12:36.039246 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851556.0390825, d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:12:36.039381 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] VM Paused (Lifecycle Event)
May 27 03:12:36.048615 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Took 6.39 seconds to spawn the instance on the hypervisor.
May 27 03:12:36.048800 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:12:36.233122 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:12:36.346870 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Successfully created port: 6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:12:36.479218 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-143cf8bd-3239-4cec-8b55-94f10902ce06 req-a4567e11-2d9b-4f3f-86f2-3a90dfa51c9e service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Received event network-changed-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:36.480346 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-143cf8bd-3239-4cec-8b55-94f10902ce06 req-a4567e11-2d9b-4f3f-86f2-3a90dfa51c9e service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Refreshing instance network info cache due to event network-changed-4405512d-bcd7-42bc-b7c6-116269917f4f. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:12:36.480346 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-143cf8bd-3239-4cec-8b55-94f10902ce06 req-a4567e11-2d9b-4f3f-86f2-3a90dfa51c9e service nova] Acquiring lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:12:36.480346 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-143cf8bd-3239-4cec-8b55-94f10902ce06 req-a4567e11-2d9b-4f3f-86f2-3a90dfa51c9e service nova] Acquired lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:12:36.480346 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-143cf8bd-3239-4cec-8b55-94f10902ce06 req-a4567e11-2d9b-4f3f-86f2-3a90dfa51c9e service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Refreshing network info cache for port 4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:12:36.541876 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:12:36.548037 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851556.5477295, d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:12:36.548173 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] VM Resumed (Lifecycle Event)
May 27 03:12:36.555285 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2e4cc49-a0b7-4ea7-bf3a-556dfbd76cf5 req-126d8c66-73f8-420b-9f93-9b70e3e4abbc service nova] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Received event network-vif-plugged-b6f7f47c-373e-4f60-898a-db8116d5fb48 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:36.555479 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2e4cc49-a0b7-4ea7-bf3a-556dfbd76cf5 req-126d8c66-73f8-420b-9f93-9b70e3e4abbc service nova] Acquiring lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:36.556267 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2e4cc49-a0b7-4ea7-bf3a-556dfbd76cf5 req-126d8c66-73f8-420b-9f93-9b70e3e4abbc service nova] Lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:36.557391 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2e4cc49-a0b7-4ea7-bf3a-556dfbd76cf5 req-126d8c66-73f8-420b-9f93-9b70e3e4abbc service nova] Lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:36.561000 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:36.569558 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2e4cc49-a0b7-4ea7-bf3a-556dfbd76cf5 req-126d8c66-73f8-420b-9f93-9b70e3e4abbc service nova] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] No waiting events found dispatching network-vif-plugged-b6f7f47c-373e-4f60-898a-db8116d5fb48 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:12:36.569726 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-f2e4cc49-a0b7-4ea7-bf3a-556dfbd76cf5 req-126d8c66-73f8-420b-9f93-9b70e3e4abbc service nova] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Received unexpected event network-vif-plugged-b6f7f47c-373e-4f60-898a-db8116d5fb48 for instance with vm_state active and task_state None.
May 27 03:12:36.570667 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Took 11.71 seconds to build instance.
May 27 03:12:36.615475 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:12:36.615704 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:12:36.738270 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:12:36.765239 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:36.903254 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Successfully updated port: 6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:12:36.984880 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-143cf8bd-3239-4cec-8b55-94f10902ce06 req-a4567e11-2d9b-4f3f-86f2-3a90dfa51c9e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:36.995900 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-bd02a397-ff7b-413f-91e9-4ad3740233be req-1334548d-d459-4027-a1f6-71a6b1148ca9 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Received event network-changed-6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:36.996416 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-bd02a397-ff7b-413f-91e9-4ad3740233be req-1334548d-d459-4027-a1f6-71a6b1148ca9 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Refreshing instance network info cache due to event network-changed-6efcedc4-a28c-4133-a81b-8076ee6bde17. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:12:36.996544 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bd02a397-ff7b-413f-91e9-4ad3740233be req-1334548d-d459-4027-a1f6-71a6b1148ca9 service nova] Acquiring lock "refresh_cache-a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:12:36.996590 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bd02a397-ff7b-413f-91e9-4ad3740233be req-1334548d-d459-4027-a1f6-71a6b1148ca9 service nova] Acquired lock "refresh_cache-a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:12:36.996670 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-bd02a397-ff7b-413f-91e9-4ad3740233be req-1334548d-d459-4027-a1f6-71a6b1148ca9 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Refreshing network info cache for port 6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:12:37.022330 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:37.022556 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:37.022709 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:37.022860 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:37.023000 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:37.025508 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Terminating instance
May 27 03:12:37.053935 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:12:37.060403 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:12:37.073903 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a4f4af5e-2ed2-4013-84b8-83ff21430e5c tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.221s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:37.118852 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:12:37.243313 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Booting with volume d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 at /dev/vda
May 27 03:12:37.284909 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:12:37.290334 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-143cf8bd-3239-4cec-8b55-94f10902ce06 req-a4567e11-2d9b-4f3f-86f2-3a90dfa51c9e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:37.302559 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:12:37.327682 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:12:37.375796 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:12:37.377246 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:12:37.386209 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:12:37.387272 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe66:186f', 'fe80::f9:d2ff:fead:2ab6', 'fe80::fc16:3eff:fe8e:48f0', 'fe80::7441:51ff:fe02:437d', 'fe80::fc16:3eff:fe8e:7b94', 'fe80::e0cc:f0ff:fe14:663f'] 
May 27 03:12:37.387417 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:12:37.387531 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:12:37.387789 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:12:37.387974 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Updating existing volume attachment record: e5357e8d-5173-489a-9a25-aea7ab016f07 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:12:37.406437 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Acquiring lock "refresh_cache-a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:12:37.459549 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-143cf8bd-3239-4cec-8b55-94f10902ce06 req-a4567e11-2d9b-4f3f-86f2-3a90dfa51c9e service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Updated VIF entry in instance network info cache for port 4405512d-bcd7-42bc-b7c6-116269917f4f. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:12:37.460537 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-143cf8bd-3239-4cec-8b55-94f10902ce06 req-a4567e11-2d9b-4f3f-86f2-3a90dfa51c9e service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Updating instance_info_cache with network_info: [{"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:12:37.498526 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-bd02a397-ff7b-413f-91e9-4ad3740233be req-1334548d-d459-4027-a1f6-71a6b1148ca9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:37.534535 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:12:37.557629 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:37.580883 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:37.590273 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-bd02a397-ff7b-413f-91e9-4ad3740233be req-1334548d-d459-4027-a1f6-71a6b1148ca9 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:12:37.604081 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:37.627009 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.404s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:37.627683 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:12:37.787326 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-bd02a397-ff7b-413f-91e9-4ad3740233be req-1334548d-d459-4027-a1f6-71a6b1148ca9 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:12:37.838061 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:37.860141 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999612951000017 future=<Future at 0x7557247b9df0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:12:37.863469 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.996262974000274 future=<Future at 0x7557247b9df0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:12:37.863601 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99610293700016 future=<Future at 0x7557247b9df0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:12:37.866649 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Instance destroyed successfully.
May 27 03:12:37.867112 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lazy-loading 'resources' on Instance uuid e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:12:37.964320 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-143cf8bd-3239-4cec-8b55-94f10902ce06 req-a4567e11-2d9b-4f3f-86f2-3a90dfa51c9e service nova] Releasing lock "refresh_cache-e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:12:38.133921 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:12:38.133921 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:12:38.134319 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:38.134483 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:38.194862 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '568dd12813254325bb16fac607894d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256f2c4e067c46a3a4ea5e9d934b1d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:12:38.289026 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-bd02a397-ff7b-413f-91e9-4ad3740233be req-1334548d-d459-4027-a1f6-71a6b1148ca9 service nova] Releasing lock "refresh_cache-a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:12:38.289459 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Acquired lock "refresh_cache-a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:12:38.289657 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:12:38.369924 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T03:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-979759750',display_name='tempest-TestShelveInstance-server-979759750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testshelveinstance-server-979759750',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvHcPIdf5ySXrzW/Bta+JqMZYLfKoPdChUu67Gw6GkqzSVoJyKWlzBAqBOO70Xjx7BpBWor+/paVzDKNqocIgiXJfQmDZBYWmRgNg/YzGb56OtqGA7X5UZkasOniGoZaQ==',key_name='tempest-TestShelveInstance-1659380719',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:11:58Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8836c8a171d34ccf9ea8e385160539ae',ramdisk_id='',reservation_id='r-u86gsxw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-195465897',owner_user_name='tempest-TestShelveInstance-195465897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:11:58Z,user_data=None,user_id='5035972df2c34359880135aaa11b26ea',uuid=e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:12:38.370118 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Converting VIF {"id": "4405512d-bcd7-42bc-b7c6-116269917f4f", "address": "fa:16:3e:8e:48:f0", "network": {"id": "686c35f5-1a05-4704-bf14-198632c86a51", "bridge": "br-int", "label": "tempest-TestShelveInstance-1570887884-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8836c8a171d34ccf9ea8e385160539ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4405512d-bc", "ovs_interfaceid": "4405512d-bcd7-42bc-b7c6-116269917f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:12:38.370737 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=4405512d-bcd7-42bc-b7c6-116269917f4f,network=Network(686c35f5-1a05-4704-bf14-198632c86a51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4405512d-bc') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:12:38.370955 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=4405512d-bcd7-42bc-b7c6-116269917f4f,network=Network(686c35f5-1a05-4704-bf14-198632c86a51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4405512d-bc') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:12:38.373666 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:38.373666 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4405512d-bc, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:12:38.374034 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:38.376143 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:12:38.376882 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:38.376882 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38d5b6de-de40-4d9c-881c-334b40b6e1dd) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:12:38.377466 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:38.378155 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:12:38.379576 np0000001475 nova-compute[98471]: INFO os_vif [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:f0,bridge_name='br-int',has_traffic_filtering=True,id=4405512d-bcd7-42bc-b7c6-116269917f4f,network=Network(686c35f5-1a05-4704-bf14-198632c86a51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4405512d-bc')
May 27 03:12:38.381084 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:12:38.381453 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:12:38.381600 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:12:38.381981 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:12:38.382325 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3a1cb25-ef73-4b14-a2eb-13676b9030ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:12:38.382428 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:12:38.410653 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:38.410653 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:38.410653 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:38.410653 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:38.410653 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:38.410653 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:38.410653 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:38.410653 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:38.410653 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:12:38.411004 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsi session list stdout=tcp: [160] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:38.411004 np0000001475 nova-compute[98471]: tcp: [161] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec (non-flash)
May 27 03:12:38.411004 np0000001475 nova-compute[98471]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:38.411004 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:38.411004 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:38.411004 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:38.411004 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:38.411004 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:38.411004 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:12:38.411004 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', '168'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', '169')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:12:38.411299 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', '160')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:12:38.412040 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec', '161')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:12:38.412836 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c27e8e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec'): ({'sdc'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:12:38.413049 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Removing multipathed devices sdb, sdc {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:12:38.413299 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Flush multipath device 33000000029397f0e {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:12:38.464836 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:12:38.508312 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:12:38.558395 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:12:38.559044 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:12:38.559888 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:12:38.571336 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:12:38.571582 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:12:38.585114 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:38.622248 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 160, target: iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec, portal: 192.168.40.100,3260]
May 27 03:12:38.622248 np0000001475 nova-compute[98471]: Logout of [sid: 160, target: iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec, portal: 192.168.40.100,3260] successful.
May 27 03:12:38.622248 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:38.634763 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:12:38.639343 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:38.651002 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Successfully created port: 49b32736-9a22-4125-9303-1b5e23d0e1f7 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:12:38.653334 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:38.666287 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5e5af3b6-f156-46f9-9cc9-b4373a2455d0 req-5393494f-8e00-47e6-a282-16e9f748f226 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Received event network-vif-unplugged-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:38.666642 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5e5af3b6-f156-46f9-9cc9-b4373a2455d0 req-5393494f-8e00-47e6-a282-16e9f748f226 service nova] Acquiring lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:38.666823 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5e5af3b6-f156-46f9-9cc9-b4373a2455d0 req-5393494f-8e00-47e6-a282-16e9f748f226 service nova] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:38.666939 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5e5af3b6-f156-46f9-9cc9-b4373a2455d0 req-5393494f-8e00-47e6-a282-16e9f748f226 service nova] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:38.667104 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5e5af3b6-f156-46f9-9cc9-b4373a2455d0 req-5393494f-8e00-47e6-a282-16e9f748f226 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] No waiting events found dispatching network-vif-unplugged-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:12:38.667177 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5e5af3b6-f156-46f9-9cc9-b4373a2455d0 req-5393494f-8e00-47e6-a282-16e9f748f226 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Received event network-vif-unplugged-4405512d-bcd7-42bc-b7c6-116269917f4f for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:12:38.667271 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5e5af3b6-f156-46f9-9cc9-b4373a2455d0 req-5393494f-8e00-47e6-a282-16e9f748f226 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Received event network-vif-unplugged-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:38.667626 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5e5af3b6-f156-46f9-9cc9-b4373a2455d0 req-5393494f-8e00-47e6-a282-16e9f748f226 service nova] Acquiring lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:38.667692 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5e5af3b6-f156-46f9-9cc9-b4373a2455d0 req-5393494f-8e00-47e6-a282-16e9f748f226 service nova] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:38.667961 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5e5af3b6-f156-46f9-9cc9-b4373a2455d0 req-5393494f-8e00-47e6-a282-16e9f748f226 service nova] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:38.667961 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5e5af3b6-f156-46f9-9cc9-b4373a2455d0 req-5393494f-8e00-47e6-a282-16e9f748f226 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] No waiting events found dispatching network-vif-unplugged-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:12:38.668043 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5e5af3b6-f156-46f9-9cc9-b4373a2455d0 req-5393494f-8e00-47e6-a282-16e9f748f226 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Received event network-vif-unplugged-4405512d-bcd7-42bc-b7c6-116269917f4f for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:12:38.687498 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 161, target: iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec, portal: 192.168.50.100,3260]
May 27 03:12:38.687498 np0000001475 nova-compute[98471]: Logout of [sid: 161, target: iqn.2023-03.storpool.com:os--volume-d3a1cb25-ef73-4b14-a2eb-13676b9030ec, portal: 192.168.50.100,3260] successful.
May 27 03:12:38.687498 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:38.702669 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:38.702915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:12:38.703031 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] <== disconnect_volume: return (321ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:12:38.703174 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:12:38.703512 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Deleting instance files /opt/stack/data/nova/instances/e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa_del
May 27 03:12:38.703967 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Deletion of /opt/stack/data/nova/instances/e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa_del complete
May 27 03:12:38.867471 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:12:39.033600 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:39.138197 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:12:39.196304 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Updating instance_info_cache with network_info: [{"id": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "address": "fa:16:3e:fe:30:4c", "network": {"id": "4d693079-1416-4ea0-a645-0e727595ef7e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1303315207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5baf44af64da4cc89825082881a2f01f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efcedc4-a2", "ovs_interfaceid": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:12:39.200691 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Successfully updated port: 49b32736-9a22-4125-9303-1b5e23d0e1f7 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:12:39.220392 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Took 1.69 seconds to destroy the instance on the hypervisor.
May 27 03:12:39.221004 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:12:39.221158 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:12:39.221241 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:12:39.221447 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:39.243252 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f42bf05c-41e5-4f9a-a773-dda67455cc8d req-c95194fd-1482-421d-bb26-c10909508e78 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Received event network-changed-49b32736-9a22-4125-9303-1b5e23d0e1f7 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:39.243758 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f42bf05c-41e5-4f9a-a773-dda67455cc8d req-c95194fd-1482-421d-bb26-c10909508e78 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Refreshing instance network info cache due to event network-changed-49b32736-9a22-4125-9303-1b5e23d0e1f7. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:12:39.243933 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f42bf05c-41e5-4f9a-a773-dda67455cc8d req-c95194fd-1482-421d-bb26-c10909508e78 service nova] Acquiring lock "refresh_cache-b4509577-bb0c-4555-85c2-9978c9f06ff6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:12:39.244077 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f42bf05c-41e5-4f9a-a773-dda67455cc8d req-c95194fd-1482-421d-bb26-c10909508e78 service nova] Acquired lock "refresh_cache-b4509577-bb0c-4555-85c2-9978c9f06ff6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:12:39.244562 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f42bf05c-41e5-4f9a-a773-dda67455cc8d req-c95194fd-1482-421d-bb26-c10909508e78 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Refreshing network info cache for port 49b32736-9a22-4125-9303-1b5e23d0e1f7 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:12:39.317619 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:39.505237 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:12:39.506123 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:12:39.506339 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Creating image(s)
May 27 03:12:39.506589 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:12:39.506730 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Ensure instance console log exists: /opt/stack/data/nova/instances/a962fbe3-4ac8-47c6-9cee-24fe923fbc6c/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:12:39.506922 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:39.507054 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:39.507167 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:39.558648 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-56f2461b-3780-43e5-8b51-4f4351b975dc req-f521f9c6-e8ba-46c1-aee9-b1bbc5b0f1b2 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Received event network-vif-deleted-4405512d-bcd7-42bc-b7c6-116269917f4f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:39.558779 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-56f2461b-3780-43e5-8b51-4f4351b975dc req-f521f9c6-e8ba-46c1-aee9-b1bbc5b0f1b2 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Neutron deleted interface 4405512d-bcd7-42bc-b7c6-116269917f4f; detaching it from the instance and deleting it from the info cache
May 27 03:12:39.558953 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-56f2461b-3780-43e5-8b51-4f4351b975dc req-f521f9c6-e8ba-46c1-aee9-b1bbc5b0f1b2 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:12:39.701197 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Releasing lock "refresh_cache-a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:12:39.701620 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Instance network_info: |[{"id": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "address": "fa:16:3e:fe:30:4c", "network": {"id": "4d693079-1416-4ea0-a645-0e727595ef7e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1303315207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5baf44af64da4cc89825082881a2f01f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efcedc4-a2", "ovs_interfaceid": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:12:39.702197 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "refresh_cache-b4509577-bb0c-4555-85c2-9978c9f06ff6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:12:39.702781 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Start _get_guest_xml network_info=[{"id": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "address": "fa:16:3e:fe:30:4c", "network": {"id": "4d693079-1416-4ea0-a645-0e727595ef7e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1303315207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5baf44af64da4cc89825082881a2f01f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efcedc4-a2", "ovs_interfaceid": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a962fbe3-4ac8-47c6-9cee-24fe923fbc6c', 'attached_at': '', 'detached_at': '', 'volume_id': 'd22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 'serial': 'd22031d1-ecdd-4525-9a7c-ee7a2baa1ff5'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'e5357e8d-5173-489a-9a25-aea7ab016f07', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:12:39.705388 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:12:39.706474 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBackupRestore-server-1677938102', uuid='a962fbe3-4ac8-47c6-9cee-24fe923fbc6c'), owner=OwnerMeta(userid='7154ada1d1aa4a0aa8b31710262b4b50', username='tempest-TestVolumeBackupRestore-1748215900-project-member', projectid='5baf44af64da4cc89825082881a2f01f', projectname='tempest-TestVolumeBackupRestore-1748215900'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "address": "fa:16:3e:fe:30:4c", "network": {"id": "4d693079-1416-4ea0-a645-0e727595ef7e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1303315207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5baf44af64da4cc89825082881a2f01f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efcedc4-a2", "ovs_interfaceid": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851559.70611) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:12:39.708113 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:12:39.708516 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:12:39.709497 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:12:39.709654 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:12:39.710606 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:12:39.710876 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:12:39.711082 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:12:39.711184 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:12:39.711300 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:12:39.711395 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:12:39.711486 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:12:39.711642 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:12:39.711833 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:12:39.711952 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:12:39.712051 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:12:39.712162 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:12:39.720993 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:12:39.721219 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:12:39.721334 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:12:39.721617 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:12:39.721882 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:12:39.736665 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:12:39.737140 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:12:39.737588 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:12:39.737781 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:12:39.738312 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:12:39.738891 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:12:39.746690 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f42bf05c-41e5-4f9a-a773-dda67455cc8d req-c95194fd-1482-421d-bb26-c10909508e78 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:39.753544 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:12:39.753544 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:39.755579 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:12:39.755579 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:39.768855 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5] added
May 27 03:12:39.768855 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:12:39.768855 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:12:39.768855 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:12:39.768855 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:12:39.768855 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:12:39.768855 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:39.768855 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:12:39.768855 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0299(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:12:39.768855 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:12:39.771026 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5] added
May 27 03:12:39.771026 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:12:39.771026 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:12:39.771026 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:12:39.771026 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:12:39.771026 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:12:39.771026 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:39.771291 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:12:39.771433 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0327(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:12:39.771599 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:12:39.808588 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f42bf05c-41e5-4f9a-a773-dda67455cc8d req-c95194fd-1482-421d-bb26-c10909508e78 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:12:39.957893 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f42bf05c-41e5-4f9a-a773-dda67455cc8d req-c95194fd-1482-421d-bb26-c10909508e78 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:12:40.016900 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:12:40.061932 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-56f2461b-3780-43e5-8b51-4f4351b975dc req-f521f9c6-e8ba-46c1-aee9-b1bbc5b0f1b2 service nova] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Detach interface failed, port_id=4405512d-bcd7-42bc-b7c6-116269917f4f, reason: Instance e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:12:40.145687 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:12:40.146516 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:12:40.146712 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Creating image(s)
May 27 03:12:40.147105 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:40.147246 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "/opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:40.147647 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "/opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:40.148124 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:12:40.150594 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:12:40.151393 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:12:40.241504 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.090s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:12:40.241907 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:40.242321 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:40.242721 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:12:40.248320 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:12:40.248693 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:12:40.356751 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.108s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:12:40.357350 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:12:40.428937 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk 1073741824" returned: 0 in 0.071s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:12:40.429454 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:40.429812 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:12:40.462070 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f42bf05c-41e5-4f9a-a773-dda67455cc8d req-c95194fd-1482-421d-bb26-c10909508e78 service nova] Releasing lock "refresh_cache-b4509577-bb0c-4555-85c2-9978c9f06ff6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:12:40.465178 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquired lock "refresh_cache-b4509577-bb0c-4555-85c2-9978c9f06ff6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:12:40.465178 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:12:40.518465 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.089s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:12:40.519464 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Took 1.30 seconds to deallocate network for instance.
May 27 03:12:40.520112 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:12:40.522688 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:12:40.615021 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:12:40.615478 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Cannot resize image /opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:12:40.615904 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:12:40.616067 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Ensure instance console log exists: /opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:12:40.616317 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:40.616547 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:40.616664 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:40.768289 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:12:40.773605 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:12:40.780758 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:12:40.780758 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:12:40.787359 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:12:40.787359 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:40.792178 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:40.798446 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:40.805901 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:40.805901 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:40.805901 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:40.805901 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:40.805901 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:40.805901 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:40.805901 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:12:40.806095 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:40.806095 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:40.806095 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:40.806095 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:40.806095 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:40.806095 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:40.806095 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:12:40.812387 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:40.812387 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:40.812387 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:40.812387 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:40.812387 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:40.812387 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:40.812387 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:12:40.812569 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:40.812569 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:40.812569 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:40.812569 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:40.812569 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:40.812569 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:40.812569 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:12:40.842714 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5, portal: 192.168.50.100,3260]
May 27 03:12:40.842714 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5, portal: 192.168.50.100,3260] successful.
May 27 03:12:40.842714 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:40.855155 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5, portal: 192.168.40.100,3260]
May 27 03:12:40.855155 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5, portal: 192.168.40.100,3260] successful.
May 27 03:12:40.855155 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:40.859267 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:40.868644 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:12:40.876769 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:40.876769 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:40.876769 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:40.876769 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:40.876769 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:40.876769 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:40.876769 np0000001475 nova-compute[98471]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:12:40.876769 np0000001475 nova-compute[98471]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:12:40.876769 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:12:40.876769 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:40.876769 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:40.876769 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:40.876769 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:40.876769 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:40.876769 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:40.876769 np0000001475 nova-compute[98471]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:12:40.876769 np0000001475 nova-compute[98471]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:12:40.876769 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:12:40.876769 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:12:40.876769 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:12:40.877583 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] HCTL ('7', '-', '-', 0) found on session 170 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:12:40.877583 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:12:40.885568 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:40.885568 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:40.885568 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:40.885568 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:40.885568 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:40.885568 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:40.885568 np0000001475 nova-compute[98471]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:12:40.885568 np0000001475 nova-compute[98471]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:12:40.885568 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:12:40.885902 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:40.885902 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:12:40.885902 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:40.885902 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:12:40.885902 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:40.885902 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:12:40.885902 np0000001475 nova-compute[98471]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:12:40.885902 np0000001475 nova-compute[98471]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:12:40.885902 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:12:40.886069 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:12:40.886069 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:12:40.887046 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] HCTL ('8', '-', '-', 0) found on session 171 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:12:40.887147 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:12:40.893820 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Searching for a device in session 170 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:12:40.894118 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:12:40.902979 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Searching for a device in session 171 and hctl ['8', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:12:41.077617 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:12:41.097515 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Took 0.58 seconds to detach 1 volumes for instance.
May 27 03:12:41.099750 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Deleting volume: d3a1cb25-ef73-4b14-a2eb-13676b9030ec {{(pid=98471) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 27 03:12:41.255341 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:41.421906 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Updating instance_info_cache with network_info: [{"id": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "address": "fa:16:3e:bf:27:ab", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b32736-9a", "ovs_interfaceid": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:12:41.555851 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:41.654345 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:41.654506 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:41.903540 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Searching for a device in session 171 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:12:41.903715 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:12:41.909643 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:12:41.909920 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:12:41.923863 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Releasing lock "refresh_cache-b4509577-bb0c-4555-85c2-9978c9f06ff6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:12:41.924109 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Instance network_info: |[{"id": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "address": "fa:16:3e:bf:27:ab", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b32736-9a", "ovs_interfaceid": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:12:41.926547 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Start _get_guest_xml network_info=[{"id": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "address": "fa:16:3e:bf:27:ab", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b32736-9a", "ovs_interfaceid": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:12:41.929434 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:12:41.930975 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-848626449', uuid='b4509577-bb0c-4555-85c2-9978c9f06ff6'), owner=OwnerMeta(userid='568dd12813254325bb16fac607894d49', username='tempest-VolumeMultiattachTests-1876764595-project-member', projectid='256f2c4e067c46a3a4ea5e9d934b1d4b', projectname='tempest-VolumeMultiattachTests-1876764595'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "address": "fa:16:3e:bf:27:ab", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b32736-9a", "ovs_interfaceid": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851561.9305475) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:12:41.932403 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:12:41.932812 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:12:41.933785 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:12:41.934000 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:12:41.935030 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:12:41.935815 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:12:41.935993 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:12:41.936113 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:12:41.936270 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:12:41.936398 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:12:41.936527 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:12:41.936724 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:12:41.936869 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:12:41.937012 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:12:41.937146 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:12:41.937293 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:12:41.952908 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-848626449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumemultiattachtests-server-848626449',id=66,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVI54RH2pdxhdx+NBQ2XGN7tNsXMkNRRM659CteSsS0ZmLSyoDiSuXTzB/DhppFfYk9ouWLVqam92P3d8MUEqPLedL5zCvpkb49Y3GdLSs3nNQ1gwwpZDY5VEnqdrskPA==',key_name='tempest-keypair-695410050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='256f2c4e067c46a3a4ea5e9d934b1d4b',ramdisk_id='',reservation_id='r-fz032dwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1876764595',owner_user_name='tempest-VolumeMultiattachTests-1876764595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:12:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='568dd12813254325bb16fac607894d49',uuid=b4509577-bb0c-4555-85c2-9978c9f06ff6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "address": "fa:16:3e:bf:27:ab", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b32736-9a", "ovs_interfaceid": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:12:41.953071 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Converting VIF {"id": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "address": "fa:16:3e:bf:27:ab", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b32736-9a", "ovs_interfaceid": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:12:41.953756 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:27:ab,bridge_name='br-int',has_traffic_filtering=True,id=49b32736-9a22-4125-9303-1b5e23d0e1f7,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b32736-9a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:12:41.954435 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'pci_devices' on Instance uuid b4509577-bb0c-4555-85c2-9978c9f06ff6 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:12:42.412534 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:12:42.458808 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] End _get_guest_xml xml=<domain type="qemu">
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:   <uuid>b4509577-bb0c-4555-85c2-9978c9f06ff6</uuid>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:   <name>instance-00000042</name>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <nova:name>tempest-VolumeMultiattachTests-server-848626449</nova:name>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:12:41</nova:creationTime>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:         <nova:user uuid="568dd12813254325bb16fac607894d49">tempest-VolumeMultiattachTests-1876764595-project-member</nova:user>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:         <nova:project uuid="256f2c4e067c46a3a4ea5e9d934b1d4b">tempest-VolumeMultiattachTests-1876764595</nova:project>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:         <nova:port uuid="49b32736-9a22-4125-9303-1b5e23d0e1f7">
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     <system>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <entry name="serial">b4509577-bb0c-4555-85c2-9978c9f06ff6</entry>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <entry name="uuid">b4509577-bb0c-4555-85c2-9978c9f06ff6</entry>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     </system>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:   <os>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:   </os>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:   <features>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:   </features>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:   <devices>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     </disk>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk.config"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     </disk>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:bf:27:ab"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <target dev="tap49b32736-9a"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     </interface>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/console.log" append="off"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     </serial>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     <video>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     </video>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     </rng>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:   </devices>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]: </domain>
May 27 03:12:42.458808 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:12:42.458808 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Preparing to wait for external event network-vif-plugged-49b32736-9a22-4125-9303-1b5e23d0e1f7 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:12:42.458808 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "b4509577-bb0c-4555-85c2-9978c9f06ff6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:42.458808 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:42.458808 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:42.458808 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-848626449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumemultiattachtests-server-848626449',id=66,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVI54RH2pdxhdx+NBQ2XGN7tNsXMkNRRM659CteSsS0ZmLSyoDiSuXTzB/DhppFfYk9ouWLVqam92P3d8MUEqPLedL5zCvpkb49Y3GdLSs3nNQ1gwwpZDY5VEnqdrskPA==',key_name='tempest-keypair-695410050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='256f2c4e067c46a3a4ea5e9d934b1d4b',ramdisk_id='',reservation_id='r-fz032dwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1876764595',owner_user_name='tempest-VolumeMultiattachTests-1876764595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:12:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='568dd12813254325bb16fac607894d49',uuid=b4509577-bb0c-4555-85c2-9978c9f06ff6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "address": "fa:16:3e:bf:27:ab", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b32736-9a", "ovs_interfaceid": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:12:42.462846 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Converting VIF {"id": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "address": "fa:16:3e:bf:27:ab", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b32736-9a", "ovs_interfaceid": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:12:42.462846 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:27:ab,bridge_name='br-int',has_traffic_filtering=True,id=49b32736-9a22-4125-9303-1b5e23d0e1f7,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b32736-9a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:12:42.462846 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:27:ab,bridge_name='br-int',has_traffic_filtering=True,id=49b32736-9a22-4125-9303-1b5e23d0e1f7,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b32736-9a') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:12:42.464245 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:42.464245 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:12:42.464245 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:12:42.465098 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:42.465388 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df8630e6-8f45-5a31-87c7-22d122b4faa1', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:12:42.466373 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:42.468439 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:42.471082 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:42.472424 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49b32736-9a, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:12:42.472651 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49b32736-9a, col_values=(('qos', UUID('570e08a0-8d6e-44ad-980c-f67ab9e16296')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:12:42.472928 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49b32736-9a, col_values=(('external_ids', {'iface-id': '49b32736-9a22-4125-9303-1b5e23d0e1f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:27:ab', 'vm-uuid': 'b4509577-bb0c-4555-85c2-9978c9f06ff6'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:12:42.474222 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:42.476405 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:12:42.481531 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:42.486895 np0000001475 nova-compute[98471]: INFO os_vif [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:27:ab,bridge_name='br-int',has_traffic_filtering=True,id=49b32736-9a22-4125-9303-1b5e23d0e1f7,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b32736-9a')
May 27 03:12:42.630722 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Acquiring lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:42.630995 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:42.631230 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Acquiring lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:42.631452 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:42.631637 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:42.634106 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Terminating instance
May 27 03:12:42.753225 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Found WWN 330000000d8ee2eeb for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:12:42.753561 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:12:42.753804 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000d8ee2eeb', 'path': '/dev/dm-0', 'multipath_id': '330000000d8ee2eeb'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:12:42.753953 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d8ee2eeb', 'path': '/dev/dm-0', 'multipath_id': '330000000d8ee2eeb'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:12:42.921585 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.267s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:42.988353 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Deleted allocations for instance e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa
May 27 03:12:43.137831 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:12:43.162948 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:43.165360 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:43.183000 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:43.187696 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:43.209293 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:43.219303 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:43.260044 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:12:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1677938102',display_name='tempest-TestVolumeBackupRestore-server-1677938102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebackuprestore-server-1677938102',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJvtkMCKCp+Osug5cwPjMuyd0NfOzm0zS1Ob5ZQVOaalH0L75bab0UTmT9ahXFgwTq1cG9FQYaO3e0fvwoiv2eOgX/vyComljkG4ST/q0E+o76e+DldKljDlzHrxNu9hg==',key_name='tempest-TestVolumeBackupRestore-1636169421',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5baf44af64da4cc89825082881a2f01f',ramdisk_id='',reservation_id='r-tj9aq6m1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-1748215900',owner_user_name='tempest-TestVolumeBackupRestore-1748215900-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:12:37Z,user_data=None,user_id='7154ada1d1aa4a0aa8b31710262b4b50',uuid=a962fbe3-4ac8-47c6-9cee-24fe923fbc6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "address": "fa:16:3e:fe:30:4c", "network": {"id": "4d693079-1416-4ea0-a645-0e727595ef7e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1303315207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5baf44af64da4cc89825082881a2f01f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efcedc4-a2", "ovs_interfaceid": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:12:43.260305 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Converting VIF {"id": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "address": "fa:16:3e:fe:30:4c", "network": {"id": "4d693079-1416-4ea0-a645-0e727595ef7e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1303315207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5baf44af64da4cc89825082881a2f01f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efcedc4-a2", "ovs_interfaceid": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:12:43.260778 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:30:4c,bridge_name='br-int',has_traffic_filtering=True,id=6efcedc4-a28c-4133-a81b-8076ee6bde17,network=Network(4d693079-1416-4ea0-a645-0e727595ef7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efcedc4-a2') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:12:43.261255 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lazy-loading 'pci_devices' on Instance uuid a962fbe3-4ac8-47c6-9cee-24fe923fbc6c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:12:43.305680 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c87f9d5e-f239-4493-a42f-9432928febc4 req-9a90ad15-38e7-4a7a-b7b3-0b6e81c690c9 service nova] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Received event network-vif-unplugged-b6f7f47c-373e-4f60-898a-db8116d5fb48 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:43.305876 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c87f9d5e-f239-4493-a42f-9432928febc4 req-9a90ad15-38e7-4a7a-b7b3-0b6e81c690c9 service nova] Acquiring lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:43.305977 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c87f9d5e-f239-4493-a42f-9432928febc4 req-9a90ad15-38e7-4a7a-b7b3-0b6e81c690c9 service nova] Lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:43.306085 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c87f9d5e-f239-4493-a42f-9432928febc4 req-9a90ad15-38e7-4a7a-b7b3-0b6e81c690c9 service nova] Lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:43.306191 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c87f9d5e-f239-4493-a42f-9432928febc4 req-9a90ad15-38e7-4a7a-b7b3-0b6e81c690c9 service nova] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] No waiting events found dispatching network-vif-unplugged-b6f7f47c-373e-4f60-898a-db8116d5fb48 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:12:43.306557 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c87f9d5e-f239-4493-a42f-9432928febc4 req-9a90ad15-38e7-4a7a-b7b3-0b6e81c690c9 service nova] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Received event network-vif-unplugged-b6f7f47c-373e-4f60-898a-db8116d5fb48 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:12:43.455442 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999714609999955 future=<Future at 0x7557247ba690 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:12:43.456516 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Instance destroyed successfully.
May 27 03:12:43.456840 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Lazy-loading 'resources' on Instance uuid d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:12:43.763786 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] End _get_guest_xml xml=<domain type="qemu">
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:   <uuid>a962fbe3-4ac8-47c6-9cee-24fe923fbc6c</uuid>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:   <name>instance-00000041</name>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestVolumeBackupRestore-server-1677938102</nova:name>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:12:39</nova:creationTime>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:         <nova:user uuid="7154ada1d1aa4a0aa8b31710262b4b50">tempest-TestVolumeBackupRestore-1748215900-project-member</nova:user>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:         <nova:project uuid="5baf44af64da4cc89825082881a2f01f">tempest-TestVolumeBackupRestore-1748215900</nova:project>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:         <nova:port uuid="6efcedc4-a28c-4133-a81b-8076ee6bde17">
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     <system>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <entry name="serial">a962fbe3-4ac8-47c6-9cee-24fe923fbc6c</entry>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <entry name="uuid">a962fbe3-4ac8-47c6-9cee-24fe923fbc6c</entry>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     </system>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:   <os>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:   </os>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:   <features>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:   </features>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:   <devices>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/a962fbe3-4ac8-47c6-9cee-24fe923fbc6c/disk.config"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     </disk>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <alias name="ua-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-0"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <serial>d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5</serial>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     </disk>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:fe:30:4c"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <target dev="tap6efcedc4-a2"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     </interface>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/a962fbe3-4ac8-47c6-9cee-24fe923fbc6c/console.log" append="off"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     </serial>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     <video>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     </video>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     </rng>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:   </devices>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]: </domain>
May 27 03:12:43.763786 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:12:43.767289 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Preparing to wait for external event network-vif-plugged-6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:12:43.767289 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Acquiring lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:43.767289 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:43.767289 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:43.767289 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:12:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1677938102',display_name='tempest-TestVolumeBackupRestore-server-1677938102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebackuprestore-server-1677938102',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJvtkMCKCp+Osug5cwPjMuyd0NfOzm0zS1Ob5ZQVOaalH0L75bab0UTmT9ahXFgwTq1cG9FQYaO3e0fvwoiv2eOgX/vyComljkG4ST/q0E+o76e+DldKljDlzHrxNu9hg==',key_name='tempest-TestVolumeBackupRestore-1636169421',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5baf44af64da4cc89825082881a2f01f',ramdisk_id='',reservation_id='r-tj9aq6m1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-1748215900',owner_user_name='tempest-TestVolumeBackupRestore-1748215900-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:12:37Z,user_data=None,user_id='7154ada1d1aa4a0aa8b31710262b4b50',uuid=a962fbe3-4ac8-47c6-9cee-24fe923fbc6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "address": "fa:16:3e:fe:30:4c", "network": {"id": "4d693079-1416-4ea0-a645-0e727595ef7e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1303315207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5baf44af64da4cc89825082881a2f01f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efcedc4-a2", "ovs_interfaceid": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:12:43.767289 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Converting VIF {"id": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "address": "fa:16:3e:fe:30:4c", "network": {"id": "4d693079-1416-4ea0-a645-0e727595ef7e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1303315207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5baf44af64da4cc89825082881a2f01f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efcedc4-a2", "ovs_interfaceid": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:12:43.767289 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:30:4c,bridge_name='br-int',has_traffic_filtering=True,id=6efcedc4-a28c-4133-a81b-8076ee6bde17,network=Network(4d693079-1416-4ea0-a645-0e727595ef7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efcedc4-a2') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:12:43.767289 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:30:4c,bridge_name='br-int',has_traffic_filtering=True,id=6efcedc4-a28c-4133-a81b-8076ee6bde17,network=Network(4d693079-1416-4ea0-a645-0e727595ef7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efcedc4-a2') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:12:43.767289 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:43.767289 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:12:43.767289 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:12:43.767289 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:43.767289 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad951dd5-0541-5104-885a-bc617a7ec332', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:12:43.768014 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:43.768404 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:12:43.777183 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:43.778718 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:43.778854 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6efcedc4-a2, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:12:43.779096 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6efcedc4-a2, col_values=(('qos', UUID('05529cd5-d918-4a0f-9a13-97d7a8218c2d')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:12:43.779234 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6efcedc4-a2, col_values=(('external_ids', {'iface-id': '6efcedc4-a28c-4133-a81b-8076ee6bde17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:30:4c', 'vm-uuid': 'a962fbe3-4ac8-47c6-9cee-24fe923fbc6c'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:12:43.780003 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:43.780994 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:12:43.792640 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:43.793406 np0000001475 nova-compute[98471]: INFO os_vif [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:30:4c,bridge_name='br-int',has_traffic_filtering=True,id=6efcedc4-a28c-4133-a81b-8076ee6bde17,network=Network(4d693079-1416-4ea0-a645-0e727595ef7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efcedc4-a2')
May 27 03:12:43.959270 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-547609385',display_name='tempest-VolumesActionsTest-instance-547609385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumesactionstest-instance-547609385',id=64,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:12:36Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='862ed9cb3549457788596bc9e00c830c',ramdisk_id='',reservation_id='r-m24ambyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-511303886',owner_user_name='tempest-VolumesActionsTest-511303886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:12:36Z,user_data=None,user_id='a0f48384818c4c0aa23d81044f9b46b8',uuid=d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6f7f47c-373e-4f60-898a-db8116d5fb48", "address": "fa:16:3e:8e:7b:94", "network": {"id": "068e39c9-6f62-4438-b419-57d3a831f21c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-329024817-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "862ed9cb3549457788596bc9e00c830c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f7f47c-37", "ovs_interfaceid": "b6f7f47c-373e-4f60-898a-db8116d5fb48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:12:43.959514 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Converting VIF {"id": "b6f7f47c-373e-4f60-898a-db8116d5fb48", "address": "fa:16:3e:8e:7b:94", "network": {"id": "068e39c9-6f62-4438-b419-57d3a831f21c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-329024817-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "862ed9cb3549457788596bc9e00c830c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6f7f47c-37", "ovs_interfaceid": "b6f7f47c-373e-4f60-898a-db8116d5fb48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:12:43.960050 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7b:94,bridge_name='br-int',has_traffic_filtering=True,id=b6f7f47c-373e-4f60-898a-db8116d5fb48,network=Network(068e39c9-6f62-4438-b419-57d3a831f21c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6f7f47c-37') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:12:43.960277 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7b:94,bridge_name='br-int',has_traffic_filtering=True,id=b6f7f47c-373e-4f60-898a-db8116d5fb48,network=Network(068e39c9-6f62-4438-b419-57d3a831f21c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6f7f47c-37') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:12:43.961612 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:43.961850 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6f7f47c-37, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:12:43.962728 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:43.963406 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:12:43.973694 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:43.974477 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:43.974631 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee9d4efd-f358-4301-9918-426a73a3041c) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:12:43.975127 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:43.975734 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:12:43.985227 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:43.987226 np0000001475 nova-compute[98471]: INFO os_vif [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7b:94,bridge_name='br-int',has_traffic_filtering=True,id=b6f7f47c-373e-4f60-898a-db8116d5fb48,network=Network(068e39c9-6f62-4438-b419-57d3a831f21c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6f7f47c-37')
May 27 03:12:43.987601 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Deleting instance files /opt/stack/data/nova/instances/d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c_del
May 27 03:12:43.988293 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Deletion of /opt/stack/data/nova/instances/d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c_del complete
May 27 03:12:43.997921 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-5fcc08d8-7c98-49bf-813a-7d7fad065cc6 tempest-TestShelveInstance-195465897 tempest-TestShelveInstance-195465897-project-member] Lock "e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.975s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:44.001563 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:12:44.001665 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:12:44.001776 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No VIF found with MAC fa:16:3e:bf:27:ab, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:12:44.002263 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Using config drive
May 27 03:12:44.494369 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Took 1.36 seconds to destroy the instance on the hypervisor.
May 27 03:12:44.494775 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:12:44.494923 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:12:44.495007 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:12:44.495189 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:44.507403 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:44.597776 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:44.630689 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Creating config drive at /opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk.config
May 27 03:12:44.634715 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2g7upip7 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:12:44.698914 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2g7upip7" returned: 0 in 0.064s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:12:45.101780 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:45.131674 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:45.132406 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:45.220579 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:45.279372 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:45.284815 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:45.295430 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:12:45.316707 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:12:45.316842 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:12:45.316916 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] No VIF found with MAC fa:16:3e:fe:30:4c, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:12:45.317348 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Using config drive
May 27 03:12:45.366363 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-67225f4e-afcd-4ab2-b299-cf287c732444 req-d7c46648-18ae-4b1f-98ee-365a16e57705 service nova] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Received event network-vif-unplugged-b6f7f47c-373e-4f60-898a-db8116d5fb48 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:45.366677 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-67225f4e-afcd-4ab2-b299-cf287c732444 req-d7c46648-18ae-4b1f-98ee-365a16e57705 service nova] Acquiring lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:45.366966 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-67225f4e-afcd-4ab2-b299-cf287c732444 req-d7c46648-18ae-4b1f-98ee-365a16e57705 service nova] Lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:45.367389 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-67225f4e-afcd-4ab2-b299-cf287c732444 req-d7c46648-18ae-4b1f-98ee-365a16e57705 service nova] Lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:45.367532 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-67225f4e-afcd-4ab2-b299-cf287c732444 req-d7c46648-18ae-4b1f-98ee-365a16e57705 service nova] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] No waiting events found dispatching network-vif-unplugged-b6f7f47c-373e-4f60-898a-db8116d5fb48 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:12:45.367654 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-67225f4e-afcd-4ab2-b299-cf287c732444 req-d7c46648-18ae-4b1f-98ee-365a16e57705 service nova] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Received event network-vif-unplugged-b6f7f47c-373e-4f60-898a-db8116d5fb48 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:12:45.367773 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-67225f4e-afcd-4ab2-b299-cf287c732444 req-d7c46648-18ae-4b1f-98ee-365a16e57705 service nova] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Received event network-vif-deleted-b6f7f47c-373e-4f60-898a-db8116d5fb48 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:45.410897 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2e3ee068-efbe-44e1-82e6-d5d500e1d672 req-c8c043af-4f7d-4aea-84cd-8abdeded0dd4 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Received event network-vif-plugged-49b32736-9a22-4125-9303-1b5e23d0e1f7 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:45.410897 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2e3ee068-efbe-44e1-82e6-d5d500e1d672 req-c8c043af-4f7d-4aea-84cd-8abdeded0dd4 service nova] Acquiring lock "b4509577-bb0c-4555-85c2-9978c9f06ff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:45.411093 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2e3ee068-efbe-44e1-82e6-d5d500e1d672 req-c8c043af-4f7d-4aea-84cd-8abdeded0dd4 service nova] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:45.412078 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2e3ee068-efbe-44e1-82e6-d5d500e1d672 req-c8c043af-4f7d-4aea-84cd-8abdeded0dd4 service nova] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:45.412255 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2e3ee068-efbe-44e1-82e6-d5d500e1d672 req-c8c043af-4f7d-4aea-84cd-8abdeded0dd4 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Processing event network-vif-plugged-49b32736-9a22-4125-9303-1b5e23d0e1f7 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:12:45.797529 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Took 1.30 seconds to deallocate network for instance.
May 27 03:12:45.816103 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851565.8156688, b4509577-bb0c-4555-85c2-9978c9f06ff6 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:12:45.816693 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:12:45.816944 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] VM Started (Lifecycle Event)
May 27 03:12:45.819602 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:12:45.823724 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:45.831494 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Instance spawned successfully.
May 27 03:12:45.831987 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:12:45.966380 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Creating config drive at /opt/stack/data/nova/instances/a962fbe3-4ac8-47c6-9cee-24fe923fbc6c/disk.config
May 27 03:12:45.969326 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a962fbe3-4ac8-47c6-9cee-24fe923fbc6c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpej7islh6 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:12:46.024906 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a962fbe3-4ac8-47c6-9cee-24fe923fbc6c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpej7islh6" returned: 0 in 0.055s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:12:46.307364 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:46.307793 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:46.326833 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:12:46.333490 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:12:46.347549 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:12:46.347673 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:12:46.347991 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:12:46.348208 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:12:46.348510 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:12:46.348841 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:12:46.414805 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:46.461869 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:46.484874 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:46.493323 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:46.556570 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:46.582508 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:46.614798 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:12:46.615058 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:12:46.809426 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:46.811322 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:46.817539 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:46.836236 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:46.837558 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:12:46.837828 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851566.837649, b4509577-bb0c-4555-85c2-9978c9f06ff6 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:12:46.837930 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] VM Paused (Lifecycle Event)
May 27 03:12:46.865877 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Took 6.72 seconds to spawn the instance on the hypervisor.
May 27 03:12:46.865877 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:12:47.118759 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:12:47.340141 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:12:47.342147 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851567.3419394, b4509577-bb0c-4555-85c2-9978c9f06ff6 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:12:47.342247 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] VM Resumed (Lifecycle Event)
May 27 03:12:47.384857 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Took 12.43 seconds to build instance.
May 27 03:12:47.480321 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-703173fe-4661-4bb0-a8f3-6328e8942ddb req-43306e00-0bf2-46bc-80c0-20dece2174c7 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Received event network-vif-plugged-49b32736-9a22-4125-9303-1b5e23d0e1f7 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:47.480637 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-703173fe-4661-4bb0-a8f3-6328e8942ddb req-43306e00-0bf2-46bc-80c0-20dece2174c7 service nova] Acquiring lock "b4509577-bb0c-4555-85c2-9978c9f06ff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:47.480775 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-703173fe-4661-4bb0-a8f3-6328e8942ddb req-43306e00-0bf2-46bc-80c0-20dece2174c7 service nova] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:47.480891 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-703173fe-4661-4bb0-a8f3-6328e8942ddb req-43306e00-0bf2-46bc-80c0-20dece2174c7 service nova] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:47.481042 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-703173fe-4661-4bb0-a8f3-6328e8942ddb req-43306e00-0bf2-46bc-80c0-20dece2174c7 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] No waiting events found dispatching network-vif-plugged-49b32736-9a22-4125-9303-1b5e23d0e1f7 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:12:47.481424 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-703173fe-4661-4bb0-a8f3-6328e8942ddb req-43306e00-0bf2-46bc-80c0-20dece2174c7 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Received unexpected event network-vif-plugged-49b32736-9a22-4125-9303-1b5e23d0e1f7 for instance with vm_state active and task_state None.
May 27 03:12:47.481557 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-703173fe-4661-4bb0-a8f3-6328e8942ddb req-43306e00-0bf2-46bc-80c0-20dece2174c7 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Received event network-vif-plugged-6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:47.481708 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-703173fe-4661-4bb0-a8f3-6328e8942ddb req-43306e00-0bf2-46bc-80c0-20dece2174c7 service nova] Acquiring lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:47.481892 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-703173fe-4661-4bb0-a8f3-6328e8942ddb req-43306e00-0bf2-46bc-80c0-20dece2174c7 service nova] Lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:47.481989 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-703173fe-4661-4bb0-a8f3-6328e8942ddb req-43306e00-0bf2-46bc-80c0-20dece2174c7 service nova] Lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:47.482181 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-703173fe-4661-4bb0-a8f3-6328e8942ddb req-43306e00-0bf2-46bc-80c0-20dece2174c7 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Processing event network-vif-plugged-6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:12:47.482350 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-703173fe-4661-4bb0-a8f3-6328e8942ddb req-43306e00-0bf2-46bc-80c0-20dece2174c7 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Received event network-vif-plugged-6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:47.482428 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-703173fe-4661-4bb0-a8f3-6328e8942ddb req-43306e00-0bf2-46bc-80c0-20dece2174c7 service nova] Acquiring lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:12:47.482583 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-703173fe-4661-4bb0-a8f3-6328e8942ddb req-43306e00-0bf2-46bc-80c0-20dece2174c7 service nova] Lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:12:47.482697 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-703173fe-4661-4bb0-a8f3-6328e8942ddb req-43306e00-0bf2-46bc-80c0-20dece2174c7 service nova] Lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:47.482838 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-703173fe-4661-4bb0-a8f3-6328e8942ddb req-43306e00-0bf2-46bc-80c0-20dece2174c7 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] No waiting events found dispatching network-vif-plugged-6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:12:47.483156 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:12:47.483617 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-703173fe-4661-4bb0-a8f3-6328e8942ddb req-43306e00-0bf2-46bc-80c0-20dece2174c7 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Received unexpected event network-vif-plugged-6efcedc4-a28c-4133-a81b-8076ee6bde17 for instance with vm_state building and task_state spawning.
May 27 03:12:47.486002 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:12:47.489034 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Instance spawned successfully.
May 27 03:12:47.489346 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:12:47.627781 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.320s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:47.708464 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Deleted allocations for instance d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c
May 27 03:12:47.844380 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:12:47.846596 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:12:47.885614 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.937s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:47.996665 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:12:47.996665 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:12:47.997894 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:12:47.997894 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:12:47.997894 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:12:47.997894 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:12:48.244910 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:12:48.246582 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:12:48.246582 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:12:48.247403 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.95 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:12:48.350195 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851568.3490837, a962fbe3-4ac8-47c6-9cee-24fe923fbc6c => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:12:48.350195 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] VM Started (Lifecycle Event)
May 27 03:12:48.364513 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:48.502978 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Took 9.00 seconds to spawn the instance on the hypervisor.
May 27 03:12:48.503154 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:12:48.718500 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d2f92080-b7ab-4d2c-bf53-2152918debce tempest-VolumesActionsTest-511303886 tempest-VolumesActionsTest-511303886-project-member] Lock "d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.087s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:48.860236 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:12:48.864437 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:12:48.976655 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:49.017980 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Took 16.09 seconds to build instance.
May 27 03:12:49.371358 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851569.3711, a962fbe3-4ac8-47c6-9cee-24fe923fbc6c => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:12:49.371706 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] VM Paused (Lifecycle Event)
May 27 03:12:49.522814 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.604s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:12:49.573844 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b889576e-8621-489f-a2d3-672408ad763d req-3b6f73b0-5517-48d3-9728-91120b009b99 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Received event network-changed-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:49.574244 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b889576e-8621-489f-a2d3-672408ad763d req-3b6f73b0-5517-48d3-9728-91120b009b99 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Refreshing instance network info cache due to event network-changed-800cb186-9c81-4bac-a72a-6a6fd06ce1f4. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:12:49.574391 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b889576e-8621-489f-a2d3-672408ad763d req-3b6f73b0-5517-48d3-9728-91120b009b99 service nova] Acquiring lock "refresh_cache-79df2202-e3ff-44de-8dee-d13a3a8304d5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:12:49.574506 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b889576e-8621-489f-a2d3-672408ad763d req-3b6f73b0-5517-48d3-9728-91120b009b99 service nova] Acquired lock "refresh_cache-79df2202-e3ff-44de-8dee-d13a3a8304d5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:12:49.574813 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-b889576e-8621-489f-a2d3-672408ad763d req-3b6f73b0-5517-48d3-9728-91120b009b99 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Refreshing network info cache for port 800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:12:49.876298 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:12:49.878165 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851569.877932, a962fbe3-4ac8-47c6-9cee-24fe923fbc6c => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:12:49.878309 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] VM Resumed (Lifecycle Event)
May 27 03:12:50.077129 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-b889576e-8621-489f-a2d3-672408ad763d req-3b6f73b0-5517-48d3-9728-91120b009b99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:50.201645 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:12:50.202120 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.99 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:12:50.380883 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:12:50.384690 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:12:50.406424 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-b889576e-8621-489f-a2d3-672408ad763d req-3b6f73b0-5517-48d3-9728-91120b009b99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:50.556727 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-b889576e-8621-489f-a2d3-672408ad763d req-3b6f73b0-5517-48d3-9728-91120b009b99 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Updated VIF entry in instance network info cache for port 800cb186-9c81-4bac-a72a-6a6fd06ce1f4. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:12:50.557874 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-b889576e-8621-489f-a2d3-672408ad763d req-3b6f73b0-5517-48d3-9728-91120b009b99 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Updating instance_info_cache with network_info: [{"id": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "address": "fa:16:3e:66:18:6f", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap800cb186-9c", "ovs_interfaceid": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:12:51.062334 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b889576e-8621-489f-a2d3-672408ad763d req-3b6f73b0-5517-48d3-9728-91120b009b99 service nova] Releasing lock "refresh_cache-79df2202-e3ff-44de-8dee-d13a3a8304d5" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:12:51.062535 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b889576e-8621-489f-a2d3-672408ad763d req-3b6f73b0-5517-48d3-9728-91120b009b99 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Received event network-changed-49b32736-9a22-4125-9303-1b5e23d0e1f7 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:51.062652 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b889576e-8621-489f-a2d3-672408ad763d req-3b6f73b0-5517-48d3-9728-91120b009b99 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Refreshing instance network info cache due to event network-changed-49b32736-9a22-4125-9303-1b5e23d0e1f7. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:12:51.062810 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b889576e-8621-489f-a2d3-672408ad763d req-3b6f73b0-5517-48d3-9728-91120b009b99 service nova] Acquiring lock "refresh_cache-b4509577-bb0c-4555-85c2-9978c9f06ff6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:12:51.062965 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b889576e-8621-489f-a2d3-672408ad763d req-3b6f73b0-5517-48d3-9728-91120b009b99 service nova] Acquired lock "refresh_cache-b4509577-bb0c-4555-85c2-9978c9f06ff6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:12:51.063010 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-b889576e-8621-489f-a2d3-672408ad763d req-3b6f73b0-5517-48d3-9728-91120b009b99 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Refreshing network info cache for port 49b32736-9a22-4125-9303-1b5e23d0e1f7 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:12:51.559437 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:51.564834 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-b889576e-8621-489f-a2d3-672408ad763d req-3b6f73b0-5517-48d3-9728-91120b009b99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:51.644450 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Received event network-changed-6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:51.646182 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Refreshing instance network info cache due to event network-changed-6efcedc4-a28c-4133-a81b-8076ee6bde17. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:12:51.646397 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] Acquiring lock "refresh_cache-a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:12:51.646498 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] Acquired lock "refresh_cache-a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:12:51.646630 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Refreshing network info cache for port 6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:12:51.942749 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-b889576e-8621-489f-a2d3-672408ad763d req-3b6f73b0-5517-48d3-9728-91120b009b99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:52.125125 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-b889576e-8621-489f-a2d3-672408ad763d req-3b6f73b0-5517-48d3-9728-91120b009b99 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Updated VIF entry in instance network info cache for port 49b32736-9a22-4125-9303-1b5e23d0e1f7. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:12:52.125664 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-b889576e-8621-489f-a2d3-672408ad763d req-3b6f73b0-5517-48d3-9728-91120b009b99 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Updating instance_info_cache with network_info: [{"id": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "address": "fa:16:3e:bf:27:ab", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b32736-9a", "ovs_interfaceid": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:12:52.149430 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:52.478960 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:52.622809 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Updated VIF entry in instance network info cache for port 6efcedc4-a28c-4133-a81b-8076ee6bde17. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:12:52.623229 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Updating instance_info_cache with network_info: [{"id": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "address": "fa:16:3e:fe:30:4c", "network": {"id": "4d693079-1416-4ea0-a645-0e727595ef7e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1303315207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5baf44af64da4cc89825082881a2f01f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efcedc4-a2", "ovs_interfaceid": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:12:52.628106 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b889576e-8621-489f-a2d3-672408ad763d req-3b6f73b0-5517-48d3-9728-91120b009b99 service nova] Releasing lock "refresh_cache-b4509577-bb0c-4555-85c2-9978c9f06ff6" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:12:52.759945 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:52.860125 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0003761389998544473 future=<Future at 0x7557247b9df0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:12:52.860353 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:12:52.860353 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=5.594858483999815 future=<Future at 0x7557247ba690 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:12:52.860353 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=5.594780960999742 future=<Future at 0x7557247ba690 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:12:52.861246 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Emitting event <LifecycleEvent: 1779851557.8596363, e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:12:52.861506 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] VM Stopped (Lifecycle Event)
May 27 03:12:53.124728 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] Releasing lock "refresh_cache-a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:12:53.124951 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Received event network-changed-6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:53.125076 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Refreshing instance network info cache due to event network-changed-6efcedc4-a28c-4133-a81b-8076ee6bde17. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:12:53.125220 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] Acquiring lock "refresh_cache-a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:12:53.125334 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] Acquired lock "refresh_cache-a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:12:53.125437 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Refreshing network info cache for port 6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:12:53.196370 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:12:53.196715 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:12:53.199525 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:12:53.199830 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:12:53.200082 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:12:53.200397 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:12:53.366014 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-315c6e76-b794-4240-8cc8-4daac560fbf6 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: e09d6c7b-e928-43dc-83d0-ba4ba25dd1aa] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:12:53.627345 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:53.951362 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:53.979409 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:54.110544 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Updated VIF entry in instance network info cache for port 6efcedc4-a28c-4133-a81b-8076ee6bde17. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:12:54.110544 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Updating instance_info_cache with network_info: [{"id": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "address": "fa:16:3e:fe:30:4c", "network": {"id": "4d693079-1416-4ea0-a645-0e727595ef7e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1303315207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5baf44af64da4cc89825082881a2f01f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efcedc4-a2", "ovs_interfaceid": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:12:54.614042 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] Releasing lock "refresh_cache-a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:12:54.614242 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Received event network-changed-6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:12:54.614367 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Refreshing instance network info cache due to event network-changed-6efcedc4-a28c-4133-a81b-8076ee6bde17. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:12:54.614633 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] Acquiring lock "refresh_cache-a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:12:54.614633 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] Acquired lock "refresh_cache-a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:12:54.614807 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Refreshing network info cache for port 6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:12:55.067931 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:55.116809 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:55.470482 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:12:55.632616 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Updated VIF entry in instance network info cache for port 6efcedc4-a28c-4133-a81b-8076ee6bde17. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:12:55.633012 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Updating instance_info_cache with network_info: [{"id": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "address": "fa:16:3e:fe:30:4c", "network": {"id": "4d693079-1416-4ea0-a645-0e727595ef7e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1303315207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5baf44af64da4cc89825082881a2f01f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efcedc4-a2", "ovs_interfaceid": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:12:56.136825 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-28e7ebeb-570d-4b50-a16c-51201f292f6c req-c4d6356c-f2b1-4914-96af-2212f74af1d8 service nova] Releasing lock "refresh_cache-a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:12:56.196717 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:12:56.198791 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:12:56.567159 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:57.807784 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:58.456277 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0010939590001726174 future=<Future at 0x7557247ba690 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:12:58.456382 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:12:58.456666 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Emitting event <LifecycleEvent: 1779851563.4550679, d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:12:58.456819 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] VM Stopped (Lifecycle Event)
May 27 03:12:58.959433 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: d37fc2e4-a4e1-49c2-ac17-e2d98d8aa73c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:12:58.981187 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:12:59.840021 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:01.200617 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:13:01.570871 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:02.200057 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:13:02.704853 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:02.705264 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:02.705318 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:02.705563 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:13:02.733242 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:02.733449 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:03.186199 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:03.235420 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:13:03.730352 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:13:03.798030 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:03.798317 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:03.803048 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:13:03.803245 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Claim successful on node np0000001475
May 27 03:13:03.822537 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:13:03.822951 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:13:03.917234 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:13:03.922965 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:13:03.983347 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:04.026147 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:13:04.026628 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:13:04.124373 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:13:04.124790 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:13:04.124954 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-4 (vdc) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:13:04.125099 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-5 (vdd) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:13:04.129436 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:13:04.131198 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:13:04.132222 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:13:04.182439 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:13:04.182842 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=12918MB free_disk=72.7313003540039GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:13:04.183031 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:05.003204 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:05.059833 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:13:05.060059 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:13:05.562584 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:13:06.069109 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.271s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:06.069826 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.886s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:06.070424 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:13:06.571057 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:06.576476 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:13:06.577058 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:13:06.581276 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:06.581657 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:06.695256 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8eeaf68cfb534238bfe879dd6e8f858f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0011da7449e7948bf2c8a41955f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:13:07.065026 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Successfully created port: 6e51e7a7-91a2-45f4-9726-f73ab6548bc8 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:13:07.084567 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:13:07.131625 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:13:07.131790 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance a962fbe3-4ac8-47c6-9cee-24fe923fbc6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:13:07.131902 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance b4509577-bb0c-4555-85c2-9978c9f06ff6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:13:07.132002 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 1ed98a24-0f9c-402b-b08e-17c3ced297ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:13:07.132166 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:13:07.132572 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:13:04 up 44 min,  2 users,  load average: 4.43, 6.57, 5.43\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '4', 'num_os_type_None': '4', 'num_proj_256f2c4e067c46a3a4ea5e9d934b1d4b': '2', 'io_workload': '1', 'num_proj_5baf44af64da4cc89825082881a2f01f': '1', 'num_vm_building': '1', 'num_proj_bf4b0011da7449e7948bf2c8a41955f5': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:13:07.341235 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:13:07.341443 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:13:07.502520 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Successfully updated port: 6e51e7a7-91a2-45f4-9726-f73ab6548bc8 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:13:07.557245 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ef505a62-8993-44b6-8e11-41938f397afe req-d24e5b42-0dbf-4050-adaf-7b64ff3164d3 service nova] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Received event network-changed-6e51e7a7-91a2-45f4-9726-f73ab6548bc8 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:13:07.557623 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ef505a62-8993-44b6-8e11-41938f397afe req-d24e5b42-0dbf-4050-adaf-7b64ff3164d3 service nova] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Refreshing instance network info cache due to event network-changed-6e51e7a7-91a2-45f4-9726-f73ab6548bc8. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:13:07.557833 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ef505a62-8993-44b6-8e11-41938f397afe req-d24e5b42-0dbf-4050-adaf-7b64ff3164d3 service nova] Acquiring lock "refresh_cache-1ed98a24-0f9c-402b-b08e-17c3ced297ce" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:13:07.557945 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ef505a62-8993-44b6-8e11-41938f397afe req-d24e5b42-0dbf-4050-adaf-7b64ff3164d3 service nova] Acquired lock "refresh_cache-1ed98a24-0f9c-402b-b08e-17c3ced297ce" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:13:07.558056 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ef505a62-8993-44b6-8e11-41938f397afe req-d24e5b42-0dbf-4050-adaf-7b64ff3164d3 service nova] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Refreshing network info cache for port 6e51e7a7-91a2-45f4-9726-f73ab6548bc8 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:13:07.589816 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:13:07.844261 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:13:08.005182 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "refresh_cache-1ed98a24-0f9c-402b-b08e-17c3ced297ce" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:13:08.060002 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-ef505a62-8993-44b6-8e11-41938f397afe req-d24e5b42-0dbf-4050-adaf-7b64ff3164d3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:08.094252 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Booting with volume 160850b8-bef4-4786-ac9b-41f02aba007d at /dev/vda
May 27 03:13:08.120758 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ef505a62-8993-44b6-8e11-41938f397afe req-d24e5b42-0dbf-4050-adaf-7b64ff3164d3 service nova] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:13:08.130919 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:13:08.142031 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:13:08.164370 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:13:08.211088 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:13:08.211336 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:13:08.219252 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:13:08.221059 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe66:186f', 'fe80::f9:d2ff:fead:2ab6', 'fe80::fc16:3eff:febf:27ab', 'fe80::fc16:3eff:fefe:304c', 'fe80::b09a:56ff:feca:77b3'] 
May 27 03:13:08.221181 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:13:08.221328 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:13:08.221550 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:13:08.221758 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Updating existing volume attachment record: c7e2886e-3dbb-40d9-b677-be55775201d4 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:13:08.255826 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ef505a62-8993-44b6-8e11-41938f397afe req-d24e5b42-0dbf-4050-adaf-7b64ff3164d3 service nova] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:13:08.356900 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:13:08.357123 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.288s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:08.357517 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:13:08.758331 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ef505a62-8993-44b6-8e11-41938f397afe req-d24e5b42-0dbf-4050-adaf-7b64ff3164d3 service nova] Releasing lock "refresh_cache-1ed98a24-0f9c-402b-b08e-17c3ced297ce" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:13:08.758861 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquired lock "refresh_cache-1ed98a24-0f9c-402b-b08e-17c3ced297ce" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:13:08.759013 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:13:08.987187 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:09.333432 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:13:09.505550 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:09.635904 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Updating instance_info_cache with network_info: [{"id": "6e51e7a7-91a2-45f4-9726-f73ab6548bc8", "address": "fa:16:3e:9a:d5:e4", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e51e7a7-91", "ovs_interfaceid": "6e51e7a7-91a2-45f4-9726-f73ab6548bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:13:10.140942 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Releasing lock "refresh_cache-1ed98a24-0f9c-402b-b08e-17c3ced297ce" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:13:10.141345 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Instance network_info: |[{"id": "6e51e7a7-91a2-45f4-9726-f73ab6548bc8", "address": "fa:16:3e:9a:d5:e4", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e51e7a7-91", "ovs_interfaceid": "6e51e7a7-91a2-45f4-9726-f73ab6548bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:13:10.315212 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:13:10.316264 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:13:10.316504 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Creating image(s)
May 27 03:13:10.316727 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:13:10.316877 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Ensure instance console log exists: /opt/stack/data/nova/instances/1ed98a24-0f9c-402b-b08e-17c3ced297ce/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:13:10.317078 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:10.317315 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:10.317448 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:10.317948 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Start _get_guest_xml network_info=[{"id": "6e51e7a7-91a2-45f4-9726-f73ab6548bc8", "address": "fa:16:3e:9a:d5:e4", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e51e7a7-91", "ovs_interfaceid": "6e51e7a7-91a2-45f4-9726-f73ab6548bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '160850b8-bef4-4786-ac9b-41f02aba007d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1ed98a24-0f9c-402b-b08e-17c3ced297ce', 'attached_at': '', 'detached_at': '', 'volume_id': '160850b8-bef4-4786-ac9b-41f02aba007d', 'serial': '160850b8-bef4-4786-ac9b-41f02aba007d'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'c7e2886e-3dbb-40d9-b677-be55775201d4', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:13:10.322174 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:13:10.323565 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1055934182', uuid='1ed98a24-0f9c-402b-b08e-17c3ced297ce'), owner=OwnerMeta(userid='8eeaf68cfb534238bfe879dd6e8f858f', username='tempest-TestVolumeBootPattern-360350731-project-member', projectid='bf4b0011da7449e7948bf2c8a41955f5', projectname='tempest-TestVolumeBootPattern-360350731'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6e51e7a7-91a2-45f4-9726-f73ab6548bc8", "address": "fa:16:3e:9a:d5:e4", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e51e7a7-91", "ovs_interfaceid": "6e51e7a7-91a2-45f4-9726-f73ab6548bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851590.3231304) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:13:10.325677 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:13:10.326077 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:13:10.327196 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:13:10.327432 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:13:10.328598 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:13:10.328993 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:13:10.329180 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:13:10.329334 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:13:10.329521 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:13:10.329655 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:13:10.329820 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:13:10.330031 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:13:10.330136 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:13:10.330298 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:13:10.330450 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:13:10.330707 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:13:10.346099 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:13:10.346673 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '160850b8-bef4-4786-ac9b-41f02aba007d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:13:10.346673 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:13:10.347084 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:13:10.347362 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '160850b8-bef4-4786-ac9b-41f02aba007d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:13:10.359062 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:13:10.359750 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:13:10.360396 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:13:10.360803 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:13:10.361309 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:13:10.361397 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:13:10.373315 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:13:10.373315 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:10.379322 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:13:10.379322 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:10.386461 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d] added
May 27 03:13:10.386461 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:13:10.386461 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:13:10.386461 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:13:10.386461 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:13:10.386461 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:13:10.386461 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:10.386779 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:13:10.386957 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:13:10.387172 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:13:10.390290 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d] added
May 27 03:13:10.390290 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:13:10.390290 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:13:10.390290 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:13:10.390290 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:13:10.390290 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:13:10.390290 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:10.390524 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:13:10.390681 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0292(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:13:10.390858 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:13:11.387696 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:13:11.391300 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:13:11.405455 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:13:11.405455 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:13:11.408316 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:13:11.408316 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:11.420444 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:11.422771 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:11.441920 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:11.441920 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:11.441920 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:11.441920 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:11.441920 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:11.441920 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:11.441920 np0000001475 nova-compute[98471]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:13:11.441920 np0000001475 nova-compute[98471]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:13:11.441920 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:13:11.441920 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:11.441920 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:11.441920 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:11.441920 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:11.441920 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:11.441920 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:11.441920 np0000001475 nova-compute[98471]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:13:11.441920 np0000001475 nova-compute[98471]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:13:11.441920 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:13:11.447514 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:11.447514 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:11.447514 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:11.447514 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:11.447514 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:11.447514 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:11.447514 np0000001475 nova-compute[98471]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:13:11.447514 np0000001475 nova-compute[98471]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:13:11.447514 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:13:11.447716 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:11.447716 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:11.447716 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:11.447716 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:11.447716 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:11.447716 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:11.447716 np0000001475 nova-compute[98471]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:13:11.447716 np0000001475 nova-compute[98471]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:13:11.447716 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:13:11.490373 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d, portal: 192.168.50.100,3260]
May 27 03:13:11.490373 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d, portal: 192.168.50.100,3260] successful.
May 27 03:13:11.490373 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:11.496668 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d, portal: 192.168.40.100,3260]
May 27 03:13:11.496668 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d, portal: 192.168.40.100,3260] successful.
May 27 03:13:11.496668 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:11.501310 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:11.509424 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d (non-flash)
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d (non-flash)
May 27 03:13:11.529716 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d (non-flash)
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d (non-flash)
May 27 03:13:11.529716 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('9', '-', '-', 0) found on session 172 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:13:11.529716 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:13:11.531240 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:11.531240 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:11.531240 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:11.531240 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:11.531240 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:11.531240 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:11.531240 np0000001475 nova-compute[98471]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:13:11.531240 np0000001475 nova-compute[98471]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:13:11.531240 np0000001475 nova-compute[98471]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d (non-flash)
May 27 03:13:11.531240 np0000001475 nova-compute[98471]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d (non-flash)
May 27 03:13:11.531240 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:13:11.531548 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:11.531548 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:11.531548 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:11.531548 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:11.531548 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:11.531548 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:11.531548 np0000001475 nova-compute[98471]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:13:11.531548 np0000001475 nova-compute[98471]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:13:11.531548 np0000001475 nova-compute[98471]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d (non-flash)
May 27 03:13:11.531548 np0000001475 nova-compute[98471]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d (non-flash)
May 27 03:13:11.531548 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:13:11.531839 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:13:11.531934 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:13:11.533196 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('16', '-', '-', 0) found on session 173 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:13:11.533334 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:13:11.546664 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 172 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:13:11.547979 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '160850b8-bef4-4786-ac9b-41f02aba007d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:13:11.552309 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 173 and hctl ['16', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:13:11.583121 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:12.552879 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 173 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:13:12.553391 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '160850b8-bef4-4786-ac9b-41f02aba007d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:13:13.379380 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Found WWN 3300000008a3eab92 for multipath device dm-6 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:13:13.379612 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:13:13.381568 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '3300000008a3eab92', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '3300000008a3eab92'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:13:13.381681 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008a3eab92', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '3300000008a3eab92'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:13:13.424605 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '160850b8-bef4-4786-ac9b-41f02aba007d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '1ed98a24-0f9c-402b-b08e-17c3ced297ce', 'attached_at': '', 'detached_at': '', 'volume_id': '160850b8-bef4-4786-ac9b-41f02aba007d', 'serial': '160850b8-bef4-4786-ac9b-41f02aba007d'} {{(pid=98471) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 03:13:13.425305 np0000001475 nova-compute[98471]: WARNING stevedore.named [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 03:13:13.425528 np0000001475 nova-compute[98471]: WARNING castellan.key_manager [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:13:13.425690 np0000001475 nova-compute[98471]: WARNING nova.keymgr.conf_key_mgr [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:13:13.446721 np0000001475 nova-compute[98471]: WARNING os_brick.encryptors.luks [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 27 03:13:13.447059 np0000001475 nova-compute[98471]: WARNING stevedore.named [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 03:13:13.447242 np0000001475 nova-compute[98471]: WARNING castellan.key_manager [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:13:13.447370 np0000001475 nova-compute[98471]: WARNING nova.keymgr.conf_key_mgr [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:13:13.447851 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x755704771160>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '160850b8-bef4-4786-ac9b-41f02aba007d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '1ed98a24-0f9c-402b-b08e-17c3ced297ce', 'attached_at': '', 'detached_at': '', 'volume_id': '160850b8-bef4-4786-ac9b-41f02aba007d', 'serial': '160850b8-bef4-4786-ac9b-41f02aba007d'} {{(pid=98471) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 27 03:13:13.447997 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors.luks [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] formatting encrypted volume /dev/dm-6 {{(pid=98471) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 27 03:13:13.989610 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:16.596358 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:17.522848 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Secret XML: <secret ephemeral="no" private="no">
May 27 03:13:17.522848 np0000001475 nova-compute[98471]:   <usage type="volume">
May 27 03:13:17.522848 np0000001475 nova-compute[98471]:     <volume>160850b8-bef4-4786-ac9b-41f02aba007d</volume>
May 27 03:13:17.522848 np0000001475 nova-compute[98471]:   </usage>
May 27 03:13:17.522848 np0000001475 nova-compute[98471]: </secret>
May 27 03:13:17.522848 np0000001475 nova-compute[98471]:  {{(pid=98471) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 27 03:13:18.035810 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1055934182',display_name='tempest-TestVolumeBootPattern-server-1055934182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-1055934182',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-edt2ghwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:13:08Z,user_data=None,user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=1ed98a24-0f9c-402b-b08e-17c3ced297ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e51e7a7-91a2-45f4-9726-f73ab6548bc8", "address": "fa:16:3e:9a:d5:e4", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e51e7a7-91", "ovs_interfaceid": "6e51e7a7-91a2-45f4-9726-f73ab6548bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:13:18.036393 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "6e51e7a7-91a2-45f4-9726-f73ab6548bc8", "address": "fa:16:3e:9a:d5:e4", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e51e7a7-91", "ovs_interfaceid": "6e51e7a7-91a2-45f4-9726-f73ab6548bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:13:18.036546 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d5:e4,bridge_name='br-int',has_traffic_filtering=True,id=6e51e7a7-91a2-45f4-9726-f73ab6548bc8,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e51e7a7-91') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:13:18.037422 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ed98a24-0f9c-402b-b08e-17c3ced297ce {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:13:18.540725 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] End _get_guest_xml xml=<domain type="qemu">
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:   <uuid>1ed98a24-0f9c-402b-b08e-17c3ced297ce</uuid>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:   <name>instance-00000043</name>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestVolumeBootPattern-server-1055934182</nova:name>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:13:10</nova:creationTime>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:         <nova:properties/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:         <nova:user uuid="8eeaf68cfb534238bfe879dd6e8f858f">tempest-TestVolumeBootPattern-360350731-project-member</nova:user>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:         <nova:project uuid="bf4b0011da7449e7948bf2c8a41955f5">tempest-TestVolumeBootPattern-360350731</nova:project>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:         <nova:port uuid="6e51e7a7-91a2-45f4-9726-f73ab6548bc8">
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     <system>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <entry name="serial">1ed98a24-0f9c-402b-b08e-17c3ced297ce</entry>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <entry name="uuid">1ed98a24-0f9c-402b-b08e-17c3ced297ce</entry>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     </system>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:   <os>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:   </os>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:   <features>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:   </features>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:   <devices>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/1ed98a24-0f9c-402b-b08e-17c3ced297ce/disk.config"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     </disk>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <alias name="ua-160850b8-bef4-4786-ac9b-41f02aba007d"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <serial>160850b8-bef4-4786-ac9b-41f02aba007d</serial>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <encryption format="luks">
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:         <secret type="passphrase" uuid="81f988dc-14fb-47fa-822a-ca69f71fb7cf"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       </encryption>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     </disk>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:9a:d5:e4"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <target dev="tap6e51e7a7-91"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     </interface>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/1ed98a24-0f9c-402b-b08e-17c3ced297ce/console.log" append="off"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     </serial>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     <video>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     </video>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     </rng>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:   </devices>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]: </domain>
May 27 03:13:18.540725 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:13:18.543714 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Preparing to wait for external event network-vif-plugged-6e51e7a7-91a2-45f4-9726-f73ab6548bc8 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:13:18.543714 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:18.543714 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:18.543714 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:18.543714 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1055934182',display_name='tempest-TestVolumeBootPattern-server-1055934182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-1055934182',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-edt2ghwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:13:08Z,user_data=None,user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=1ed98a24-0f9c-402b-b08e-17c3ced297ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e51e7a7-91a2-45f4-9726-f73ab6548bc8", "address": "fa:16:3e:9a:d5:e4", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e51e7a7-91", "ovs_interfaceid": "6e51e7a7-91a2-45f4-9726-f73ab6548bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:13:18.543714 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "6e51e7a7-91a2-45f4-9726-f73ab6548bc8", "address": "fa:16:3e:9a:d5:e4", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e51e7a7-91", "ovs_interfaceid": "6e51e7a7-91a2-45f4-9726-f73ab6548bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:13:18.543714 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d5:e4,bridge_name='br-int',has_traffic_filtering=True,id=6e51e7a7-91a2-45f4-9726-f73ab6548bc8,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e51e7a7-91') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:13:18.543714 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d5:e4,bridge_name='br-int',has_traffic_filtering=True,id=6e51e7a7-91a2-45f4-9726-f73ab6548bc8,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e51e7a7-91') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:13:18.544231 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:18.544273 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:13:18.544561 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:13:18.545286 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:18.545471 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03843d99-f8d2-5e65-b556-4eaec4295473', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:13:18.546309 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:18.547223 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:13:18.549256 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:18.549449 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e51e7a7-91, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:13:18.549847 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e51e7a7-91, col_values=(('qos', UUID('ac6ecc27-c5aa-4286-99b8-b2faa23a4701')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:13:18.550049 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e51e7a7-91, col_values=(('external_ids', {'iface-id': '6e51e7a7-91a2-45f4-9726-f73ab6548bc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:d5:e4', 'vm-uuid': '1ed98a24-0f9c-402b-b08e-17c3ced297ce'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:13:18.550887 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:18.552507 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:13:18.557133 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:18.558188 np0000001475 nova-compute[98471]: INFO os_vif [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d5:e4,bridge_name='br-int',has_traffic_filtering=True,id=6e51e7a7-91a2-45f4-9726-f73ab6548bc8,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e51e7a7-91')
May 27 03:13:19.796237 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:20.036699 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-52e4aa7a-8d3b-410b-803d-a47e5a43d21f req-1f13a91b-56dc-4bb5-84ab-655c8871a2cc service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Received event network-changed-6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:13:20.036699 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-52e4aa7a-8d3b-410b-803d-a47e5a43d21f req-1f13a91b-56dc-4bb5-84ab-655c8871a2cc service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Refreshing instance network info cache due to event network-changed-6efcedc4-a28c-4133-a81b-8076ee6bde17. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:13:20.036699 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-52e4aa7a-8d3b-410b-803d-a47e5a43d21f req-1f13a91b-56dc-4bb5-84ab-655c8871a2cc service nova] Acquiring lock "refresh_cache-a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:13:20.036699 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-52e4aa7a-8d3b-410b-803d-a47e5a43d21f req-1f13a91b-56dc-4bb5-84ab-655c8871a2cc service nova] Acquired lock "refresh_cache-a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:13:20.036699 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-52e4aa7a-8d3b-410b-803d-a47e5a43d21f req-1f13a91b-56dc-4bb5-84ab-655c8871a2cc service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Refreshing network info cache for port 6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:13:20.076821 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:13:20.077008 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:13:20.077008 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No VIF found with MAC fa:16:3e:9a:d5:e4, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:13:20.077415 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Using config drive
May 27 03:13:20.492622 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Acquiring lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:20.492866 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:20.493095 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Acquiring lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:20.493261 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:20.493401 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:20.496167 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Terminating instance
May 27 03:13:20.538826 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-52e4aa7a-8d3b-410b-803d-a47e5a43d21f req-1f13a91b-56dc-4bb5-84ab-655c8871a2cc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:20.585210 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:20.726999 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Creating config drive at /opt/stack/data/nova/instances/1ed98a24-0f9c-402b-b08e-17c3ced297ce/disk.config
May 27 03:13:20.730365 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1ed98a24-0f9c-402b-b08e-17c3ced297ce/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4h283wwv {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:13:20.803566 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1ed98a24-0f9c-402b-b08e-17c3ced297ce/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4h283wwv" returned: 0 in 0.073s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:13:20.908949 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-52e4aa7a-8d3b-410b-803d-a47e5a43d21f req-1f13a91b-56dc-4bb5-84ab-655c8871a2cc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:20.999972 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:13:21.028948 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:21.032863 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:21.057422 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:21.062627 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:21.096771 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:21.147249 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-52e4aa7a-8d3b-410b-803d-a47e5a43d21f req-1f13a91b-56dc-4bb5-84ab-655c8871a2cc service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Updated VIF entry in instance network info cache for port 6efcedc4-a28c-4133-a81b-8076ee6bde17. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:13:21.147646 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-52e4aa7a-8d3b-410b-803d-a47e5a43d21f req-1f13a91b-56dc-4bb5-84ab-655c8871a2cc service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Updating instance_info_cache with network_info: [{"id": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "address": "fa:16:3e:fe:30:4c", "network": {"id": "4d693079-1416-4ea0-a645-0e727595ef7e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1303315207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5baf44af64da4cc89825082881a2f01f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efcedc4-a2", "ovs_interfaceid": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:13:21.308159 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:21.338078 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:21.340884 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:21.535053 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:21.546073 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99954801099966 future=<Future at 0x7557047e60c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:13:21.546445 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99910874599982 future=<Future at 0x7557047e60c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:13:21.547257 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.998292340999797 future=<Future at 0x7557047e60c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:13:21.555760 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Instance destroyed successfully.
May 27 03:13:21.556210 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lazy-loading 'resources' on Instance uuid a962fbe3-4ac8-47c6-9cee-24fe923fbc6c {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:13:21.586177 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8092a765-fd12-4cf2-ab33-0a98f3af061a req-1e880fe0-137f-4e18-b4ea-45ba8de66a92 service nova] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Received event network-vif-plugged-6e51e7a7-91a2-45f4-9726-f73ab6548bc8 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:13:21.586439 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8092a765-fd12-4cf2-ab33-0a98f3af061a req-1e880fe0-137f-4e18-b4ea-45ba8de66a92 service nova] Acquiring lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:21.586701 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8092a765-fd12-4cf2-ab33-0a98f3af061a req-1e880fe0-137f-4e18-b4ea-45ba8de66a92 service nova] Lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:21.586701 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8092a765-fd12-4cf2-ab33-0a98f3af061a req-1e880fe0-137f-4e18-b4ea-45ba8de66a92 service nova] Lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:21.586964 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8092a765-fd12-4cf2-ab33-0a98f3af061a req-1e880fe0-137f-4e18-b4ea-45ba8de66a92 service nova] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Processing event network-vif-plugged-6e51e7a7-91a2-45f4-9726-f73ab6548bc8 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:13:21.597977 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:21.650979 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-52e4aa7a-8d3b-410b-803d-a47e5a43d21f req-1f13a91b-56dc-4bb5-84ab-655c8871a2cc service nova] Releasing lock "refresh_cache-a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:13:21.725141 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:21.731139 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:21.733845 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:21.755672 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:22.058914 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:12:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1677938102',display_name='tempest-TestVolumeBackupRestore-server-1677938102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebackuprestore-server-1677938102',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJvtkMCKCp+Osug5cwPjMuyd0NfOzm0zS1Ob5ZQVOaalH0L75bab0UTmT9ahXFgwTq1cG9FQYaO3e0fvwoiv2eOgX/vyComljkG4ST/q0E+o76e+DldKljDlzHrxNu9hg==',key_name='tempest-TestVolumeBackupRestore-1636169421',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:12:48Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5baf44af64da4cc89825082881a2f01f',ramdisk_id='',reservation_id='r-tj9aq6m1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBackupRestore-1748215900',owner_user_name='tempest-TestVolumeBackupRestore-1748215900-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:12:49Z,user_data=None,user_id='7154ada1d1aa4a0aa8b31710262b4b50',uuid=a962fbe3-4ac8-47c6-9cee-24fe923fbc6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "address": "fa:16:3e:fe:30:4c", "network": {"id": "4d693079-1416-4ea0-a645-0e727595ef7e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1303315207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5baf44af64da4cc89825082881a2f01f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efcedc4-a2", "ovs_interfaceid": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:13:22.059430 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Converting VIF {"id": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "address": "fa:16:3e:fe:30:4c", "network": {"id": "4d693079-1416-4ea0-a645-0e727595ef7e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1303315207-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5baf44af64da4cc89825082881a2f01f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6efcedc4-a2", "ovs_interfaceid": "6efcedc4-a28c-4133-a81b-8076ee6bde17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:13:22.059730 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:30:4c,bridge_name='br-int',has_traffic_filtering=True,id=6efcedc4-a28c-4133-a81b-8076ee6bde17,network=Network(4d693079-1416-4ea0-a645-0e727595ef7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efcedc4-a2') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:13:22.060008 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:30:4c,bridge_name='br-int',has_traffic_filtering=True,id=6efcedc4-a28c-4133-a81b-8076ee6bde17,network=Network(4d693079-1416-4ea0-a645-0e727595ef7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efcedc4-a2') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:13:22.064923 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:22.065149 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6efcedc4-a2, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:13:22.066148 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:22.067045 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:13:22.067236 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:22.067947 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:22.068065 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05529cd5-d918-4a0f-9a13-97d7a8218c2d) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:13:22.070881 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:22.071477 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:13:22.073004 np0000001475 nova-compute[98471]: INFO os_vif [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:30:4c,bridge_name='br-int',has_traffic_filtering=True,id=6efcedc4-a28c-4133-a81b-8076ee6bde17,network=Network(4d693079-1416-4ea0-a645-0e727595ef7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6efcedc4-a2')
May 27 03:13:22.075582 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:13:22.075923 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:13:22.076171 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:13:22.076533 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:13:22.076815 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:13:22.076945 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:13:22.101565 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6e731102-56dc-439a-b3a5-d297f14935cf req-88a49030-d0a2-433e-abac-514a5fb93bd5 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Received event network-vif-unplugged-6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:13:22.101703 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6e731102-56dc-439a-b3a5-d297f14935cf req-88a49030-d0a2-433e-abac-514a5fb93bd5 service nova] Acquiring lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:22.101888 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6e731102-56dc-439a-b3a5-d297f14935cf req-88a49030-d0a2-433e-abac-514a5fb93bd5 service nova] Lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:22.102006 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6e731102-56dc-439a-b3a5-d297f14935cf req-88a49030-d0a2-433e-abac-514a5fb93bd5 service nova] Lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:22.102133 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6e731102-56dc-439a-b3a5-d297f14935cf req-88a49030-d0a2-433e-abac-514a5fb93bd5 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] No waiting events found dispatching network-vif-unplugged-6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:13:22.102263 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6e731102-56dc-439a-b3a5-d297f14935cf req-88a49030-d0a2-433e-abac-514a5fb93bd5 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Received event network-vif-unplugged-6efcedc4-a28c-4133-a81b-8076ee6bde17 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:13:22.102365 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6e731102-56dc-439a-b3a5-d297f14935cf req-88a49030-d0a2-433e-abac-514a5fb93bd5 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Received event network-vif-unplugged-6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:13:22.102482 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6e731102-56dc-439a-b3a5-d297f14935cf req-88a49030-d0a2-433e-abac-514a5fb93bd5 service nova] Acquiring lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:22.102613 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6e731102-56dc-439a-b3a5-d297f14935cf req-88a49030-d0a2-433e-abac-514a5fb93bd5 service nova] Lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:22.102720 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-6e731102-56dc-439a-b3a5-d297f14935cf req-88a49030-d0a2-433e-abac-514a5fb93bd5 service nova] Lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:22.102821 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6e731102-56dc-439a-b3a5-d297f14935cf req-88a49030-d0a2-433e-abac-514a5fb93bd5 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] No waiting events found dispatching network-vif-unplugged-6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:13:22.102928 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6e731102-56dc-439a-b3a5-d297f14935cf req-88a49030-d0a2-433e-abac-514a5fb93bd5 service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Received event network-vif-unplugged-6efcedc4-a28c-4133-a81b-8076ee6bde17 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:13:22.110108 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:22.110108 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:22.110108 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:22.110108 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:22.110108 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:22.110108 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:22.110108 np0000001475 nova-compute[98471]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:13:22.110108 np0000001475 nova-compute[98471]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:13:22.110108 np0000001475 nova-compute[98471]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d (non-flash)
May 27 03:13:22.110108 np0000001475 nova-compute[98471]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d (non-flash)
May 27 03:13:22.110108 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:13:22.110648 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:22.110648 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:22.110648 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:22.110648 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:22.110648 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:22.110648 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:22.110648 np0000001475 nova-compute[98471]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:13:22.110648 np0000001475 nova-compute[98471]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5 (non-flash)
May 27 03:13:22.110648 np0000001475 nova-compute[98471]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d (non-flash)
May 27 03:13:22.110648 np0000001475 nova-compute[98471]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d (non-flash)
May 27 03:13:22.110648 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:13:22.110648 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', '168'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', '171'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', '172'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', '173')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:13:22.110648 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', '171')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:13:22.111755 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5', '170')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:13:22.112632 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572475ae80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5'): ({'sdb'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:13:22.112927 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Removing multipathed devices sdc, sdb {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:13:22.113156 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Flush multipath device 330000000d8ee2eeb {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:13:22.164589 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:13:22.197258 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:13:22.239290 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:13:22.239482 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:13:22.240572 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:13:22.255766 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:13:22.256088 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:13:22.269689 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:22.300900 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 171, target: iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5, portal: 192.168.40.100,3260]
May 27 03:13:22.300900 np0000001475 nova-compute[98471]: Logout of [sid: 171, target: iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5, portal: 192.168.40.100,3260] successful.
May 27 03:13:22.300900 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:22.319317 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:22.330949 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:22.369112 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 170, target: iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5, portal: 192.168.50.100,3260]
May 27 03:13:22.369112 np0000001475 nova-compute[98471]: Logout of [sid: 170, target: iqn.2023-03.storpool.com:os--volume-d22031d1-ecdd-4525-9a7c-ee7a2baa1ff5, portal: 192.168.50.100,3260] successful.
May 27 03:13:22.369112 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:22.386705 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:22.387058 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:13:22.387058 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] <== disconnect_volume: return (311ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:13:22.387309 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:13:22.387530 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Deleting instance files /opt/stack/data/nova/instances/a962fbe3-4ac8-47c6-9cee-24fe923fbc6c_del
May 27 03:13:22.388525 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Deletion of /opt/stack/data/nova/instances/a962fbe3-4ac8-47c6-9cee-24fe923fbc6c_del complete
May 27 03:13:22.896722 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Took 1.90 seconds to destroy the instance on the hypervisor.
May 27 03:13:22.897404 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:13:22.897712 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:13:22.897872 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:13:22.898114 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:22.960037 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:23.137544 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851603.134658, 1ed98a24-0f9c-402b-b08e-17c3ced297ce => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:13:23.137544 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] VM Started (Lifecycle Event)
May 27 03:13:23.139033 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:13:23.142936 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:13:23.148522 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Instance spawned successfully.
May 27 03:13:23.149928 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:13:23.637805 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:13:23.640328 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:13:23.642756 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-cbf81533-30ed-4ab6-b1b5-b0bb2f1c22d2 req-ba188ce6-12a2-4cd2-a06f-4194eeabb5c4 service nova] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Received event network-vif-plugged-6e51e7a7-91a2-45f4-9726-f73ab6548bc8 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:13:23.642938 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cbf81533-30ed-4ab6-b1b5-b0bb2f1c22d2 req-ba188ce6-12a2-4cd2-a06f-4194eeabb5c4 service nova] Acquiring lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:23.643092 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cbf81533-30ed-4ab6-b1b5-b0bb2f1c22d2 req-ba188ce6-12a2-4cd2-a06f-4194eeabb5c4 service nova] Lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:23.643223 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-cbf81533-30ed-4ab6-b1b5-b0bb2f1c22d2 req-ba188ce6-12a2-4cd2-a06f-4194eeabb5c4 service nova] Lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:23.643652 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-cbf81533-30ed-4ab6-b1b5-b0bb2f1c22d2 req-ba188ce6-12a2-4cd2-a06f-4194eeabb5c4 service nova] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] No waiting events found dispatching network-vif-plugged-6e51e7a7-91a2-45f4-9726-f73ab6548bc8 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:13:23.643839 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-cbf81533-30ed-4ab6-b1b5-b0bb2f1c22d2 req-ba188ce6-12a2-4cd2-a06f-4194eeabb5c4 service nova] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Received unexpected event network-vif-plugged-6e51e7a7-91a2-45f4-9726-f73ab6548bc8 for instance with vm_state building and task_state spawning.
May 27 03:13:23.657765 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:13:23.657765 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:13:23.657765 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:13:23.657765 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:13:23.657765 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:13:23.657765 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:13:23.685149 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:13:24.144944 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:13:24.145382 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851604.145046, 1ed98a24-0f9c-402b-b08e-17c3ced297ce => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:13:24.145449 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] VM Paused (Lifecycle Event)
May 27 03:13:24.165585 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-6f58b555-b36b-40b0-a9a2-f39ce36865ab req-48e143ae-a8a4-48d8-8a23-925236e900ea service nova] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Received event network-vif-deleted-6efcedc4-a28c-4133-a81b-8076ee6bde17 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:13:24.165874 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Took 13.85 seconds to spawn the instance on the hypervisor.
May 27 03:13:24.166107 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:13:24.187963 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Took 1.29 seconds to deallocate network for instance.
May 27 03:13:24.648093 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:13:24.650864 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851604.6505651, 1ed98a24-0f9c-402b-b08e-17c3ced297ce => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:13:24.651057 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] VM Resumed (Lifecycle Event)
May 27 03:13:24.677375 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Took 20.93 seconds to build instance.
May 27 03:13:24.736924 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Took 0.55 seconds to detach 1 volumes for instance.
May 27 03:13:25.153682 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:13:25.156073 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:13:25.178939 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-077ff9a3-3922-4696-a854-5e05564ba128 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.445s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:25.242624 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:25.242800 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:25.467238 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:13:25.467486 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:13:25.703951 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "b4509577-bb0c-4555-85c2-9978c9f06ff6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:25.704377 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:25.762334 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:25.762582 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:25.762844 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:25.763133 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:25.763233 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:25.765996 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Terminating instance
May 27 03:13:25.970502 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:13:26.207811 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'flavor' on Instance uuid b4509577-bb0c-4555-85c2-9978c9f06ff6 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:13:26.269256 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:13:26.284765 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:26.288016 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:26.302749 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:26.305530 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:26.320064 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:26.324953 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:26.421193 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8f5ed655-f617-49cf-b2c7-d8f7250b5e3a req-00ccb74a-5c1b-4180-858d-d7061831996f service nova] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Received event network-vif-unplugged-6e51e7a7-91a2-45f4-9726-f73ab6548bc8 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:13:26.421339 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8f5ed655-f617-49cf-b2c7-d8f7250b5e3a req-00ccb74a-5c1b-4180-858d-d7061831996f service nova] Acquiring lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:26.421557 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8f5ed655-f617-49cf-b2c7-d8f7250b5e3a req-00ccb74a-5c1b-4180-858d-d7061831996f service nova] Lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:26.421698 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8f5ed655-f617-49cf-b2c7-d8f7250b5e3a req-00ccb74a-5c1b-4180-858d-d7061831996f service nova] Lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:26.421846 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8f5ed655-f617-49cf-b2c7-d8f7250b5e3a req-00ccb74a-5c1b-4180-858d-d7061831996f service nova] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] No waiting events found dispatching network-vif-unplugged-6e51e7a7-91a2-45f4-9726-f73ab6548bc8 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:13:26.421990 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8f5ed655-f617-49cf-b2c7-d8f7250b5e3a req-00ccb74a-5c1b-4180-858d-d7061831996f service nova] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Received event network-vif-unplugged-6e51e7a7-91a2-45f4-9726-f73ab6548bc8 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:13:26.476959 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.234s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:26.524805 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Deleted allocations for instance a962fbe3-4ac8-47c6-9cee-24fe923fbc6c
May 27 03:13:26.588677 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999729167999703 future=<Future at 0x7557247753d0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:13:26.590857 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Instance destroyed successfully.
May 27 03:13:26.591356 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'resources' on Instance uuid 1ed98a24-0f9c-402b-b08e-17c3ced297ce {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:13:26.598541 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:27.090828 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:27.093591 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:13:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1055934182',display_name='tempest-TestVolumeBootPattern-server-1055934182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-1055934182',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:13:24Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-edt2ghwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:13:24Z,user_data=None,user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=1ed98a24-0f9c-402b-b08e-17c3ced297ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e51e7a7-91a2-45f4-9726-f73ab6548bc8", "address": "fa:16:3e:9a:d5:e4", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e51e7a7-91", "ovs_interfaceid": "6e51e7a7-91a2-45f4-9726-f73ab6548bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:13:27.093847 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "6e51e7a7-91a2-45f4-9726-f73ab6548bc8", "address": "fa:16:3e:9a:d5:e4", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e51e7a7-91", "ovs_interfaceid": "6e51e7a7-91a2-45f4-9726-f73ab6548bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:13:27.094418 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d5:e4,bridge_name='br-int',has_traffic_filtering=True,id=6e51e7a7-91a2-45f4-9726-f73ab6548bc8,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e51e7a7-91') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:13:27.094624 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d5:e4,bridge_name='br-int',has_traffic_filtering=True,id=6e51e7a7-91a2-45f4-9726-f73ab6548bc8,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e51e7a7-91') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:13:27.095433 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:27.095630 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e51e7a7-91, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:13:27.096530 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:27.097479 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:13:27.098274 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:27.098413 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac6ecc27-c5aa-4286-99b8-b2faa23a4701) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:13:27.098828 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:27.099313 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:13:27.100018 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:27.101549 np0000001475 nova-compute[98471]: INFO os_vif [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:d5:e4,bridge_name='br-int',has_traffic_filtering=True,id=6e51e7a7-91a2-45f4-9726-f73ab6548bc8,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e51e7a7-91')
May 27 03:13:27.104647 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:13:27.104926 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '160850b8-bef4-4786-ac9b-41f02aba007d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:13:27.105039 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:13:27.105373 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:13:27.105627 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '160850b8-bef4-4786-ac9b-41f02aba007d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:13:27.105755 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:13:27.129391 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:27.129391 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:27.129391 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:27.129391 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:27.129391 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:27.129391 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:27.129391 np0000001475 nova-compute[98471]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d (non-flash)
May 27 03:13:27.129391 np0000001475 nova-compute[98471]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d (non-flash)
May 27 03:13:27.129391 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:13:27.129708 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:27.129708 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:27.129708 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:27.129708 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:27.129708 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:27.129708 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:27.129708 np0000001475 nova-compute[98471]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d (non-flash)
May 27 03:13:27.129708 np0000001475 nova-compute[98471]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d (non-flash)
May 27 03:13:27.129708 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:13:27.129708 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', '168'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', '172'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', '173')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:13:27.130050 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', '173')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:13:27.130774 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d', '172')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:13:27.131475 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c3f9f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d'): ({'sdd'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:13:27.131658 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Removing multipathed devices sdd, sdk {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:13:27.131893 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flush multipath device 3300000008a3eab92 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:13:27.163442 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:13:27.200257 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:13:27.213554 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:27.249087 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if SCSI volumes sdd, sdk have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:13:27.249281 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] SCSI volumes sdd, sdk have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:13:27.250373 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if device paths {'sdd', 'sdk'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:13:27.260755 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Device paths {'sdd', 'sdk'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:13:27.260911 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:13:27.271854 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:27.301397 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 173, target: iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d, portal: 192.168.40.100,3260]
May 27 03:13:27.301397 np0000001475 nova-compute[98471]: Logout of [sid: 173, target: iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d, portal: 192.168.40.100,3260] successful.
May 27 03:13:27.301397 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:27.316211 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:27.327708 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:27.361666 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 172, target: iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d, portal: 192.168.50.100,3260]
May 27 03:13:27.361666 np0000001475 nova-compute[98471]: Logout of [sid: 172, target: iqn.2023-03.storpool.com:os--volume-160850b8-bef4-4786-ac9b-41f02aba007d, portal: 192.168.50.100,3260] successful.
May 27 03:13:27.361666 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:27.377929 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:27.379060 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:13:27.379261 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== disconnect_volume: return (274ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:13:27.379401 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:13:27.379672 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Deleting instance files /opt/stack/data/nova/instances/1ed98a24-0f9c-402b-b08e-17c3ced297ce_del
May 27 03:13:27.380176 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Deletion of /opt/stack/data/nova/instances/1ed98a24-0f9c-402b-b08e-17c3ced297ce_del complete
May 27 03:13:27.535063 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-92547587-a482-477d-a411-851899b55ff8 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Lock "a962fbe3-4ac8-47c6-9cee-24fe923fbc6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.042s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:27.886566 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Took 1.62 seconds to destroy the instance on the hypervisor.
May 27 03:13:27.887574 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:13:27.887835 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:13:27.887924 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:13:27.888161 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:27.947026 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:28.278549 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "b4509577-bb0c-4555-85c2-9978c9f06ff6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:28.279177 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:28.279177 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Attaching volume 2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c to /dev/vdb
May 27 03:13:28.320421 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:13:28.334070 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:13:28.355337 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:13:28.406332 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:13:28.406704 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:13:28.417275 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:13:28.418412 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe66:186f', 'fe80::f9:d2ff:fead:2ab6', 'fe80::fc16:3eff:febf:27ab'] 
May 27 03:13:28.418596 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:13:28.418596 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:13:28.418989 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:13:28.419335 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Updating existing volume attachment record: 103b6884-0368-4ed5-8e7e-2b0c552d8317 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:13:28.487503 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-130472e3-8bf7-46ee-b981-31f8b95d07b0 req-985b4b3c-3f22-41e9-b0e8-f0f2366c80f8 service nova] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Received event network-vif-unplugged-6e51e7a7-91a2-45f4-9726-f73ab6548bc8 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:13:28.487828 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-130472e3-8bf7-46ee-b981-31f8b95d07b0 req-985b4b3c-3f22-41e9-b0e8-f0f2366c80f8 service nova] Acquiring lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:28.488022 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-130472e3-8bf7-46ee-b981-31f8b95d07b0 req-985b4b3c-3f22-41e9-b0e8-f0f2366c80f8 service nova] Lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:28.488173 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-130472e3-8bf7-46ee-b981-31f8b95d07b0 req-985b4b3c-3f22-41e9-b0e8-f0f2366c80f8 service nova] Lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:28.488287 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-130472e3-8bf7-46ee-b981-31f8b95d07b0 req-985b4b3c-3f22-41e9-b0e8-f0f2366c80f8 service nova] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] No waiting events found dispatching network-vif-unplugged-6e51e7a7-91a2-45f4-9726-f73ab6548bc8 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:13:28.488398 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-130472e3-8bf7-46ee-b981-31f8b95d07b0 req-985b4b3c-3f22-41e9-b0e8-f0f2366c80f8 service nova] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Received event network-vif-unplugged-6e51e7a7-91a2-45f4-9726-f73ab6548bc8 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:13:28.488530 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-130472e3-8bf7-46ee-b981-31f8b95d07b0 req-985b4b3c-3f22-41e9-b0e8-f0f2366c80f8 service nova] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Received event network-vif-deleted-6e51e7a7-91a2-45f4-9726-f73ab6548bc8 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:13:28.488675 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-130472e3-8bf7-46ee-b981-31f8b95d07b0 req-985b4b3c-3f22-41e9-b0e8-f0f2366c80f8 service nova] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Neutron deleted interface 6e51e7a7-91a2-45f4-9726-f73ab6548bc8; detaching it from the instance and deleting it from the info cache
May 27 03:13:28.488887 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-130472e3-8bf7-46ee-b981-31f8b95d07b0 req-985b4b3c-3f22-41e9-b0e8-f0f2366c80f8 service nova] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:13:28.630443 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:13:28.983687 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:13:28.984005 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:13:28.984245 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:13:28.984784 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:13:28.985112 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:13:28.993186 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-130472e3-8bf7-46ee-b981-31f8b95d07b0 req-985b4b3c-3f22-41e9-b0e8-f0f2366c80f8 service nova] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Detach interface failed, port_id=6e51e7a7-91a2-45f4-9726-f73ab6548bc8, reason: Instance 1ed98a24-0f9c-402b-b08e-17c3ced297ce could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:13:29.002322 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:13:29.003148 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:13:29.006389 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:13:29.006590 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:13:29.007085 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:13:29.007300 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.startup = automatic
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.scan = manual
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:13:29.022042 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:13:29.022042 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.startup = automatic
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.scan = manual
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:13:29.024670 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:13:29.024670 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:29.036870 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:29.041758 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:13:29.053968 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:29.053968 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:29.053968 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:29.053968 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:29.053968 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:29.053968 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:29.053968 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:13:29.054218 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:29.054218 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:29.054218 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:29.054218 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:29.054218 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:29.054218 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:29.054218 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:13:29.054783 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.048s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:13:29.054783 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:13:29.055465 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] HCTL ('15', '0', '0', 0) found on session 169 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:13:29.055618 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:13:29.060533 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:29.060533 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:29.060533 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:29.060533 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:29.060533 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:29.060533 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:29.060533 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:13:29.060725 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:29.060725 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:29.060725 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:29.060725 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:29.060725 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:29.060725 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:29.060725 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:13:29.061034 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.054s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:13:29.061196 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:13:29.061860 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] HCTL ('14', '0', '0', 0) found on session 168 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:13:29.062015 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:13:29.068455 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Searching for a device in session 169 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:13:29.068685 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:13:29.071028 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Searching for a device in session 168 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:13:29.071300 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:13:29.132731 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Took 1.24 seconds to deallocate network for instance.
May 27 03:13:29.681868 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Took 0.55 seconds to detach 1 volumes for instance.
May 27 03:13:30.006629 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:13:30.188185 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:30.188370 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:30.352289 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:13:30.352516 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:13:30.805985 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:30.854953 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:13:31.020862 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Found WWN 330000000667f34e2 for multipath device dm-5 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:13:31.021153 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.036s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:13:31.021343 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] <== connect_volume: return (2036ms) {'type': 'block', 'scsi_wwn': '330000000667f34e2', 'path': '/dev/dm-5', 'multipath_id': '330000000667f34e2'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:13:31.021520 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000667f34e2', 'path': '/dev/dm-5', 'multipath_id': '330000000667f34e2'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:13:31.024098 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'flavor' on Instance uuid b4509577-bb0c-4555-85c2-9978c9f06ff6 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:13:31.361831 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.173s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:31.423178 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Deleted allocations for instance 1ed98a24-0f9c-402b-b08e-17c3ced297ce
May 27 03:13:31.527264 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Attempting to attach volume 2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:13:31.529294 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:13:31.529294 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:13:31.529294 np0000001475 nova-compute[98471]:   <alias name="ua-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c"/>
May 27 03:13:31.529294 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:13:31.529294 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:13:31.529294 np0000001475 nova-compute[98471]:   <serial>2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c</serial>
May 27 03:13:31.529294 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:13:31.529294 np0000001475 nova-compute[98471]: </disk>
May 27 03:13:31.529294 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:13:32.098840 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:32.432503 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-85b65e95-6cf2-4b60-96f8-779656ccdbcd tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "1ed98a24-0f9c-402b-b08e-17c3ced297ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.670s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:32.504834 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:33.204038 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:13:33.204420 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:13:33.204420 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:13:33.204527 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No VIF found with MAC fa:16:3e:bf:27:ab, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:13:34.595077 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:34.758727 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-b3e1142d-26a1-4551-b380-226516ba3751 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.480s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:36.034280 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "fc5a0cb1-d043-498f-af71-6947ba559007" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:36.034721 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "fc5a0cb1-d043-498f-af71-6947ba559007" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:36.479467 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-81f6d8d8-2de4-4cfa-873e-736469bbbb30 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "b4509577-bb0c-4555-85c2-9978c9f06ff6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:36.479677 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-81f6d8d8-2de4-4cfa-873e-736469bbbb30 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:36.536176 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:13:36.551366 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0057793320002019755 future=<Future at 0x7557047e60c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:13:36.552230 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Emitting event <LifecycleEvent: 1779851601.5454576, a962fbe3-4ac8-47c6-9cee-24fe923fbc6c => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:13:36.552933 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:13:36.553205 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] VM Stopped (Lifecycle Event)
May 27 03:13:36.554438 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=5.033984263000093 future=<Future at 0x7557247753d0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:13:36.554551 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=5.033832570999948 future=<Future at 0x7557247753d0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:13:36.611595 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:36.615453 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:36.981675 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-81f6d8d8-2de4-4cfa-873e-736469bbbb30 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Detaching volume 2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c
May 27 03:13:37.022346 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-81f6d8d8-2de4-4cfa-873e-736469bbbb30 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Attempting to driver detach volume 2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c from mountpoint /dev/vdb
May 27 03:13:37.027215 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-81f6d8d8-2de4-4cfa-873e-736469bbbb30 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Found disk vdb by alias ua-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:13:37.028508 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-81f6d8d8-2de4-4cfa-873e-736469bbbb30 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Found disk vdb by alias ua-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:13:37.028656 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-81f6d8d8-2de4-4cfa-873e-736469bbbb30 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Attempting to detach device vdb from instance b4509577-bb0c-4555-85c2-9978c9f06ff6 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:13:37.028835 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-81f6d8d8-2de4-4cfa-873e-736469bbbb30 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:13:37.028835 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:13:37.028835 np0000001475 nova-compute[98471]:   <alias name="ua-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c"/>
May 27 03:13:37.028835 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:13:37.028835 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:13:37.028835 np0000001475 nova-compute[98471]:   <serial>2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c</serial>
May 27 03:13:37.028835 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:13:37.028835 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:13:37.028835 np0000001475 nova-compute[98471]: </disk>
May 27 03:13:37.028835 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:13:37.035475 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-81f6d8d8-2de4-4cfa-873e-736469bbbb30 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Successfully detached device vdb from instance b4509577-bb0c-4555-85c2-9978c9f06ff6 from the persistent domain config.
May 27 03:13:37.035924 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-81f6d8d8-2de4-4cfa-873e-736469bbbb30 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] (1/8): Attempting to detach device vdb with device alias ua-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c from instance b4509577-bb0c-4555-85c2-9978c9f06ff6 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:13:37.036069 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-81f6d8d8-2de4-4cfa-873e-736469bbbb30 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:13:37.036069 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:13:37.036069 np0000001475 nova-compute[98471]:   <alias name="ua-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c"/>
May 27 03:13:37.036069 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:13:37.036069 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:13:37.036069 np0000001475 nova-compute[98471]:   <serial>2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c</serial>
May 27 03:13:37.036069 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:13:37.036069 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:13:37.036069 np0000001475 nova-compute[98471]: </disk>
May 27 03:13:37.036069 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:13:37.056493 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: a962fbe3-4ac8-47c6-9cee-24fe923fbc6c] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:13:37.083216 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:37.083392 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:37.087301 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:13:37.087443 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Claim successful on node np0000001475
May 27 03:13:37.100255 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:37.568156 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851617.5676684, b4509577-bb0c-4555-85c2-9978c9f06ff6 => ua-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:13:37.569120 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-81f6d8d8-2de4-4cfa-873e-736469bbbb30 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c for instance b4509577-bb0c-4555-85c2-9978c9f06ff6 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:13:37.571393 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-81f6d8d8-2de4-4cfa-873e-736469bbbb30 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Successfully detached device vdb from instance b4509577-bb0c-4555-85c2-9978c9f06ff6 from the live domain config.
May 27 03:13:37.679519 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:38.114490 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-81f6d8d8-2de4-4cfa-873e-736469bbbb30 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Detected multiple connections on this host for volume: 2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c, skipping target disconnect.
May 27 03:13:38.280729 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:13:38.281072 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:13:38.663576 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-81f6d8d8-2de4-4cfa-873e-736469bbbb30 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'flavor' on Instance uuid b4509577-bb0c-4555-85c2-9978c9f06ff6 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:13:38.783660 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:13:39.291890 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.207s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:39.291890 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:13:39.440689 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:39.483958 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:39.668972 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-81f6d8d8-2de4-4cfa-873e-736469bbbb30 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.189s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:39.694340 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "b4509577-bb0c-4555-85c2-9978c9f06ff6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:39.694554 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:39.694812 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "b4509577-bb0c-4555-85c2-9978c9f06ff6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:39.694974 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:39.695102 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:39.697225 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Terminating instance
May 27 03:13:39.796522 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:13:39.797341 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:13:39.797341 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:39.797525 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:39.873798 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8eeaf68cfb534238bfe879dd6e8f858f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0011da7449e7948bf2c8a41955f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:13:40.201246 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:13:40.219751 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:40.236909 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:40.300209 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:13:40.363253 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:40.381734 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:40.529564 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999726543000179 future=<Future at 0x7557047e7f80 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:13:40.532380 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Instance destroyed successfully.
May 27 03:13:40.532703 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'resources' on Instance uuid b4509577-bb0c-4555-85c2-9978c9f06ff6 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:13:40.779548 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Successfully created port: 8b43f898-1af7-4168-ad4c-4b5c7596d28c {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:13:40.807981 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:13:41.029031 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:41.036465 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-848626449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumemultiattachtests-server-848626449',id=66,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVI54RH2pdxhdx+NBQ2XGN7tNsXMkNRRM659CteSsS0ZmLSyoDiSuXTzB/DhppFfYk9ouWLVqam92P3d8MUEqPLedL5zCvpkb49Y3GdLSs3nNQ1gwwpZDY5VEnqdrskPA==',key_name='tempest-keypair-695410050',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:12:46Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='256f2c4e067c46a3a4ea5e9d934b1d4b',ramdisk_id='',reservation_id='r-fz032dwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1876764595',owner_user_name='tempest-VolumeMultiattachTests-1876764595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='568dd12813254325bb16fac607894d49',uuid=b4509577-bb0c-4555-85c2-9978c9f06ff6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "address": "fa:16:3e:bf:27:ab", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b32736-9a", "ovs_interfaceid": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:13:41.036692 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Converting VIF {"id": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "address": "fa:16:3e:bf:27:ab", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b32736-9a", "ovs_interfaceid": "49b32736-9a22-4125-9303-1b5e23d0e1f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:13:41.037642 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:27:ab,bridge_name='br-int',has_traffic_filtering=True,id=49b32736-9a22-4125-9303-1b5e23d0e1f7,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b32736-9a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:13:41.038291 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:27:ab,bridge_name='br-int',has_traffic_filtering=True,id=49b32736-9a22-4125-9303-1b5e23d0e1f7,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b32736-9a') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:13:41.039583 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:41.039931 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49b32736-9a, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:13:41.041318 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:41.042459 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:13:41.043222 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:41.043409 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=570e08a0-8d6e-44ad-980c-f67ab9e16296) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:13:41.044359 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:41.045197 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:13:41.050234 np0000001475 nova-compute[98471]: INFO os_vif [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:27:ab,bridge_name='br-int',has_traffic_filtering=True,id=49b32736-9a22-4125-9303-1b5e23d0e1f7,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b32736-9a')
May 27 03:13:41.085718 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:13:41.086035 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:13:41.086573 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:13:41.086693 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:13:41.087487 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:13:41.087487 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:13:41.119270 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:41.119270 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:41.119270 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:41.119270 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:41.119270 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:41.119270 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:41.119270 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:13:41.119559 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:41.119559 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:13:41.119559 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:41.119559 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:13:41.119559 np0000001475 nova-compute[98471]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:41.119559 np0000001475 nova-compute[98471]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c (non-flash)
May 27 03:13:41.119559 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:13:41.119703 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', '168'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', '169')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:13:41.119783 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', '168')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:13:41.120792 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', '169')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:13:41.121560 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755724789580>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c'): ({'sdj'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:13:41.121761 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Removing multipathed devices sdj, sdi {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:13:41.122783 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Flush multipath device 330000000667f34e2 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:13:41.312120 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Booting with volume 80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c at /dev/vda
May 27 03:13:41.317274 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Successfully updated port: 8b43f898-1af7-4168-ad4c-4b5c7596d28c {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:13:41.346929 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:13:41.358303 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b4d7ca23-47e8-4b57-8882-362078affa2e req-5853d8e9-3d47-463b-bb3b-28715149701d service nova] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Received event network-changed-8b43f898-1af7-4168-ad4c-4b5c7596d28c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:13:41.358454 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b4d7ca23-47e8-4b57-8882-362078affa2e req-5853d8e9-3d47-463b-bb3b-28715149701d service nova] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Refreshing instance network info cache due to event network-changed-8b43f898-1af7-4168-ad4c-4b5c7596d28c. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:13:41.358642 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b4d7ca23-47e8-4b57-8882-362078affa2e req-5853d8e9-3d47-463b-bb3b-28715149701d service nova] Acquiring lock "refresh_cache-fc5a0cb1-d043-498f-af71-6947ba559007" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:13:41.358808 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b4d7ca23-47e8-4b57-8882-362078affa2e req-5853d8e9-3d47-463b-bb3b-28715149701d service nova] Acquired lock "refresh_cache-fc5a0cb1-d043-498f-af71-6947ba559007" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:13:41.359186 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-b4d7ca23-47e8-4b57-8882-362078affa2e req-5853d8e9-3d47-463b-bb3b-28715149701d service nova] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Refreshing network info cache for port 8b43f898-1af7-4168-ad4c-4b5c7596d28c {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:13:41.360403 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:13:41.380824 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:13:41.421361 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:13:41.421724 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:13:41.429659 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:13:41.430542 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe66:186f', 'fe80::f9:d2ff:fead:2ab6'] 
May 27 03:13:41.430675 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:13:41.430754 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:13:41.430977 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:13:41.431179 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Updating existing volume attachment record: b86e9fc5-f9e0-4d50-83b1-cfd88cca39d3 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:13:41.589037 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0005020680000598077 future=<Future at 0x7557247753d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:13:41.589699 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] Emitting event <LifecycleEvent: 1779851606.5883307, 1ed98a24-0f9c-402b-b08e-17c3ced297ce => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:13:41.590120 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:13:41.590260 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] VM Stopped (Lifecycle Event)
May 27 03:13:41.592374 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=13.936852790000103 future=<Future at 0x7557047e7f80 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:13:41.592506 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=13.936698203000105 future=<Future at 0x7557047e7f80 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:13:41.625124 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:41.819493 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "refresh_cache-fc5a0cb1-d043-498f-af71-6947ba559007" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:13:41.863187 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-b4d7ca23-47e8-4b57-8882-362078affa2e req-5853d8e9-3d47-463b-bb3b-28715149701d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:41.922169 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-b4d7ca23-47e8-4b57-8882-362078affa2e req-5853d8e9-3d47-463b-bb3b-28715149701d service nova] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:13:42.041839 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-b4d7ca23-47e8-4b57-8882-362078affa2e req-5853d8e9-3d47-463b-bb3b-28715149701d service nova] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:13:42.094287 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-625ad8de-a395-418e-ac90-4e43bddaac40 tempest-TestVolumeBackupRestore-1748215900 tempest-TestVolumeBackupRestore-1748215900-project-member] [instance: 1ed98a24-0f9c-402b-b08e-17c3ced297ce] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:13:42.543734 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b4d7ca23-47e8-4b57-8882-362078affa2e req-5853d8e9-3d47-463b-bb3b-28715149701d service nova] Releasing lock "refresh_cache-fc5a0cb1-d043-498f-af71-6947ba559007" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:13:42.544242 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquired lock "refresh_cache-fc5a0cb1-d043-498f-af71-6947ba559007" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:13:42.544334 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:13:43.101437 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:13:43.267392 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:43.391157 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Updating instance_info_cache with network_info: [{"id": "8b43f898-1af7-4168-ad4c-4b5c7596d28c", "address": "fa:16:3e:21:55:54", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b43f898-1a", "ovs_interfaceid": "8b43f898-1af7-4168-ad4c-4b5c7596d28c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:13:43.518990 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:13:43.520126 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:13:43.520771 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Creating image(s)
May 27 03:13:43.520771 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:13:43.520945 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Ensure instance console log exists: /opt/stack/data/nova/instances/fc5a0cb1-d043-498f-af71-6947ba559007/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:13:43.521109 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:43.521263 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:43.521385 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:43.893143 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Releasing lock "refresh_cache-fc5a0cb1-d043-498f-af71-6947ba559007" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:13:43.893577 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Instance network_info: |[{"id": "8b43f898-1af7-4168-ad4c-4b5c7596d28c", "address": "fa:16:3e:21:55:54", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b43f898-1a", "ovs_interfaceid": "8b43f898-1af7-4168-ad4c-4b5c7596d28c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:13:43.894099 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Start _get_guest_xml network_info=[{"id": "8b43f898-1af7-4168-ad4c-4b5c7596d28c", "address": "fa:16:3e:21:55:54", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b43f898-1a", "ovs_interfaceid": "8b43f898-1af7-4168-ad4c-4b5c7596d28c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'fc5a0cb1-d043-498f-af71-6947ba559007', 'attached_at': '', 'detached_at': '', 'volume_id': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'serial': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'b86e9fc5-f9e0-4d50-83b1-cfd88cca39d3', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:13:43.896654 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:13:43.897782 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-2118130998', uuid='fc5a0cb1-d043-498f-af71-6947ba559007'), owner=OwnerMeta(userid='8eeaf68cfb534238bfe879dd6e8f858f', username='tempest-TestVolumeBootPattern-360350731-project-member', projectid='bf4b0011da7449e7948bf2c8a41955f5', projectname='tempest-TestVolumeBootPattern-360350731'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8b43f898-1af7-4168-ad4c-4b5c7596d28c", "address": "fa:16:3e:21:55:54", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b43f898-1a", "ovs_interfaceid": "8b43f898-1af7-4168-ad4c-4b5c7596d28c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851623.8974278) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:13:43.898894 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:13:43.899219 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:13:43.900224 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:13:43.900409 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:13:43.901402 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:13:43.901647 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:13:43.901789 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:13:43.901886 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:13:43.902013 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:13:43.902122 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:13:43.902235 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:13:43.902398 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:13:43.902500 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:13:43.902606 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:13:43.902770 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:13:43.902857 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:13:43.912110 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:13:43.912414 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:13:43.912539 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:13:44.050107 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "bdb99676-cb52-4819-896e-b82dd6fa842a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:44.050282 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:44.552703 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:13:45.098942 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:45.099408 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:45.102239 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:13:45.102370 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Claim successful on node np0000001475
May 27 03:13:46.044183 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:46.115250 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2c921b98-b5eb-47ae-9514-c84f7aeb3cac req-d0466735-5dac-4812-bc3f-b20315cc0aea service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Received event network-vif-unplugged-49b32736-9a22-4125-9303-1b5e23d0e1f7 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:13:46.115728 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2c921b98-b5eb-47ae-9514-c84f7aeb3cac req-d0466735-5dac-4812-bc3f-b20315cc0aea service nova] Acquiring lock "b4509577-bb0c-4555-85c2-9978c9f06ff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:46.115902 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2c921b98-b5eb-47ae-9514-c84f7aeb3cac req-d0466735-5dac-4812-bc3f-b20315cc0aea service nova] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:46.116041 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2c921b98-b5eb-47ae-9514-c84f7aeb3cac req-d0466735-5dac-4812-bc3f-b20315cc0aea service nova] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:46.116198 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2c921b98-b5eb-47ae-9514-c84f7aeb3cac req-d0466735-5dac-4812-bc3f-b20315cc0aea service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] No waiting events found dispatching network-vif-unplugged-49b32736-9a22-4125-9303-1b5e23d0e1f7 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:13:46.116274 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2c921b98-b5eb-47ae-9514-c84f7aeb3cac req-d0466735-5dac-4812-bc3f-b20315cc0aea service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Received event network-vif-unplugged-49b32736-9a22-4125-9303-1b5e23d0e1f7 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:13:46.325637 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:13:46.325861 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:13:46.626532 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:46.828342 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:13:47.334840 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.235s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:47.335312 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:13:47.840548 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:13:47.840720 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:13:47.841017 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:47.841225 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:47.917997 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fbbe453781546378e2ba3b6656e4d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132164e1033644c98f55a442c1bc16d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:13:48.164647 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b5dd83c1-314a-4104-b9ca-5241c5e61478 req-b1499254-f8e3-4b32-8a8a-fb0bcca4cd03 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Received event network-vif-unplugged-49b32736-9a22-4125-9303-1b5e23d0e1f7 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:13:48.164836 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b5dd83c1-314a-4104-b9ca-5241c5e61478 req-b1499254-f8e3-4b32-8a8a-fb0bcca4cd03 service nova] Acquiring lock "b4509577-bb0c-4555-85c2-9978c9f06ff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:48.165021 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b5dd83c1-314a-4104-b9ca-5241c5e61478 req-b1499254-f8e3-4b32-8a8a-fb0bcca4cd03 service nova] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:48.165175 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b5dd83c1-314a-4104-b9ca-5241c5e61478 req-b1499254-f8e3-4b32-8a8a-fb0bcca4cd03 service nova] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:48.165319 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b5dd83c1-314a-4104-b9ca-5241c5e61478 req-b1499254-f8e3-4b32-8a8a-fb0bcca4cd03 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] No waiting events found dispatching network-vif-unplugged-49b32736-9a22-4125-9303-1b5e23d0e1f7 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:13:48.165454 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b5dd83c1-314a-4104-b9ca-5241c5e61478 req-b1499254-f8e3-4b32-8a8a-fb0bcca4cd03 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Received event network-vif-unplugged-49b32736-9a22-4125-9303-1b5e23d0e1f7 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:13:48.285327 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Successfully created port: a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:13:48.343251 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:13:48.688543 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Successfully updated port: a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:13:48.845862 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:13:49.190310 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:13:49.190471 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquired lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:13:49.190510 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:13:49.753638 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:13:49.852692 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:13:49.853567 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:13:49.853837 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Creating image(s)
May 27 03:13:49.854237 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:49.854377 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "/opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:49.854782 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "/opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:49.855111 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "1fb36d6ae2c509d80157b16ab25ea95bdf94fbee" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:49.855492 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "1fb36d6ae2c509d80157b16ab25ea95bdf94fbee" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:49.894448 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:50.048315 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Updating instance_info_cache with network_info: [{"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:13:50.223867 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5cffe88e-97fa-4dd5-9c8a-5ca93d302f08 req-a7a870c9-d1e9-4ac0-acb3-764a9e1755ef service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received event network-changed-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:13:50.224212 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5cffe88e-97fa-4dd5-9c8a-5ca93d302f08 req-a7a870c9-d1e9-4ac0-acb3-764a9e1755ef service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Refreshing instance network info cache due to event network-changed-a525bd86-a59c-49e5-ba46-0df00f91a72c. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:13:50.224509 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5cffe88e-97fa-4dd5-9c8a-5ca93d302f08 req-a7a870c9-d1e9-4ac0-acb3-764a9e1755ef service nova] Acquiring lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:13:50.299508 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:13:50.301859 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:13:50.302142 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fb36d6ae2c509d80157b16ab25ea95bdf94fbee.part --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:13:50.387188 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fb36d6ae2c509d80157b16ab25ea95bdf94fbee.part --force-share --output=json" returned: 0 in 0.085s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:13:50.387719 np0000001475 nova-compute[98471]: DEBUG nova.virt.images [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] e4962c6e-b61e-49bb-8c87-5b9dabb75a44 was qcow2, converting to raw {{(pid=98471) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 03:13:50.388304 np0000001475 nova-compute[98471]: DEBUG nova.privsep.utils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98471) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 03:13:50.388565 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fb36d6ae2c509d80157b16ab25ea95bdf94fbee.part /opt/stack/data/nova/instances/_base/1fb36d6ae2c509d80157b16ab25ea95bdf94fbee.converted {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:13:50.520754 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fb36d6ae2c509d80157b16ab25ea95bdf94fbee.part /opt/stack/data/nova/instances/_base/1fb36d6ae2c509d80157b16ab25ea95bdf94fbee.converted" returned: 0 in 0.132s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:13:50.525646 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fb36d6ae2c509d80157b16ab25ea95bdf94fbee.converted --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:13:50.552042 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Releasing lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:13:50.552845 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Instance network_info: |[{"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:13:50.553608 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5cffe88e-97fa-4dd5-9c8a-5ca93d302f08 req-a7a870c9-d1e9-4ac0-acb3-764a9e1755ef service nova] Acquired lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:13:50.554008 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-5cffe88e-97fa-4dd5-9c8a-5ca93d302f08 req-a7a870c9-d1e9-4ac0-acb3-764a9e1755ef service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Refreshing network info cache for port a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:13:50.609999 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fb36d6ae2c509d80157b16ab25ea95bdf94fbee.converted --force-share --output=json" returned: 0 in 0.084s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:13:50.610564 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "1fb36d6ae2c509d80157b16ab25ea95bdf94fbee" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.755s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:50.610980 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:13:50.613669 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:13:50.614552 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fb36d6ae2c509d80157b16ab25ea95bdf94fbee --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:13:50.711139 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fb36d6ae2c509d80157b16ab25ea95bdf94fbee --force-share --output=json" returned: 0 in 0.096s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:13:50.711558 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "1fb36d6ae2c509d80157b16ab25ea95bdf94fbee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:50.712027 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "1fb36d6ae2c509d80157b16ab25ea95bdf94fbee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:50.712538 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:13:50.715087 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:13:50.715356 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fb36d6ae2c509d80157b16ab25ea95bdf94fbee --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:13:50.809478 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fb36d6ae2c509d80157b16ab25ea95bdf94fbee --force-share --output=json" returned: 0 in 0.094s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:13:50.809945 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fb36d6ae2c509d80157b16ab25ea95bdf94fbee,backing_fmt=raw /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:13:50.860823 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fb36d6ae2c509d80157b16ab25ea95bdf94fbee,backing_fmt=raw /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk 1073741824" returned: 0 in 0.051s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:13:50.861279 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "1fb36d6ae2c509d80157b16ab25ea95bdf94fbee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.149s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:50.861604 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fb36d6ae2c509d80157b16ab25ea95bdf94fbee --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:13:50.947412 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fb36d6ae2c509d80157b16ab25ea95bdf94fbee --force-share --output=json" returned: 0 in 0.085s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:13:50.948019 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:13:50.948272 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:13:51.032566 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:13:51.033015 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Cannot resize image /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:13:51.033407 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:13:51.033584 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Ensure instance console log exists: /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:13:51.033904 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:51.034139 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:51.034261 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:51.035942 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Start _get_guest_xml network_info=[{"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T03:13:42Z,direct_url=<?>,disk_format='qcow2',id=e4962c6e-b61e-49bb-8c87-5b9dabb75a44,min_disk=0,min_ram=0,name='tempest-scenario-img--1140933566',owner='132164e1033644c98f55a442c1bc16d6',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T03:13:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'e4962c6e-b61e-49bb-8c87-5b9dabb75a44'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:13:51.039782 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:13:51.041101 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='e4962c6e-b61e-49bb-8c87-5b9dabb75a44', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-437477219', uuid='bdb99676-cb52-4819-896e-b82dd6fa842a'), owner=OwnerMeta(userid='9fbbe453781546378e2ba3b6656e4d7b', username='tempest-TestMinimumBasicScenario-31061921-project-member', projectid='132164e1033644c98f55a442c1bc16d6', projectname='tempest-TestMinimumBasicScenario-31061921'), image=ImageMeta(id='e4962c6e-b61e-49bb-8c87-5b9dabb75a44', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851631.0407252) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:13:51.042160 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:13:51.042447 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:13:51.043262 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:13:51.043427 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:13:51.044343 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:13:51.044629 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T03:13:42Z,direct_url=<?>,disk_format='qcow2',id=e4962c6e-b61e-49bb-8c87-5b9dabb75a44,min_disk=0,min_ram=0,name='tempest-scenario-img--1140933566',owner='132164e1033644c98f55a442c1bc16d6',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T03:13:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:13:51.044768 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:13:51.044866 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:13:51.044993 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:13:51.045068 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:13:51.045160 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:13:51.045331 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:13:51.045426 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:13:51.045535 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:13:51.045634 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:13:51.045749 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:13:51.055217 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-437477219',display_name='tempest-TestMinimumBasicScenario-server-437477219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testminimumbasicscenario-server-437477219',id=69,image_ref='e4962c6e-b61e-49bb-8c87-5b9dabb75a44',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3JBgwam4Le1srCQd7CEpIw9vZQi8nr12K+dJ6UF0MnYrhjwK2G9BH71q1pSMTOrvL2r5MKfH6kITLwS/O6Bz1rul8SVU5Cu4+tfXbKZB1mpXHo/4cPQZCV1/I2dTIFEQ==',key_name='tempest-TestMinimumBasicScenario-1604290436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='132164e1033644c98f55a442c1bc16d6',ramdisk_id='',reservation_id='r-ksicpwh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e4962c6e-b61e-49bb-8c87-5b9dabb75a44',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-31061921',owner_user_name='tempest-TestMinimumBasicScenario-31061921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:13:49Z,user_data=None,user_id='9fbbe453781546378e2ba3b6656e4d7b',uuid=bdb99676-cb52-4819-896e-b82dd6fa842a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:13:51.055345 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Converting VIF {"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:13:51.055931 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=a525bd86-a59c-49e5-ba46-0df00f91a72c,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa525bd86-a5') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:13:51.056436 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lazy-loading 'pci_devices' on Instance uuid bdb99676-cb52-4819-896e-b82dd6fa842a {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:13:51.057503 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:51.058911 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-5cffe88e-97fa-4dd5-9c8a-5ca93d302f08 req-a7a870c9-d1e9-4ac0-acb3-764a9e1755ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:51.304890 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-5cffe88e-97fa-4dd5-9c8a-5ca93d302f08 req-a7a870c9-d1e9-4ac0-acb3-764a9e1755ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:51.357954 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:13:51.358370 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:13:51.358825 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:13:51.359055 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:13:51.359463 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.84 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:13:51.420679 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-5cffe88e-97fa-4dd5-9c8a-5ca93d302f08 req-a7a870c9-d1e9-4ac0-acb3-764a9e1755ef service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Updated VIF entry in instance network info cache for port a525bd86-a59c-49e5-ba46-0df00f91a72c. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:13:51.420679 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-5cffe88e-97fa-4dd5-9c8a-5ca93d302f08 req-a7a870c9-d1e9-4ac0-acb3-764a9e1755ef service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Updating instance_info_cache with network_info: [{"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:13:51.562895 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] End _get_guest_xml xml=<domain type="qemu">
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:   <uuid>bdb99676-cb52-4819-896e-b82dd6fa842a</uuid>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:   <name>instance-00000045</name>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestMinimumBasicScenario-server-437477219</nova:name>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:13:51</nova:creationTime>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <nova:image uuid="e4962c6e-b61e-49bb-8c87-5b9dabb75a44">
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:         <nova:properties/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:         <nova:user uuid="9fbbe453781546378e2ba3b6656e4d7b">tempest-TestMinimumBasicScenario-31061921-project-member</nova:user>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:         <nova:project uuid="132164e1033644c98f55a442c1bc16d6">tempest-TestMinimumBasicScenario-31061921</nova:project>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="e4962c6e-b61e-49bb-8c87-5b9dabb75a44"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:         <nova:port uuid="a525bd86-a59c-49e5-ba46-0df00f91a72c">
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     <system>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <entry name="serial">bdb99676-cb52-4819-896e-b82dd6fa842a</entry>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <entry name="uuid">bdb99676-cb52-4819-896e-b82dd6fa842a</entry>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     </system>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:   <os>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:   </os>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:   <features>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:   </features>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:   <devices>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     </disk>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk.config"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     </disk>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:a9:9c:8c"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <target dev="tapa525bd86-a5"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     </interface>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/console.log" append="off"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     </serial>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     <video>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     </video>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     </rng>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:   </devices>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]: </domain>
May 27 03:13:51.562895 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:13:51.564763 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Preparing to wait for external event network-vif-plugged-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:13:51.564763 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:51.564763 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:51.564763 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:51.564763 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-437477219',display_name='tempest-TestMinimumBasicScenario-server-437477219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testminimumbasicscenario-server-437477219',id=69,image_ref='e4962c6e-b61e-49bb-8c87-5b9dabb75a44',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3JBgwam4Le1srCQd7CEpIw9vZQi8nr12K+dJ6UF0MnYrhjwK2G9BH71q1pSMTOrvL2r5MKfH6kITLwS/O6Bz1rul8SVU5Cu4+tfXbKZB1mpXHo/4cPQZCV1/I2dTIFEQ==',key_name='tempest-TestMinimumBasicScenario-1604290436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='132164e1033644c98f55a442c1bc16d6',ramdisk_id='',reservation_id='r-ksicpwh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e4962c6e-b61e-49bb-8c87-5b9dabb75a44',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-31061921',owner_user_name='tempest-TestMinimumBasicScenario-31061921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:13:49Z,user_data=None,user_id='9fbbe453781546378e2ba3b6656e4d7b',uuid=bdb99676-cb52-4819-896e-b82dd6fa842a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:13:51.564763 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Converting VIF {"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:13:51.564763 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=a525bd86-a59c-49e5-ba46-0df00f91a72c,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa525bd86-a5') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:13:51.565046 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=a525bd86-a59c-49e5-ba46-0df00f91a72c,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa525bd86-a5') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:13:51.566670 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:51.566670 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:13:51.566670 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:13:51.567780 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:51.567780 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99b7013c-df0b-50d2-b5af-4c3e17281be7', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:13:51.569164 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:51.569164 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:13:51.569164 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:51.571451 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:51.571451 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa525bd86-a5, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:13:51.571451 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa525bd86-a5, col_values=(('qos', UUID('8484a49f-5eff-4ec6-8db8-2b97960ec383')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:13:51.571451 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa525bd86-a5, col_values=(('external_ids', {'iface-id': 'a525bd86-a59c-49e5-ba46-0df00f91a72c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:9c:8c', 'vm-uuid': 'bdb99676-cb52-4819-896e-b82dd6fa842a'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:13:51.571858 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:51.573313 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:13:51.576965 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:51.577790 np0000001475 nova-compute[98471]: INFO os_vif [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=a525bd86-a59c-49e5-ba46-0df00f91a72c,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa525bd86-a5')
May 27 03:13:51.627549 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:51.922455 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5cffe88e-97fa-4dd5-9c8a-5ca93d302f08 req-a7a870c9-d1e9-4ac0-acb3-764a9e1755ef service nova] Releasing lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:13:53.095107 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:13:53.095511 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:13:53.095511 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] No VIF found with MAC fa:16:3e:a9:9c:8c, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:13:53.095825 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Using config drive
May 27 03:13:53.197611 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:13:53.197958 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:13:53.199515 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:13:53.199866 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:13:53.601763 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:13:53.715550 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Creating config drive at /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk.config
May 27 03:13:53.718588 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz6ejlx9w {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:13:53.775858 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpz6ejlx9w" returned: 0 in 0.057s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:13:54.168228 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:54.187393 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:54.199771 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:13:54.200163 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:13:54.200484 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 10.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:13:54.282437 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:54.334646 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-928e8e20-60ea-49b6-bb64-89937faeb7cd req-065b7d58-6465-413d-9716-172292c0d880 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received event network-vif-plugged-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:13:54.334646 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-928e8e20-60ea-49b6-bb64-89937faeb7cd req-065b7d58-6465-413d-9716-172292c0d880 service nova] Acquiring lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:54.334646 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-928e8e20-60ea-49b6-bb64-89937faeb7cd req-065b7d58-6465-413d-9716-172292c0d880 service nova] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:54.334646 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-928e8e20-60ea-49b6-bb64-89937faeb7cd req-065b7d58-6465-413d-9716-172292c0d880 service nova] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:54.334646 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-928e8e20-60ea-49b6-bb64-89937faeb7cd req-065b7d58-6465-413d-9716-172292c0d880 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Processing event network-vif-plugged-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:13:54.467815 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:54.470134 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:54.486398 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:54.839198 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851634.8388274, bdb99676-cb52-4819-896e-b82dd6fa842a => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:13:54.839552 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:13:54.839717 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] VM Started (Lifecycle Event)
May 27 03:13:54.842862 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:13:54.846006 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Instance spawned successfully.
May 27 03:13:54.846791 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:13:55.342993 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:13:55.345605 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:13:55.355712 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:13:55.356669 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:13:55.357085 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:13:55.358038 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:13:55.358379 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:13:55.358998 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:13:55.529698 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0004425160000209871 future=<Future at 0x7557047e7f80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:13:55.529873 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:13:55.530335 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Emitting event <LifecycleEvent: 1779851620.5291321, b4509577-bb0c-4555-85c2-9978c9f06ff6 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:13:55.530461 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] VM Stopped (Lifecycle Event)
May 27 03:13:55.848360 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:13:55.848534 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851635.848358, bdb99676-cb52-4819-896e-b82dd6fa842a => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:13:55.848647 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] VM Paused (Lifecycle Event)
May 27 03:13:55.865219 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Took 6.01 seconds to spawn the instance on the hypervisor.
May 27 03:13:55.865219 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:13:56.032838 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:13:56.037672 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 4 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:13:56.350962 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:13:56.353164 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851636.352954, bdb99676-cb52-4819-896e-b82dd6fa842a => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:13:56.353224 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] VM Resumed (Lifecycle Event)
May 27 03:13:56.375176 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Took 11.32 seconds to build instance.
May 27 03:13:56.411335 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b9354130-410e-46ea-ac28-25aff4025c0c req-b8104d87-1c44-44c2-a156-b652cb3a0ba2 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received event network-vif-plugged-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:13:56.411655 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b9354130-410e-46ea-ac28-25aff4025c0c req-b8104d87-1c44-44c2-a156-b652cb3a0ba2 service nova] Acquiring lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:56.411800 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b9354130-410e-46ea-ac28-25aff4025c0c req-b8104d87-1c44-44c2-a156-b652cb3a0ba2 service nova] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:56.411876 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b9354130-410e-46ea-ac28-25aff4025c0c req-b8104d87-1c44-44c2-a156-b652cb3a0ba2 service nova] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:56.412032 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b9354130-410e-46ea-ac28-25aff4025c0c req-b8104d87-1c44-44c2-a156-b652cb3a0ba2 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] No waiting events found dispatching network-vif-plugged-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:13:56.412199 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-b9354130-410e-46ea-ac28-25aff4025c0c req-b8104d87-1c44-44c2-a156-b652cb3a0ba2 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received unexpected event network-vif-plugged-a525bd86-a59c-49e5-ba46-0df00f91a72c for instance with vm_state active and task_state None.
May 27 03:13:56.542651 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] During sync_power_state the instance has a pending task (deleting). Skip.
May 27 03:13:56.573267 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:56.629253 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:13:56.855920 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:13:56.857718 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:13:56.877844 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-00d3a2b7-2872-4388-892b-81515712cae5 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.827s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:13:58.052532 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "bdb99676-cb52-4819-896e-b82dd6fa842a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:13:58.052532 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:13:58.555707 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lazy-loading 'flavor' on Instance uuid bdb99676-cb52-4819-896e-b82dd6fa842a {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:13:59.560237 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:14:00.627173 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "bdb99676-cb52-4819-896e-b82dd6fa842a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:14:00.627627 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:14:00.627627 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Attaching volume 46760c7d-e1cb-4af6-80af-c454d67464d8 to /dev/vdb
May 27 03:14:00.662983 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:14:00.673490 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:14:00.696158 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:14:00.742561 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:14:00.742881 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:14:00.752366 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:14:00.753311 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe66:186f', 'fe80::f9:d2ff:fead:2ab6', 'fe80::fc16:3eff:fea9:9c8c', 'fe80::3473:3eff:fecc:f718'] 
May 27 03:14:00.753410 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:14:00.753521 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:14:00.753764 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:14:00.754018 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Updating existing volume attachment record: f2d2de04-e6b6-4fe6-903c-e3a6e37d52dc {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:14:01.303076 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:14:01.303529 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46760c7d-e1cb-4af6-80af-c454d67464d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:14:01.303693 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:14:01.575595 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:04.199957 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:14:04.704891 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:14:04.705080 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:14:04.705203 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:14:04.705325 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:14:05.734646 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:14:05.822422 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:14:05.822884 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:14:05.923392 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:14:05.928014 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:14:06.023028 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:14:06.023519 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:14:06.114988 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:14:06.119466 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:14:06.213050 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:14:06.213487 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:14:06.298499 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:14:06.298968 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:14:06.299072 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-4 (vdc) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:14:06.299174 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-5 (vdd) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:14:06.302876 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:14:06.303917 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:14:06.348599 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:14:06.349044 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=13256MB free_disk=72.64296340942383GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:14:06.349245 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:14:06.349476 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:14:06.579253 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:06.646434 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:07.399633 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:14:07.400023 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance b4509577-bb0c-4555-85c2-9978c9f06ff6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:14:07.400023 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance fc5a0cb1-d043-498f-af71-6947ba559007 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:14:07.400023 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance bdb99676-cb52-4819-896e-b82dd6fa842a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:14:07.400217 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:14:07.400217 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:14:06 up 45 min,  2 users,  load average: 2.84, 5.74, 5.21\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '2', 'num_os_type_None': '4', 'num_proj_256f2c4e067c46a3a4ea5e9d934b1d4b': '2', 'io_workload': '1', 'num_task_deleting': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_bf4b0011da7449e7948bf2c8a41955f5': '1', 'num_proj_132164e1033644c98f55a442c1bc16d6': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:14:07.589827 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:14:07.590119 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:14:08.092989 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:14:08.601763 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:14:08.602224 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.252s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:14:08.602273 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 41.60 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:14:11.582673 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:11.646579 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:16.585325 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:16.647789 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:21.587968 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:21.649165 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:26.588858 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:26.649430 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:31.591058 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:31.650195 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:36.593784 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:36.651583 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:41.154124 np0000001475 nova-compute[98471]: WARNING os_brick.exception [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Flushing 330000000667f34e2 failed: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 27 03:14:41.154577 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:14:41.194654 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:14:41.239215 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Checking to see if SCSI volumes sdj, sdi have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:14:41.239411 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] SCSI volumes sdj, sdi have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:14:41.240424 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Checking to see if device paths {'sdj', 'sdi'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:14:41.250998 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Device paths {'sdj', 'sdi'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:14:41.251219 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:14:41.261942 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:41.293735 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 168, target: iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c, portal: 192.168.40.100,3260]
May 27 03:14:41.293735 np0000001475 nova-compute[98471]: Logout of [sid: 168, target: iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c, portal: 192.168.40.100,3260] successful.
May 27 03:14:41.293735 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:41.309554 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:41.320130 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:41.345897 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 169, target: iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c, portal: 192.168.50.100,3260]
May 27 03:14:41.345897 np0000001475 nova-compute[98471]: Logout of [sid: 169, target: iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c, portal: 192.168.50.100,3260] successful.
May 27 03:14:41.345897 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:41.358390 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:41.358518 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Removing multipath device map 330000000667f34e2 to stop multipathd from monitoring the device. {{(pid=98471) _cleanup_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1009}}
May 27 03:14:41.358797 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Multipath 330000000667f34e2 no longer present {{(pid=98471) multipath_del_map /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:894}}
May 27 03:14:41.358961 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] There were errors removing {'sdj', 'sdi'}, leftovers may remain in the system
May 27 03:14:41.359183 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 60.273s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:14:41.360993 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] <== disconnect_volume: exception (60272ms)
May 27 03:14:41.360993 np0000001475 nova-compute[98471]: Chained Exception #1
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:         Traceback (most recent call last):
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py", line 396, in remove_connection
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:             self.flush_multipath_device(multipath_name)
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py", line 475, in flush_multipath_device
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:             self._execute('multipath', '-f', device_map_name, run_as_root=True,
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/executor.py", line 53, in _execute
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:             result = self.__execute(*args, **kwargs)
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 173, in execute
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:             return execute_root(*cmd, **kwargs)
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 315, in _wrap
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:             return self.channel.remote_call(name, args, kwargs, r_call_timeout)
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 266, in remote_call
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:             raise exc_type(*result[2])
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:         oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:         Command: multipath -f 330000000667f34e2
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:         Exit code: 1
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:         Stdout: ''
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:         Stderr: '2747.824733 | 330000000667f34e2: map in use\n'
May 27 03:14:41.360993 np0000001475 nova-compute[98471]:          {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:188}}
May 27 03:14:41.361528 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 57.447s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:14:41.361670 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Ignoring Volume Error on vol 2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c during delete
May 27 03:14:41.361670 np0000001475 nova-compute[98471]: Chained Exception #1
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:         Traceback (most recent call last):
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py", line 396, in remove_connection
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:             self.flush_multipath_device(multipath_name)
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py", line 475, in flush_multipath_device
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:             self._execute('multipath', '-f', device_map_name, run_as_root=True,
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/executor.py", line 53, in _execute
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:             result = self.__execute(*args, **kwargs)
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/os_brick/privileged/rootwrap.py", line 173, in execute
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:             return execute_root(*cmd, **kwargs)
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/priv_context.py", line 315, in _wrap
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:             return self.channel.remote_call(name, args, kwargs, r_call_timeout)
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:           File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py", line 266, in remote_call
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:             raise exc_type(*result[2])
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:         oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:         Command: multipath -f 330000000667f34e2
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:         Exit code: 1
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:         Stdout: ''
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:         Stderr: '2747.824733 | 330000000667f34e2: map in use\n'
May 27 03:14:41.361670 np0000001475 nova-compute[98471]:         : os_brick.exception.ExceptionChainer:
May 27 03:14:41.362159 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:14:41.362227 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Deleting instance files /opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6_del
May 27 03:14:41.363036 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Deletion of /opt/stack/data/nova/instances/b4509577-bb0c-4555-85c2-9978c9f06ff6_del complete
May 27 03:14:41.372132 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:14:41.373035 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:14:41.373661 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:14:41.373882 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:14:41.374564 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:14:41.374954 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:14:41.384389 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:14:41.384389 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:41.389187 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:14:41.389187 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:41.396024 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c] added
May 27 03:14:41.396024 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:14:41.396024 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:14:41.396024 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:14:41.396024 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:14:41.396024 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:14:41.396024 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:41.396372 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:14:41.396372 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0225(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:14:41.397195 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:14:41.401912 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c] added
May 27 03:14:41.401912 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:14:41.401912 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:14:41.401912 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:14:41.401912 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:14:41.401912 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:14:41.401912 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:41.402150 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:14:41.402265 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0274(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:14:41.402355 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:14:41.596549 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:41.869443 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Took 61.67 seconds to destroy the instance on the hypervisor.
May 27 03:14:41.870130 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:14:41.870512 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:14:41.870640 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:14:41.870963 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:14:41.960649 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f22d0457-ba2c-4c26-8889-59bbdc55f256 req-6951e5ac-8cbb-4526-ade4-1c805d416d92 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Received event network-vif-deleted-49b32736-9a22-4125-9303-1b5e23d0e1f7 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-f22d0457-ba2c-4c26-8889-59bbdc55f256 req-6951e5ac-8cbb-4526-ade4-1c805d416d92 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Neutron deleted interface 49b32736-9a22-4125-9303-1b5e23d0e1f7; detaching it from the instance and deleting it from the info cache
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f22d0457-ba2c-4c26-8889-59bbdc55f256 req-6951e5ac-8cbb-4526-ade4-1c805d416d92 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:14:43.176762 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:14:43.176762 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:43.176762 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:43.176762 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:43.176762 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:43.176762 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c, portal: 192.168.40.100,3260]
May 27 03:14:43.176762 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c, portal: 192.168.40.100,3260] successful.
May 27 03:14:43.182915 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c, portal: 192.168.50.100,3260]
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c, portal: 192.168.50.100,3260] successful.
May 27 03:14:43.182915 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.127s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('7', '-', '-', 0) found on session 174 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 174 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:43.182915 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('8', '-', '-', 0) found on session 175 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 175 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:14:43.182915 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f22d0457-ba2c-4c26-8889-59bbdc55f256 req-6951e5ac-8cbb-4526-ade4-1c805d416d92 service nova] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Detach interface failed, port_id=49b32736-9a22-4125-9303-1b5e23d0e1f7, reason: Instance b4509577-bb0c-4555-85c2-9978c9f06ff6 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:14:43.312607 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Took 1.44 seconds to deallocate network for instance.
May 27 03:14:43.327552 np0000001475 nova-compute[98471]: WARNING nova.volume.cinder [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Attachment 103b6884-0368-4ed5-8e7e-2b0c552d8317 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 103b6884-0368-4ed5-8e7e-2b0c552d8317. (HTTP 404) (Request-ID: req-b8f45d02-96a2-44f0-8414-ed9de977e40d)
May 27 03:14:43.327805 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: b4509577-bb0c-4555-85c2-9978c9f06ff6] Took 0.01 seconds to detach 1 volumes for instance.
May 27 03:14:43.374495 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:14:43.833127 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:14:43.833290 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:14:44.039003 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:14:44.039247 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:14:44.389475 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Found WWN 330000000b3e2107e for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:14:44.389871 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:14:44.390313 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 43.087s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:14:44.390543 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46760c7d-e1cb-4af6-80af-c454d67464d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:14:44.391067 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== connect_volume: return (60478ms) {'type': 'block', 'scsi_wwn': '330000000b3e2107e', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000b3e2107e'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:14:44.391196 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b3e2107e', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000b3e2107e'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:14:44.403076 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:14:44.403681 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:14:44.404269 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:14:44.405029 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:14:44.405337 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:14:44.405599 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:14:44.419228 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'fc5a0cb1-d043-498f-af71-6947ba559007', 'attached_at': '', 'detached_at': '', 'volume_id': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'serial': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c'} {{(pid=98471) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 03:14:44.419862 np0000001475 nova-compute[98471]: WARNING stevedore.named [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 03:14:44.420044 np0000001475 nova-compute[98471]: WARNING castellan.key_manager [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:14:44.420187 np0000001475 nova-compute[98471]: WARNING nova.keymgr.conf_key_mgr [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:14:44.421040 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:14:44.421040 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:44.421437 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x75573c39c860>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'fc5a0cb1-d043-498f-af71-6947ba559007', 'attached_at': '', 'detached_at': '', 'volume_id': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'serial': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c'} {{(pid=98471) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 27 03:14:44.421639 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98471) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 27 03:14:44.421777 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors.luks [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] opening encrypted volume /dev/dm-0 {{(pid=98471) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 27 03:14:44.431001 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:14:44.431001 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:44.432212 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8] added
May 27 03:14:44.432212 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:14:44.432212 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:14:44.432212 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:14:44.432212 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:14:44.432212 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:14:44.432212 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:44.432369 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:14:44.432587 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:14:44.432870 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:14:44.443661 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8] added
May 27 03:14:44.443661 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:14:44.443661 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:14:44.443661 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:14:44.443661 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:14:44.443661 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:14:44.443661 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:44.443956 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:14:44.444016 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0388(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:14:44.444174 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:14:44.460767 np0000001475 nova-compute[98471]: WARNING os_brick.encryptors.luks [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 27 03:14:44.460898 np0000001475 nova-compute[98471]: INFO os_brick.encryptors.luks [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] /dev/dm-0 is not a valid LUKS device; formatting device for first use
May 27 03:14:44.461019 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors.luks [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] formatting encrypted volume /dev/dm-0 {{(pid=98471) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 27 03:14:44.541765 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:14:45.047851 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.214s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:14:45.095425 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Deleted allocations for instance b4509577-bb0c-4555-85c2-9978c9f06ff6
May 27 03:14:45.433317 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:14:45.444764 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:14:45.446765 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:14:45.446765 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:14:45.457669 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:14:45.457669 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:45.463636 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:45.472904 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:45.479849 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:45.479849 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:45.479849 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:45.479849 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:45.479849 np0000001475 nova-compute[98471]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:45.479849 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:45.479849 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:14:45.480154 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:45.480154 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:45.480154 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:45.480154 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:45.480154 np0000001475 nova-compute[98471]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:45.480154 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:45.480154 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:14:45.490725 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:45.490725 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:45.490725 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:45.490725 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:45.490725 np0000001475 nova-compute[98471]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:45.490725 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:45.490725 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:14:45.490980 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:45.490980 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:45.490980 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:45.490980 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:45.490980 np0000001475 nova-compute[98471]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:45.490980 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:45.490980 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:14:45.523197 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8, portal: 192.168.40.100,3260]
May 27 03:14:45.523197 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8, portal: 192.168.40.100,3260] successful.
May 27 03:14:45.523197 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:45.535725 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:45.548381 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8, portal: 192.168.50.100,3260]
May 27 03:14:45.548381 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8, portal: 192.168.50.100,3260] successful.
May 27 03:14:45.548381 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:45.550174 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:45.550174 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:45.550174 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:45.550174 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:45.550174 np0000001475 nova-compute[98471]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:45.550174 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:45.550174 np0000001475 nova-compute[98471]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:14:45.550174 np0000001475 nova-compute[98471]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:14:45.550174 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:14:45.550391 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:45.550391 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:45.550391 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:45.550391 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:45.550391 np0000001475 nova-compute[98471]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:45.550391 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:45.550391 np0000001475 nova-compute[98471]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:14:45.550391 np0000001475 nova-compute[98471]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:14:45.550391 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:14:45.550663 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:14:45.550843 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:14:45.551817 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] HCTL ('9', '-', '-', 0) found on session 176 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:14:45.551920 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:14:45.561662 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:45.567610 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Searching for a device in session 176 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:14:45.567864 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46760c7d-e1cb-4af6-80af-c454d67464d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:14:45.577831 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:45.577831 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:45.577831 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:45.577831 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:45.577831 np0000001475 nova-compute[98471]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:45.577831 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:45.577831 np0000001475 nova-compute[98471]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:14:45.577831 np0000001475 nova-compute[98471]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:14:45.577831 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:14:45.577831 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:45.577831 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:45.577831 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:45.577831 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:45.577831 np0000001475 nova-compute[98471]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:45.577831 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:45.577831 np0000001475 nova-compute[98471]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:14:45.577831 np0000001475 nova-compute[98471]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:14:45.577831 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:14:45.578205 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:14:45.578205 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:14:45.579024 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] HCTL ('14', '-', '-', 0) found on session 177 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:14:45.579127 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:14:45.592175 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Searching for a device in session 177 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:14:45.592380 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '46760c7d-e1cb-4af6-80af-c454d67464d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:14:46.105533 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7e04a831-0d56-48a2-b11e-acf3dcc7214a tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "b4509577-bb0c-4555-85c2-9978c9f06ff6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 66.411s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:14:46.407771 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:14:46.615374 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:46.687947 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:14:46.688183 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:14:47.190912 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Detaching volume 2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c
May 27 03:14:47.234264 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Attempting to driver detach volume 2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c from mountpoint /dev/vdd
May 27 03:14:47.241419 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Found disk vdd by alias ua-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:14:47.242493 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Found disk vdd by alias ua-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:14:47.242621 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Attempting to detach device vdd from instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:14:47.242878 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:14:47.242878 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:14:47.242878 np0000001475 nova-compute[98471]:   <alias name="ua-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c"/>
May 27 03:14:47.242878 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:14:47.242878 np0000001475 nova-compute[98471]:   <target dev="vdd" bus="virtio"/>
May 27 03:14:47.242878 np0000001475 nova-compute[98471]:   <serial>2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c</serial>
May 27 03:14:47.242878 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:14:47.242878 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 27 03:14:47.242878 np0000001475 nova-compute[98471]: </disk>
May 27 03:14:47.242878 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:14:47.248270 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Successfully detached device vdd from instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 from the persistent domain config.
May 27 03:14:47.248462 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] (1/8): Attempting to detach device vdd with device alias ua-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c from instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:14:47.248735 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:14:47.248735 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:14:47.248735 np0000001475 nova-compute[98471]:   <alias name="ua-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c"/>
May 27 03:14:47.248735 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-5"/>
May 27 03:14:47.248735 np0000001475 nova-compute[98471]:   <target dev="vdd" bus="virtio"/>
May 27 03:14:47.248735 np0000001475 nova-compute[98471]:   <serial>2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c</serial>
May 27 03:14:47.248735 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:14:47.248735 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 27 03:14:47.248735 np0000001475 nova-compute[98471]: </disk>
May 27 03:14:47.248735 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:14:47.439087 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Found WWN 3300000006fac5e05 for multipath device dm-1 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:14:47.446321 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.056s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:14:47.446634 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] <== connect_volume: return (46142ms) {'type': 'block', 'scsi_wwn': '3300000006fac5e05', 'path': '/dev/dm-1', 'multipath_id': '3300000006fac5e05'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:14:47.446839 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006fac5e05', 'path': '/dev/dm-1', 'multipath_id': '3300000006fac5e05'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:14:47.454053 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lazy-loading 'flavor' on Instance uuid bdb99676-cb52-4819-896e-b82dd6fa842a {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:14:47.754240 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851687.753626, 79df2202-e3ff-44de-8dee-d13a3a8304d5 => ua-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:14:47.755256 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Start waiting for the detach event from libvirt for device vdd with device alias ua-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c for instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:14:47.758395 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Successfully detached device vdd from instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 from the live domain config.
May 27 03:14:47.794593 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:14:47.795010 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:14:47.795292 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:14:47.957325 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Attempting to attach volume 46760c7d-e1cb-4af6-80af-c454d67464d8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:14:47.959034 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:14:47.959034 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:14:47.959034 np0000001475 nova-compute[98471]:   <alias name="ua-46760c7d-e1cb-4af6-80af-c454d67464d8"/>
May 27 03:14:47.959034 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-1"/>
May 27 03:14:47.959034 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:14:47.959034 np0000001475 nova-compute[98471]:   <serial>46760c7d-e1cb-4af6-80af-c454d67464d8</serial>
May 27 03:14:47.959034 np0000001475 nova-compute[98471]: </disk>
May 27 03:14:47.959034 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:14:49.643643 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:14:49.644189 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:14:49.644189 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:14:49.644189 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] No VIF found with MAC fa:16:3e:a9:9c:8c, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:14:49.758832 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.963s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:14:49.759135 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:14:49.759349 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:14:49.813252 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:49.813252 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:49.813252 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:49.813252 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:49.813252 np0000001475 nova-compute[98471]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:49.813252 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:49.813252 np0000001475 nova-compute[98471]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:14:49.813252 np0000001475 nova-compute[98471]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:14:49.813252 np0000001475 nova-compute[98471]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c7be26f-a3a0-4958-984b-53f4fbc75684 (non-flash)
May 27 03:14:49.813252 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:14:49.813705 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:49.813705 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:49.813705 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:49.813705 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:49.813705 np0000001475 nova-compute[98471]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:49.813705 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:49.813705 np0000001475 nova-compute[98471]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:14:49.813705 np0000001475 nova-compute[98471]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:14:49.813705 np0000001475 nova-compute[98471]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c7be26f-a3a0-4958-984b-53f4fbc75684 (non-flash)
May 27 03:14:49.813705 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:14:49.813971 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', '174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', '175'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', '177'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c7be26f-a3a0-4958-984b-53f4fbc75684', '178')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:14:49.813971 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c, 0): [] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:14:49.814099 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c') {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 03:14:49.814472 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c, 0): [] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:14:49.814472 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c97f39d-3dc7-4dcf-a8d0-b79678c37e0c') {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 27 03:14:49.814620 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7557247c8180>, {}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:14:49.814753 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Disconnecting from: [] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:14:49.814993 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.057s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:14:49.815133 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] <== disconnect_volume: return (2019ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:14:49.815306 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:14:50.200295 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:14:50.201378 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:14:50.201983 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:14:50.202887 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:14:50.388426 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'flavor' on Instance uuid 79df2202-e3ff-44de-8dee-d13a3a8304d5 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:14:50.705292 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:14:51.200792 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8ebfc039-de4f-493e-a38b-4a3e6a84f411 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 50.573s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:14:51.396402 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-27ac05ec-5165-46dd-be13-1a61ff03ef1d tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.708s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:14:51.617380 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:51.705191 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:14:51.705611 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.49 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:14:52.064794 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:14:52.064910 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:14:52.217560 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors.luks [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] opening encrypted volume /dev/dm-0 {{(pid=98471) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 27 03:14:52.567362 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Detaching volume 2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b
May 27 03:14:52.638095 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Attempting to driver detach volume 2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b from mountpoint /dev/vdc
May 27 03:14:52.677240 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': '79df2202-e3ff-44de-8dee-d13a3a8304d5', 'attached_at': '', 'detached_at': '', 'volume_id': '2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'serial': '2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b'} {{(pid=98471) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 03:14:52.685687 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Found disk vdc by alias ua-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:14:52.690284 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Found disk vdc by alias ua-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:14:52.690533 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Attempting to detach device vdc from instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:14:52.691611 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:14:52.691611 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:14:52.691611 np0000001475 nova-compute[98471]:   <alias name="ua-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b"/>
May 27 03:14:52.691611 np0000001475 nova-compute[98471]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 27 03:14:52.691611 np0000001475 nova-compute[98471]:   <target dev="vdc" bus="virtio"/>
May 27 03:14:52.691611 np0000001475 nova-compute[98471]:   <serial>2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b</serial>
May 27 03:14:52.691611 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 27 03:14:52.691611 np0000001475 nova-compute[98471]:   <encryption format="luks">
May 27 03:14:52.691611 np0000001475 nova-compute[98471]:     <secret type="passphrase" uuid="a33829a8-0b64-4b75-8240-82c2c661d9c6"/>
May 27 03:14:52.691611 np0000001475 nova-compute[98471]:   </encryption>
May 27 03:14:52.691611 np0000001475 nova-compute[98471]: </disk>
May 27 03:14:52.691611 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:14:52.698848 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Successfully detached device vdc from instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 from the persistent domain config.
May 27 03:14:52.699080 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] (1/8): Attempting to detach device vdc with device alias ua-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b from instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:14:52.699656 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:14:52.699656 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:14:52.699656 np0000001475 nova-compute[98471]:   <alias name="ua-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b"/>
May 27 03:14:52.699656 np0000001475 nova-compute[98471]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 27 03:14:52.699656 np0000001475 nova-compute[98471]:   <target dev="vdc" bus="virtio"/>
May 27 03:14:52.699656 np0000001475 nova-compute[98471]:   <serial>2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b</serial>
May 27 03:14:52.699656 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 27 03:14:52.699656 np0000001475 nova-compute[98471]:   <encryption format="luks">
May 27 03:14:52.699656 np0000001475 nova-compute[98471]:     <secret type="passphrase" uuid="a33829a8-0b64-4b75-8240-82c2c661d9c6"/>
May 27 03:14:52.699656 np0000001475 nova-compute[98471]:   </encryption>
May 27 03:14:52.699656 np0000001475 nova-compute[98471]: </disk>
May 27 03:14:52.699656 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:14:53.200297 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:14:53.200888 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:14:53.217524 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851693.2170606, 79df2202-e3ff-44de-8dee-d13a3a8304d5 => ua-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:14:53.220073 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b for instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:14:53.222973 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Successfully detached device vdc from instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 from the live domain config.
May 27 03:14:53.225571 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:14:53.226073 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:14:53.227571 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:14:53.227571 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:14:53.227571 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:14:53.227571 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c7be26f-a3a0-4958-984b-53f4fbc75684 (non-flash)
May 27 03:14:53.262560 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b (non-flash)
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c7be26f-a3a0-4958-984b-53f4fbc75684 (non-flash)
May 27 03:14:53.262560 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', '174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', '175'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', '177'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c7be26f-a3a0-4958-984b-53f4fbc75684', '178')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', '165')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:14:53.262560 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b', '166')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:14:53.264027 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c4db740>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b'): ({'sdh'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:14:53.264362 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Removing multipathed devices sdh, sdg {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:14:53.264721 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Flush multipath device 3300000007fa8bdb9 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:14:53.298491 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:14:53.334607 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:14:53.380002 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:14:53.381328 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:14:53.381328 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:14:53.393326 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:14:53.393326 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:14:53.405833 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:53.441730 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 165, target: iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b, portal: 192.168.40.100,3260]
May 27 03:14:53.441730 np0000001475 nova-compute[98471]: Logout of [sid: 165, target: iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b, portal: 192.168.40.100,3260] successful.
May 27 03:14:53.441730 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:53.466363 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:53.480220 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:53.517485 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 166, target: iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b, portal: 192.168.50.100,3260]
May 27 03:14:53.517485 np0000001475 nova-compute[98471]: Logout of [sid: 166, target: iqn.2023-03.storpool.com:os--volume-2bd89d61-8e0b-4dd6-a8bc-5d66bb479e9b, portal: 192.168.50.100,3260] successful.
May 27 03:14:53.517485 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:53.541676 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:53.545600 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:14:53.545600 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] <== disconnect_volume: return (316ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:14:53.545600 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:14:54.122895 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'flavor' on Instance uuid 79df2202-e3ff-44de-8dee-d13a3a8304d5 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:14:54.176340 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a91f5cd3-d265-4a7a-8b73-84a21e45822b req-e775cfd4-bd7d-4df1-a10d-977d5072a597 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received event network-changed-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:14:54.176536 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a91f5cd3-d265-4a7a-8b73-84a21e45822b req-e775cfd4-bd7d-4df1-a10d-977d5072a597 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Refreshing instance network info cache due to event network-changed-a525bd86-a59c-49e5-ba46-0df00f91a72c. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:14:54.176757 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a91f5cd3-d265-4a7a-8b73-84a21e45822b req-e775cfd4-bd7d-4df1-a10d-977d5072a597 service nova] Acquiring lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:14:54.176898 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a91f5cd3-d265-4a7a-8b73-84a21e45822b req-e775cfd4-bd7d-4df1-a10d-977d5072a597 service nova] Acquired lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:14:54.177033 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a91f5cd3-d265-4a7a-8b73-84a21e45822b req-e775cfd4-bd7d-4df1-a10d-977d5072a597 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Refreshing network info cache for port a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:14:54.200653 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:14:54.202459 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:14:54.202459 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98471) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 27 03:14:54.680077 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-a91f5cd3-d265-4a7a-8b73-84a21e45822b req-e775cfd4-bd7d-4df1-a10d-977d5072a597 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:14:54.705469 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:14:55.047066 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-a91f5cd3-d265-4a7a-8b73-84a21e45822b req-e775cfd4-bd7d-4df1-a10d-977d5072a597 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:14:55.082196 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:13:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2118130998',display_name='tempest-TestVolumeBootPattern-server-2118130998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-2118130998',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-3kdyr9mt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:13:41Z,user_data=None,user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=fc5a0cb1-d043-498f-af71-6947ba559007,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b43f898-1af7-4168-ad4c-4b5c7596d28c", "address": "fa:16:3e:21:55:54", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b43f898-1a", "ovs_interfaceid": "8b43f898-1af7-4168-ad4c-4b5c7596d28c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:14:55.082366 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "8b43f898-1af7-4168-ad4c-4b5c7596d28c", "address": "fa:16:3e:21:55:54", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b43f898-1a", "ovs_interfaceid": "8b43f898-1af7-4168-ad4c-4b5c7596d28c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:14:55.083146 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:55:54,bridge_name='br-int',has_traffic_filtering=True,id=8b43f898-1af7-4168-ad4c-4b5c7596d28c,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b43f898-1a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:14:55.084218 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'pci_devices' on Instance uuid fc5a0cb1-d043-498f-af71-6947ba559007 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:14:55.131975 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-8e19f94f-84c3-408a-a63c-9599c024ebde tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.066s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:14:55.166079 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a91f5cd3-d265-4a7a-8b73-84a21e45822b req-e775cfd4-bd7d-4df1-a10d-977d5072a597 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Updated VIF entry in instance network info cache for port a525bd86-a59c-49e5-ba46-0df00f91a72c. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:14:55.166355 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a91f5cd3-d265-4a7a-8b73-84a21e45822b req-e775cfd4-bd7d-4df1-a10d-977d5072a597 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Updating instance_info_cache with network_info: [{"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:14:55.405848 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:14:55.406272 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:14:55.587179 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] End _get_guest_xml xml=<domain type="qemu">
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:   <uuid>fc5a0cb1-d043-498f-af71-6947ba559007</uuid>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:   <name>instance-00000044</name>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestVolumeBootPattern-server-2118130998</nova:name>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:13:43</nova:creationTime>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:         <nova:properties/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:         <nova:user uuid="8eeaf68cfb534238bfe879dd6e8f858f">tempest-TestVolumeBootPattern-360350731-project-member</nova:user>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:         <nova:project uuid="bf4b0011da7449e7948bf2c8a41955f5">tempest-TestVolumeBootPattern-360350731</nova:project>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:         <nova:port uuid="8b43f898-1af7-4168-ad4c-4b5c7596d28c">
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     <system>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <entry name="serial">fc5a0cb1-d043-498f-af71-6947ba559007</entry>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <entry name="uuid">fc5a0cb1-d043-498f-af71-6947ba559007</entry>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     </system>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:   <os>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:   </os>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:   <features>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:   </features>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:   <devices>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/fc5a0cb1-d043-498f-af71-6947ba559007/disk.config"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     </disk>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <alias name="ua-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <serial>80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c</serial>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     </disk>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:21:55:54"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <target dev="tap8b43f898-1a"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     </interface>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/fc5a0cb1-d043-498f-af71-6947ba559007/console.log" append="off"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     </serial>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     <video>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     </video>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     </rng>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:   </devices>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]: </domain>
May 27 03:14:55.587179 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:14:55.589000 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Preparing to wait for external event network-vif-plugged-8b43f898-1af7-4168-ad4c-4b5c7596d28c {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:14:55.589000 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "fc5a0cb1-d043-498f-af71-6947ba559007-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:14:55.589000 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "fc5a0cb1-d043-498f-af71-6947ba559007-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:14:55.589000 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "fc5a0cb1-d043-498f-af71-6947ba559007-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:14:55.589000 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:13:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2118130998',display_name='tempest-TestVolumeBootPattern-server-2118130998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-2118130998',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-3kdyr9mt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:13:41Z,user_data=None,user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=fc5a0cb1-d043-498f-af71-6947ba559007,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b43f898-1af7-4168-ad4c-4b5c7596d28c", "address": "fa:16:3e:21:55:54", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b43f898-1a", "ovs_interfaceid": "8b43f898-1af7-4168-ad4c-4b5c7596d28c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:14:55.589000 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "8b43f898-1af7-4168-ad4c-4b5c7596d28c", "address": "fa:16:3e:21:55:54", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b43f898-1a", "ovs_interfaceid": "8b43f898-1af7-4168-ad4c-4b5c7596d28c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:14:55.589394 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:55:54,bridge_name='br-int',has_traffic_filtering=True,id=8b43f898-1af7-4168-ad4c-4b5c7596d28c,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b43f898-1a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:14:55.589766 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:55:54,bridge_name='br-int',has_traffic_filtering=True,id=8b43f898-1af7-4168-ad4c-4b5c7596d28c,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b43f898-1a') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:14:55.590308 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:55.590607 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:14:55.590903 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:14:55.591799 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:55.591974 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9e7675c-91ff-564f-8c89-12b7362eb699', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:14:55.604215 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:55.605018 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:14:55.605615 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:55.607918 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:55.608101 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b43f898-1a, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:14:55.608505 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b43f898-1a, col_values=(('qos', UUID('2f468601-64c2-407f-b146-fbd111be63fc')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:14:55.608680 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b43f898-1a, col_values=(('external_ids', {'iface-id': '8b43f898-1af7-4168-ad4c-4b5c7596d28c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:55:54', 'vm-uuid': 'fc5a0cb1-d043-498f-af71-6947ba559007'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:14:55.609661 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:55.611050 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:14:55.616779 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:55.618600 np0000001475 nova-compute[98471]: INFO os_vif [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:55:54,bridge_name='br-int',has_traffic_filtering=True,id=8b43f898-1af7-4168-ad4c-4b5c7596d28c,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b43f898-1a')
May 27 03:14:55.669932 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a91f5cd3-d265-4a7a-8b73-84a21e45822b req-e775cfd4-bd7d-4df1-a10d-977d5072a597 service nova] Releasing lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:14:55.700600 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:14:55.700932 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:14:55.701528 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:14:55.908515 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Detaching volume 2b29ec93-8fbc-4216-a128-2e09120243ee
May 27 03:14:55.945278 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Attempting to driver detach volume 2b29ec93-8fbc-4216-a128-2e09120243ee from mountpoint /dev/vdb
May 27 03:14:55.949556 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Found disk vdb by alias ua-2b29ec93-8fbc-4216-a128-2e09120243ee {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:14:55.950642 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Found disk vdb by alias ua-2b29ec93-8fbc-4216-a128-2e09120243ee {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:14:55.950779 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Attempting to detach device vdb from instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:14:55.950959 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:14:55.950959 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:14:55.950959 np0000001475 nova-compute[98471]:   <alias name="ua-2b29ec93-8fbc-4216-a128-2e09120243ee"/>
May 27 03:14:55.950959 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:14:55.950959 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:14:55.950959 np0000001475 nova-compute[98471]:   <serial>2b29ec93-8fbc-4216-a128-2e09120243ee</serial>
May 27 03:14:55.950959 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:14:55.950959 np0000001475 nova-compute[98471]: </disk>
May 27 03:14:55.950959 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:14:55.955570 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Successfully detached device vdb from instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 from the persistent domain config.
May 27 03:14:55.955702 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] (1/8): Attempting to detach device vdb with device alias ua-2b29ec93-8fbc-4216-a128-2e09120243ee from instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:14:55.955908 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:14:55.955908 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:14:55.955908 np0000001475 nova-compute[98471]:   <alias name="ua-2b29ec93-8fbc-4216-a128-2e09120243ee"/>
May 27 03:14:55.955908 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:14:55.955908 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:14:55.955908 np0000001475 nova-compute[98471]:   <serial>2b29ec93-8fbc-4216-a128-2e09120243ee</serial>
May 27 03:14:55.955908 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:14:55.955908 np0000001475 nova-compute[98471]: </disk>
May 27 03:14:55.955908 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:14:56.199968 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:14:56.200254 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Cleaning up deleted instances {{(pid=98471) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 27 03:14:56.242034 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0fbf1d7d-a2bd-4341-9781-baa343a11620 req-f117286f-3059-4067-8296-750cde67af92 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received event network-changed-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:14:56.242347 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0fbf1d7d-a2bd-4341-9781-baa343a11620 req-f117286f-3059-4067-8296-750cde67af92 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Refreshing instance network info cache due to event network-changed-a525bd86-a59c-49e5-ba46-0df00f91a72c. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:14:56.242537 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0fbf1d7d-a2bd-4341-9781-baa343a11620 req-f117286f-3059-4067-8296-750cde67af92 service nova] Acquiring lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:14:56.242652 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0fbf1d7d-a2bd-4341-9781-baa343a11620 req-f117286f-3059-4067-8296-750cde67af92 service nova] Acquired lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:14:56.242797 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-0fbf1d7d-a2bd-4341-9781-baa343a11620 req-f117286f-3059-4067-8296-750cde67af92 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Refreshing network info cache for port a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:14:56.419550 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851696.4192, 79df2202-e3ff-44de-8dee-d13a3a8304d5 => ua-2b29ec93-8fbc-4216-a128-2e09120243ee> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:14:56.420606 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2b29ec93-8fbc-4216-a128-2e09120243ee for instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:14:56.422780 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Successfully detached device vdb from instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 from the live domain config.
May 27 03:14:56.423655 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:14:56.423942 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b29ec93-8fbc-4216-a128-2e09120243ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:14:56.424082 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:14:56.424342 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:14:56.424604 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2b29ec93-8fbc-4216-a128-2e09120243ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:14:56.424732 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:14:56.454007 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:56.454007 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:56.454007 np0000001475 nova-compute[98471]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:56.454007 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:56.454007 np0000001475 nova-compute[98471]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:14:56.454007 np0000001475 nova-compute[98471]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:14:56.454007 np0000001475 nova-compute[98471]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c7be26f-a3a0-4958-984b-53f4fbc75684 (non-flash)
May 27 03:14:56.454007 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:14:56.454263 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:56.454263 np0000001475 nova-compute[98471]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee (non-flash)
May 27 03:14:56.454263 np0000001475 nova-compute[98471]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:56.454263 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:14:56.454263 np0000001475 nova-compute[98471]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:14:56.454263 np0000001475 nova-compute[98471]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:14:56.454263 np0000001475 nova-compute[98471]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6c7be26f-a3a0-4958-984b-53f4fbc75684 (non-flash)
May 27 03:14:56.454263 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:14:56.454405 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', '174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', '175'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', '177'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6c7be26f-a3a0-4958-984b-53f4fbc75684', '178')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:14:56.454405 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', '163')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:14:56.455451 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee', '164')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:14:56.456206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572478b060>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee'): ({'sdf'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:14:56.456819 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Removing multipathed devices sdf, sde {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:14:56.456819 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Flush multipath device 3300000007bd29158 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:14:56.494150 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:14:56.533169 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:14:56.581201 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:14:56.581385 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:14:56.582614 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:14:56.595469 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:14:56.595649 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:14:56.607061 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:56.643865 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 163, target: iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee, portal: 192.168.40.100,3260]
May 27 03:14:56.643865 np0000001475 nova-compute[98471]: Logout of [sid: 163, target: iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee, portal: 192.168.40.100,3260] successful.
May 27 03:14:56.643865 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:56.656720 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:56.661269 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:56.672426 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:56.704184 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] There are 0 instances to clean {{(pid=98471) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 27 03:14:56.704589 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:14:56.711509 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 164, target: iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee, portal: 192.168.50.100,3260]
May 27 03:14:56.711509 np0000001475 nova-compute[98471]: Logout of [sid: 164, target: iqn.2023-03.storpool.com:os--volume-2b29ec93-8fbc-4216-a128-2e09120243ee, portal: 192.168.50.100,3260] successful.
May 27 03:14:56.711509 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:56.725637 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:14:56.725962 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:14:56.726135 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] <== disconnect_volume: return (302ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:14:56.726267 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:14:56.747761 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-0fbf1d7d-a2bd-4341-9781-baa343a11620 req-f117286f-3059-4067-8296-750cde67af92 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:14:57.013111 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-0fbf1d7d-a2bd-4341-9781-baa343a11620 req-f117286f-3059-4067-8296-750cde67af92 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:14:57.139984 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:14:57.140118 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:14:57.140256 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No VIF found with MAC fa:16:3e:21:55:54, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:14:57.140789 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Using config drive
May 27 03:14:57.156432 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-0fbf1d7d-a2bd-4341-9781-baa343a11620 req-f117286f-3059-4067-8296-750cde67af92 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Updated VIF entry in instance network info cache for port a525bd86-a59c-49e5-ba46-0df00f91a72c. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:14:57.156665 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-0fbf1d7d-a2bd-4341-9781-baa343a11620 req-f117286f-3059-4067-8296-750cde67af92 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Updating instance_info_cache with network_info: [{"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:14:57.270108 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'flavor' on Instance uuid 79df2202-e3ff-44de-8dee-d13a3a8304d5 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:14:57.647307 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:14:57.660893 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0fbf1d7d-a2bd-4341-9781-baa343a11620 req-f117286f-3059-4067-8296-750cde67af92 service nova] Releasing lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:14:57.760085 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Creating config drive at /opt/stack/data/nova/instances/fc5a0cb1-d043-498f-af71-6947ba559007/disk.config
May 27 03:14:57.762763 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fc5a0cb1-d043-498f-af71-6947ba559007/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpubi15d6f {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:14:57.814791 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fc5a0cb1-d043-498f-af71-6947ba559007/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpubi15d6f" returned: 0 in 0.052s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:14:58.211836 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:58.234288 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:58.280535 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0877cfbe-de29-4c02-aec0-d04dc143b637 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.874s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:14:58.329133 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:58.425403 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-393b91b2-2d74-4562-8ae2-d1e33ed1ed50 req-cc1fab66-df33-4fc1-8d27-f541ca8c158d service nova] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Received event network-vif-plugged-8b43f898-1af7-4168-ad4c-4b5c7596d28c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:14:58.426076 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-393b91b2-2d74-4562-8ae2-d1e33ed1ed50 req-cc1fab66-df33-4fc1-8d27-f541ca8c158d service nova] Acquiring lock "fc5a0cb1-d043-498f-af71-6947ba559007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:14:58.426305 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-393b91b2-2d74-4562-8ae2-d1e33ed1ed50 req-cc1fab66-df33-4fc1-8d27-f541ca8c158d service nova] Lock "fc5a0cb1-d043-498f-af71-6947ba559007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:14:58.426549 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-393b91b2-2d74-4562-8ae2-d1e33ed1ed50 req-cc1fab66-df33-4fc1-8d27-f541ca8c158d service nova] Lock "fc5a0cb1-d043-498f-af71-6947ba559007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:14:58.426663 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-393b91b2-2d74-4562-8ae2-d1e33ed1ed50 req-cc1fab66-df33-4fc1-8d27-f541ca8c158d service nova] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Processing event network-vif-plugged-8b43f898-1af7-4168-ad4c-4b5c7596d28c {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:14:58.658687 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "bdb99676-cb52-4819-896e-b82dd6fa842a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:14:58.659634 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:14:58.659634 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Rebooting instance
May 27 03:14:58.666556 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:58.668222 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:58.671467 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:58.688829 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:14:58.700701 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:14:58.701218 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.50 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:14:58.954637 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:14:58.956068 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851698.9555297, fc5a0cb1-d043-498f-af71-6947ba559007 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:14:58.956532 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] VM Started (Lifecycle Event)
May 27 03:14:58.958778 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:14:58.962224 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Instance spawned successfully.
May 27 03:14:58.962631 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:14:59.237366 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:14:59.237513 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquired lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:14:59.237663 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:14:59.460845 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:14:59.463320 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:14:59.471302 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:14:59.471458 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:14:59.471639 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:14:59.471831 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:14:59.472080 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:14:59.472204 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:14:59.741241 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:14:59.966117 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:14:59.966339 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851699.9661763, fc5a0cb1-d043-498f-af71-6947ba559007 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:14:59.966432 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] VM Paused (Lifecycle Event)
May 27 03:14:59.978157 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Took 76.46 seconds to spawn the instance on the hypervisor.
May 27 03:14:59.978609 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:15:00.055803 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:00.182143 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Updating instance_info_cache with network_info: [{"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:15:00.469069 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:15:00.471315 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851700.470985, fc5a0cb1-d043-498f-af71-6947ba559007 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:15:00.471540 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] VM Resumed (Lifecycle Event)
May 27 03:15:00.486966 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Took 83.45 seconds to build instance.
May 27 03:15:00.507387 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ee631244-b85d-4377-bbe7-16f15c69019b req-09af1fc8-6ece-41ec-8b28-3af1fc60ae99 service nova] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Received event network-vif-plugged-8b43f898-1af7-4168-ad4c-4b5c7596d28c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:00.507903 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ee631244-b85d-4377-bbe7-16f15c69019b req-09af1fc8-6ece-41ec-8b28-3af1fc60ae99 service nova] Acquiring lock "fc5a0cb1-d043-498f-af71-6947ba559007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:00.508151 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ee631244-b85d-4377-bbe7-16f15c69019b req-09af1fc8-6ece-41ec-8b28-3af1fc60ae99 service nova] Lock "fc5a0cb1-d043-498f-af71-6947ba559007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:00.508271 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ee631244-b85d-4377-bbe7-16f15c69019b req-09af1fc8-6ece-41ec-8b28-3af1fc60ae99 service nova] Lock "fc5a0cb1-d043-498f-af71-6947ba559007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:00.508384 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ee631244-b85d-4377-bbe7-16f15c69019b req-09af1fc8-6ece-41ec-8b28-3af1fc60ae99 service nova] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] No waiting events found dispatching network-vif-plugged-8b43f898-1af7-4168-ad4c-4b5c7596d28c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:15:00.508783 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-ee631244-b85d-4377-bbe7-16f15c69019b req-09af1fc8-6ece-41ec-8b28-3af1fc60ae99 service nova] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Received unexpected event network-vif-plugged-8b43f898-1af7-4168-ad4c-4b5c7596d28c for instance with vm_state active and task_state None.
May 27 03:15:00.610945 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:00.684970 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Releasing lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:15:00.977547 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:15:00.979993 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:15:00.990774 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-e4e92bb2-d14c-4a00-99b9-375dcc1d27d5 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "fc5a0cb1-d043-498f-af71-6947ba559007" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 84.955s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:01.188603 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:15:01.202763 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:15:01.657348 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:02.048143 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "fc5a0cb1-d043-498f-af71-6947ba559007" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:02.048693 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "fc5a0cb1-d043-498f-af71-6947ba559007" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:02.048693 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "fc5a0cb1-d043-498f-af71-6947ba559007-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:02.048693 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "fc5a0cb1-d043-498f-af71-6947ba559007-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:02.048872 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "fc5a0cb1-d043-498f-af71-6947ba559007-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:02.051093 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Terminating instance
May 27 03:15:02.082812 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:02.082960 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:02.083121 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:02.083242 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:02.083330 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:02.085315 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Terminating instance
May 27 03:15:02.222859 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:02.225440 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:02.244050 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:02.251538 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:02.281244 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:02.362021 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-df47585c-f69e-4d55-ba8c-e64147fd55e3 req-53678391-64a8-4407-8396-fc70595627db service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received event network-vif-unplugged-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:02.362538 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-df47585c-f69e-4d55-ba8c-e64147fd55e3 req-53678391-64a8-4407-8396-fc70595627db service nova] Acquiring lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:02.362711 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-df47585c-f69e-4d55-ba8c-e64147fd55e3 req-53678391-64a8-4407-8396-fc70595627db service nova] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:02.362867 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-df47585c-f69e-4d55-ba8c-e64147fd55e3 req-53678391-64a8-4407-8396-fc70595627db service nova] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:02.363006 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-df47585c-f69e-4d55-ba8c-e64147fd55e3 req-53678391-64a8-4407-8396-fc70595627db service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] No waiting events found dispatching network-vif-unplugged-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:15:02.363166 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-df47585c-f69e-4d55-ba8c-e64147fd55e3 req-53678391-64a8-4407-8396-fc70595627db service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received unexpected event network-vif-unplugged-a525bd86-a59c-49e5-ba46-0df00f91a72c for instance with vm_state active and task_state reboot_started_hard.
May 27 03:15:02.523083 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999705964999976 future=<Future at 0x7557243dc5f0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:15:02.523728 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999098196999967 future=<Future at 0x7557243dc5f0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:15:02.524336 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.998449433000133 future=<Future at 0x7557243dc5f0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:15:02.525527 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Instance destroyed successfully.
May 27 03:15:02.526018 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lazy-loading 'resources' on Instance uuid bdb99676-cb52-4819-896e-b82dd6fa842a {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:15:02.554642 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:15:02.576070 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:02.578474 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:02.588223 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:15:02.596952 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:02.599708 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:02.612889 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:02.627961 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:02.629870 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:02.660917 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:02.704625 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:02.716128 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fd5661d0-64d5-4c2f-834e-39f235e248d9 req-5d487a75-4b27-4f10-94d7-29c1b63e2abe service nova] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Received event network-vif-unplugged-8b43f898-1af7-4168-ad4c-4b5c7596d28c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:02.716655 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fd5661d0-64d5-4c2f-834e-39f235e248d9 req-5d487a75-4b27-4f10-94d7-29c1b63e2abe service nova] Acquiring lock "fc5a0cb1-d043-498f-af71-6947ba559007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:02.717123 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fd5661d0-64d5-4c2f-834e-39f235e248d9 req-5d487a75-4b27-4f10-94d7-29c1b63e2abe service nova] Lock "fc5a0cb1-d043-498f-af71-6947ba559007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:02.717123 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fd5661d0-64d5-4c2f-834e-39f235e248d9 req-5d487a75-4b27-4f10-94d7-29c1b63e2abe service nova] Lock "fc5a0cb1-d043-498f-af71-6947ba559007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:02.717242 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fd5661d0-64d5-4c2f-834e-39f235e248d9 req-5d487a75-4b27-4f10-94d7-29c1b63e2abe service nova] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] No waiting events found dispatching network-vif-unplugged-8b43f898-1af7-4168-ad4c-4b5c7596d28c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:15:02.717363 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fd5661d0-64d5-4c2f-834e-39f235e248d9 req-5d487a75-4b27-4f10-94d7-29c1b63e2abe service nova] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Received event network-vif-unplugged-8b43f898-1af7-4168-ad4c-4b5c7596d28c for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:15:02.732819 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:02.765003 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9f552f25-61cc-4dc3-aa1a-e334cae7c881 req-9e99b85e-af2c-45d2-9663-398d3fe21df5 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Received event network-vif-unplugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:02.765268 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9f552f25-61cc-4dc3-aa1a-e334cae7c881 req-9e99b85e-af2c-45d2-9663-398d3fe21df5 service nova] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:02.765371 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9f552f25-61cc-4dc3-aa1a-e334cae7c881 req-9e99b85e-af2c-45d2-9663-398d3fe21df5 service nova] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:02.765510 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9f552f25-61cc-4dc3-aa1a-e334cae7c881 req-9e99b85e-af2c-45d2-9663-398d3fe21df5 service nova] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:02.765802 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9f552f25-61cc-4dc3-aa1a-e334cae7c881 req-9e99b85e-af2c-45d2-9663-398d3fe21df5 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] No waiting events found dispatching network-vif-unplugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:15:02.765914 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9f552f25-61cc-4dc3-aa1a-e334cae7c881 req-9e99b85e-af2c-45d2-9663-398d3fe21df5 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Received event network-vif-unplugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:15:02.969486 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:02.985984 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999678141999993 future=<Future at 0x755704637740 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:15:02.992720 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Instance destroyed successfully.
May 27 03:15:02.993627 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'resources' on Instance uuid fc5a0cb1-d043-498f-af71-6947ba559007 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:15:02.997247 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99967842399974 future=<Future at 0x7557247ba3f0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:15:03.000176 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Instance destroyed successfully.
May 27 03:15:03.000988 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'resources' on Instance uuid 79df2202-e3ff-44de-8dee-d13a3a8304d5 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:15:03.006296 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.008221 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.027230 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.028943 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-437477219',display_name='tempest-TestMinimumBasicScenario-server-437477219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testminimumbasicscenario-server-437477219',id=69,image_ref='e4962c6e-b61e-49bb-8c87-5b9dabb75a44',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3JBgwam4Le1srCQd7CEpIw9vZQi8nr12K+dJ6UF0MnYrhjwK2G9BH71q1pSMTOrvL2r5MKfH6kITLwS/O6Bz1rul8SVU5Cu4+tfXbKZB1mpXHo/4cPQZCV1/I2dTIFEQ==',key_name='tempest-TestMinimumBasicScenario-1604290436',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:13:55Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='132164e1033644c98f55a442c1bc16d6',ramdisk_id='',reservation_id='r-ksicpwh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e4962c6e-b61e-49bb-8c87-5b9dabb75a44',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-31061921',owner_user_name='tempest-TestMinimumBasicScenario-31061921-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:15:01Z,user_data=None,user_id='9fbbe453781546378e2ba3b6656e4d7b',uuid=bdb99676-cb52-4819-896e-b82dd6fa842a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:15:03.029138 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Converting VIF {"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:15:03.029874 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=a525bd86-a59c-49e5-ba46-0df00f91a72c,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa525bd86-a5') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:15:03.030542 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=a525bd86-a59c-49e5-ba46-0df00f91a72c,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa525bd86-a5') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:15:03.031682 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.031918 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa525bd86-a5, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:03.033612 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:15:03.042797 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.043931 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.043931 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8484a49f-5eff-4ec6-8db8-2b97960ec383) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:03.044340 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.044765 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:15:03.053932 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.058476 np0000001475 nova-compute[98471]: INFO os_vif [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=a525bd86-a59c-49e5-ba46-0df00f91a72c,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa525bd86-a5')
May 27 03:15:03.061769 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:15:03.062045 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46760c7d-e1cb-4af6-80af-c454d67464d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:15:03.062217 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:15:03.062817 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:15:03.063070 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46760c7d-e1cb-4af6-80af-c454d67464d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:15:03.063149 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:15:03.091447 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:15:03.091447 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:15:03.091447 np0000001475 nova-compute[98471]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:03.091447 np0000001475 nova-compute[98471]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:03.091447 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:15:03.091647 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsi session list stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:15:03.091647 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:15:03.091647 np0000001475 nova-compute[98471]: tcp: [176] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:03.091647 np0000001475 nova-compute[98471]: tcp: [177] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:03.091647 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:15:03.091835 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', '174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', '175'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', '176'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', '177')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:15:03.091926 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', '176')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:15:03.092883 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', '177')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:15:03.093580 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755724711bc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8'): ({'sdi'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:15:03.093867 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Removing multipathed devices sdi, sdd {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:15:03.094026 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Flush multipath device 3300000006fac5e05 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:15:03.135656 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:15:03.188415 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:15:03.230153 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Checking to see if SCSI volumes sdi, sdd have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:15:03.230299 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] SCSI volumes sdi, sdd have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:15:03.231074 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Checking to see if device paths {'sdi', 'sdd'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:15:03.244320 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Device paths {'sdi', 'sdd'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:15:03.244534 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:15:03.257017 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:03.282308 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.283655 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 176, target: iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8, portal: 192.168.40.100,3260]
May 27 03:15:03.283655 np0000001475 nova-compute[98471]: Logout of [sid: 176, target: iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8, portal: 192.168.40.100,3260] successful.
May 27 03:15:03.283655 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:03.293484 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.295156 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.297371 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:03.308169 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:03.317467 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.326629 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.340750 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 177, target: iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8, portal: 192.168.50.100,3260]
May 27 03:15:03.340750 np0000001475 nova-compute[98471]: Logout of [sid: 177, target: iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8, portal: 192.168.50.100,3260] successful.
May 27 03:15:03.340750 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:03.354650 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:03.354881 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:15:03.355006 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] <== disconnect_volume: return (292ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:15:03.355105 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:15:03.359683 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Start _get_guest_xml network_info=[{"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e4962c6e-b61e-49bb-8c87-5b9dabb75a44,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'e4962c6e-b61e-49bb-8c87-5b9dabb75a44'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46760c7d-e1cb-4af6-80af-c454d67464d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, 'status': 'reserved', 'instance': 'bdb99676-cb52-4819-896e-b82dd6fa842a', 'attached_at': '', 'detached_at': '', 'volume_id': '46760c7d-e1cb-4af6-80af-c454d67464d8', 'serial': '46760c7d-e1cb-4af6-80af-c454d67464d8'}, 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': 'f2d2de04-e6b6-4fe6-903c-e3a6e37d52dc', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:15:03.362109 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:15:03.363073 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='e4962c6e-b61e-49bb-8c87-5b9dabb75a44', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-437477219', uuid='bdb99676-cb52-4819-896e-b82dd6fa842a'), owner=OwnerMeta(userid='9fbbe453781546378e2ba3b6656e4d7b', username='tempest-TestMinimumBasicScenario-31061921-project-member', projectid='132164e1033644c98f55a442c1bc16d6', projectname='tempest-TestMinimumBasicScenario-31061921'), image=ImageMeta(id='e4962c6e-b61e-49bb-8c87-5b9dabb75a44', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851703.3628044) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:15:03.364279 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:15:03.364575 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:15:03.365482 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:15:03.365621 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:15:03.366518 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:15:03.366751 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e4962c6e-b61e-49bb-8c87-5b9dabb75a44,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:15:03.366886 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:15:03.366979 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:15:03.367081 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:15:03.367162 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:15:03.367254 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:15:03.367378 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:15:03.367491 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:15:03.367598 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:15:03.367689 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:15:03.367812 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:15:03.367935 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lazy-loading 'vcpu_model' on Instance uuid bdb99676-cb52-4819-896e-b82dd6fa842a {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:15:03.411154 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.435882 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.496056 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:13:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2118130998',display_name='tempest-TestVolumeBootPattern-server-2118130998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-2118130998',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:14:59Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-3kdyr9mt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:15:00Z,user_data=None,user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=fc5a0cb1-d043-498f-af71-6947ba559007,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b43f898-1af7-4168-ad4c-4b5c7596d28c", "address": "fa:16:3e:21:55:54", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b43f898-1a", "ovs_interfaceid": "8b43f898-1af7-4168-ad4c-4b5c7596d28c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:15:03.496266 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "8b43f898-1af7-4168-ad4c-4b5c7596d28c", "address": "fa:16:3e:21:55:54", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b43f898-1a", "ovs_interfaceid": "8b43f898-1af7-4168-ad4c-4b5c7596d28c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:15:03.496839 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:55:54,bridge_name='br-int',has_traffic_filtering=True,id=8b43f898-1af7-4168-ad4c-4b5c7596d28c,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b43f898-1a') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:15:03.497088 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:55:54,bridge_name='br-int',has_traffic_filtering=True,id=8b43f898-1af7-4168-ad4c-4b5c7596d28c,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b43f898-1a') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:15:03.497994 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.498228 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b43f898-1a, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:03.499144 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.499848 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:15:03.504316 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:10:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-762538925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumemultiattachtests-server-762538925',id=63,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVI54RH2pdxhdx+NBQ2XGN7tNsXMkNRRM659CteSsS0ZmLSyoDiSuXTzB/DhppFfYk9ouWLVqam92P3d8MUEqPLedL5zCvpkb49Y3GdLSs3nNQ1gwwpZDY5VEnqdrskPA==',key_name='tempest-keypair-695410050',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:11:12Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='256f2c4e067c46a3a4ea5e9d934b1d4b',ramdisk_id='',reservation_id='r-kp3hy32l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1876764595',owner_user_name='tempest-VolumeMultiattachTests-1876764595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:11:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='568dd12813254325bb16fac607894d49',uuid=79df2202-e3ff-44de-8dee-d13a3a8304d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "address": "fa:16:3e:66:18:6f", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap800cb186-9c", "ovs_interfaceid": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:15:03.504490 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Converting VIF {"id": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "address": "fa:16:3e:66:18:6f", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap800cb186-9c", "ovs_interfaceid": "800cb186-9c81-4bac-a72a-6a6fd06ce1f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:15:03.504908 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:18:6f,bridge_name='br-int',has_traffic_filtering=True,id=800cb186-9c81-4bac-a72a-6a6fd06ce1f4,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap800cb186-9c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:15:03.505090 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:18:6f,bridge_name='br-int',has_traffic_filtering=True,id=800cb186-9c81-4bac-a72a-6a6fd06ce1f4,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap800cb186-9c') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:15:03.505312 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.506441 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.506696 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f468601-64c2-407f-b146-fbd111be63fc) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:03.507139 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.507555 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:15:03.512700 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.513124 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.513443 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap800cb186-9c, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:03.514146 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.515198 np0000001475 nova-compute[98471]: INFO os_vif [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:55:54,bridge_name='br-int',has_traffic_filtering=True,id=8b43f898-1af7-4168-ad4c-4b5c7596d28c,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b43f898-1a')
May 27 03:15:03.515854 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:15:03.516258 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.516574 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d877891c-fe2b-4875-8c21-a81c035566cb) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:03.518192 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:03.519109 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:15:03.521046 np0000001475 nova-compute[98471]: INFO os_vif [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:18:6f,bridge_name='br-int',has_traffic_filtering=True,id=800cb186-9c81-4bac-a72a-6a6fd06ce1f4,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap800cb186-9c')
May 27 03:15:03.521310 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Deleting instance files /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5_del
May 27 03:15:03.521996 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Deletion of /opt/stack/data/nova/instances/79df2202-e3ff-44de-8dee-d13a3a8304d5_del complete
May 27 03:15:03.544775 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'fc5a0cb1-d043-498f-af71-6947ba559007', 'attached_at': '', 'detached_at': '', 'volume_id': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'serial': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c'} {{(pid=98471) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 27 03:15:03.545249 np0000001475 nova-compute[98471]: WARNING stevedore.named [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 27 03:15:03.545478 np0000001475 nova-compute[98471]: WARNING castellan.key_manager [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:15:03.545631 np0000001475 nova-compute[98471]: WARNING nova.keymgr.conf_key_mgr [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 27 03:15:03.546125 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7557243df5f0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'fc5a0cb1-d043-498f-af71-6947ba559007', 'attached_at': '', 'detached_at': '', 'volume_id': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'serial': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c'} {{(pid=98471) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 27 03:15:03.546245 np0000001475 nova-compute[98471]: DEBUG os_brick.encryptors.luks [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] closing encrypted volume /dev/dm-2 {{(pid=98471) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 27 03:15:03.569981 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:15:03.570260 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:15:03.570457 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:15:03.570810 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:15:03.571101 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:15:03.571253 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:15:03.593410 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:15:03.593410 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:15:03.593410 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:15:03.593410 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:15:03.593410 np0000001475 nova-compute[98471]: tcp: [175] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c (non-flash)
May 27 03:15:03.593410 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:15:03.593721 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', '174'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', '175')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:15:03.593721 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', '174')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:15:03.594378 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c', '175')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:15:03.595021 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572464f380>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c'): ({'sdc'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:15:03.595222 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Removing multipathed devices sdb, sdc {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:15:03.595464 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flush multipath device 330000000b3e2107e {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:15:03.632295 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:15:03.672415 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:15:03.720086 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:15:03.720206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:15:03.720798 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:15:03.732813 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:15:03.733003 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:15:03.745179 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:03.774651 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 174, target: iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c, portal: 192.168.40.100,3260]
May 27 03:15:03.774651 np0000001475 nova-compute[98471]: Logout of [sid: 174, target: iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c, portal: 192.168.40.100,3260] successful.
May 27 03:15:03.774651 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:03.785241 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:03.794728 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:03.821714 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 175, target: iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c, portal: 192.168.50.100,3260]
May 27 03:15:03.821714 np0000001475 nova-compute[98471]: Logout of [sid: 175, target: iqn.2023-03.storpool.com:os--volume-80e8ea1f-b9ad-4ee9-9db4-e9c34778a64c, portal: 192.168.50.100,3260] successful.
May 27 03:15:03.821714 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:03.831953 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:03.833149 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:15:03.833281 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== disconnect_volume: return (262ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:15:03.833411 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:15:03.833694 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Deleting instance files /opt/stack/data/nova/instances/fc5a0cb1-d043-498f-af71-6947ba559007_del
May 27 03:15:03.834173 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Deletion of /opt/stack/data/nova/instances/fc5a0cb1-d043-498f-af71-6947ba559007_del complete
May 27 03:15:03.870470 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Object Instance<bdb99676-cb52-4819-896e-b82dd6fa842a> lazy-loaded attributes: resources,vcpu_model {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:15:03.880239 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk.config --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:15:03.967489 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk.config --force-share --output=json" returned: 0 in 0.087s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:15:03.967992 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:03.968227 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "/opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:03.968778 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "/opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:03.969207 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:15:03.969581 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46760c7d-e1cb-4af6-80af-c454d67464d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:15:03.969758 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:15:03.970050 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:15:03.970249 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46760c7d-e1cb-4af6-80af-c454d67464d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:15:03.985515 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:15:03.986021 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:15:03.986242 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:15:03.986782 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:15:03.987246 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:15:03.987436 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:15:03.996616 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:15:03.996616 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:04.000589 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:15:04.000589 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:04.007046 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8] added
May 27 03:15:04.007046 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:15:04.007046 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:15:04.007046 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:15:04.007046 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:15:04.007046 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:15:04.007046 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:04.007205 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:15:04.007503 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0212(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:15:04.007846 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:15:04.011480 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8] added
May 27 03:15:04.011480 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:15:04.011480 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:15:04.011480 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:15:04.011480 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:15:04.011480 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:15:04.011480 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:04.011621 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:15:04.011852 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0243(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:15:04.011928 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:15:04.029572 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Took 1.44 seconds to destroy the instance on the hypervisor.
May 27 03:15:04.030280 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:15:04.030900 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:15:04.031042 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:15:04.031704 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:04.091046 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:04.340006 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Took 1.79 seconds to destroy the instance on the hypervisor.
May 27 03:15:04.340602 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:15:04.340821 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:15:04.341038 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:15:04.341265 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:04.400441 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:04.428793 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-258c4f3b-c247-489d-9d9a-6b1a6be1bb37 req-0f0a3692-1b8d-4501-bf28-408612d48cfd service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received event network-vif-unplugged-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:04.429228 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-258c4f3b-c247-489d-9d9a-6b1a6be1bb37 req-0f0a3692-1b8d-4501-bf28-408612d48cfd service nova] Acquiring lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:04.429452 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-258c4f3b-c247-489d-9d9a-6b1a6be1bb37 req-0f0a3692-1b8d-4501-bf28-408612d48cfd service nova] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:04.429632 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-258c4f3b-c247-489d-9d9a-6b1a6be1bb37 req-0f0a3692-1b8d-4501-bf28-408612d48cfd service nova] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:04.429786 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-258c4f3b-c247-489d-9d9a-6b1a6be1bb37 req-0f0a3692-1b8d-4501-bf28-408612d48cfd service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] No waiting events found dispatching network-vif-unplugged-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:15:04.430006 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-258c4f3b-c247-489d-9d9a-6b1a6be1bb37 req-0f0a3692-1b8d-4501-bf28-408612d48cfd service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received unexpected event network-vif-unplugged-a525bd86-a59c-49e5-ba46-0df00f91a72c for instance with vm_state active and task_state reboot_started_hard.
May 27 03:15:04.775079 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-38eb7222-fea7-4d29-98a4-5792b6f6e998 req-4b996621-08dd-49a8-8006-3fd2a3323f26 service nova] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Received event network-vif-unplugged-8b43f898-1af7-4168-ad4c-4b5c7596d28c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:04.775797 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-38eb7222-fea7-4d29-98a4-5792b6f6e998 req-4b996621-08dd-49a8-8006-3fd2a3323f26 service nova] Acquiring lock "fc5a0cb1-d043-498f-af71-6947ba559007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:04.775797 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-38eb7222-fea7-4d29-98a4-5792b6f6e998 req-4b996621-08dd-49a8-8006-3fd2a3323f26 service nova] Lock "fc5a0cb1-d043-498f-af71-6947ba559007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:04.775797 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-38eb7222-fea7-4d29-98a4-5792b6f6e998 req-4b996621-08dd-49a8-8006-3fd2a3323f26 service nova] Lock "fc5a0cb1-d043-498f-af71-6947ba559007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:04.776145 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-38eb7222-fea7-4d29-98a4-5792b6f6e998 req-4b996621-08dd-49a8-8006-3fd2a3323f26 service nova] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] No waiting events found dispatching network-vif-unplugged-8b43f898-1af7-4168-ad4c-4b5c7596d28c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:15:04.776145 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-38eb7222-fea7-4d29-98a4-5792b6f6e998 req-4b996621-08dd-49a8-8006-3fd2a3323f26 service nova] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Received event network-vif-unplugged-8b43f898-1af7-4168-ad4c-4b5c7596d28c for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:15:04.776145 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-38eb7222-fea7-4d29-98a4-5792b6f6e998 req-4b996621-08dd-49a8-8006-3fd2a3323f26 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Received event network-vif-deleted-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:04.776280 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-38eb7222-fea7-4d29-98a4-5792b6f6e998 req-4b996621-08dd-49a8-8006-3fd2a3323f26 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Neutron deleted interface 800cb186-9c81-4bac-a72a-6a6fd06ce1f4; detaching it from the instance and deleting it from the info cache
May 27 03:15:04.776363 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-38eb7222-fea7-4d29-98a4-5792b6f6e998 req-4b996621-08dd-49a8-8006-3fd2a3323f26 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:15:04.777418 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:15:04.819936 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Received event network-vif-unplugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:04.820363 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:04.820550 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:04.820683 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:04.820828 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] No waiting events found dispatching network-vif-unplugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:15:04.821052 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Received event network-vif-unplugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:15:04.821086 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Received event network-vif-plugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:04.821271 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:04.821656 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:04.821797 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:04.821936 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] No waiting events found dispatching network-vif-plugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:15:04.822070 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Received unexpected event network-vif-plugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 for instance with vm_state active and task_state deleting.
May 27 03:15:04.822181 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Received event network-vif-plugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:04.822347 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:04.822516 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:04.822650 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:04.822806 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] No waiting events found dispatching network-vif-plugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:15:04.822949 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Received unexpected event network-vif-plugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 for instance with vm_state active and task_state deleting.
May 27 03:15:04.823082 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Received event network-vif-unplugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:04.823227 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:04.823395 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:04.823543 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:04.823911 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] No waiting events found dispatching network-vif-unplugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:15:04.824053 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Received event network-vif-unplugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:15:04.824178 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Received event network-vif-unplugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:04.824308 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] Acquiring lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:04.824460 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:04.824582 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:04.824703 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] No waiting events found dispatching network-vif-unplugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:15:04.824848 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f2caf40a-0b52-41ac-a146-f3890b69853a req-1fd5fa24-8ba0-4cac-87cf-d81f3c6c7313 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Received event network-vif-unplugged-800cb186-9c81-4bac-a72a-6a6fd06ce1f4 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:15:05.008225 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:15:05.012255 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:15:05.018443 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:15:05.018443 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:15:05.023221 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:15:05.023221 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:05.029314 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:05.034897 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:05.039718 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 03:15:05.039718 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:15:05.039839 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 03:15:05.039839 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:15:05.039950 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 03:15:05.039950 np0000001475 nova-compute[98471]: 
May 27 03:15:05.044810 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 03:15:05.044810 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:15:05.044940 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 03:15:05.044940 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:15:05.044940 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 03:15:05.044940 np0000001475 nova-compute[98471]: 
May 27 03:15:05.065295 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8, portal: 192.168.40.100,3260]
May 27 03:15:05.065295 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8, portal: 192.168.40.100,3260] successful.
May 27 03:15:05.065295 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:05.076199 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:05.087456 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8, portal: 192.168.50.100,3260]
May 27 03:15:05.087456 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8, portal: 192.168.50.100,3260] successful.
May 27 03:15:05.087456 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:05.087964 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:05.087964 np0000001475 nova-compute[98471]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:05.087964 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:15:05.088156 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:05.088156 np0000001475 nova-compute[98471]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:05.088156 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:15:05.088444 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.102s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:15:05.088550 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:15:05.089216 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] HCTL ('7', '-', '-', 0) found on session 179 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:15:05.089327 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:15:05.098643 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:05.105554 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Searching for a device in session 179 and hctl ['7', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:15:05.110168 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:05.110168 np0000001475 nova-compute[98471]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:05.110168 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:15:05.110314 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:05.110314 np0000001475 nova-compute[98471]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:05.110314 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:15:05.110599 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.123s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:15:05.110756 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:15:05.111251 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] HCTL ('8', '-', '-', 0) found on session 180 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:15:05.111372 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:15:05.112028 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:15:05.125561 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Searching for a device in session 180 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:15:05.125561 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '46760c7d-e1cb-4af6-80af-c454d67464d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:15:05.199754 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:15:05.280576 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Took 1.25 seconds to deallocate network for instance.
May 27 03:15:05.282682 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-38eb7222-fea7-4d29-98a4-5792b6f6e998 req-4b996621-08dd-49a8-8006-3fd2a3323f26 service nova] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Detach interface failed, port_id=800cb186-9c81-4bac-a72a-6a6fd06ce1f4, reason: Instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:15:05.614093 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Took 1.27 seconds to deallocate network for instance.
May 27 03:15:05.703821 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:05.704035 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:05.704132 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:05.704270 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:15:05.715652 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:15:05.716369 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:15:05.760536 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:15:05.761137 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=13786MB free_disk=72.68119812011719GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:15:05.761276 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:05.761541 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:05.788363 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:06.104628 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Searching for a device in session 179 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:15:06.105054 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46760c7d-e1cb-4af6-80af-c454d67464d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:15:06.162311 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Took 0.55 seconds to detach 1 volumes for instance.
May 27 03:15:06.480892 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5c147a27-004b-4095-8b27-dd9b234e7da0 req-0bdb75ed-3223-41cb-a9bb-c465bec25c1d service nova] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Received event network-vif-deleted-8b43f898-1af7-4168-ad4c-4b5c7596d28c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:06.658283 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:06.667387 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:06.881956 np0000001475 nova-compute[98471]: WARNING nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 79df2202-e3ff-44de-8dee-d13a3a8304d5 is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. Skipping heal of allocation because we do not know what to do.
May 27 03:15:06.882085 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance fc5a0cb1-d043-498f-af71-6947ba559007 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:15:06.882178 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance bdb99676-cb52-4819-896e-b82dd6fa842a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:15:06.882331 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:15:06.882462 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:15:05 up 46 min,  2 users,  load average: 2.33, 5.04, 5.00\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_deleting': '1', 'num_os_type_None': '2', 'num_proj_bf4b0011da7449e7948bf2c8a41955f5': '1', 'io_workload': '0', 'num_task_reboot_started_hard': '1', 'num_proj_132164e1033644c98f55a442c1bc16d6': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:15:07.002248 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Found WWN 3300000006fac5e05 for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:15:07.002629 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:15:07.002864 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '3300000006fac5e05', 'path': '/dev/dm-0', 'multipath_id': '3300000006fac5e05'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:15:07.002989 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006fac5e05', 'path': '/dev/dm-0', 'multipath_id': '3300000006fac5e05'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:15:07.030678 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:15:07.030897 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:15:07.508352 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-437477219',display_name='tempest-TestMinimumBasicScenario-server-437477219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testminimumbasicscenario-server-437477219',id=69,image_ref='e4962c6e-b61e-49bb-8c87-5b9dabb75a44',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3JBgwam4Le1srCQd7CEpIw9vZQi8nr12K+dJ6UF0MnYrhjwK2G9BH71q1pSMTOrvL2r5MKfH6kITLwS/O6Bz1rul8SVU5Cu4+tfXbKZB1mpXHo/4cPQZCV1/I2dTIFEQ==',key_name='tempest-TestMinimumBasicScenario-1604290436',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:13:55Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='132164e1033644c98f55a442c1bc16d6',ramdisk_id='',reservation_id='r-ksicpwh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e4962c6e-b61e-49bb-8c87-5b9dabb75a44',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-31061921',owner_user_name='tempest-TestMinimumBasicScenario-31061921-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:15:01Z,user_data=None,user_id='9fbbe453781546378e2ba3b6656e4d7b',uuid=bdb99676-cb52-4819-896e-b82dd6fa842a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:15:07.508996 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Converting VIF {"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:15:07.509248 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=a525bd86-a59c-49e5-ba46-0df00f91a72c,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa525bd86-a5') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:15:07.510226 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lazy-loading 'pci_devices' on Instance uuid bdb99676-cb52-4819-896e-b82dd6fa842a {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:15:07.533659 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:15:08.012108 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Object Instance<bdb99676-cb52-4819-896e-b82dd6fa842a> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:15:08.013362 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] End _get_guest_xml xml=<domain type="qemu">
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:   <uuid>bdb99676-cb52-4819-896e-b82dd6fa842a</uuid>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:   <name>instance-00000045</name>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestMinimumBasicScenario-server-437477219</nova:name>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:15:03</nova:creationTime>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <nova:image uuid="e4962c6e-b61e-49bb-8c87-5b9dabb75a44">
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:         <nova:user uuid="9fbbe453781546378e2ba3b6656e4d7b">tempest-TestMinimumBasicScenario-31061921-project-member</nova:user>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:         <nova:project uuid="132164e1033644c98f55a442c1bc16d6">tempest-TestMinimumBasicScenario-31061921</nova:project>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="e4962c6e-b61e-49bb-8c87-5b9dabb75a44"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:         <nova:port uuid="a525bd86-a59c-49e5-ba46-0df00f91a72c">
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     <system>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <entry name="serial">bdb99676-cb52-4819-896e-b82dd6fa842a</entry>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <entry name="uuid">bdb99676-cb52-4819-896e-b82dd6fa842a</entry>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     </system>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:   <os>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:   </os>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:   <features>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:   </features>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:   <devices>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     </disk>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk.config"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     </disk>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <alias name="ua-46760c7d-e1cb-4af6-80af-c454d67464d8"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-0"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <target dev="vdb" bus="virtio"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <serial>46760c7d-e1cb-4af6-80af-c454d67464d8</serial>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     </disk>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:a9:9c:8c"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <target dev="tapa525bd86-a5"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     </interface>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/console.log" append="off"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     </serial>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     <video>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     </video>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     </rng>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:   </devices>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]: </domain>
May 27 03:15:08.013362 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:15:08.015583 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:15:08.042902 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:15:08.043278 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.282s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:08.044087 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:15:08.044579 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.256s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:08.049832 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.005s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:08.053343 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.386s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:08.108237 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:15:08.109338 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Deleted allocations for instance 79df2202-e3ff-44de-8dee-d13a3a8304d5
May 27 03:15:08.112127 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:15:08.214695 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:15:08.215220 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:15:08.215964 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lazy-loading 'trusted_certs' on Instance uuid bdb99676-cb52-4819-896e-b82dd6fa842a {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:15:08.256396 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:15:08.256721 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:15:08.517626 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:08.718150 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Object Instance<bdb99676-cb52-4819-896e-b82dd6fa842a> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:15:08.719785 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fb36d6ae2c509d80157b16ab25ea95bdf94fbee --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:15:08.761790 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:15:08.813590 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fb36d6ae2c509d80157b16ab25ea95bdf94fbee --force-share --output=json" returned: 0 in 0.095s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:15:08.813971 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:15:08.814202 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:15:08.901326 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:15:08.901837 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Cannot resize image /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:15:08.902149 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lazy-loading 'migration_context' on Instance uuid bdb99676-cb52-4819-896e-b82dd6fa842a {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:15:09.119259 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-99ff1f4b-18c5-4874-8ec4-997b213ab2f3 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "79df2202-e3ff-44de-8dee-d13a3a8304d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.036s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:09.269413 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.216s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:09.313352 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Deleted allocations for instance fc5a0cb1-d043-498f-af71-6947ba559007
May 27 03:15:09.404609 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Object Instance<bdb99676-cb52-4819-896e-b82dd6fa842a> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:15:09.405644 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-437477219',display_name='tempest-TestMinimumBasicScenario-server-437477219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testminimumbasicscenario-server-437477219',id=69,image_ref='e4962c6e-b61e-49bb-8c87-5b9dabb75a44',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3JBgwam4Le1srCQd7CEpIw9vZQi8nr12K+dJ6UF0MnYrhjwK2G9BH71q1pSMTOrvL2r5MKfH6kITLwS/O6Bz1rul8SVU5Cu4+tfXbKZB1mpXHo/4cPQZCV1/I2dTIFEQ==',key_name='tempest-TestMinimumBasicScenario-1604290436',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:13:55Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='132164e1033644c98f55a442c1bc16d6',ramdisk_id='',reservation_id='r-ksicpwh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e4962c6e-b61e-49bb-8c87-5b9dabb75a44',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-31061921',owner_user_name='tempest-TestMinimumBasicScenario-31061921-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:15:01Z,user_data=None,user_id='9fbbe453781546378e2ba3b6656e4d7b',uuid=bdb99676-cb52-4819-896e-b82dd6fa842a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:15:09.405886 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Converting VIF {"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:15:09.406473 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=a525bd86-a59c-49e5-ba46-0df00f91a72c,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa525bd86-a5') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:15:09.406795 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=a525bd86-a59c-49e5-ba46-0df00f91a72c,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa525bd86-a5') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:15:09.407258 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:09.407610 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:09.407944 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:15:09.408546 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:09.408688 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99b7013c-df0b-50d2-b5af-4c3e17281be7', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:09.409487 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:09.410213 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:15:09.411972 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:09.412123 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa525bd86-a5, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:09.412437 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa525bd86-a5, col_values=(('qos', UUID('335dee8b-3bd7-4b46-b133-78482f1d98ef')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:09.412687 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa525bd86-a5, col_values=(('external_ids', {'iface-id': 'a525bd86-a59c-49e5-ba46-0df00f91a72c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:9c:8c', 'vm-uuid': 'bdb99676-cb52-4819-896e-b82dd6fa842a'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:09.413319 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:09.414599 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:15:09.420094 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:09.420925 np0000001475 nova-compute[98471]: INFO os_vif [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=a525bd86-a59c-49e5-ba46-0df00f91a72c,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa525bd86-a5')
May 27 03:15:09.820165 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:09.843141 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:09.956079 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:09.960473 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:10.039656 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-090dae5d-82c3-4b51-8d9f-2c07c83ba606 req-1441113d-42ea-4b8a-b062-df075a2c3376 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received event network-vif-plugged-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:10.040309 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-090dae5d-82c3-4b51-8d9f-2c07c83ba606 req-1441113d-42ea-4b8a-b062-df075a2c3376 service nova] Acquiring lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:10.040432 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-090dae5d-82c3-4b51-8d9f-2c07c83ba606 req-1441113d-42ea-4b8a-b062-df075a2c3376 service nova] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:10.040520 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-090dae5d-82c3-4b51-8d9f-2c07c83ba606 req-1441113d-42ea-4b8a-b062-df075a2c3376 service nova] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:10.040675 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-090dae5d-82c3-4b51-8d9f-2c07c83ba606 req-1441113d-42ea-4b8a-b062-df075a2c3376 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] No waiting events found dispatching network-vif-plugged-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:15:10.040850 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-090dae5d-82c3-4b51-8d9f-2c07c83ba606 req-1441113d-42ea-4b8a-b062-df075a2c3376 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received unexpected event network-vif-plugged-a525bd86-a59c-49e5-ba46-0df00f91a72c for instance with vm_state active and task_state reboot_started_hard.
May 27 03:15:10.174543 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:10.175902 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:10.178038 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:10.198611 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:10.335917 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6f8c21bc-9aab-4b6e-aa70-5d59e694b1c2 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "fc5a0cb1-d043-498f-af71-6947ba559007" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.287s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:10.631952 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Removed pending STOPPED event for bdb99676-cb52-4819-896e-b82dd6fa842a due to new event <LifecycleEvent: 1779851710.6315022, bdb99676-cb52-4819-896e-b82dd6fa842a => Resumed> {{(pid=98471) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 03:15:10.632115 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851710.6315022, bdb99676-cb52-4819-896e-b82dd6fa842a => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:15:10.632353 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] VM Resumed (Lifecycle Event)
May 27 03:15:10.633544 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Instance event wait completed in 0 seconds for  {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:15:10.637733 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Instance rebooted successfully.
May 27 03:15:11.135156 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:15:11.137854 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:15:11.647566 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 27 03:15:11.647921 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851711.6477027, bdb99676-cb52-4819-896e-b82dd6fa842a => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:15:11.648036 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] VM Started (Lifecycle Event)
May 27 03:15:11.660322 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:12.115776 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-84755697-2275-4800-91ff-87b01e78a85a req-2239aecd-ce37-4888-a1a8-c57a37196740 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received event network-vif-plugged-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:12.115776 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-84755697-2275-4800-91ff-87b01e78a85a req-2239aecd-ce37-4888-a1a8-c57a37196740 service nova] Acquiring lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:12.115776 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-84755697-2275-4800-91ff-87b01e78a85a req-2239aecd-ce37-4888-a1a8-c57a37196740 service nova] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:12.115776 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-84755697-2275-4800-91ff-87b01e78a85a req-2239aecd-ce37-4888-a1a8-c57a37196740 service nova] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:12.115776 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-84755697-2275-4800-91ff-87b01e78a85a req-2239aecd-ce37-4888-a1a8-c57a37196740 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] No waiting events found dispatching network-vif-plugged-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:15:12.115776 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-84755697-2275-4800-91ff-87b01e78a85a req-2239aecd-ce37-4888-a1a8-c57a37196740 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received unexpected event network-vif-plugged-a525bd86-a59c-49e5-ba46-0df00f91a72c for instance with vm_state active and task_state reboot_started_hard.
May 27 03:15:12.156208 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:15:12.159779 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:15:12.163516 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:15:12.163636 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:15:12.163737 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:15:12.163884 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] No VIF found with MAC fa:16:3e:a9:9c:8c, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:15:12.164236 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:15:12.662946 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 27 03:15:12.674049 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-71c4ae88-5145-4f50-aa5e-6813ea3d17e2 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 14.015s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:14.414053 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:14.447079 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "53735ed3-493a-4af7-9950-3fd6a68db4c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:14.447404 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:14.949844 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:15:15.510922 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:15.511247 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:15.514939 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:15:15.515096 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Claim successful on node np0000001475
May 27 03:15:15.906007 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:15.906224 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:16.409274 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:15:16.567580 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Refreshing inventories for resource provider 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 27 03:15:16.614371 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Updating ProviderTree inventory for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 27 03:15:16.614578 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Updating inventory in ProviderTree for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 27 03:15:16.663541 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:16.667968 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Refreshing aggregate associations for resource provider 379b682a-2af7-4cd6-bb46-9d0c412d430a, aggregates: None {{(pid=98471) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 27 03:15:16.725791 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Refreshing trait associations for resource provider 379b682a-2af7-4cd6-bb46-9d0c412d430a, traits: HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ARCH_X86_64,HW_CPU_X86_SSSE3,COMPUTE_ARCH_S390X,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NODE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ARCH_RISCV64,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ARCH_AARCH64,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_MIPSEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_ARCH_X86_64,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE {{(pid=98471) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 27 03:15:16.882624 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:15:16.882851 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:15:16.957609 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:17.385193 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:15:17.523190 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0003957560002163518 future=<Future at 0x7557243dc5f0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:15:17.523374 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:15:17.523431 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=0.46193515999993906 future=<Future at 0x755704637740 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:15:17.523524 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=0.46182900299982066 future=<Future at 0x755704637740 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:15:17.892576 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.381s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:17.893418 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.935s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:17.893928 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:15:17.904315 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:15:17.904315 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Claim successful on node np0000001475
May 27 03:15:17.985760 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0003472540001894231 future=<Future at 0x755704637740 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:15:17.986359 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] Emitting event <LifecycleEvent: 1779851702.9853075, fc5a0cb1-d043-498f-af71-6947ba559007 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:15:17.986532 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:15:17.986753 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] VM Stopped (Lifecycle Event)
May 27 03:15:17.987802 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=0.009050047000073391 future=<Future at 0x7557247ba3f0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:15:17.987897 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=0.008917630999803805 future=<Future at 0x7557247ba3f0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:15:17.997170 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0002360670000598475 future=<Future at 0x7557247ba3f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:15:17.997686 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Emitting event <LifecycleEvent: 1779851702.9967716, 79df2202-e3ff-44de-8dee-d13a3a8304d5 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:15:17.997756 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:15:17.997894 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] VM Stopped (Lifecycle Event)
May 27 03:15:18.403460 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:15:18.403712 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:15:18.404031 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:18.404347 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:18.482951 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '568dd12813254325bb16fac607894d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256f2c4e067c46a3a4ea5e9d934b1d4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:15:18.489488 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-24d78c95-134d-4162-840d-2c019d8da57f tempest-TestStampPattern-1535526847 tempest-TestStampPattern-1535526847-project-member] [instance: fc5a0cb1-d043-498f-af71-6947ba559007] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:15:18.500044 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 79df2202-e3ff-44de-8dee-d13a3a8304d5] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:15:18.908100 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:15:18.976566 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Successfully created port: 96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:15:19.121546 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:15:19.121787 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:15:19.411770 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:15:19.415608 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:19.479968 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Successfully updated port: 96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:15:19.537076 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1e9aa8ef-ac9f-476d-8f1e-6cd5600f8d6b req-bc5c8b89-175f-4d02-a232-34ec64aab5e4 service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Received event network-changed-96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:19.537151 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1e9aa8ef-ac9f-476d-8f1e-6cd5600f8d6b req-bc5c8b89-175f-4d02-a232-34ec64aab5e4 service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Refreshing instance network info cache due to event network-changed-96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:15:19.537335 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1e9aa8ef-ac9f-476d-8f1e-6cd5600f8d6b req-bc5c8b89-175f-4d02-a232-34ec64aab5e4 service nova] Acquiring lock "refresh_cache-53735ed3-493a-4af7-9950-3fd6a68db4c1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:15:19.537489 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1e9aa8ef-ac9f-476d-8f1e-6cd5600f8d6b req-bc5c8b89-175f-4d02-a232-34ec64aab5e4 service nova] Acquired lock "refresh_cache-53735ed3-493a-4af7-9950-3fd6a68db4c1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:15:19.537654 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-1e9aa8ef-ac9f-476d-8f1e-6cd5600f8d6b req-bc5c8b89-175f-4d02-a232-34ec64aab5e4 service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Refreshing network info cache for port 96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:15:19.624367 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:15:19.982117 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "refresh_cache-53735ed3-493a-4af7-9950-3fd6a68db4c1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:15:20.039849 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-1e9aa8ef-ac9f-476d-8f1e-6cd5600f8d6b req-bc5c8b89-175f-4d02-a232-34ec64aab5e4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:20.111705 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-1e9aa8ef-ac9f-476d-8f1e-6cd5600f8d6b req-bc5c8b89-175f-4d02-a232-34ec64aab5e4 service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:15:20.132877 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.240s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:20.133213 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:15:20.269133 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-1e9aa8ef-ac9f-476d-8f1e-6cd5600f8d6b req-bc5c8b89-175f-4d02-a232-34ec64aab5e4 service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:15:20.424197 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:15:20.424197 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:15:20.424197 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Creating image(s)
May 27 03:15:20.424197 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "/opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:20.424197 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "/opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:20.424197 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "/opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:20.425162 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:15:20.428148 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:15:20.429964 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:15:20.532510 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.102s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:15:20.536887 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:20.536887 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:20.536887 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:15:20.538346 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:15:20.539529 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:15:20.634701 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.095s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:15:20.635482 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:15:20.662464 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:15:20.665280 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:15:20.666211 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:20.666758 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:20.722406 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1/disk 1073741824" returned: 0 in 0.087s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:15:20.725760 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:20.725760 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:15:20.765186 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8eeaf68cfb534238bfe879dd6e8f858f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0011da7449e7948bf2c8a41955f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:15:20.771889 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-1e9aa8ef-ac9f-476d-8f1e-6cd5600f8d6b req-bc5c8b89-175f-4d02-a232-34ec64aab5e4 service nova] Releasing lock "refresh_cache-53735ed3-493a-4af7-9950-3fd6a68db4c1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:15:20.772702 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquired lock "refresh_cache-53735ed3-493a-4af7-9950-3fd6a68db4c1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:15:20.773007 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:15:20.834445 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.111s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:15:20.834886 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:15:20.835152 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:15:20.937519 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:15:20.937971 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Cannot resize image /opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:15:20.938675 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:15:20.938913 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Ensure instance console log exists: /opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:15:20.939291 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:20.939588 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:20.939781 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:21.163829 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:15:21.206345 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Successfully created port: 465489db-a702-4ce5-a807-4b56dc3ad058 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:15:21.345874 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:15:21.553569 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:21.664789 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:21.668134 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:15:21.679762 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Updating instance_info_cache with network_info: [{"id": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "address": "fa:16:3e:aa:08:24", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed4ce5-7d", "ovs_interfaceid": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:15:21.702459 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Successfully updated port: 465489db-a702-4ce5-a807-4b56dc3ad058 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:15:21.753726 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-482318bd-442c-475d-a585-16d510183ffe req-f23b1873-b6e9-41a5-8baf-80eb3f796255 service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Received event network-changed-465489db-a702-4ce5-a807-4b56dc3ad058 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:21.753958 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-482318bd-442c-475d-a585-16d510183ffe req-f23b1873-b6e9-41a5-8baf-80eb3f796255 service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Refreshing instance network info cache due to event network-changed-465489db-a702-4ce5-a807-4b56dc3ad058. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:15:21.754209 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-482318bd-442c-475d-a585-16d510183ffe req-f23b1873-b6e9-41a5-8baf-80eb3f796255 service nova] Acquiring lock "refresh_cache-3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:15:21.754581 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-482318bd-442c-475d-a585-16d510183ffe req-f23b1873-b6e9-41a5-8baf-80eb3f796255 service nova] Acquired lock "refresh_cache-3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:15:21.754799 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-482318bd-442c-475d-a585-16d510183ffe req-f23b1873-b6e9-41a5-8baf-80eb3f796255 service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Refreshing network info cache for port 465489db-a702-4ce5-a807-4b56dc3ad058 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:15:22.173193 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Booting with volume c53c2d86-066a-4251-93bf-cbf268ce13a6 at /dev/vda
May 27 03:15:22.183570 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Releasing lock "refresh_cache-53735ed3-493a-4af7-9950-3fd6a68db4c1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:15:22.183838 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Instance network_info: |[{"id": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "address": "fa:16:3e:aa:08:24", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed4ce5-7d", "ovs_interfaceid": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:15:22.185779 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Start _get_guest_xml network_info=[{"id": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "address": "fa:16:3e:aa:08:24", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed4ce5-7d", "ovs_interfaceid": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:15:22.190115 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:15:22.191245 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-984967112', uuid='53735ed3-493a-4af7-9950-3fd6a68db4c1'), owner=OwnerMeta(userid='568dd12813254325bb16fac607894d49', username='tempest-VolumeMultiattachTests-1876764595-project-member', projectid='256f2c4e067c46a3a4ea5e9d934b1d4b', projectname='tempest-VolumeMultiattachTests-1876764595'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "address": "fa:16:3e:aa:08:24", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed4ce5-7d", "ovs_interfaceid": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851722.190925) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:15:22.192551 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:15:22.192877 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:15:22.194040 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:15:22.194202 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:15:22.195223 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:15:22.195518 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:15:22.195642 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:15:22.195754 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:15:22.195874 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:15:22.195959 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:15:22.196050 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:15:22.196197 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:15:22.196293 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:15:22.196403 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:15:22.196492 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:15:22.196602 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:15:22.205955 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:15:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-984967112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumemultiattachtests-server-984967112',id=70,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjks1ILwFfSIHh1qd0a2ug3pSuIMQ5gfqaOWhghbFt1Y7DI87r2CjdFfq2DuncZO9wGuj3vN4+h7zwjYHD1J81UcLxDNabj0mPxL3yKfkNy49KSAtN7yyl65ZTaw9o4lA==',key_name='tempest-keypair-612389790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='256f2c4e067c46a3a4ea5e9d934b1d4b',ramdisk_id='',reservation_id='r-1asykh05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1876764595',owner_user_name='tempest-VolumeMultiattachTests-1876764595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:15:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='568dd12813254325bb16fac607894d49',uuid=53735ed3-493a-4af7-9950-3fd6a68db4c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "address": "fa:16:3e:aa:08:24", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed4ce5-7d", "ovs_interfaceid": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:15:22.206109 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Converting VIF {"id": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "address": "fa:16:3e:aa:08:24", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed4ce5-7d", "ovs_interfaceid": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:15:22.206626 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:08:24,bridge_name='br-int',has_traffic_filtering=True,id=96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ed4ce5-7d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:15:22.207270 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'pci_devices' on Instance uuid 53735ed3-493a-4af7-9950-3fd6a68db4c1 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:15:22.208703 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "refresh_cache-3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:15:22.210957 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:15:22.221000 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:15:22.240533 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:15:22.259768 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-482318bd-442c-475d-a585-16d510183ffe req-f23b1873-b6e9-41a5-8baf-80eb3f796255 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:22.284770 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:15:22.285312 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:15:22.295262 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:15:22.296309 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fea9:9c8c', 'fe80::3473:3eff:fecc:f718'] 
May 27 03:15:22.296456 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:15:22.296590 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:15:22.296915 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:15:22.297143 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Updating existing volume attachment record: d4b31896-ad13-4693-a04b-b36753d92152 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:15:22.322852 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-482318bd-442c-475d-a585-16d510183ffe req-f23b1873-b6e9-41a5-8baf-80eb3f796255 service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:15:22.468037 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-482318bd-442c-475d-a585-16d510183ffe req-f23b1873-b6e9-41a5-8baf-80eb3f796255 service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:15:22.713685 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] End _get_guest_xml xml=<domain type="qemu">
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:   <uuid>53735ed3-493a-4af7-9950-3fd6a68db4c1</uuid>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:   <name>instance-00000046</name>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <nova:name>tempest-VolumeMultiattachTests-server-984967112</nova:name>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:15:22</nova:creationTime>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:         <nova:user uuid="568dd12813254325bb16fac607894d49">tempest-VolumeMultiattachTests-1876764595-project-member</nova:user>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:         <nova:project uuid="256f2c4e067c46a3a4ea5e9d934b1d4b">tempest-VolumeMultiattachTests-1876764595</nova:project>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:         <nova:port uuid="96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2">
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     <system>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <entry name="serial">53735ed3-493a-4af7-9950-3fd6a68db4c1</entry>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <entry name="uuid">53735ed3-493a-4af7-9950-3fd6a68db4c1</entry>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     </system>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:   <os>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:   </os>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:   <features>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:   </features>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:   <devices>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1/disk"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     </disk>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1/disk.config"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     </disk>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:aa:08:24"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <target dev="tap96ed4ce5-7d"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     </interface>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1/console.log" append="off"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     </serial>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     <video>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     </video>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     </rng>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:   </devices>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]: </domain>
May 27 03:15:22.713685 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:15:22.715505 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Preparing to wait for external event network-vif-plugged-96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:15:22.715505 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "53735ed3-493a-4af7-9950-3fd6a68db4c1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:22.715505 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:22.715505 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:22.715505 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:15:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-984967112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumemultiattachtests-server-984967112',id=70,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjks1ILwFfSIHh1qd0a2ug3pSuIMQ5gfqaOWhghbFt1Y7DI87r2CjdFfq2DuncZO9wGuj3vN4+h7zwjYHD1J81UcLxDNabj0mPxL3yKfkNy49KSAtN7yyl65ZTaw9o4lA==',key_name='tempest-keypair-612389790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='256f2c4e067c46a3a4ea5e9d934b1d4b',ramdisk_id='',reservation_id='r-1asykh05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1876764595',owner_user_name='tempest-VolumeMultiattachTests-1876764595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:15:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='568dd12813254325bb16fac607894d49',uuid=53735ed3-493a-4af7-9950-3fd6a68db4c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "address": "fa:16:3e:aa:08:24", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed4ce5-7d", "ovs_interfaceid": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:15:22.715505 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Converting VIF {"id": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "address": "fa:16:3e:aa:08:24", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed4ce5-7d", "ovs_interfaceid": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:15:22.716594 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:08:24,bridge_name='br-int',has_traffic_filtering=True,id=96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ed4ce5-7d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:15:22.716594 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:08:24,bridge_name='br-int',has_traffic_filtering=True,id=96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ed4ce5-7d') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:15:22.716838 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:22.717120 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:22.717416 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:15:22.718164 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:22.718371 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b773df3-bcd8-54ba-ab7c-cead180d8ba7', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:22.719278 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:22.720158 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:15:22.720242 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:22.722089 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:22.722230 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96ed4ce5-7d, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:22.722552 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96ed4ce5-7d, col_values=(('qos', UUID('e34b74ab-0f23-42aa-9500-5a089ff15480')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:22.722708 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96ed4ce5-7d, col_values=(('external_ids', {'iface-id': '96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:08:24', 'vm-uuid': '53735ed3-493a-4af7-9950-3fd6a68db4c1'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:22.723531 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:22.724696 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:15:22.729537 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:22.730481 np0000001475 nova-compute[98471]: INFO os_vif [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:08:24,bridge_name='br-int',has_traffic_filtering=True,id=96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ed4ce5-7d')
May 27 03:15:22.970514 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-482318bd-442c-475d-a585-16d510183ffe req-f23b1873-b6e9-41a5-8baf-80eb3f796255 service nova] Releasing lock "refresh_cache-3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:15:22.971113 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquired lock "refresh_cache-3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:15:22.971327 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:15:23.533963 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:15:23.670962 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:23.796896 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Updating instance_info_cache with network_info: [{"id": "465489db-a702-4ce5-a807-4b56dc3ad058", "address": "fa:16:3e:1d:0a:4a", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap465489db-a7", "ovs_interfaceid": "465489db-a702-4ce5-a807-4b56dc3ad058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:15:24.250443 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:15:24.250541 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:15:24.250647 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No VIF found with MAC fa:16:3e:aa:08:24, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:15:24.251096 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Using config drive
May 27 03:15:24.298898 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Releasing lock "refresh_cache-3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:15:24.299309 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Instance network_info: |[{"id": "465489db-a702-4ce5-a807-4b56dc3ad058", "address": "fa:16:3e:1d:0a:4a", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap465489db-a7", "ovs_interfaceid": "465489db-a702-4ce5-a807-4b56dc3ad058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:15:24.397336 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:15:24.398552 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:15:24.398852 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Creating image(s)
May 27 03:15:24.399176 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:15:24.399484 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Ensure instance console log exists: /opt/stack/data/nova/instances/3cdaa1c9-48d4-41fd-a93b-a27686f56c9d/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:15:24.399542 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:24.399727 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:24.399850 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:24.400288 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Start _get_guest_xml network_info=[{"id": "465489db-a702-4ce5-a807-4b56dc3ad058", "address": "fa:16:3e:1d:0a:4a", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap465489db-a7", "ovs_interfaceid": "465489db-a702-4ce5-a807-4b56dc3ad058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c53c2d86-066a-4251-93bf-cbf268ce13a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '3cdaa1c9-48d4-41fd-a93b-a27686f56c9d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c53c2d86-066a-4251-93bf-cbf268ce13a6', 'serial': 'c53c2d86-066a-4251-93bf-cbf268ce13a6'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'd4b31896-ad13-4693-a04b-b36753d92152', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:15:24.402636 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:15:24.403752 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1756622356', uuid='3cdaa1c9-48d4-41fd-a93b-a27686f56c9d'), owner=OwnerMeta(userid='8eeaf68cfb534238bfe879dd6e8f858f', username='tempest-TestVolumeBootPattern-360350731-project-member', projectid='bf4b0011da7449e7948bf2c8a41955f5', projectname='tempest-TestVolumeBootPattern-360350731'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "465489db-a702-4ce5-a807-4b56dc3ad058", "address": "fa:16:3e:1d:0a:4a", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap465489db-a7", "ovs_interfaceid": "465489db-a702-4ce5-a807-4b56dc3ad058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851724.4033585) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:15:24.405674 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:15:24.405991 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:15:24.406875 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:15:24.407058 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:15:24.407958 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:15:24.408227 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:15:24.408412 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:15:24.408515 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:15:24.408627 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:15:24.408707 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:15:24.408816 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:15:24.408956 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:15:24.409049 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:15:24.409151 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:15:24.409244 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:15:24.409536 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:15:24.419549 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:15:24.419865 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c53c2d86-066a-4251-93bf-cbf268ce13a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:15:24.420041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:15:24.756434 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:24.869906 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Creating config drive at /opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1/disk.config
May 27 03:15:24.873768 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp55fhkr_9 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:15:24.927376 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp55fhkr_9" returned: 0 in 0.053s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:15:25.272827 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.853s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:15:25.273218 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c53c2d86-066a-4251-93bf-cbf268ce13a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:15:25.287250 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:15:25.288041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:15:25.288656 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:15:25.288656 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:15:25.289346 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:15:25.289596 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:15:25.298374 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:25.303726 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:15:25.303726 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:25.309318 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:15:25.309318 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:25.320866 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6] added
May 27 03:15:25.320866 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:15:25.320866 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:15:25.320866 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:15:25.320866 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:15:25.320866 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:15:25.320866 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:25.320866 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:15:25.320866 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:15:25.320866 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:15:25.322234 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:25.328236 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6] added
May 27 03:15:25.328236 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:15:25.328236 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:15:25.328236 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:15:25.328236 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:15:25.328236 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:15:25.328236 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:25.328236 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:15:25.328236 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0396(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:15:25.328536 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:15:25.417995 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:25.487419 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-793156c5-4dd0-4655-a904-1d53f63dcd8b req-29cc680e-7947-4e2c-be9b-36ab967e8054 service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Received event network-vif-plugged-96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:25.487698 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-793156c5-4dd0-4655-a904-1d53f63dcd8b req-29cc680e-7947-4e2c-be9b-36ab967e8054 service nova] Acquiring lock "53735ed3-493a-4af7-9950-3fd6a68db4c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:25.487934 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-793156c5-4dd0-4655-a904-1d53f63dcd8b req-29cc680e-7947-4e2c-be9b-36ab967e8054 service nova] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:25.488114 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-793156c5-4dd0-4655-a904-1d53f63dcd8b req-29cc680e-7947-4e2c-be9b-36ab967e8054 service nova] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:25.488290 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-793156c5-4dd0-4655-a904-1d53f63dcd8b req-29cc680e-7947-4e2c-be9b-36ab967e8054 service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Processing event network-vif-plugged-96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:15:25.645608 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:25.648895 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:25.671018 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:26.137098 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:15:26.137763 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851726.1371675, 53735ed3-493a-4af7-9950-3fd6a68db4c1 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:15:26.137919 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] VM Started (Lifecycle Event)
May 27 03:15:26.139886 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:15:26.144189 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Instance spawned successfully.
May 27 03:15:26.144623 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:15:26.320111 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:15:26.328803 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:15:26.335936 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:15:26.335936 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:15:26.346387 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:15:26.346387 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:26.359763 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:26.365519 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:26.379935 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:26.379935 np0000001475 nova-compute[98471]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:26.379935 np0000001475 nova-compute[98471]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38394621-1598-43c4-b2b1-c1e955164a74 (non-flash)
May 27 03:15:26.379935 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:15:26.379935 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:26.379935 np0000001475 nova-compute[98471]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:26.379935 np0000001475 nova-compute[98471]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38394621-1598-43c4-b2b1-c1e955164a74 (non-flash)
May 27 03:15:26.379935 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:15:26.386366 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:26.386366 np0000001475 nova-compute[98471]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:26.386366 np0000001475 nova-compute[98471]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38394621-1598-43c4-b2b1-c1e955164a74 (non-flash)
May 27 03:15:26.386366 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:15:26.386366 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:26.386366 np0000001475 nova-compute[98471]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:26.386366 np0000001475 nova-compute[98471]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38394621-1598-43c4-b2b1-c1e955164a74 (non-flash)
May 27 03:15:26.386366 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:15:26.425595 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6, portal: 192.168.50.100,3260]
May 27 03:15:26.425595 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6, portal: 192.168.50.100,3260] successful.
May 27 03:15:26.425595 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:26.436842 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:26.442315 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6, portal: 192.168.40.100,3260]
May 27 03:15:26.442315 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6, portal: 192.168.40.100,3260] successful.
May 27 03:15:26.442315 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:26.451640 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:26.451640 np0000001475 nova-compute[98471]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:26.451640 np0000001475 nova-compute[98471]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38394621-1598-43c4-b2b1-c1e955164a74 (non-flash)
May 27 03:15:26.451640 np0000001475 nova-compute[98471]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:15:26.451640 np0000001475 nova-compute[98471]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:15:26.451640 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:15:26.451869 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:26.451869 np0000001475 nova-compute[98471]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:26.451869 np0000001475 nova-compute[98471]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38394621-1598-43c4-b2b1-c1e955164a74 (non-flash)
May 27 03:15:26.451869 np0000001475 nova-compute[98471]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:15:26.451869 np0000001475 nova-compute[98471]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:15:26.451869 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:15:26.452204 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:15:26.452360 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:15:26.453353 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('10', '-', '-', 0) found on session 183 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:15:26.453488 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:15:26.460205 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:26.470846 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 183 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:15:26.470846 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c53c2d86-066a-4251-93bf-cbf268ce13a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:15:26.475031 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:26.475031 np0000001475 nova-compute[98471]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:26.475031 np0000001475 nova-compute[98471]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38394621-1598-43c4-b2b1-c1e955164a74 (non-flash)
May 27 03:15:26.475031 np0000001475 nova-compute[98471]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:15:26.475031 np0000001475 nova-compute[98471]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:15:26.475031 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:15:26.475299 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:26.475299 np0000001475 nova-compute[98471]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:26.475299 np0000001475 nova-compute[98471]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38394621-1598-43c4-b2b1-c1e955164a74 (non-flash)
May 27 03:15:26.475299 np0000001475 nova-compute[98471]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:15:26.475299 np0000001475 nova-compute[98471]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:15:26.475299 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:15:26.475492 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:15:26.475583 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:15:26.476454 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('11', '-', '-', 0) found on session 184 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:15:26.476538 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:15:26.492952 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 184 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:15:26.492952 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c53c2d86-066a-4251-93bf-cbf268ce13a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:15:26.643294 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:15:26.646404 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:15:26.654353 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:15:26.654353 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:15:26.654353 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:15:26.654569 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:15:26.654865 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:15:26.656717 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:15:26.665905 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:27.150236 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:15:27.150680 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851727.150228, 53735ed3-493a-4af7-9950-3fd6a68db4c1 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:15:27.150680 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] VM Paused (Lifecycle Event)
May 27 03:15:27.160144 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Took 6.74 seconds to spawn the instance on the hypervisor.
May 27 03:15:27.160556 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:15:27.289927 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:15:27.548731 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d6e1e7c7-ed41-4707-bf48-aadd17655549 req-4aac7be4-d6f4-4512-87e9-f58c385a1d8e service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Received event network-vif-plugged-96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:27.548969 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d6e1e7c7-ed41-4707-bf48-aadd17655549 req-4aac7be4-d6f4-4512-87e9-f58c385a1d8e service nova] Acquiring lock "53735ed3-493a-4af7-9950-3fd6a68db4c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:27.549059 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d6e1e7c7-ed41-4707-bf48-aadd17655549 req-4aac7be4-d6f4-4512-87e9-f58c385a1d8e service nova] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:27.549181 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-d6e1e7c7-ed41-4707-bf48-aadd17655549 req-4aac7be4-d6f4-4512-87e9-f58c385a1d8e service nova] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:27.549363 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-d6e1e7c7-ed41-4707-bf48-aadd17655549 req-4aac7be4-d6f4-4512-87e9-f58c385a1d8e service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] No waiting events found dispatching network-vif-plugged-96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:15:27.549797 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-d6e1e7c7-ed41-4707-bf48-aadd17655549 req-4aac7be4-d6f4-4512-87e9-f58c385a1d8e service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Received unexpected event network-vif-plugged-96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2 for instance with vm_state active and task_state None.
May 27 03:15:27.652451 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:15:27.655655 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851727.6545558, 53735ed3-493a-4af7-9950-3fd6a68db4c1 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:15:27.655655 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] VM Resumed (Lifecycle Event)
May 27 03:15:27.669595 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Took 12.21 seconds to build instance.
May 27 03:15:27.724886 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:28.157562 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:15:28.159945 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:15:28.174212 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.727s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:28.309041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Found WWN 3300000004aff3034 for multipath device dm-1 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:15:28.309277 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:15:28.309453 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== connect_volume: return (3889ms) {'type': 'block', 'scsi_wwn': '3300000004aff3034', 'path': '/dev/dm-1', 'multipath_id': '3300000004aff3034'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:15:28.309576 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004aff3034', 'path': '/dev/dm-1', 'multipath_id': '3300000004aff3034'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:15:28.815186 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:15:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1756622356',display_name='tempest-TestVolumeBootPattern-server-1756622356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-1756622356',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxiBxFJXQ0pi6NSh0eiJkxIWAyiQKZ6tDcI2UaIJXmnscpWmpB128UCvOl68Z3t1wAlM2bRyPBneyWVgyrNQhWbZD8pCD7t9O6embas8c/ONUVT+oDfoim2ELlZ5AF1Lw==',key_name='tempest-keypair-864530749',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-lncjwlw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:15:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=3cdaa1c9-48d4-41fd-a93b-a27686f56c9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "465489db-a702-4ce5-a807-4b56dc3ad058", "address": "fa:16:3e:1d:0a:4a", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap465489db-a7", "ovs_interfaceid": "465489db-a702-4ce5-a807-4b56dc3ad058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:15:28.815406 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "465489db-a702-4ce5-a807-4b56dc3ad058", "address": "fa:16:3e:1d:0a:4a", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap465489db-a7", "ovs_interfaceid": "465489db-a702-4ce5-a807-4b56dc3ad058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:15:28.816187 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:0a:4a,bridge_name='br-int',has_traffic_filtering=True,id=465489db-a702-4ce5-a807-4b56dc3ad058,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465489db-a7') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:15:28.816945 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:15:29.321130 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] End _get_guest_xml xml=<domain type="qemu">
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:   <uuid>3cdaa1c9-48d4-41fd-a93b-a27686f56c9d</uuid>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:   <name>instance-00000047</name>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestVolumeBootPattern-server-1756622356</nova:name>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:15:24</nova:creationTime>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:         <nova:user uuid="8eeaf68cfb534238bfe879dd6e8f858f">tempest-TestVolumeBootPattern-360350731-project-member</nova:user>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:         <nova:project uuid="bf4b0011da7449e7948bf2c8a41955f5">tempest-TestVolumeBootPattern-360350731</nova:project>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:         <nova:port uuid="465489db-a702-4ce5-a807-4b56dc3ad058">
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     <system>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <entry name="serial">3cdaa1c9-48d4-41fd-a93b-a27686f56c9d</entry>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <entry name="uuid">3cdaa1c9-48d4-41fd-a93b-a27686f56c9d</entry>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     </system>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:   <os>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:   </os>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:   <features>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:   </features>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:   <devices>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/3cdaa1c9-48d4-41fd-a93b-a27686f56c9d/disk.config"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     </disk>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <alias name="ua-c53c2d86-066a-4251-93bf-cbf268ce13a6"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-1"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <serial>c53c2d86-066a-4251-93bf-cbf268ce13a6</serial>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     </disk>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:1d:0a:4a"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <target dev="tap465489db-a7"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     </interface>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/3cdaa1c9-48d4-41fd-a93b-a27686f56c9d/console.log" append="off"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     </serial>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     <video>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     </video>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     </rng>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:   </devices>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]: </domain>
May 27 03:15:29.321130 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:15:29.323423 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Preparing to wait for external event network-vif-plugged-465489db-a702-4ce5-a807-4b56dc3ad058 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:15:29.323423 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:29.323423 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:29.323423 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:29.323423 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:15:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1756622356',display_name='tempest-TestVolumeBootPattern-server-1756622356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-1756622356',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxiBxFJXQ0pi6NSh0eiJkxIWAyiQKZ6tDcI2UaIJXmnscpWmpB128UCvOl68Z3t1wAlM2bRyPBneyWVgyrNQhWbZD8pCD7t9O6embas8c/ONUVT+oDfoim2ELlZ5AF1Lw==',key_name='tempest-keypair-864530749',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-lncjwlw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:15:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=3cdaa1c9-48d4-41fd-a93b-a27686f56c9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "465489db-a702-4ce5-a807-4b56dc3ad058", "address": "fa:16:3e:1d:0a:4a", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap465489db-a7", "ovs_interfaceid": "465489db-a702-4ce5-a807-4b56dc3ad058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:15:29.323423 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "465489db-a702-4ce5-a807-4b56dc3ad058", "address": "fa:16:3e:1d:0a:4a", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap465489db-a7", "ovs_interfaceid": "465489db-a702-4ce5-a807-4b56dc3ad058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:15:29.323423 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:0a:4a,bridge_name='br-int',has_traffic_filtering=True,id=465489db-a702-4ce5-a807-4b56dc3ad058,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465489db-a7') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:15:29.323423 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:0a:4a,bridge_name='br-int',has_traffic_filtering=True,id=465489db-a702-4ce5-a807-4b56dc3ad058,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465489db-a7') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:15:29.323795 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:29.324464 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:29.324464 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:15:29.324785 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:29.324942 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77ccbf9d-e0bd-500f-aaa7-185ec0e664d7', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:29.325711 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:29.326347 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:15:29.326903 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:29.328427 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:29.328565 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap465489db-a7, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:29.328885 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap465489db-a7, col_values=(('qos', UUID('0963e31a-0b49-4f34-989e-71d51a004a50')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:29.329360 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap465489db-a7, col_values=(('external_ids', {'iface-id': '465489db-a702-4ce5-a807-4b56dc3ad058', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:0a:4a', 'vm-uuid': '3cdaa1c9-48d4-41fd-a93b-a27686f56c9d'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:29.330550 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:29.330695 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:15:29.336095 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:29.337060 np0000001475 nova-compute[98471]: INFO os_vif [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:0a:4a,bridge_name='br-int',has_traffic_filtering=True,id=465489db-a702-4ce5-a807-4b56dc3ad058,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465489db-a7')
May 27 03:15:29.599033 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-73047d5c-b41d-4b58-b847-04b6ab5bfeec req-5973fb58-d77d-41ae-aeca-27734ddbb63d service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Received event network-changed-96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:29.599297 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-73047d5c-b41d-4b58-b847-04b6ab5bfeec req-5973fb58-d77d-41ae-aeca-27734ddbb63d service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Refreshing instance network info cache due to event network-changed-96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:15:29.599525 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-73047d5c-b41d-4b58-b847-04b6ab5bfeec req-5973fb58-d77d-41ae-aeca-27734ddbb63d service nova] Acquiring lock "refresh_cache-53735ed3-493a-4af7-9950-3fd6a68db4c1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:15:29.599736 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-73047d5c-b41d-4b58-b847-04b6ab5bfeec req-5973fb58-d77d-41ae-aeca-27734ddbb63d service nova] Acquired lock "refresh_cache-53735ed3-493a-4af7-9950-3fd6a68db4c1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:15:29.599905 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-73047d5c-b41d-4b58-b847-04b6ab5bfeec req-5973fb58-d77d-41ae-aeca-27734ddbb63d service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Refreshing network info cache for port 96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:15:30.102672 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-73047d5c-b41d-4b58-b847-04b6ab5bfeec req-5973fb58-d77d-41ae-aeca-27734ddbb63d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:30.410539 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-73047d5c-b41d-4b58-b847-04b6ab5bfeec req-5973fb58-d77d-41ae-aeca-27734ddbb63d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:30.536173 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-73047d5c-b41d-4b58-b847-04b6ab5bfeec req-5973fb58-d77d-41ae-aeca-27734ddbb63d service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Updated VIF entry in instance network info cache for port 96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:15:30.536399 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-73047d5c-b41d-4b58-b847-04b6ab5bfeec req-5973fb58-d77d-41ae-aeca-27734ddbb63d service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Updating instance_info_cache with network_info: [{"id": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "address": "fa:16:3e:aa:08:24", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed4ce5-7d", "ovs_interfaceid": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:15:30.856798 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:15:30.856970 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:15:30.857097 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No VIF found with MAC fa:16:3e:1d:0a:4a, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:15:30.857551 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Using config drive
May 27 03:15:31.038138 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-73047d5c-b41d-4b58-b847-04b6ab5bfeec req-5973fb58-d77d-41ae-aeca-27734ddbb63d service nova] Releasing lock "refresh_cache-53735ed3-493a-4af7-9950-3fd6a68db4c1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:15:31.362725 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:31.484349 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Creating config drive at /opt/stack/data/nova/instances/3cdaa1c9-48d4-41fd-a93b-a27686f56c9d/disk.config
May 27 03:15:31.488171 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3cdaa1c9-48d4-41fd-a93b-a27686f56c9d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpem8l2x6z {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:15:31.565861 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3cdaa1c9-48d4-41fd-a93b-a27686f56c9d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpem8l2x6z" returned: 0 in 0.077s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:15:31.666918 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:32.010963 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:32.045012 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:32.138767 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:32.211710 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-84fc987b-4aaa-401b-97dc-3f152d4c5236 req-2a90371a-8930-4544-bfec-4ea02fbd113e service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Received event network-vif-plugged-465489db-a702-4ce5-a807-4b56dc3ad058 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:32.212965 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-84fc987b-4aaa-401b-97dc-3f152d4c5236 req-2a90371a-8930-4544-bfec-4ea02fbd113e service nova] Acquiring lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:32.212965 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-84fc987b-4aaa-401b-97dc-3f152d4c5236 req-2a90371a-8930-4544-bfec-4ea02fbd113e service nova] Lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:32.212965 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-84fc987b-4aaa-401b-97dc-3f152d4c5236 req-2a90371a-8930-4544-bfec-4ea02fbd113e service nova] Lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:32.212965 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-84fc987b-4aaa-401b-97dc-3f152d4c5236 req-2a90371a-8930-4544-bfec-4ea02fbd113e service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Processing event network-vif-plugged-465489db-a702-4ce5-a807-4b56dc3ad058 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:15:32.372990 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:32.374788 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:32.379172 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:32.396737 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:32.760274 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851732.7598941, 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:15:32.760659 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] VM Started (Lifecycle Event)
May 27 03:15:32.761963 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:15:32.765325 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:15:32.767637 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Instance spawned successfully.
May 27 03:15:32.768131 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:15:33.263722 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:15:33.265633 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:15:33.273856 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:15:33.273982 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:15:33.274290 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:15:33.274486 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:15:33.274903 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:15:33.275157 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:15:33.767651 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:15:33.768116 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851733.7677214, 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:15:33.768116 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] VM Paused (Lifecycle Event)
May 27 03:15:33.779993 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Took 9.38 seconds to spawn the instance on the hypervisor.
May 27 03:15:33.780171 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:15:34.264800 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-11c7e819-5955-46c6-9582-749fa8a83aeb req-62dc98a9-bca5-4cbe-8ba8-0c5a9f639de2 service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Received event network-vif-plugged-465489db-a702-4ce5-a807-4b56dc3ad058 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:34.264989 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-11c7e819-5955-46c6-9582-749fa8a83aeb req-62dc98a9-bca5-4cbe-8ba8-0c5a9f639de2 service nova] Acquiring lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:34.265122 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-11c7e819-5955-46c6-9582-749fa8a83aeb req-62dc98a9-bca5-4cbe-8ba8-0c5a9f639de2 service nova] Lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:34.265249 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-11c7e819-5955-46c6-9582-749fa8a83aeb req-62dc98a9-bca5-4cbe-8ba8-0c5a9f639de2 service nova] Lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:34.265376 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-11c7e819-5955-46c6-9582-749fa8a83aeb req-62dc98a9-bca5-4cbe-8ba8-0c5a9f639de2 service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] No waiting events found dispatching network-vif-plugged-465489db-a702-4ce5-a807-4b56dc3ad058 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:15:34.265539 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-11c7e819-5955-46c6-9582-749fa8a83aeb req-62dc98a9-bca5-4cbe-8ba8-0c5a9f639de2 service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Received unexpected event network-vif-plugged-465489db-a702-4ce5-a807-4b56dc3ad058 for instance with vm_state active and task_state None.
May 27 03:15:34.271474 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:15:34.275123 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851734.2748837, 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:15:34.275257 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] VM Resumed (Lifecycle Event)
May 27 03:15:34.288291 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Took 17.38 seconds to build instance.
May 27 03:15:34.329699 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:34.778640 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:15:34.781339 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:15:34.791043 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.885s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:34.884700 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3971af39-8f44-445a-9d98-851f4b59ba41 req-eec537c4-ea72-4853-84dc-26f80b8f07b2 service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Received event network-changed-465489db-a702-4ce5-a807-4b56dc3ad058 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:34.885025 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-3971af39-8f44-445a-9d98-851f4b59ba41 req-eec537c4-ea72-4853-84dc-26f80b8f07b2 service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Refreshing instance network info cache due to event network-changed-465489db-a702-4ce5-a807-4b56dc3ad058. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:15:34.885178 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3971af39-8f44-445a-9d98-851f4b59ba41 req-eec537c4-ea72-4853-84dc-26f80b8f07b2 service nova] Acquiring lock "refresh_cache-3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:15:34.885290 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3971af39-8f44-445a-9d98-851f4b59ba41 req-eec537c4-ea72-4853-84dc-26f80b8f07b2 service nova] Acquired lock "refresh_cache-3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:15:34.885436 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-3971af39-8f44-445a-9d98-851f4b59ba41 req-eec537c4-ea72-4853-84dc-26f80b8f07b2 service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Refreshing network info cache for port 465489db-a702-4ce5-a807-4b56dc3ad058 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:15:35.387725 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-3971af39-8f44-445a-9d98-851f4b59ba41 req-eec537c4-ea72-4853-84dc-26f80b8f07b2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:35.722410 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-3971af39-8f44-445a-9d98-851f4b59ba41 req-eec537c4-ea72-4853-84dc-26f80b8f07b2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:35.876920 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-3971af39-8f44-445a-9d98-851f4b59ba41 req-eec537c4-ea72-4853-84dc-26f80b8f07b2 service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Updated VIF entry in instance network info cache for port 465489db-a702-4ce5-a807-4b56dc3ad058. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:15:35.877348 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-3971af39-8f44-445a-9d98-851f4b59ba41 req-eec537c4-ea72-4853-84dc-26f80b8f07b2 service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Updating instance_info_cache with network_info: [{"id": "465489db-a702-4ce5-a807-4b56dc3ad058", "address": "fa:16:3e:1d:0a:4a", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap465489db-a7", "ovs_interfaceid": "465489db-a702-4ce5-a807-4b56dc3ad058", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:15:36.379115 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-3971af39-8f44-445a-9d98-851f4b59ba41 req-eec537c4-ea72-4853-84dc-26f80b8f07b2 service nova] Releasing lock "refresh_cache-3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:15:36.668591 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:39.331369 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:41.671300 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:44.332050 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:46.671560 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:49.333180 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:49.898155 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-750cea2d-dcf1-4c4a-903c-66d30b879898 req-6c7bc6e0-6d01-4b80-9132-0342f2d20daf service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received event network-changed-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:49.898279 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-750cea2d-dcf1-4c4a-903c-66d30b879898 req-6c7bc6e0-6d01-4b80-9132-0342f2d20daf service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Refreshing instance network info cache due to event network-changed-a525bd86-a59c-49e5-ba46-0df00f91a72c. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:15:49.898433 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-750cea2d-dcf1-4c4a-903c-66d30b879898 req-6c7bc6e0-6d01-4b80-9132-0342f2d20daf service nova] Acquiring lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:15:49.898795 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-750cea2d-dcf1-4c4a-903c-66d30b879898 req-6c7bc6e0-6d01-4b80-9132-0342f2d20daf service nova] Acquired lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:15:49.898933 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-750cea2d-dcf1-4c4a-903c-66d30b879898 req-6c7bc6e0-6d01-4b80-9132-0342f2d20daf service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Refreshing network info cache for port a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:15:50.007118 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:50.363980 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-761585a2-cb3a-4e35-97f3-8063887a773e req-297411a2-76b9-45ff-bef3-8b26f2cfb396 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received event network-changed-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:50.364301 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-761585a2-cb3a-4e35-97f3-8063887a773e req-297411a2-76b9-45ff-bef3-8b26f2cfb396 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Refreshing instance network info cache due to event network-changed-a525bd86-a59c-49e5-ba46-0df00f91a72c. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:15:50.364301 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-761585a2-cb3a-4e35-97f3-8063887a773e req-297411a2-76b9-45ff-bef3-8b26f2cfb396 service nova] Acquiring lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:15:50.400675 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-750cea2d-dcf1-4c4a-903c-66d30b879898 req-6c7bc6e0-6d01-4b80-9132-0342f2d20daf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:50.705678 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-750cea2d-dcf1-4c4a-903c-66d30b879898 req-6c7bc6e0-6d01-4b80-9132-0342f2d20daf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:50.824417 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-750cea2d-dcf1-4c4a-903c-66d30b879898 req-6c7bc6e0-6d01-4b80-9132-0342f2d20daf service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Updated VIF entry in instance network info cache for port a525bd86-a59c-49e5-ba46-0df00f91a72c. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:15:50.824656 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-750cea2d-dcf1-4c4a-903c-66d30b879898 req-6c7bc6e0-6d01-4b80-9132-0342f2d20daf service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Updating instance_info_cache with network_info: [{"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:15:50.936373 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "bdb99676-cb52-4819-896e-b82dd6fa842a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:50.936480 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:51.044229 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:15:51.044389 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:15:51.044609 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.15 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:15:51.200224 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:15:51.200657 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:15:51.326599 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-750cea2d-dcf1-4c4a-903c-66d30b879898 req-6c7bc6e0-6d01-4b80-9132-0342f2d20daf service nova] Releasing lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:15:51.327042 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-761585a2-cb3a-4e35-97f3-8063887a773e req-297411a2-76b9-45ff-bef3-8b26f2cfb396 service nova] Acquired lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:15:51.327223 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-761585a2-cb3a-4e35-97f3-8063887a773e req-297411a2-76b9-45ff-bef3-8b26f2cfb396 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Refreshing network info cache for port a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:15:51.439097 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Detaching volume 46760c7d-e1cb-4af6-80af-c454d67464d8
May 27 03:15:51.488008 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Attempting to driver detach volume 46760c7d-e1cb-4af6-80af-c454d67464d8 from mountpoint /dev/vdb
May 27 03:15:51.493649 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Found disk vdb by alias ua-46760c7d-e1cb-4af6-80af-c454d67464d8 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:15:51.495113 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Found disk vdb by alias ua-46760c7d-e1cb-4af6-80af-c454d67464d8 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:15:51.495312 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Attempting to detach device vdb from instance bdb99676-cb52-4819-896e-b82dd6fa842a from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:15:51.495973 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:15:51.495973 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:15:51.495973 np0000001475 nova-compute[98471]:   <alias name="ua-46760c7d-e1cb-4af6-80af-c454d67464d8"/>
May 27 03:15:51.495973 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-0"/>
May 27 03:15:51.495973 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:15:51.495973 np0000001475 nova-compute[98471]:   <serial>46760c7d-e1cb-4af6-80af-c454d67464d8</serial>
May 27 03:15:51.495973 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 03:15:51.495973 np0000001475 nova-compute[98471]: </disk>
May 27 03:15:51.495973 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:15:51.503299 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Successfully detached device vdb from instance bdb99676-cb52-4819-896e-b82dd6fa842a from the persistent domain config.
May 27 03:15:51.503621 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] (1/8): Attempting to detach device vdb with device alias ua-46760c7d-e1cb-4af6-80af-c454d67464d8 from instance bdb99676-cb52-4819-896e-b82dd6fa842a from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:15:51.504021 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:15:51.504021 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:15:51.504021 np0000001475 nova-compute[98471]:   <alias name="ua-46760c7d-e1cb-4af6-80af-c454d67464d8"/>
May 27 03:15:51.504021 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-0"/>
May 27 03:15:51.504021 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:15:51.504021 np0000001475 nova-compute[98471]:   <serial>46760c7d-e1cb-4af6-80af-c454d67464d8</serial>
May 27 03:15:51.504021 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 27 03:15:51.504021 np0000001475 nova-compute[98471]: </disk>
May 27 03:15:51.504021 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:15:51.675539 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:51.829379 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-761585a2-cb3a-4e35-97f3-8063887a773e req-297411a2-76b9-45ff-bef3-8b26f2cfb396 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:51.999641 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851751.9993184, bdb99676-cb52-4819-896e-b82dd6fa842a => ua-46760c7d-e1cb-4af6-80af-c454d67464d8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:15:52.006909 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-46760c7d-e1cb-4af6-80af-c454d67464d8 for instance bdb99676-cb52-4819-896e-b82dd6fa842a {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:15:52.012050 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Successfully detached device vdb from instance bdb99676-cb52-4819-896e-b82dd6fa842a from the live domain config.
May 27 03:15:52.021163 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:15:52.021472 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46760c7d-e1cb-4af6-80af-c454d67464d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:15:52.021609 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:15:52.021968 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:15:52.022252 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46760c7d-e1cb-4af6-80af-c454d67464d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:15:52.022373 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:15:52.046796 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:52.046796 np0000001475 nova-compute[98471]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:52.046796 np0000001475 nova-compute[98471]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:15:52.046796 np0000001475 nova-compute[98471]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:15:52.046796 np0000001475 nova-compute[98471]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38394621-1598-43c4-b2b1-c1e955164a74 (non-flash)
May 27 03:15:52.046796 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:15:52.047400 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsi session list stdout=tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:52.047400 np0000001475 nova-compute[98471]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8 (non-flash)
May 27 03:15:52.047400 np0000001475 nova-compute[98471]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:15:52.047400 np0000001475 nova-compute[98471]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:15:52.047400 np0000001475 nova-compute[98471]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38394621-1598-43c4-b2b1-c1e955164a74 (non-flash)
May 27 03:15:52.047400 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:15:52.047400 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', '179'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', '184'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38394621-1598-43c4-b2b1-c1e955164a74', '186')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:15:52.047400 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', '179')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:15:52.047945 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8', '180')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:15:52.049886 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7557046e2de0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8'): ({'sdc'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:15:52.050100 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Removing multipathed devices sdb, sdc {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:15:52.050317 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Flush multipath device 3300000006fac5e05 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:15:52.079723 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:15:52.130790 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:15:52.133457 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-761585a2-cb3a-4e35-97f3-8063887a773e req-297411a2-76b9-45ff-bef3-8b26f2cfb396 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:52.184273 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:15:52.184273 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:15:52.184688 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:15:52.199878 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:15:52.200109 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:15:52.211446 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:52.251848 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 179, target: iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8, portal: 192.168.40.100,3260]
May 27 03:15:52.251848 np0000001475 nova-compute[98471]: Logout of [sid: 179, target: iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8, portal: 192.168.40.100,3260] successful.
May 27 03:15:52.251848 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:52.267381 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:52.278516 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:52.309141 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 180, target: iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8, portal: 192.168.50.100,3260]
May 27 03:15:52.309141 np0000001475 nova-compute[98471]: Logout of [sid: 180, target: iqn.2023-03.storpool.com:os--volume-46760c7d-e1cb-4af6-80af-c454d67464d8, portal: 192.168.50.100,3260] successful.
May 27 03:15:52.309141 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:52.325637 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-761585a2-cb3a-4e35-97f3-8063887a773e req-297411a2-76b9-45ff-bef3-8b26f2cfb396 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Updated VIF entry in instance network info cache for port a525bd86-a59c-49e5-ba46-0df00f91a72c. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:15:52.326341 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-761585a2-cb3a-4e35-97f3-8063887a773e req-297411a2-76b9-45ff-bef3-8b26f2cfb396 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Updating instance_info_cache with network_info: [{"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:15:52.328075 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:15:52.328377 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:15:52.328617 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] <== disconnect_volume: return (306ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:15:52.328804 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:15:52.832330 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-761585a2-cb3a-4e35-97f3-8063887a773e req-297411a2-76b9-45ff-bef3-8b26f2cfb396 service nova] Releasing lock "refresh_cache-bdb99676-cb52-4819-896e-b82dd6fa842a" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:15:52.890316 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lazy-loading 'flavor' on Instance uuid bdb99676-cb52-4819-896e-b82dd6fa842a {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:15:53.200185 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:15:53.200522 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:15:53.895491 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-490ca1bf-3f90-4bd7-9151-01f9ee147ed3 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.959s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:54.199702 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:15:54.199967 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:15:54.200362 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:15:54.333997 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:55.311502 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "bdb99676-cb52-4819-896e-b82dd6fa842a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:55.314021 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:55.314021 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:55.314021 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:55.314021 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:55.317789 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Terminating instance
May 27 03:15:55.824917 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:15:55.844914 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:55.849446 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:55.865989 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:55.871333 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:55.897622 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:56.013526 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-222c89c3-73c9-4b50-9008-6eae994b8959 req-f97dae44-0ef3-4e45-9f83-a1118d769a35 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received event network-vif-unplugged-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:56.013526 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-222c89c3-73c9-4b50-9008-6eae994b8959 req-f97dae44-0ef3-4e45-9f83-a1118d769a35 service nova] Acquiring lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:56.013526 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-222c89c3-73c9-4b50-9008-6eae994b8959 req-f97dae44-0ef3-4e45-9f83-a1118d769a35 service nova] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:56.013526 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-222c89c3-73c9-4b50-9008-6eae994b8959 req-f97dae44-0ef3-4e45-9f83-a1118d769a35 service nova] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:56.013526 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-222c89c3-73c9-4b50-9008-6eae994b8959 req-f97dae44-0ef3-4e45-9f83-a1118d769a35 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] No waiting events found dispatching network-vif-unplugged-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:15:56.013526 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-222c89c3-73c9-4b50-9008-6eae994b8959 req-f97dae44-0ef3-4e45-9f83-a1118d769a35 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received event network-vif-unplugged-a525bd86-a59c-49e5-ba46-0df00f91a72c for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:15:56.168317 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:56.197490 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:15:56.197644 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:15:56.199375 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:15:56.200028 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.47 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:15:56.207767 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99961297200025 future=<Future at 0x7557241d0ad0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:15:56.207767 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999361597000188 future=<Future at 0x7557241d0ad0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:15:56.207767 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.998634046999996 future=<Future at 0x7557241d0ad0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:15:56.208852 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Instance destroyed successfully.
May 27 03:15:56.209264 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lazy-loading 'resources' on Instance uuid bdb99676-cb52-4819-896e-b82dd6fa842a {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:15:56.674262 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:56.714055 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-437477219',display_name='tempest-TestMinimumBasicScenario-server-437477219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testminimumbasicscenario-server-437477219',id=69,image_ref='e4962c6e-b61e-49bb-8c87-5b9dabb75a44',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3JBgwam4Le1srCQd7CEpIw9vZQi8nr12K+dJ6UF0MnYrhjwK2G9BH71q1pSMTOrvL2r5MKfH6kITLwS/O6Bz1rul8SVU5Cu4+tfXbKZB1mpXHo/4cPQZCV1/I2dTIFEQ==',key_name='tempest-TestMinimumBasicScenario-1604290436',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:13:55Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='132164e1033644c98f55a442c1bc16d6',ramdisk_id='',reservation_id='r-ksicpwh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e4962c6e-b61e-49bb-8c87-5b9dabb75a44',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-31061921',owner_user_name='tempest-TestMinimumBasicScenario-31061921-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:15:12Z,user_data=None,user_id='9fbbe453781546378e2ba3b6656e4d7b',uuid=bdb99676-cb52-4819-896e-b82dd6fa842a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:15:56.714318 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Converting VIF {"id": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "address": "fa:16:3e:a9:9c:8c", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa525bd86-a5", "ovs_interfaceid": "a525bd86-a59c-49e5-ba46-0df00f91a72c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:15:56.714980 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=a525bd86-a59c-49e5-ba46-0df00f91a72c,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa525bd86-a5') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:15:56.715312 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=a525bd86-a59c-49e5-ba46-0df00f91a72c,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa525bd86-a5') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:15:56.716771 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:56.717051 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa525bd86-a5, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:56.718000 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:56.718815 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:15:56.720022 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:56.720205 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=335dee8b-3bd7-4b46-b133-78482f1d98ef) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:15:56.720621 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:15:56.721411 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:15:56.722675 np0000001475 nova-compute[98471]: INFO os_vif [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:9c:8c,bridge_name='br-int',has_traffic_filtering=True,id=a525bd86-a59c-49e5-ba46-0df00f91a72c,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa525bd86-a5')
May 27 03:15:56.722929 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Deleting instance files /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a_del
May 27 03:15:56.723566 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Deletion of /opt/stack/data/nova/instances/bdb99676-cb52-4819-896e-b82dd6fa842a_del complete
May 27 03:15:57.229684 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Took 1.41 seconds to destroy the instance on the hypervisor.
May 27 03:15:57.230406 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:15:57.230746 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:15:57.230886 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:15:57.231100 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:57.364424 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:15:58.073777 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e7031c50-ed41-494c-be82-d9969832a15d req-0b5cfde6-59d8-4623-b3f0-90cd95f2b3c3 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received event network-vif-unplugged-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:58.073777 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e7031c50-ed41-494c-be82-d9969832a15d req-0b5cfde6-59d8-4623-b3f0-90cd95f2b3c3 service nova] Acquiring lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:58.073777 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e7031c50-ed41-494c-be82-d9969832a15d req-0b5cfde6-59d8-4623-b3f0-90cd95f2b3c3 service nova] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:58.073777 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e7031c50-ed41-494c-be82-d9969832a15d req-0b5cfde6-59d8-4623-b3f0-90cd95f2b3c3 service nova] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:15:58.073777 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e7031c50-ed41-494c-be82-d9969832a15d req-0b5cfde6-59d8-4623-b3f0-90cd95f2b3c3 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] No waiting events found dispatching network-vif-unplugged-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:15:58.073777 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e7031c50-ed41-494c-be82-d9969832a15d req-0b5cfde6-59d8-4623-b3f0-90cd95f2b3c3 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received event network-vif-unplugged-a525bd86-a59c-49e5-ba46-0df00f91a72c for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:15:58.073777 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e7031c50-ed41-494c-be82-d9969832a15d req-0b5cfde6-59d8-4623-b3f0-90cd95f2b3c3 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Received event network-vif-deleted-a525bd86-a59c-49e5-ba46-0df00f91a72c {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:15:58.073777 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-e7031c50-ed41-494c-be82-d9969832a15d req-0b5cfde6-59d8-4623-b3f0-90cd95f2b3c3 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Neutron deleted interface a525bd86-a59c-49e5-ba46-0df00f91a72c; detaching it from the instance and deleting it from the info cache
May 27 03:15:58.073777 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-e7031c50-ed41-494c-be82-d9969832a15d req-0b5cfde6-59d8-4623-b3f0-90cd95f2b3c3 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:15:58.097420 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:15:58.579189 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e7031c50-ed41-494c-be82-d9969832a15d req-0b5cfde6-59d8-4623-b3f0-90cd95f2b3c3 service nova] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Detach interface failed, port_id=a525bd86-a59c-49e5-ba46-0df00f91a72c, reason: Instance bdb99676-cb52-4819-896e-b82dd6fa842a could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:15:58.599627 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Took 1.37 seconds to deallocate network for instance.
May 27 03:15:59.118960 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:15:59.119365 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:15:59.289704 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:15:59.289930 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:15:59.671440 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:15:59.793422 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:16:00.175660 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] While synchronizing instance power states, found 3 instances in the database and 2 instances on the hypervisor.
May 27 03:16:00.176097 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Triggering sync for uuid bdb99676-cb52-4819-896e-b82dd6fa842a {{(pid=98471) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 03:16:00.176097 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Triggering sync for uuid 53735ed3-493a-4af7-9950-3fd6a68db4c1 {{(pid=98471) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 03:16:00.176189 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Triggering sync for uuid 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d {{(pid=98471) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 27 03:16:00.177931 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "bdb99676-cb52-4819-896e-b82dd6fa842a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:00.178190 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "53735ed3-493a-4af7-9950-3fd6a68db4c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:00.178408 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:00.178716 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.02 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:16:00.179125 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:00.179267 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:00.329030 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.208s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:00.389810 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Deleted allocations for instance bdb99676-cb52-4819-896e-b82dd6fa842a
May 27 03:16:00.683758 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.505s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:00.684329 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.505s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:01.399221 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a08c86d8-a522-4b9c-b754-e28ecae97f56 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.087s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:01.399929 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.223s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:01.677348 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:01.720787 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:01.903857 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "bdb99676-cb52-4819-896e-b82dd6fa842a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.504s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:04.877590 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "55c414d9-4157-42a2-a40b-04907e27620f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:04.878122 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "55c414d9-4157-42a2-a40b-04907e27620f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:05.379698 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:16:05.926440 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:05.926798 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:05.929847 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:16:05.929994 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Claim successful on node np0000001475
May 27 03:16:06.199929 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:16:06.496304 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "53735ed3-493a-4af7-9950-3fd6a68db4c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:06.496837 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:06.689995 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:06.704090 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:06.722327 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:06.999711 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'flavor' on Instance uuid 53735ed3-493a-4af7-9950-3fd6a68db4c1 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:16:07.092720 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:16:07.092986 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:16:07.595637 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:16:08.005220 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:08.104265 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.177s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:08.104396 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.400s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:08.104489 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:08.105468 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:16:08.106585 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:16:08.610084 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:16:08.610240 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:16:08.610420 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:08.610609 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:08.671711 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fbbe453781546378e2ba3b6656e4d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132164e1033644c98f55a442c1bc16d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:16:09.045171 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Successfully created port: 2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:16:09.100385 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "53735ed3-493a-4af7-9950-3fd6a68db4c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:09.100602 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:09.100734 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Attaching volume 6ed60925-e08e-4645-80b0-2558b11b96f7 to /dev/vdb
May 27 03:16:09.112477 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:16:09.128680 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:16:09.131341 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:09.151355 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:16:09.164679 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:16:09.189362 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:09.224598 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:16:09.225600 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:09.241108 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:16:09.241569 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:16:09.252479 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:16:09.254085 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:feaa:824', 'fe80::f9:d2ff:fead:2ab6', 'fe80::fc16:3eff:fe1d:a4a', 'fe80::1870:c1ff:feca:47f8'] 
May 27 03:16:09.254242 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:16:09.254478 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:16:09.254890 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:16:09.255375 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Updating existing volume attachment record: 1796b093-60c8-49f2-9ebd-ed1eb90242fd {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:16:09.326465 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:16:09.331621 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:16:09.332637 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:09.390399 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.057s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:16:09.391145 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=13048MB free_disk=72.68349075317383GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:16:09.391442 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:09.391506 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:09.566079 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Successfully updated port: 2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:16:09.615506 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:16:09.621819 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-83cf9fe9-687b-4cab-a933-25d267b0f305 req-054d146a-ac30-4fdd-97bf-b99a99379dae service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received event network-changed-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:09.621977 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-83cf9fe9-687b-4cab-a933-25d267b0f305 req-054d146a-ac30-4fdd-97bf-b99a99379dae service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Refreshing instance network info cache due to event network-changed-2ae8763f-7d5e-4b11-879d-135cf5899359. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:16:09.622127 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-83cf9fe9-687b-4cab-a933-25d267b0f305 req-054d146a-ac30-4fdd-97bf-b99a99379dae service nova] Acquiring lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:16:09.625767 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-83cf9fe9-687b-4cab-a933-25d267b0f305 req-054d146a-ac30-4fdd-97bf-b99a99379dae service nova] Acquired lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:16:09.625767 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-83cf9fe9-687b-4cab-a933-25d267b0f305 req-054d146a-ac30-4fdd-97bf-b99a99379dae service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Refreshing network info cache for port 2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:16:09.831796 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:16:09.832167 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7', 'iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6ed60925-e08e-4645-80b0-2558b11b96f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:16:09.832300 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:16:09.832631 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:16:09.832889 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7', 'iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6ed60925-e08e-4645-80b0-2558b11b96f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:16:09.845133 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:16:09.845795 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:16:09.846297 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:16:09.847833 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:16:09.847833 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:16:09.847833 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:16:09.859087 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:16:09.859087 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:09.864570 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:16:09.864570 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:09.872084 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7] added
May 27 03:16:09.872084 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:16:09.872084 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:16:09.872084 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:16:09.872084 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:16:09.872084 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:16:09.872084 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:09.872319 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:16:09.872474 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0255(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:16:09.872667 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:16:09.876379 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7] added
May 27 03:16:09.876379 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:16:09.876379 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:16:09.876379 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:16:09.876379 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:16:09.876379 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:16:09.876379 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:09.876549 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:16:09.876697 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0301(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:16:09.876850 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:16:10.068259 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:16:10.126555 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-83cf9fe9-687b-4cab-a933-25d267b0f305 req-054d146a-ac30-4fdd-97bf-b99a99379dae service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:10.186942 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-83cf9fe9-687b-4cab-a933-25d267b0f305 req-054d146a-ac30-4fdd-97bf-b99a99379dae service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:16:10.302719 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-83cf9fe9-687b-4cab-a933-25d267b0f305 req-054d146a-ac30-4fdd-97bf-b99a99379dae service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:16:10.524609 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 53735ed3-493a-4af7-9950-3fd6a68db4c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:16:10.524754 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:16:10.524847 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 55c414d9-4157-42a2-a40b-04907e27620f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:16:10.525039 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:16:10.525170 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:16:09 up 47 min,  2 users,  load average: 3.05, 4.70, 4.88\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_256f2c4e067c46a3a4ea5e9d934b1d4b': '1', 'io_workload': '1', 'num_proj_bf4b0011da7449e7948bf2c8a41955f5': '1', 'num_vm_building': '1', 'num_task_networking': '1', 'num_proj_132164e1033644c98f55a442c1bc16d6': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:16:10.627523 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:16:10.630760 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:16:10.630760 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Creating image(s)
May 27 03:16:10.630760 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "/opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:10.630760 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "/opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:10.630760 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "/opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:10.630760 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "d9d55e5ca0a609b991b306071387194bdc6d2246" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:10.630760 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "d9d55e5ca0a609b991b306071387194bdc6d2246" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:10.726957 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:16:10.727276 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:16:10.804636 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-83cf9fe9-687b-4cab-a933-25d267b0f305 req-054d146a-ac30-4fdd-97bf-b99a99379dae service nova] Releasing lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:16:10.805120 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquired lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:16:10.805665 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:16:10.873579 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:16:10.877296 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:16:10.886587 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:16:10.886587 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:16:10.893624 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:16:10.893624 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:10.905768 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:10.915644 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:10.921954 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:10.921954 np0000001475 nova-compute[98471]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:10.921954 np0000001475 nova-compute[98471]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:10.921954 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:16:10.921954 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:10.921954 np0000001475 nova-compute[98471]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:10.921954 np0000001475 nova-compute[98471]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:10.921954 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:16:10.932442 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:10.932442 np0000001475 nova-compute[98471]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:10.932442 np0000001475 nova-compute[98471]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:10.932442 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:16:10.932657 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:10.932657 np0000001475 nova-compute[98471]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:10.932657 np0000001475 nova-compute[98471]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:10.932657 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:16:10.955272 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7, portal: 192.168.50.100,3260]
May 27 03:16:10.955272 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7, portal: 192.168.50.100,3260] successful.
May 27 03:16:10.955272 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:10.969580 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:10.979217 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7, portal: 192.168.40.100,3260]
May 27 03:16:10.979217 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7, portal: 192.168.40.100,3260] successful.
May 27 03:16:10.979217 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:10.991256 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:10.991256 np0000001475 nova-compute[98471]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:10.991256 np0000001475 nova-compute[98471]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:10.991256 np0000001475 nova-compute[98471]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7 (non-flash)
May 27 03:16:10.991256 np0000001475 nova-compute[98471]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7 (non-flash)
May 27 03:16:10.991256 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:16:10.991535 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:10.991535 np0000001475 nova-compute[98471]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:10.991535 np0000001475 nova-compute[98471]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:10.991535 np0000001475 nova-compute[98471]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7 (non-flash)
May 27 03:16:10.991535 np0000001475 nova-compute[98471]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7 (non-flash)
May 27 03:16:10.991535 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:16:10.991688 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:16:10.991873 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:16:10.992568 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] HCTL ('8', '-', '-', 0) found on session 188 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:16:10.992681 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:16:10.998408 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:11.013402 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Searching for a device in session 188 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:16:11.014866 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6ed60925-e08e-4645-80b0-2558b11b96f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:16:11.018771 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:11.018771 np0000001475 nova-compute[98471]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:11.018771 np0000001475 nova-compute[98471]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:11.018771 np0000001475 nova-compute[98471]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7 (non-flash)
May 27 03:16:11.018771 np0000001475 nova-compute[98471]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7 (non-flash)
May 27 03:16:11.018771 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:16:11.018980 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:11.018980 np0000001475 nova-compute[98471]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:11.018980 np0000001475 nova-compute[98471]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:11.018980 np0000001475 nova-compute[98471]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7 (non-flash)
May 27 03:16:11.018980 np0000001475 nova-compute[98471]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7 (non-flash)
May 27 03:16:11.018980 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:16:11.019324 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:16:11.019515 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:16:11.020543 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] HCTL ('9', '-', '-', 0) found on session 189 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:16:11.020776 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:16:11.043966 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Searching for a device in session 189 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:16:11.044185 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6ed60925-e08e-4645-80b0-2558b11b96f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:16:11.184120 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:16:11.190606 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:16:11.191243 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9d55e5ca0a609b991b306071387194bdc6d2246.part --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:11.206769 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0015427210000780178 future=<Future at 0x7557241d0ad0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:16:11.206769 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:16:11.207483 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Emitting event <LifecycleEvent: 1779851756.2045112, bdb99676-cb52-4819-896e-b82dd6fa842a => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:16:11.207880 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] VM Stopped (Lifecycle Event)
May 27 03:16:11.231031 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:16:11.284732 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9d55e5ca0a609b991b306071387194bdc6d2246.part --force-share --output=json" returned: 0 in 0.093s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:16:11.285125 np0000001475 nova-compute[98471]: DEBUG nova.virt.images [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] 5c367424-f8f8-4322-aa47-7443f358eee6 was qcow2, converting to raw {{(pid=98471) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 27 03:16:11.285635 np0000001475 nova-compute[98471]: DEBUG nova.privsep.utils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98471) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 27 03:16:11.285887 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d9d55e5ca0a609b991b306071387194bdc6d2246.part /opt/stack/data/nova/instances/_base/d9d55e5ca0a609b991b306071387194bdc6d2246.converted {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:11.387626 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:16:11.443047 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d9d55e5ca0a609b991b306071387194bdc6d2246.part /opt/stack/data/nova/instances/_base/d9d55e5ca0a609b991b306071387194bdc6d2246.converted" returned: 0 in 0.157s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:16:11.450048 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9d55e5ca0a609b991b306071387194bdc6d2246.converted --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:11.544315 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9d55e5ca0a609b991b306071387194bdc6d2246.converted --force-share --output=json" returned: 0 in 0.094s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:16:11.545002 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "d9d55e5ca0a609b991b306071387194bdc6d2246" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.915s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:11.545333 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:16:11.548234 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:16:11.549412 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9d55e5ca0a609b991b306071387194bdc6d2246 --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:11.566073 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:11.646888 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9d55e5ca0a609b991b306071387194bdc6d2246 --force-share --output=json" returned: 0 in 0.097s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:16:11.647261 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "d9d55e5ca0a609b991b306071387194bdc6d2246" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:11.647669 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "d9d55e5ca0a609b991b306071387194bdc6d2246" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:11.648070 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:16:11.650366 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:16:11.650652 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9d55e5ca0a609b991b306071387194bdc6d2246 --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:11.702419 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:11.714096 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: bdb99676-cb52-4819-896e-b82dd6fa842a] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:11.722942 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:11.739162 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9d55e5ca0a609b991b306071387194bdc6d2246 --force-share --output=json" returned: 0 in 0.088s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:16:11.739697 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d9d55e5ca0a609b991b306071387194bdc6d2246,backing_fmt=raw /opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:11.754094 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:16:11.754530 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.363s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:11.759838 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Updating instance_info_cache with network_info: [{"id": "2ae8763f-7d5e-4b11-879d-135cf5899359", "address": "fa:16:3e:7b:4f:67", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae8763f-7d", "ovs_interfaceid": "2ae8763f-7d5e-4b11-879d-135cf5899359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:16:11.762396 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:16:11.793376 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d9d55e5ca0a609b991b306071387194bdc6d2246,backing_fmt=raw /opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f/disk 1073741824" returned: 0 in 0.054s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:16:11.793690 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "d9d55e5ca0a609b991b306071387194bdc6d2246" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.146s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:11.793995 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9d55e5ca0a609b991b306071387194bdc6d2246 --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:11.850089 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:16:11.879201 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9d55e5ca0a609b991b306071387194bdc6d2246 --force-share --output=json" returned: 0 in 0.085s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:16:11.879793 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:16:11.880162 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:11.967255 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:16:11.967635 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Cannot resize image /opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:16:11.968031 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:16:11.968203 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Ensure instance console log exists: /opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:16:11.968520 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:11.968722 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:11.968875 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:12.264101 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Releasing lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:16:12.264635 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Instance network_info: |[{"id": "2ae8763f-7d5e-4b11-879d-135cf5899359", "address": "fa:16:3e:7b:4f:67", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae8763f-7d", "ovs_interfaceid": "2ae8763f-7d5e-4b11-879d-135cf5899359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:16:12.266630 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Start _get_guest_xml network_info=[{"id": "2ae8763f-7d5e-4b11-879d-135cf5899359", "address": "fa:16:3e:7b:4f:67", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae8763f-7d", "ovs_interfaceid": "2ae8763f-7d5e-4b11-879d-135cf5899359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T03:16:03Z,direct_url=<?>,disk_format='qcow2',id=5c367424-f8f8-4322-aa47-7443f358eee6,min_disk=0,min_ram=0,name='tempest-scenario-img--491737503',owner='132164e1033644c98f55a442c1bc16d6',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T03:16:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': '5c367424-f8f8-4322-aa47-7443f358eee6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:16:12.271553 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:16:12.272811 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='5c367424-f8f8-4322-aa47-7443f358eee6', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-487010695', uuid='55c414d9-4157-42a2-a40b-04907e27620f'), owner=OwnerMeta(userid='9fbbe453781546378e2ba3b6656e4d7b', username='tempest-TestMinimumBasicScenario-31061921-project-member', projectid='132164e1033644c98f55a442c1bc16d6', projectname='tempest-TestMinimumBasicScenario-31061921'), image=ImageMeta(id='5c367424-f8f8-4322-aa47-7443f358eee6', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2ae8763f-7d5e-4b11-879d-135cf5899359", "address": "fa:16:3e:7b:4f:67", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae8763f-7d", "ovs_interfaceid": "2ae8763f-7d5e-4b11-879d-135cf5899359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851772.272479) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:16:12.274094 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:16:12.274434 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:16:12.275522 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:16:12.275674 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:16:12.276558 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:16:12.276934 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T03:16:03Z,direct_url=<?>,disk_format='qcow2',id=5c367424-f8f8-4322-aa47-7443f358eee6,min_disk=0,min_ram=0,name='tempest-scenario-img--491737503',owner='132164e1033644c98f55a442c1bc16d6',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T03:16:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:16:12.277025 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:16:12.277143 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:16:12.277266 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:16:12.277371 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:16:12.277449 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:16:12.277816 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:16:12.277816 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:16:12.277901 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:16:12.277972 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:16:12.278123 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:16:12.287807 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-487010695',display_name='tempest-TestMinimumBasicScenario-server-487010695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testminimumbasicscenario-server-487010695',id=72,image_ref='5c367424-f8f8-4322-aa47-7443f358eee6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCy+Ol/SQVsBXa+demI2qQfNr+xpGXprsbFw6W/XckxdHqRfc6EIJ1KzdbsTxC6prmDhBu+I4kx6qtlEeKBDsU3MTjZg0JYi3bveOfOQdRdgtEjrtbmiSio5rKO17QY3DQ==',key_name='tempest-TestMinimumBasicScenario-1896972298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='132164e1033644c98f55a442c1bc16d6',ramdisk_id='',reservation_id='r-z98g8ls1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5c367424-f8f8-4322-aa47-7443f358eee6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-31061921',owner_user_name='tempest-TestMinimumBasicScenario-31061921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:16:10Z,user_data=None,user_id='9fbbe453781546378e2ba3b6656e4d7b',uuid=55c414d9-4157-42a2-a40b-04907e27620f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ae8763f-7d5e-4b11-879d-135cf5899359", "address": "fa:16:3e:7b:4f:67", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae8763f-7d", "ovs_interfaceid": "2ae8763f-7d5e-4b11-879d-135cf5899359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:16:12.288014 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Converting VIF {"id": "2ae8763f-7d5e-4b11-879d-135cf5899359", "address": "fa:16:3e:7b:4f:67", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae8763f-7d", "ovs_interfaceid": "2ae8763f-7d5e-4b11-879d-135cf5899359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:16:12.288524 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:4f:67,bridge_name='br-int',has_traffic_filtering=True,id=2ae8763f-7d5e-4b11-879d-135cf5899359,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae8763f-7d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:16:12.289088 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lazy-loading 'pci_devices' on Instance uuid 55c414d9-4157-42a2-a40b-04907e27620f {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:16:12.792175 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] End _get_guest_xml xml=<domain type="qemu">
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:   <uuid>55c414d9-4157-42a2-a40b-04907e27620f</uuid>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:   <name>instance-00000048</name>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestMinimumBasicScenario-server-487010695</nova:name>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:16:12</nova:creationTime>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <nova:image uuid="5c367424-f8f8-4322-aa47-7443f358eee6">
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:         <nova:properties/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:         <nova:user uuid="9fbbe453781546378e2ba3b6656e4d7b">tempest-TestMinimumBasicScenario-31061921-project-member</nova:user>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:         <nova:project uuid="132164e1033644c98f55a442c1bc16d6">tempest-TestMinimumBasicScenario-31061921</nova:project>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="5c367424-f8f8-4322-aa47-7443f358eee6"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:         <nova:port uuid="2ae8763f-7d5e-4b11-879d-135cf5899359">
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     <system>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <entry name="serial">55c414d9-4157-42a2-a40b-04907e27620f</entry>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <entry name="uuid">55c414d9-4157-42a2-a40b-04907e27620f</entry>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     </system>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:   <os>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:   </os>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:   <features>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:   </features>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:   <devices>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f/disk"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     </disk>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f/disk.config"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     </disk>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:7b:4f:67"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <target dev="tap2ae8763f-7d"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     </interface>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f/console.log" append="off"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     </serial>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     <video>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     </video>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     </rng>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:   </devices>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]: </domain>
May 27 03:16:12.792175 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:16:12.794192 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Preparing to wait for external event network-vif-plugged-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:16:12.794192 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "55c414d9-4157-42a2-a40b-04907e27620f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:12.794192 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "55c414d9-4157-42a2-a40b-04907e27620f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:12.794192 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "55c414d9-4157-42a2-a40b-04907e27620f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:12.794192 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-487010695',display_name='tempest-TestMinimumBasicScenario-server-487010695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testminimumbasicscenario-server-487010695',id=72,image_ref='5c367424-f8f8-4322-aa47-7443f358eee6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCy+Ol/SQVsBXa+demI2qQfNr+xpGXprsbFw6W/XckxdHqRfc6EIJ1KzdbsTxC6prmDhBu+I4kx6qtlEeKBDsU3MTjZg0JYi3bveOfOQdRdgtEjrtbmiSio5rKO17QY3DQ==',key_name='tempest-TestMinimumBasicScenario-1896972298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='132164e1033644c98f55a442c1bc16d6',ramdisk_id='',reservation_id='r-z98g8ls1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5c367424-f8f8-4322-aa47-7443f358eee6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-31061921',owner_user_name='tempest-TestMinimumBasicScenario-31061921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:16:10Z,user_data=None,user_id='9fbbe453781546378e2ba3b6656e4d7b',uuid=55c414d9-4157-42a2-a40b-04907e27620f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ae8763f-7d5e-4b11-879d-135cf5899359", "address": "fa:16:3e:7b:4f:67", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae8763f-7d", "ovs_interfaceid": "2ae8763f-7d5e-4b11-879d-135cf5899359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:16:12.794192 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Converting VIF {"id": "2ae8763f-7d5e-4b11-879d-135cf5899359", "address": "fa:16:3e:7b:4f:67", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae8763f-7d", "ovs_interfaceid": "2ae8763f-7d5e-4b11-879d-135cf5899359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:16:12.794433 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:4f:67,bridge_name='br-int',has_traffic_filtering=True,id=2ae8763f-7d5e-4b11-879d-135cf5899359,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae8763f-7d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:16:12.794550 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:4f:67,bridge_name='br-int',has_traffic_filtering=True,id=2ae8763f-7d5e-4b11-879d-135cf5899359,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae8763f-7d') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:16:12.795034 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:12.795399 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:16:12.795751 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:16:12.796561 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:12.796736 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '037152c1-36f1-50dc-ac7f-c538ca869cd6', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:16:12.804489 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:12.805162 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:16:12.805689 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:12.807816 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:12.807816 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ae8763f-7d, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:16:12.807816 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ae8763f-7d, col_values=(('qos', UUID('71078c6a-29a5-4749-b118-7107333e218d')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:16:12.807816 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ae8763f-7d, col_values=(('external_ids', {'iface-id': '2ae8763f-7d5e-4b11-879d-135cf5899359', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:4f:67', 'vm-uuid': '55c414d9-4157-42a2-a40b-04907e27620f'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:16:12.808487 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:12.809569 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:16:12.814520 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:12.815400 np0000001475 nova-compute[98471]: INFO os_vif [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:4f:67,bridge_name='br-int',has_traffic_filtering=True,id=2ae8763f-7d5e-4b11-879d-135cf5899359,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae8763f-7d')
May 27 03:16:12.866059 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Found WWN 330000000e16f472c for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:16:12.866415 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:16:12.866581 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000e16f472c', 'path': '/dev/dm-0', 'multipath_id': '330000000e16f472c'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:16:12.866696 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e16f472c', 'path': '/dev/dm-0', 'multipath_id': '330000000e16f472c'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:16:12.869503 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'flavor' on Instance uuid 53735ed3-493a-4af7-9950-3fd6a68db4c1 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:16:13.372819 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Attempting to attach volume 6ed60925-e08e-4645-80b0-2558b11b96f7 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:16:13.374905 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:16:13.374905 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:16:13.374905 np0000001475 nova-compute[98471]:   <alias name="ua-6ed60925-e08e-4645-80b0-2558b11b96f7"/>
May 27 03:16:13.374905 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-0"/>
May 27 03:16:13.374905 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:16:13.374905 np0000001475 nova-compute[98471]:   <serial>6ed60925-e08e-4645-80b0-2558b11b96f7</serial>
May 27 03:16:13.374905 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:16:13.374905 np0000001475 nova-compute[98471]: </disk>
May 27 03:16:13.374905 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:16:14.333053 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:16:14.333207 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:16:14.333318 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] No VIF found with MAC fa:16:3e:7b:4f:67, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:16:14.333759 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Using config drive
May 27 03:16:14.840433 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:14.954194 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Creating config drive at /opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f/disk.config
May 27 03:16:14.956991 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpa8ijyc34 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:15.010633 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpa8ijyc34" returned: 0 in 0.053s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:16:15.026109 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:16:15.026240 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:16:15.026370 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:16:15.026429 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] No VIF found with MAC fa:16:3e:aa:08:24, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:16:15.366435 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-acb5a0cc-f751-4460-b3e7-730a6750670d tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:15.366649 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-acb5a0cc-f751-4460-b3e7-730a6750670d tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:15.366823 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-acb5a0cc-f751-4460-b3e7-730a6750670d tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:15.369565 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-acb5a0cc-f751-4460-b3e7-730a6750670d tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98471) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 27 03:16:15.370311 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-acb5a0cc-f751-4460-b3e7-730a6750670d tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'flavor' on Instance uuid 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:16:15.417184 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:15.437305 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:15.438397 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:15.528102 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:15.619216 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-64e000d0-874d-4565-b36b-8addc8562b07 req-be6a6683-f50f-478d-bf0d-55f5c4681192 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received event network-vif-plugged-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:15.619786 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-64e000d0-874d-4565-b36b-8addc8562b07 req-be6a6683-f50f-478d-bf0d-55f5c4681192 service nova] Acquiring lock "55c414d9-4157-42a2-a40b-04907e27620f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:15.620026 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-64e000d0-874d-4565-b36b-8addc8562b07 req-be6a6683-f50f-478d-bf0d-55f5c4681192 service nova] Lock "55c414d9-4157-42a2-a40b-04907e27620f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:15.620200 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-64e000d0-874d-4565-b36b-8addc8562b07 req-be6a6683-f50f-478d-bf0d-55f5c4681192 service nova] Lock "55c414d9-4157-42a2-a40b-04907e27620f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:15.620352 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-64e000d0-874d-4565-b36b-8addc8562b07 req-be6a6683-f50f-478d-bf0d-55f5c4681192 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Processing event network-vif-plugged-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:16:15.739056 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:15.740701 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:15.742753 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:15.759581 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:16.155279 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:16:16.155631 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851776.1551113, 55c414d9-4157-42a2-a40b-04907e27620f => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:16:16.155631 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] VM Started (Lifecycle Event)
May 27 03:16:16.158542 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:16:16.160933 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Instance spawned successfully.
May 27 03:16:16.162586 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:16:16.403961 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:16.407599 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:16.426487 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:16.428377 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:16.450225 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:16.451236 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:16.567978 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c7fe4c13-4dbb-49ce-bf20-480d6d664ab3 req-7838bbdc-a2f3-4108-9709-0eaf5b5885e8 service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Received event network-vif-unplugged-465489db-a702-4ce5-a807-4b56dc3ad058 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:16.568866 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c7fe4c13-4dbb-49ce-bf20-480d6d664ab3 req-7838bbdc-a2f3-4108-9709-0eaf5b5885e8 service nova] Acquiring lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:16.569063 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c7fe4c13-4dbb-49ce-bf20-480d6d664ab3 req-7838bbdc-a2f3-4108-9709-0eaf5b5885e8 service nova] Lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:16.569216 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c7fe4c13-4dbb-49ce-bf20-480d6d664ab3 req-7838bbdc-a2f3-4108-9709-0eaf5b5885e8 service nova] Lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:16.569356 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c7fe4c13-4dbb-49ce-bf20-480d6d664ab3 req-7838bbdc-a2f3-4108-9709-0eaf5b5885e8 service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] No waiting events found dispatching network-vif-unplugged-465489db-a702-4ce5-a807-4b56dc3ad058 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:16:16.569464 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c7fe4c13-4dbb-49ce-bf20-480d6d664ab3 req-7838bbdc-a2f3-4108-9709-0eaf5b5885e8 service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Received unexpected event network-vif-unplugged-465489db-a702-4ce5-a807-4b56dc3ad058 for instance with vm_state active and task_state powering-off.
May 27 03:16:16.575384 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c5bddb83-bf04-41a2-930d-0dfe8bcf2978 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.475s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:16.657954 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:16.662011 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:16:16.669131 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:16:16.671757 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:16:16.671757 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:16:16.671757 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:16:16.671757 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:16:16.671757 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:16:16.691525 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:16.703635 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:16.730954 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Instance destroyed successfully.
May 27 03:16:16.730954 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-acb5a0cc-f751-4460-b3e7-730a6750670d tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'numa_topology' on Instance uuid 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:16:17.166831 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:16:17.167295 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851777.166921, 55c414d9-4157-42a2-a40b-04907e27620f => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:16:17.167295 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] VM Paused (Lifecycle Event)
May 27 03:16:17.176151 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Took 6.55 seconds to spawn the instance on the hypervisor.
May 27 03:16:17.178110 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:17.229351 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "53735ed3-493a-4af7-9950-3fd6a68db4c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:17.229563 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:17.233752 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-acb5a0cc-f751-4460-b3e7-730a6750670d tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Object Instance<3cdaa1c9-48d4-41fd-a93b-a27686f56c9d> lazy-loaded attributes: flavor,numa_topology {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:16:17.234012 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-acb5a0cc-f751-4460-b3e7-730a6750670d tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:17.665748 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-11972d0b-ea49-46da-8430-d03735ceded5 req-87315b47-a494-4a9c-b650-c035d2f54eb8 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received event network-vif-plugged-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:17.665929 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-11972d0b-ea49-46da-8430-d03735ceded5 req-87315b47-a494-4a9c-b650-c035d2f54eb8 service nova] Acquiring lock "55c414d9-4157-42a2-a40b-04907e27620f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:17.666064 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-11972d0b-ea49-46da-8430-d03735ceded5 req-87315b47-a494-4a9c-b650-c035d2f54eb8 service nova] Lock "55c414d9-4157-42a2-a40b-04907e27620f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:17.666175 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-11972d0b-ea49-46da-8430-d03735ceded5 req-87315b47-a494-4a9c-b650-c035d2f54eb8 service nova] Lock "55c414d9-4157-42a2-a40b-04907e27620f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:17.666281 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-11972d0b-ea49-46da-8430-d03735ceded5 req-87315b47-a494-4a9c-b650-c035d2f54eb8 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] No waiting events found dispatching network-vif-plugged-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:16:17.666385 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-11972d0b-ea49-46da-8430-d03735ceded5 req-87315b47-a494-4a9c-b650-c035d2f54eb8 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received unexpected event network-vif-plugged-2ae8763f-7d5e-4b11-879d-135cf5899359 for instance with vm_state active and task_state None.
May 27 03:16:17.673408 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:17.675515 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851777.6753159, 55c414d9-4157-42a2-a40b-04907e27620f => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:16:17.675628 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] VM Resumed (Lifecycle Event)
May 27 03:16:17.689687 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Took 11.81 seconds to build instance.
May 27 03:16:17.731634 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Detaching volume 6ed60925-e08e-4645-80b0-2558b11b96f7
May 27 03:16:17.743576 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-acb5a0cc-f751-4460-b3e7-730a6750670d tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.377s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:17.774103 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Attempting to driver detach volume 6ed60925-e08e-4645-80b0-2558b11b96f7 from mountpoint /dev/vdb
May 27 03:16:17.778847 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Found disk vdb by alias ua-6ed60925-e08e-4645-80b0-2558b11b96f7 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:16:17.779833 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Found disk vdb by alias ua-6ed60925-e08e-4645-80b0-2558b11b96f7 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:16:17.779970 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Attempting to detach device vdb from instance 53735ed3-493a-4af7-9950-3fd6a68db4c1 from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:16:17.780215 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:16:17.780215 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:16:17.780215 np0000001475 nova-compute[98471]:   <alias name="ua-6ed60925-e08e-4645-80b0-2558b11b96f7"/>
May 27 03:16:17.780215 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-0"/>
May 27 03:16:17.780215 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:16:17.780215 np0000001475 nova-compute[98471]:   <serial>6ed60925-e08e-4645-80b0-2558b11b96f7</serial>
May 27 03:16:17.780215 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:16:17.780215 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:16:17.780215 np0000001475 nova-compute[98471]: </disk>
May 27 03:16:17.780215 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:16:17.784962 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Successfully detached device vdb from instance 53735ed3-493a-4af7-9950-3fd6a68db4c1 from the persistent domain config.
May 27 03:16:17.785066 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] (1/8): Attempting to detach device vdb with device alias ua-6ed60925-e08e-4645-80b0-2558b11b96f7 from instance 53735ed3-493a-4af7-9950-3fd6a68db4c1 from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:16:17.785270 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:16:17.785270 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:16:17.785270 np0000001475 nova-compute[98471]:   <alias name="ua-6ed60925-e08e-4645-80b0-2558b11b96f7"/>
May 27 03:16:17.785270 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-0"/>
May 27 03:16:17.785270 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:16:17.785270 np0000001475 nova-compute[98471]:   <serial>6ed60925-e08e-4645-80b0-2558b11b96f7</serial>
May 27 03:16:17.785270 np0000001475 nova-compute[98471]:   <shareable/>
May 27 03:16:17.785270 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:16:17.785270 np0000001475 nova-compute[98471]: </disk>
May 27 03:16:17.785270 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:16:17.809232 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:18.178023 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:18.182031 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:16:18.190623 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7939eeeb-aea3-4d8d-b2d4-6445e9e0f4cb tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "55c414d9-4157-42a2-a40b-04907e27620f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.313s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:18.236102 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-6ed60925-e08e-4645-80b0-2558b11b96f7 for instance 53735ed3-493a-4af7-9950-3fd6a68db4c1 {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:16:18.638243 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a1bdb3d3-532b-4216-9414-dce68ecbea56 req-b730514e-2340-4b39-ae07-9568dd7fab26 service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Received event network-vif-unplugged-465489db-a702-4ce5-a807-4b56dc3ad058 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:18.638243 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a1bdb3d3-532b-4216-9414-dce68ecbea56 req-b730514e-2340-4b39-ae07-9568dd7fab26 service nova] Acquiring lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:18.638243 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a1bdb3d3-532b-4216-9414-dce68ecbea56 req-b730514e-2340-4b39-ae07-9568dd7fab26 service nova] Lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:18.638243 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a1bdb3d3-532b-4216-9414-dce68ecbea56 req-b730514e-2340-4b39-ae07-9568dd7fab26 service nova] Lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:18.638243 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a1bdb3d3-532b-4216-9414-dce68ecbea56 req-b730514e-2340-4b39-ae07-9568dd7fab26 service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] No waiting events found dispatching network-vif-unplugged-465489db-a702-4ce5-a807-4b56dc3ad058 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:16:18.638243 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-a1bdb3d3-532b-4216-9414-dce68ecbea56 req-b730514e-2340-4b39-ae07-9568dd7fab26 service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Received unexpected event network-vif-unplugged-465489db-a702-4ce5-a807-4b56dc3ad058 for instance with vm_state stopped and task_state None.
May 27 03:16:18.685420 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999720471999808 future=<Future at 0x75572c21a4b0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:16:18.687712 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851778.6854963, 53735ed3-493a-4af7-9950-3fd6a68db4c1 => ua-6ed60925-e08e-4645-80b0-2558b11b96f7> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:16:18.688994 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.996193189999758 future=<Future at 0x75572c21a4b0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:16:18.689209 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.995900576999702 future=<Future at 0x75572c21a4b0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:16:18.698710 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Successfully detached device vdb from instance 53735ed3-493a-4af7-9950-3fd6a68db4c1 from the live domain config.
May 27 03:16:18.736754 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:16:18.737572 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7', 'iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6ed60925-e08e-4645-80b0-2558b11b96f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:16:18.737572 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:16:18.738915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:16:18.738915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7', 'iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6ed60925-e08e-4645-80b0-2558b11b96f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:16:18.738915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:16:18.767063 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:18.767063 np0000001475 nova-compute[98471]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:18.767063 np0000001475 nova-compute[98471]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:18.767063 np0000001475 nova-compute[98471]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7 (non-flash)
May 27 03:16:18.767063 np0000001475 nova-compute[98471]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7 (non-flash)
May 27 03:16:18.767063 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:16:18.767063 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:18.767063 np0000001475 nova-compute[98471]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:18.767063 np0000001475 nova-compute[98471]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:18.767063 np0000001475 nova-compute[98471]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7 (non-flash)
May 27 03:16:18.767063 np0000001475 nova-compute[98471]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7 (non-flash)
May 27 03:16:18.767063 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:16:18.767063 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', '184'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7', '188'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7', '189')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:16:18.767063 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7', '189')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:16:18.770063 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7', '188')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:16:18.772609 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7557046e3740>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7'): ({'sdc'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:16:18.772609 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Removing multipathed devices sdc, sdd {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:16:18.772609 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Flush multipath device 330000000e16f472c {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:16:18.809240 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:16:18.861864 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:16:18.909413 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:16:18.909551 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:16:18.910813 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:16:18.921433 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:16:18.921618 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:16:18.936115 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:18.970318 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 189, target: iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7, portal: 192.168.40.100,3260]
May 27 03:16:18.970318 np0000001475 nova-compute[98471]: Logout of [sid: 189, target: iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7, portal: 192.168.40.100,3260] successful.
May 27 03:16:18.970318 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:18.985047 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:18.995385 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:19.031851 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 188, target: iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7, portal: 192.168.50.100,3260]
May 27 03:16:19.031851 np0000001475 nova-compute[98471]: Logout of [sid: 188, target: iqn.2023-03.storpool.com:os--volume-6ed60925-e08e-4645-80b0-2558b11b96f7, portal: 192.168.50.100,3260] successful.
May 27 03:16:19.031851 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:19.049757 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:19.049757 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:16:19.049757 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] <== disconnect_volume: return (310ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:16:19.049757 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:16:19.596980 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'flavor' on Instance uuid 53735ed3-493a-4af7-9950-3fd6a68db4c1 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:16:20.399729 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "55c414d9-4157-42a2-a40b-04907e27620f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:20.399933 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "55c414d9-4157-42a2-a40b-04907e27620f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:20.602343 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-95acfd97-41de-4ce8-b423-c786a52a29fd tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.373s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:20.909103 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lazy-loading 'flavor' on Instance uuid 55c414d9-4157-42a2-a40b-04907e27620f {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:16:21.673478 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "53735ed3-493a-4af7-9950-3fd6a68db4c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:21.673909 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:21.673962 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "53735ed3-493a-4af7-9950-3fd6a68db4c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:21.674093 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:21.674228 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:21.678294 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Terminating instance
May 27 03:16:21.705519 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:21.915158 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "55c414d9-4157-42a2-a40b-04907e27620f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:22.181426 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:16:22.208673 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:22.211616 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:22.230367 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:22.231790 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:22.259182 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:22.348156 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c6d4c1a0-2290-41e4-8d63-4dc35ba29c81 req-cfa5520c-cfab-48d3-87dc-0f657ab39c00 service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Received event network-vif-unplugged-96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:22.348313 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c6d4c1a0-2290-41e4-8d63-4dc35ba29c81 req-cfa5520c-cfab-48d3-87dc-0f657ab39c00 service nova] Acquiring lock "53735ed3-493a-4af7-9950-3fd6a68db4c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:22.348450 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c6d4c1a0-2290-41e4-8d63-4dc35ba29c81 req-cfa5520c-cfab-48d3-87dc-0f657ab39c00 service nova] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:22.348570 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c6d4c1a0-2290-41e4-8d63-4dc35ba29c81 req-cfa5520c-cfab-48d3-87dc-0f657ab39c00 service nova] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:22.348696 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c6d4c1a0-2290-41e4-8d63-4dc35ba29c81 req-cfa5520c-cfab-48d3-87dc-0f657ab39c00 service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] No waiting events found dispatching network-vif-unplugged-96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:16:22.348794 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c6d4c1a0-2290-41e4-8d63-4dc35ba29c81 req-cfa5520c-cfab-48d3-87dc-0f657ab39c00 service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Received event network-vif-unplugged-96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:16:22.486851 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:22.500323 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:22.507668 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Instance destroyed successfully.
May 27 03:16:22.508208 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999694963000366 future=<Future at 0x75572c0b36e0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:16:22.508554 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lazy-loading 'resources' on Instance uuid 53735ed3-493a-4af7-9950-3fd6a68db4c1 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:16:22.643733 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:22.643966 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:22.644121 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:22.644248 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:22.644362 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:22.646727 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Terminating instance
May 27 03:16:22.810675 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:23.011121 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:15:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-984967112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-volumemultiattachtests-server-984967112',id=70,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjks1ILwFfSIHh1qd0a2ug3pSuIMQ5gfqaOWhghbFt1Y7DI87r2CjdFfq2DuncZO9wGuj3vN4+h7zwjYHD1J81UcLxDNabj0mPxL3yKfkNy49KSAtN7yyl65ZTaw9o4lA==',key_name='tempest-keypair-612389790',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:15:27Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='256f2c4e067c46a3a4ea5e9d934b1d4b',ramdisk_id='',reservation_id='r-1asykh05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1876764595',owner_user_name='tempest-VolumeMultiattachTests-1876764595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:15:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='568dd12813254325bb16fac607894d49',uuid=53735ed3-493a-4af7-9950-3fd6a68db4c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "address": "fa:16:3e:aa:08:24", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed4ce5-7d", "ovs_interfaceid": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:16:23.011336 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Converting VIF {"id": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "address": "fa:16:3e:aa:08:24", "network": {"id": "c313c98f-c9fe-4d74-9538-33205edd51a3", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1801307379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "256f2c4e067c46a3a4ea5e9d934b1d4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ed4ce5-7d", "ovs_interfaceid": "96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:16:23.011859 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:08:24,bridge_name='br-int',has_traffic_filtering=True,id=96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ed4ce5-7d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:16:23.012082 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:08:24,bridge_name='br-int',has_traffic_filtering=True,id=96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ed4ce5-7d') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:16:23.014287 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:23.014287 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96ed4ce5-7d, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:16:23.015441 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:23.015441 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:16:23.020413 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:23.021305 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:23.021305 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e34b74ab-0f23-42aa-9500-5a089ff15480) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:16:23.021515 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:23.022020 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:16:23.026397 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:23.028475 np0000001475 nova-compute[98471]: INFO os_vif [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:08:24,bridge_name='br-int',has_traffic_filtering=True,id=96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2,network=Network(c313c98f-c9fe-4d74-9538-33205edd51a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ed4ce5-7d')
May 27 03:16:23.028827 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Deleting instance files /opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1_del
May 27 03:16:23.029672 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Deletion of /opt/stack/data/nova/instances/53735ed3-493a-4af7-9950-3fd6a68db4c1_del complete
May 27 03:16:23.034683 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "55c414d9-4157-42a2-a40b-04907e27620f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:23.034886 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "55c414d9-4157-42a2-a40b-04907e27620f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:23.035043 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Attaching volume 9ee95878-1b61-4914-98a3-55c4f7cbdb45 to /dev/vdb
May 27 03:16:23.074316 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:16:23.084286 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:16:23.103352 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:23.143866 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:16:23.144238 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:16:23.149991 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:16:23.152240 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:16:23.153326 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe7b:4f67', 'fe80::3473:3eff:fecc:f718'] 
May 27 03:16:23.153474 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:16:23.153608 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:16:23.153921 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:16:23.154147 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Updating existing volume attachment record: 71604990-c37a-4162-8a32-91050bc83992 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:16:23.160689 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Instance destroyed successfully.
May 27 03:16:23.161144 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'resources' on Instance uuid 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:16:23.539079 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Took 1.36 seconds to destroy the instance on the hypervisor.
May 27 03:16:23.539608 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:16:23.539800 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:16:23.539902 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:16:23.540151 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:23.600106 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:23.663969 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:15:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1756622356',display_name='tempest-TestVolumeBootPattern-server-1756622356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-1756622356',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxiBxFJXQ0pi6NSh0eiJkxIWAyiQKZ6tDcI2UaIJXmnscpWmpB128UCvOl68Z3t1wAlM2bRyPBneyWVgyrNQhWbZD8pCD7t9O6embas8c/ONUVT+oDfoim2ELlZ5AF1Lw==',key_name='tempest-keypair-864530749',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:15:33Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-lncjwlw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:16:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=3cdaa1c9-48d4-41fd-a93b-a27686f56c9d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "465489db-a702-4ce5-a807-4b56dc3ad058", "address": "fa:16:3e:1d:0a:4a", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap465489db-a7", "ovs_interfaceid": "465489db-a702-4ce5-a807-4b56dc3ad058", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:16:23.664226 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "465489db-a702-4ce5-a807-4b56dc3ad058", "address": "fa:16:3e:1d:0a:4a", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap465489db-a7", "ovs_interfaceid": "465489db-a702-4ce5-a807-4b56dc3ad058", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:16:23.664864 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:0a:4a,bridge_name='br-int',has_traffic_filtering=True,id=465489db-a702-4ce5-a807-4b56dc3ad058,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465489db-a7') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:16:23.665079 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:0a:4a,bridge_name='br-int',has_traffic_filtering=True,id=465489db-a702-4ce5-a807-4b56dc3ad058,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465489db-a7') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:16:23.666482 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:23.666901 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap465489db-a7, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:16:23.667894 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:23.668916 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:23.669680 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:23.669858 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0963e31a-0b49-4f34-989e-71d51a004a50) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:16:23.670241 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:23.670827 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:16:23.672871 np0000001475 nova-compute[98471]: INFO os_vif [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:0a:4a,bridge_name='br-int',has_traffic_filtering=True,id=465489db-a702-4ce5-a807-4b56dc3ad058,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465489db-a7')
May 27 03:16:23.674631 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:16:23.675119 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c53c2d86-066a-4251-93bf-cbf268ce13a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:16:23.675318 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:16:23.675939 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:16:23.676336 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c53c2d86-066a-4251-93bf-cbf268ce13a6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:16:23.676555 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:16:23.701842 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:23.701842 np0000001475 nova-compute[98471]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:23.701842 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:16:23.701961 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:23.701961 np0000001475 nova-compute[98471]: tcp: [184] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6 (non-flash)
May 27 03:16:23.701961 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:16:23.702253 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', '184')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:16:23.702253 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', '184')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:16:23.703168 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6', '183')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:16:23.703866 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c4db7e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6'): ({'sde'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:16:23.704048 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Removing multipathed devices sdf, sde {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:16:23.704247 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flush multipath device 3300000004aff3034 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:16:23.705458 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:16:23.705758 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45', 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ee95878-1b61-4914-98a3-55c4f7cbdb45', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:16:23.705914 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:16:23.763331 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:16:23.805129 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:16:23.850221 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:16:23.850557 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:16:23.851148 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:16:23.865310 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:16:23.865544 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:16:23.875480 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:23.908460 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 184, target: iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6, portal: 192.168.40.100,3260]
May 27 03:16:23.908460 np0000001475 nova-compute[98471]: Logout of [sid: 184, target: iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6, portal: 192.168.40.100,3260] successful.
May 27 03:16:23.908460 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:23.922087 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:23.931982 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:23.964187 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 183, target: iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6, portal: 192.168.50.100,3260]
May 27 03:16:23.964187 np0000001475 nova-compute[98471]: Logout of [sid: 183, target: iqn.2023-03.storpool.com:os--volume-c53c2d86-066a-4251-93bf-cbf268ce13a6, portal: 192.168.50.100,3260] successful.
May 27 03:16:23.964187 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:23.974631 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:23.974893 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:16:23.975004 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== disconnect_volume: return (299ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:16:23.975107 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:16:23.975358 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Deleting instance files /opt/stack/data/nova/instances/3cdaa1c9-48d4-41fd-a93b-a27686f56c9d_del
May 27 03:16:23.975874 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Deletion of /opt/stack/data/nova/instances/3cdaa1c9-48d4-41fd-a93b-a27686f56c9d_del complete
May 27 03:16:23.977992 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.272s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:16:23.978189 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45', 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ee95878-1b61-4914-98a3-55c4f7cbdb45', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:16:23.991952 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:16:23.992578 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:16:23.994149 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:16:23.994335 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:16:23.997517 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:16:23.998776 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:16:24.008260 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:16:24.008260 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:24.016018 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:16:24.016018 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:24.023055 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45] added
May 27 03:16:24.023055 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:16:24.023055 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:16:24.023055 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:16:24.023055 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:16:24.023055 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:16:24.023055 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:24.023055 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:16:24.023055 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0282(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:16:24.023055 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:16:24.029541 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45] added
May 27 03:16:24.029541 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:16:24.029541 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:16:24.029541 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:16:24.029541 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:16:24.029541 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:16:24.029541 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:24.030065 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:16:24.030065 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:16:24.030065 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:16:24.057995 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-32341444-e701-4ad0-a831-94b7e34974fb req-20dc83f0-b746-401e-bce2-a3979aae90fd service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Received event network-vif-deleted-96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:24.058179 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-32341444-e701-4ad0-a831-94b7e34974fb req-20dc83f0-b746-401e-bce2-a3979aae90fd service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Neutron deleted interface 96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2; detaching it from the instance and deleting it from the info cache
May 27 03:16:24.058362 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-32341444-e701-4ad0-a831-94b7e34974fb req-20dc83f0-b746-401e-bce2-a3979aae90fd service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:16:24.399227 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-298308dc-3d93-49ce-be3d-6c6b4a92ea98 req-261bdd76-6b87-4009-8a00-b03bfff8e9d2 service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Received event network-vif-unplugged-96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:24.399598 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-298308dc-3d93-49ce-be3d-6c6b4a92ea98 req-261bdd76-6b87-4009-8a00-b03bfff8e9d2 service nova] Acquiring lock "53735ed3-493a-4af7-9950-3fd6a68db4c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:24.399598 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-298308dc-3d93-49ce-be3d-6c6b4a92ea98 req-261bdd76-6b87-4009-8a00-b03bfff8e9d2 service nova] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:24.399715 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-298308dc-3d93-49ce-be3d-6c6b4a92ea98 req-261bdd76-6b87-4009-8a00-b03bfff8e9d2 service nova] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:24.399881 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-298308dc-3d93-49ce-be3d-6c6b4a92ea98 req-261bdd76-6b87-4009-8a00-b03bfff8e9d2 service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] No waiting events found dispatching network-vif-unplugged-96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:16:24.399996 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-298308dc-3d93-49ce-be3d-6c6b4a92ea98 req-261bdd76-6b87-4009-8a00-b03bfff8e9d2 service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Received event network-vif-unplugged-96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:16:24.485530 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Took 1.34 seconds to destroy the instance on the hypervisor.
May 27 03:16:24.486139 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:16:24.486453 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:16:24.486565 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:16:24.486836 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:24.513277 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:16:24.563080 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-32341444-e701-4ad0-a831-94b7e34974fb req-20dc83f0-b746-401e-bce2-a3979aae90fd service nova] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Detach interface failed, port_id=96ed4ce5-7d5a-426f-b0e9-d32d4b2637d2, reason: Instance 53735ed3-493a-4af7-9950-3fd6a68db4c1 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:16:24.588533 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:25.015568 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Took 1.48 seconds to deallocate network for instance.
May 27 03:16:25.023146 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:16:25.030472 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:16:25.037153 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:16:25.037153 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:16:25.042633 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:16:25.042633 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:25.048328 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:25.057295 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:25.058505 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 03:16:25.058505 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:16:25.058699 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 03:16:25.058699 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:16:25.058973 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 03:16:25.058973 np0000001475 nova-compute[98471]: 
May 27 03:16:25.068769 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 03:16:25.068769 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:16:25.068999 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 03:16:25.068999 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:16:25.069116 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 03:16:25.069116 np0000001475 nova-compute[98471]: 
May 27 03:16:25.090186 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45, portal: 192.168.40.100,3260]
May 27 03:16:25.090186 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45, portal: 192.168.40.100,3260] successful.
May 27 03:16:25.090186 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:25.101124 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:25.110847 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45, portal: 192.168.50.100,3260]
May 27 03:16:25.110847 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45, portal: 192.168.50.100,3260] successful.
May 27 03:16:25.110847 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:25.113573 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:25.113573 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:25.113573 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:16:25.113971 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsi session list stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:25.113971 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:25.113971 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:16:25.114294 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.120s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:16:25.114438 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:16:25.115051 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] HCTL ('7', '-', '-', 0) found on session 190 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:16:25.115195 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:16:25.123367 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:25.136099 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:25.136099 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:25.136099 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:16:25.136099 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsi session list stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:25.136099 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:25.136099 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:16:25.136099 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:16:25.136099 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:16:25.136099 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] HCTL ('8', '-', '-', 0) found on session 191 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:16:25.136099 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:16:25.136099 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Searching for a device in session 190 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:16:25.136099 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ee95878-1b61-4914-98a3-55c4f7cbdb45', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:16:25.149435 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Searching for a device in session 191 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:16:25.149435 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9ee95878-1b61-4914-98a3-55c4f7cbdb45', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:16:25.442779 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:16:25.520919 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:25.521075 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:25.709364 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Acquiring lock "a43f3291-bb24-41c9-b5b0-da6878a929ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:25.709627 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "a43f3291-bb24-41c9-b5b0-da6878a929ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:25.730425 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:16:25.730624 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:16:25.944679 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Took 1.46 seconds to deallocate network for instance.
May 27 03:16:25.996445 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:16:26.211920 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:16:26.233582 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:16:26.447752 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-43c389cc-6684-4d18-b776-30e3ed553a88 req-5aedf796-7ffe-4b9d-9d78-bbfbcb8888cd service nova] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Received event network-vif-deleted-465489db-a702-4ce5-a807-4b56dc3ad058 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:26.487064 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Took 0.54 seconds to detach 1 volumes for instance.
May 27 03:16:26.707025 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:26.739112 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.218s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:26.760950 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:26.761105 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:26.765570 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:16:26.765693 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Claim successful on node np0000001475
May 27 03:16:26.807295 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Deleted allocations for instance 53735ed3-493a-4af7-9950-3fd6a68db4c1
May 27 03:16:26.991802 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:27.010830 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Found WWN 3300000005be48fb2 for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:16:27.011103 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:16:27.011249 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] <== connect_volume: return (3305ms) {'type': 'block', 'scsi_wwn': '3300000005be48fb2', 'path': '/dev/dm-0', 'multipath_id': '3300000005be48fb2'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:16:27.011367 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005be48fb2', 'path': '/dev/dm-0', 'multipath_id': '3300000005be48fb2'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:16:27.014055 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lazy-loading 'flavor' on Instance uuid 55c414d9-4157-42a2-a40b-04907e27620f {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:16:27.516909 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Attempting to attach volume 9ee95878-1b61-4914-98a3-55c4f7cbdb45 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:16:27.518494 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:16:27.518494 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:16:27.518494 np0000001475 nova-compute[98471]:   <alias name="ua-9ee95878-1b61-4914-98a3-55c4f7cbdb45"/>
May 27 03:16:27.518494 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-0"/>
May 27 03:16:27.518494 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:16:27.518494 np0000001475 nova-compute[98471]:   <serial>9ee95878-1b61-4914-98a3-55c4f7cbdb45</serial>
May 27 03:16:27.518494 np0000001475 nova-compute[98471]: </disk>
May 27 03:16:27.518494 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:16:27.816615 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-90147339-31b5-4876-944b-2ed7142b85c8 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Lock "53735ed3-493a-4af7-9950-3fd6a68db4c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.143s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:27.940762 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:16:27.940955 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:16:28.443519 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:16:28.672412 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:28.954943 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.194s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:28.955290 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:16:28.957359 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.966s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:29.154569 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:16:29.154829 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:16:29.155353 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:16:29.155529 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] No VIF found with MAC fa:16:3e:7b:4f:67, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:16:29.162947 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:16:29.163138 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:16:29.460538 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:16:29.460927 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:16:29.461193 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:29.461445 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:29.527926 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bab0444ac9a74758868a5056bb860779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '033672aa8b3e44549f8c8185ad55f3f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:16:29.665642 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:16:29.940270 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Successfully created port: 4f833239-93b2-4653-b99e-685143dc0fde {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:16:29.961537 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:16:30.086841 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:30.171646 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.214s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:30.249597 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Deleted allocations for instance 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d
May 27 03:16:30.427956 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Successfully updated port: 4f833239-93b2-4653-b99e-685143dc0fde {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:16:30.471138 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-828c9c93-0301-40b1-8f30-dd04ddcf886a req-20b4b321-7a74-4c59-8b8b-afc667f44735 service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Received event network-changed-4f833239-93b2-4653-b99e-685143dc0fde {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:30.474274 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-828c9c93-0301-40b1-8f30-dd04ddcf886a req-20b4b321-7a74-4c59-8b8b-afc667f44735 service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Refreshing instance network info cache due to event network-changed-4f833239-93b2-4653-b99e-685143dc0fde. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:16:30.474462 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-828c9c93-0301-40b1-8f30-dd04ddcf886a req-20b4b321-7a74-4c59-8b8b-afc667f44735 service nova] Acquiring lock "refresh_cache-a43f3291-bb24-41c9-b5b0-da6878a929ff" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:16:30.474578 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-828c9c93-0301-40b1-8f30-dd04ddcf886a req-20b4b321-7a74-4c59-8b8b-afc667f44735 service nova] Acquired lock "refresh_cache-a43f3291-bb24-41c9-b5b0-da6878a929ff" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:16:30.474713 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-828c9c93-0301-40b1-8f30-dd04ddcf886a req-20b4b321-7a74-4c59-8b8b-afc667f44735 service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Refreshing network info cache for port 4f833239-93b2-4653-b99e-685143dc0fde {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:16:30.717557 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-17cbcdd1-e2f2-45b3-98ce-acad24adf426 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "55c414d9-4157-42a2-a40b-04907e27620f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.682s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:30.929899 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Acquiring lock "refresh_cache-a43f3291-bb24-41c9-b5b0-da6878a929ff" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:16:30.968306 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:16:30.977352 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-828c9c93-0301-40b1-8f30-dd04ddcf886a req-20b4b321-7a74-4c59-8b8b-afc667f44735 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:31.034295 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-828c9c93-0301-40b1-8f30-dd04ddcf886a req-20b4b321-7a74-4c59-8b8b-afc667f44735 service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:16:31.178092 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-828c9c93-0301-40b1-8f30-dd04ddcf886a req-20b4b321-7a74-4c59-8b8b-afc667f44735 service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:16:31.255117 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22a3379f-78b7-4901-a474-d5cb42a45088 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "3cdaa1c9-48d4-41fd-a93b-a27686f56c9d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.611s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:31.472546 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Booting with volume a78b4532-5ce5-4aa5-83a5-0ee74856d95a at /dev/vdb
May 27 03:16:31.522283 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:16:31.535733 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:16:31.555514 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:31.605878 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:16:31.608555 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:16:31.619658 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:16:31.620933 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe7b:4f67', 'fe80::3473:3eff:fecc:f718'] 
May 27 03:16:31.621099 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:16:31.621243 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:16:31.621550 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:16:31.625277 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Updating existing volume attachment record: 21e49712-8b15-4aa2-b495-b8d5dc88b55b {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:16:31.680128 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-828c9c93-0301-40b1-8f30-dd04ddcf886a req-20b4b321-7a74-4c59-8b8b-afc667f44735 service nova] Releasing lock "refresh_cache-a43f3291-bb24-41c9-b5b0-da6878a929ff" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:16:31.680672 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Acquired lock "refresh_cache-a43f3291-bb24-41c9-b5b0-da6878a929ff" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:16:31.680871 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:16:31.710028 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:32.256589 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:16:32.404230 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:32.546356 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Updating instance_info_cache with network_info: [{"id": "4f833239-93b2-4653-b99e-685143dc0fde", "address": "fa:16:3e:a7:ee:83", "network": {"id": "40d85a12-de61-467c-bf94-207453df7823", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1622508986-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "033672aa8b3e44549f8c8185ad55f3f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833239-93", "ovs_interfaceid": "4f833239-93b2-4653-b99e-685143dc0fde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:16:32.652618 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f5bb6997-a521-4177-b6cd-e39ccc00e239 req-d7f323d9-c365-4d86-830e-44732ce8ee5a service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received event network-changed-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:32.652618 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f5bb6997-a521-4177-b6cd-e39ccc00e239 req-d7f323d9-c365-4d86-830e-44732ce8ee5a service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Refreshing instance network info cache due to event network-changed-2ae8763f-7d5e-4b11-879d-135cf5899359. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:16:32.652618 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f5bb6997-a521-4177-b6cd-e39ccc00e239 req-d7f323d9-c365-4d86-830e-44732ce8ee5a service nova] Acquiring lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:16:32.652618 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f5bb6997-a521-4177-b6cd-e39ccc00e239 req-d7f323d9-c365-4d86-830e-44732ce8ee5a service nova] Acquired lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:16:32.652618 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f5bb6997-a521-4177-b6cd-e39ccc00e239 req-d7f323d9-c365-4d86-830e-44732ce8ee5a service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Refreshing network info cache for port 2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:16:33.048769 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Releasing lock "refresh_cache-a43f3291-bb24-41c9-b5b0-da6878a929ff" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:16:33.048769 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Instance network_info: |[{"id": "4f833239-93b2-4653-b99e-685143dc0fde", "address": "fa:16:3e:a7:ee:83", "network": {"id": "40d85a12-de61-467c-bf94-207453df7823", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1622508986-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "033672aa8b3e44549f8c8185ad55f3f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833239-93", "ovs_interfaceid": "4f833239-93b2-4653-b99e-685143dc0fde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:16:33.159772 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f5bb6997-a521-4177-b6cd-e39ccc00e239 req-d7f323d9-c365-4d86-830e-44732ce8ee5a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:33.450558 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f5bb6997-a521-4177-b6cd-e39ccc00e239 req-d7f323d9-c365-4d86-830e-44732ce8ee5a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:33.570858 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f5bb6997-a521-4177-b6cd-e39ccc00e239 req-d7f323d9-c365-4d86-830e-44732ce8ee5a service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Updated VIF entry in instance network info cache for port 2ae8763f-7d5e-4b11-879d-135cf5899359. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:16:33.571068 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f5bb6997-a521-4177-b6cd-e39ccc00e239 req-d7f323d9-c365-4d86-830e-44732ce8ee5a service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Updating instance_info_cache with network_info: [{"id": "2ae8763f-7d5e-4b11-879d-135cf5899359", "address": "fa:16:3e:7b:4f:67", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae8763f-7d", "ovs_interfaceid": "2ae8763f-7d5e-4b11-879d-135cf5899359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:16:33.674831 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:33.685457 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.00032443999998577056 future=<Future at 0x75572c21a4b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:16:33.685789 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:16:33.685897 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=3.821973536000314 future=<Future at 0x75572c0b36e0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:16:33.685969 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=3.8218915229999766 future=<Future at 0x75572c0b36e0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:16:33.686784 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Emitting event <LifecycleEvent: 1779851778.6850116, 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:16:33.686784 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] VM Stopped (Lifecycle Event)
May 27 03:16:33.730711 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:16:33.732347 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:16:33.732663 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Creating image(s)
May 27 03:16:33.733348 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Acquiring lock "/opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:33.733548 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "/opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:33.734153 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "/opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:33.734908 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:16:33.739539 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:16:33.740606 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:33.833638 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.093s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:16:33.834047 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:33.834663 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:33.835178 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:16:33.839068 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:16:33.839470 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:33.926890 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.087s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:16:33.927416 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:33.988779 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff/disk 1073741824" returned: 0 in 0.061s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:16:33.989390 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.155s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:33.989831 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:34.062077 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5a1cbc4c-8a46-404f-812d-0a5e9771d9c5 req-6faaa3d0-c491-4d21-a1b6-6444f4c4f866 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received event network-changed-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:34.062242 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5a1cbc4c-8a46-404f-812d-0a5e9771d9c5 req-6faaa3d0-c491-4d21-a1b6-6444f4c4f866 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Refreshing instance network info cache due to event network-changed-2ae8763f-7d5e-4b11-879d-135cf5899359. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:16:34.062445 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5a1cbc4c-8a46-404f-812d-0a5e9771d9c5 req-6faaa3d0-c491-4d21-a1b6-6444f4c4f866 service nova] Acquiring lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:16:34.072826 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f5bb6997-a521-4177-b6cd-e39ccc00e239 req-d7f323d9-c365-4d86-830e-44732ce8ee5a service nova] Releasing lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:16:34.073234 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5a1cbc4c-8a46-404f-812d-0a5e9771d9c5 req-6faaa3d0-c491-4d21-a1b6-6444f4c4f866 service nova] Acquired lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:16:34.073383 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-5a1cbc4c-8a46-404f-812d-0a5e9771d9c5 req-6faaa3d0-c491-4d21-a1b6-6444f4c4f866 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Refreshing network info cache for port 2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:16:34.086418 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.096s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:16:34.087656 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:16:34.087656 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:34.184728 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:16:34.185063 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Cannot resize image /opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:16:34.185429 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:16:34.185590 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Ensure instance console log exists: /opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:16:34.185910 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:34.186131 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:34.186272 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:34.188362 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Start _get_guest_xml network_info=[{"id": "4f833239-93b2-4653-b99e-685143dc0fde", "address": "fa:16:3e:a7:ee:83", "network": {"id": "40d85a12-de61-467c-bf94-207453df7823", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1622508986-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "033672aa8b3e44549f8c8185ad55f3f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833239-93", "ovs_interfaceid": "4f833239-93b2-4653-b99e-685143dc0fde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a43f3291-bb24-41c9-b5b0-da6878a929ff', 'attached_at': '', 'detached_at': '', 'volume_id': 'a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 'serial': 'a78b4532-5ce5-4aa5-83a5-0ee74856d95a'}, 'mount_device': '/dev/vdb', 'boot_index': -1, 'attachment_id': '21e49712-8b15-4aa2-b495-b8d5dc88b55b', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:16:34.189680 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-4eba70d1-6483-49fd-b3ca-8e3250d0d27c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 3cdaa1c9-48d4-41fd-a93b-a27686f56c9d] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:34.193590 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:16:34.194919 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-instance-2036552287', uuid='a43f3291-bb24-41c9-b5b0-da6878a929ff'), owner=OwnerMeta(userid='bab0444ac9a74758868a5056bb860779', username='tempest-VolumesBackupsTest-1801307276-project-member', projectid='033672aa8b3e44549f8c8185ad55f3f7', projectname='tempest-VolumesBackupsTest-1801307276'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4f833239-93b2-4653-b99e-685143dc0fde", "address": "fa:16:3e:a7:ee:83", "network": {"id": "40d85a12-de61-467c-bf94-207453df7823", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1622508986-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "033672aa8b3e44549f8c8185ad55f3f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833239-93", "ovs_interfaceid": "4f833239-93b2-4653-b99e-685143dc0fde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851794.1945395) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:16:34.196187 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:16:34.196483 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:16:34.197467 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:16:34.197640 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:16:34.198568 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:16:34.198885 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:16:34.199024 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:16:34.199117 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:16:34.199234 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:16:34.199312 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:16:34.199402 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:16:34.199555 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:16:34.199660 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:16:34.199814 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:16:34.199961 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:16:34.200082 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:16:34.209217 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:16:34.209538 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:16:34.209667 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:16:34.210031 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:16:34.210214 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:16:34.222304 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:16:34.222865 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:16:34.223353 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:16:34.223520 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:16:34.224722 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:16:34.224932 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:16:34.233643 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:16:34.233643 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:34.238039 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:16:34.238039 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:34.243303 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a] added
May 27 03:16:34.243303 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:16:34.243303 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:16:34.243303 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:16:34.243303 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:16:34.243303 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:16:34.243303 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:34.243527 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:16:34.243924 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.02(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:16:34.243924 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:16:34.248727 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a] added
May 27 03:16:34.248727 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:16:34.248727 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:16:34.248727 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:16:34.248727 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:16:34.248727 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:16:34.248727 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:34.249088 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:16:34.249088 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0241(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:16:34.249182 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:16:34.576162 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-5a1cbc4c-8a46-404f-812d-0a5e9771d9c5 req-6faaa3d0-c491-4d21-a1b6-6444f4c4f866 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:34.857019 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-5a1cbc4c-8a46-404f-812d-0a5e9771d9c5 req-6faaa3d0-c491-4d21-a1b6-6444f4c4f866 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:34.978990 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-5a1cbc4c-8a46-404f-812d-0a5e9771d9c5 req-6faaa3d0-c491-4d21-a1b6-6444f4c4f866 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Updated VIF entry in instance network info cache for port 2ae8763f-7d5e-4b11-879d-135cf5899359. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:16:34.979264 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-5a1cbc4c-8a46-404f-812d-0a5e9771d9c5 req-6faaa3d0-c491-4d21-a1b6-6444f4c4f866 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Updating instance_info_cache with network_info: [{"id": "2ae8763f-7d5e-4b11-879d-135cf5899359", "address": "fa:16:3e:7b:4f:67", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae8763f-7d", "ovs_interfaceid": "2ae8763f-7d5e-4b11-879d-135cf5899359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:16:35.244186 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:16:35.249410 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:16:35.256487 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:16:35.256487 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:16:35.262006 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:16:35.262006 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:35.268362 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:35.274031 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:35.284357 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:35.284357 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:35.284357 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:16:35.284580 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsi session list stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:35.284580 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:35.284580 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:16:35.289547 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:35.289547 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:35.289547 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:16:35.289688 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsi session list stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:35.289688 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:35.289688 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:16:35.312162 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a, portal: 192.168.40.100,3260]
May 27 03:16:35.312162 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a, portal: 192.168.40.100,3260] successful.
May 27 03:16:35.312162 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:35.322849 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:35.328695 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a, portal: 192.168.50.100,3260]
May 27 03:16:35.328695 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a, portal: 192.168.50.100,3260] successful.
May 27 03:16:35.328695 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:35.337260 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:35.337260 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:35.337260 np0000001475 nova-compute[98471]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:35.337260 np0000001475 nova-compute[98471]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:35.337260 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:16:35.337441 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsi session list stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:35.337441 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:35.337441 np0000001475 nova-compute[98471]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:35.337441 np0000001475 nova-compute[98471]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:35.337441 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:16:35.337612 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.114s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:16:35.337704 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:16:35.338498 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] HCTL ('9', '-', '-', 0) found on session 192 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:16:35.338634 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:16:35.339064 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:35.352924 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Searching for a device in session 192 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:16:35.353167 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:16:35.358558 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:35.358558 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:35.358558 np0000001475 nova-compute[98471]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:35.358558 np0000001475 nova-compute[98471]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:35.358558 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:16:35.359103 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsi session list stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:35.359103 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:35.359103 np0000001475 nova-compute[98471]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:35.359103 np0000001475 nova-compute[98471]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:35.359103 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:16:35.359103 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.135s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:16:35.359288 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:16:35.359917 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] HCTL ('10', '-', '-', 0) found on session 193 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:16:35.360045 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:16:35.374156 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Searching for a device in session 193 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:16:35.374156 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:16:35.481668 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5a1cbc4c-8a46-404f-812d-0a5e9771d9c5 req-6faaa3d0-c491-4d21-a1b6-6444f4c4f866 service nova] Releasing lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:16:36.224074 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:16:36.373393 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "cbca099c-52a9-4d73-a91a-d9685cb310be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:36.373567 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:36.709007 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:36.875288 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:16:37.240352 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Found WWN 3300000008b8c66dd for multipath device dm-1 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:16:37.240787 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:16:37.240787 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '3300000008b8c66dd', 'path': '/dev/dm-1', 'multipath_id': '3300000008b8c66dd'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:16:37.240882 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008b8c66dd', 'path': '/dev/dm-1', 'multipath_id': '3300000008b8c66dd'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:16:37.421936 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:37.422100 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:37.425130 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:16:37.425257 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Claim successful on node np0000001475
May 27 03:16:37.508321 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.00039023799990900443 future=<Future at 0x75572c0b36e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:16:37.508653 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Emitting event <LifecycleEvent: 1779851782.5078194, 53735ed3-493a-4af7-9950-3fd6a68db4c1 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:16:37.508811 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:16:37.508923 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] VM Stopped (Lifecycle Event)
May 27 03:16:37.745944 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-2036552287',display_name='tempest-instance-2036552287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-instance-2036552287',id=73,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+vg9C+TMbdZnHCVoF1gS+4GTcBdzjbosl1rh18Mp+YNTxeIkbT/p4AP8KvDA7/4XBNol4OfONW+J6aWCcvzH3hyzr9+DCPj6vLuf5Bwh8mu26/gYSUu/D9Zg8tT0AIcQ==',key_name='tempest-keypair-670115409',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='033672aa8b3e44549f8c8185ad55f3f7',ramdisk_id='',reservation_id='r-360et7x2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1801307276',owner_user_name='tempest-VolumesBackupsTest-1801307276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:16:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bab0444ac9a74758868a5056bb860779',uuid=a43f3291-bb24-41c9-b5b0-da6878a929ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f833239-93b2-4653-b99e-685143dc0fde", "address": "fa:16:3e:a7:ee:83", "network": {"id": "40d85a12-de61-467c-bf94-207453df7823", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1622508986-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "033672aa8b3e44549f8c8185ad55f3f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833239-93", "ovs_interfaceid": "4f833239-93b2-4653-b99e-685143dc0fde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:16:37.746152 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Converting VIF {"id": "4f833239-93b2-4653-b99e-685143dc0fde", "address": "fa:16:3e:a7:ee:83", "network": {"id": "40d85a12-de61-467c-bf94-207453df7823", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1622508986-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "033672aa8b3e44549f8c8185ad55f3f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833239-93", "ovs_interfaceid": "4f833239-93b2-4653-b99e-685143dc0fde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:16:37.746873 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ee:83,bridge_name='br-int',has_traffic_filtering=True,id=4f833239-93b2-4653-b99e-685143dc0fde,network=Network(40d85a12-de61-467c-bf94-207453df7823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f833239-93') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:16:37.747541 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lazy-loading 'pci_devices' on Instance uuid a43f3291-bb24-41c9-b5b0-da6878a929ff {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:16:38.011159 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 53735ed3-493a-4af7-9950-3fd6a68db4c1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:38.250033 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] End _get_guest_xml xml=<domain type="qemu">
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:   <uuid>a43f3291-bb24-41c9-b5b0-da6878a929ff</uuid>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:   <name>instance-00000049</name>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <nova:name>tempest-instance-2036552287</nova:name>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:16:34</nova:creationTime>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:         <nova:user uuid="bab0444ac9a74758868a5056bb860779">tempest-VolumesBackupsTest-1801307276-project-member</nova:user>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:         <nova:project uuid="033672aa8b3e44549f8c8185ad55f3f7">tempest-VolumesBackupsTest-1801307276</nova:project>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:         <nova:port uuid="4f833239-93b2-4653-b99e-685143dc0fde">
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     <system>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <entry name="serial">a43f3291-bb24-41c9-b5b0-da6878a929ff</entry>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <entry name="uuid">a43f3291-bb24-41c9-b5b0-da6878a929ff</entry>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     </system>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:   <os>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:   </os>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:   <features>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:   </features>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:   <devices>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff/disk"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     </disk>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff/disk.config"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     </disk>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <alias name="ua-a78b4532-5ce5-4aa5-83a5-0ee74856d95a"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-1"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <target dev="vdb" bus="virtio"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <serial>a78b4532-5ce5-4aa5-83a5-0ee74856d95a</serial>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     </disk>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:a7:ee:83"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <target dev="tap4f833239-93"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     </interface>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff/console.log" append="off"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     </serial>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     <video>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     </video>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     </rng>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:   </devices>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]: </domain>
May 27 03:16:38.250033 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:16:38.254078 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Preparing to wait for external event network-vif-plugged-4f833239-93b2-4653-b99e-685143dc0fde {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:16:38.254078 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Acquiring lock "a43f3291-bb24-41c9-b5b0-da6878a929ff-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:38.254078 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "a43f3291-bb24-41c9-b5b0-da6878a929ff-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:38.254078 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "a43f3291-bb24-41c9-b5b0-da6878a929ff-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:38.254078 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-2036552287',display_name='tempest-instance-2036552287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-instance-2036552287',id=73,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+vg9C+TMbdZnHCVoF1gS+4GTcBdzjbosl1rh18Mp+YNTxeIkbT/p4AP8KvDA7/4XBNol4OfONW+J6aWCcvzH3hyzr9+DCPj6vLuf5Bwh8mu26/gYSUu/D9Zg8tT0AIcQ==',key_name='tempest-keypair-670115409',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='033672aa8b3e44549f8c8185ad55f3f7',ramdisk_id='',reservation_id='r-360et7x2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1801307276',owner_user_name='tempest-VolumesBackupsTest-1801307276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:16:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bab0444ac9a74758868a5056bb860779',uuid=a43f3291-bb24-41c9-b5b0-da6878a929ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f833239-93b2-4653-b99e-685143dc0fde", "address": "fa:16:3e:a7:ee:83", "network": {"id": "40d85a12-de61-467c-bf94-207453df7823", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1622508986-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "033672aa8b3e44549f8c8185ad55f3f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833239-93", "ovs_interfaceid": "4f833239-93b2-4653-b99e-685143dc0fde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:16:38.254078 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Converting VIF {"id": "4f833239-93b2-4653-b99e-685143dc0fde", "address": "fa:16:3e:a7:ee:83", "network": {"id": "40d85a12-de61-467c-bf94-207453df7823", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1622508986-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "033672aa8b3e44549f8c8185ad55f3f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833239-93", "ovs_interfaceid": "4f833239-93b2-4653-b99e-685143dc0fde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:16:38.254078 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ee:83,bridge_name='br-int',has_traffic_filtering=True,id=4f833239-93b2-4653-b99e-685143dc0fde,network=Network(40d85a12-de61-467c-bf94-207453df7823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f833239-93') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:16:38.254078 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ee:83,bridge_name='br-int',has_traffic_filtering=True,id=4f833239-93b2-4653-b99e-685143dc0fde,network=Network(40d85a12-de61-467c-bf94-207453df7823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f833239-93') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:16:38.254078 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:38.254078 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:16:38.254078 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:16:38.254078 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:38.254078 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fedaf457-12b9-568c-bdd4-dcdbed4fa551', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:16:38.254078 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:38.254788 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:16:38.254961 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:38.256574 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:38.256684 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f833239-93, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:16:38.256937 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f833239-93, col_values=(('qos', UUID('03b42bdd-3420-44b2-8840-2506f079278a')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:16:38.257066 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f833239-93, col_values=(('external_ids', {'iface-id': '4f833239-93b2-4653-b99e-685143dc0fde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:ee:83', 'vm-uuid': 'a43f3291-bb24-41c9-b5b0-da6878a929ff'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:16:38.257681 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:38.259029 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:16:38.262950 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:38.263655 np0000001475 nova-compute[98471]: INFO os_vif [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ee:83,bridge_name='br-int',has_traffic_filtering=True,id=4f833239-93b2-4653-b99e-685143dc0fde,network=Network(40d85a12-de61-467c-bf94-207453df7823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f833239-93')
May 27 03:16:38.589508 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:16:38.589691 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:16:39.092161 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:16:39.598806 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.176s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:39.599257 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:16:39.778102 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:16:39.778259 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:16:39.778303 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:16:39.778425 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] No VIF found with MAC fa:16:3e:a7:ee:83, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:16:39.778826 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Using config drive
May 27 03:16:40.104909 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:16:40.108761 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:16:40.108761 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:40.108761 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:40.178609 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8eeaf68cfb534238bfe879dd6e8f858f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0011da7449e7948bf2c8a41955f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:16:40.284397 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:40.407777 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Creating config drive at /opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff/disk.config
May 27 03:16:40.411920 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpftuu6pqb {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:40.466307 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpftuu6pqb" returned: 0 in 0.054s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:16:40.606566 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:16:40.647531 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Successfully created port: 62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:16:40.845075 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:40.861924 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:40.863387 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:40.947503 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:41.028838 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-760901f7-5254-430f-a4c6-f8ba0e5a023b req-21ea39f8-44b6-4832-8538-1ff045752970 service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Received event network-vif-plugged-4f833239-93b2-4653-b99e-685143dc0fde {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:41.029052 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-760901f7-5254-430f-a4c6-f8ba0e5a023b req-21ea39f8-44b6-4832-8538-1ff045752970 service nova] Acquiring lock "a43f3291-bb24-41c9-b5b0-da6878a929ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:41.029307 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-760901f7-5254-430f-a4c6-f8ba0e5a023b req-21ea39f8-44b6-4832-8538-1ff045752970 service nova] Lock "a43f3291-bb24-41c9-b5b0-da6878a929ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:41.029383 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-760901f7-5254-430f-a4c6-f8ba0e5a023b req-21ea39f8-44b6-4832-8538-1ff045752970 service nova] Lock "a43f3291-bb24-41c9-b5b0-da6878a929ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:41.029631 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-760901f7-5254-430f-a4c6-f8ba0e5a023b req-21ea39f8-44b6-4832-8538-1ff045752970 service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Processing event network-vif-plugged-4f833239-93b2-4653-b99e-685143dc0fde {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:16:41.110309 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:16:41.135192 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Successfully updated port: 62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:16:41.189381 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-db6b8a09-4c78-47d1-9347-5a9d86cbf31b req-233b7a06-7be8-4d83-b8d9-0dbb004464cc service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Received event network-changed-62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:41.189381 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-db6b8a09-4c78-47d1-9347-5a9d86cbf31b req-233b7a06-7be8-4d83-b8d9-0dbb004464cc service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Refreshing instance network info cache due to event network-changed-62fa65d3-e430-4df5-aad7-c5c21ddd7968. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:16:41.190626 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-db6b8a09-4c78-47d1-9347-5a9d86cbf31b req-233b7a06-7be8-4d83-b8d9-0dbb004464cc service nova] Acquiring lock "refresh_cache-cbca099c-52a9-4d73-a91a-d9685cb310be" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:16:41.190626 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-db6b8a09-4c78-47d1-9347-5a9d86cbf31b req-233b7a06-7be8-4d83-b8d9-0dbb004464cc service nova] Acquired lock "refresh_cache-cbca099c-52a9-4d73-a91a-d9685cb310be" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:16:41.190626 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-db6b8a09-4c78-47d1-9347-5a9d86cbf31b req-233b7a06-7be8-4d83-b8d9-0dbb004464cc service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Refreshing network info cache for port 62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:16:41.195113 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:41.196597 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:41.198065 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:41.216853 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:41.606988 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851801.6065543, a43f3291-bb24-41c9-b5b0-da6878a929ff => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:16:41.607525 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:16:41.607726 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] VM Started (Lifecycle Event)
May 27 03:16:41.609801 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:16:41.612684 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Instance spawned successfully.
May 27 03:16:41.613029 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:16:41.615484 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Booting with volume 4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 at /dev/vda
May 27 03:16:41.638375 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "refresh_cache-cbca099c-52a9-4d73-a91a-d9685cb310be" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:16:41.655455 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:16:41.666240 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:16:41.686048 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:41.700192 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-db6b8a09-4c78-47d1-9347-5a9d86cbf31b req-233b7a06-7be8-4d83-b8d9-0dbb004464cc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:41.710541 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:41.730274 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:16:41.730593 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:16:41.738339 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:16:41.739245 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fe7b:4f67', 'fe80::3473:3eff:fecc:f718', 'fe80::fc16:3eff:fea7:ee83', 'fe80::d464:44ff:fed9:ceeb'] 
May 27 03:16:41.739377 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:16:41.739509 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:16:41.739845 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:16:41.740047 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Updating existing volume attachment record: 21566e49-20c8-40a0-98e4-e648566dc72a {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:16:41.778535 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-db6b8a09-4c78-47d1-9347-5a9d86cbf31b req-233b7a06-7be8-4d83-b8d9-0dbb004464cc service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:16:41.898313 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-db6b8a09-4c78-47d1-9347-5a9d86cbf31b req-233b7a06-7be8-4d83-b8d9-0dbb004464cc service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:16:42.110457 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:42.114058 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:16:42.122598 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:16:42.122764 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:16:42.123020 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:16:42.123283 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:16:42.123544 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:16:42.123852 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:16:42.400670 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-db6b8a09-4c78-47d1-9347-5a9d86cbf31b req-233b7a06-7be8-4d83-b8d9-0dbb004464cc service nova] Releasing lock "refresh_cache-cbca099c-52a9-4d73-a91a-d9685cb310be" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:16:42.401254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquired lock "refresh_cache-cbca099c-52a9-4d73-a91a-d9685cb310be" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:16:42.401451 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:16:42.616138 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:16:42.616520 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851802.6162605, a43f3291-bb24-41c9-b5b0-da6878a929ff => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:16:42.616520 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] VM Paused (Lifecycle Event)
May 27 03:16:42.629109 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Took 8.90 seconds to spawn the instance on the hypervisor.
May 27 03:16:42.629337 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:42.960135 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:16:43.073077 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fdeb2dd7-b2b6-4507-a3e2-48913c24bc87 req-455d7e4b-71bf-4340-b6df-31ff9f4e1b63 service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Received event network-vif-plugged-4f833239-93b2-4653-b99e-685143dc0fde {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:43.073293 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fdeb2dd7-b2b6-4507-a3e2-48913c24bc87 req-455d7e4b-71bf-4340-b6df-31ff9f4e1b63 service nova] Acquiring lock "a43f3291-bb24-41c9-b5b0-da6878a929ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:43.073503 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fdeb2dd7-b2b6-4507-a3e2-48913c24bc87 req-455d7e4b-71bf-4340-b6df-31ff9f4e1b63 service nova] Lock "a43f3291-bb24-41c9-b5b0-da6878a929ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:43.073628 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fdeb2dd7-b2b6-4507-a3e2-48913c24bc87 req-455d7e4b-71bf-4340-b6df-31ff9f4e1b63 service nova] Lock "a43f3291-bb24-41c9-b5b0-da6878a929ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:43.073792 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fdeb2dd7-b2b6-4507-a3e2-48913c24bc87 req-455d7e4b-71bf-4340-b6df-31ff9f4e1b63 service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] No waiting events found dispatching network-vif-plugged-4f833239-93b2-4653-b99e-685143dc0fde {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:16:43.074013 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-fdeb2dd7-b2b6-4507-a3e2-48913c24bc87 req-455d7e4b-71bf-4340-b6df-31ff9f4e1b63 service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Received unexpected event network-vif-plugged-4f833239-93b2-4653-b99e-685143dc0fde for instance with vm_state active and task_state None.
May 27 03:16:43.098596 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:43.119097 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:43.123660 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851803.1233518, a43f3291-bb24-41c9-b5b0-da6878a929ff => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:16:43.123828 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] VM Resumed (Lifecycle Event)
May 27 03:16:43.138847 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Took 16.42 seconds to build instance.
May 27 03:16:43.239084 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Updating instance_info_cache with network_info: [{"id": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "address": "fa:16:3e:9f:3b:b8", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa65d3-e4", "ovs_interfaceid": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:16:43.259431 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:43.626781 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:43.628779 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:16:43.641019 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "a43f3291-bb24-41c9-b5b0-da6878a929ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.931s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:43.741089 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Releasing lock "refresh_cache-cbca099c-52a9-4d73-a91a-d9685cb310be" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:16:43.741467 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Instance network_info: |[{"id": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "address": "fa:16:3e:9f:3b:b8", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa65d3-e4", "ovs_interfaceid": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:16:43.836901 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:16:43.837847 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:16:43.838083 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Creating image(s)
May 27 03:16:43.838375 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:16:43.839089 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Ensure instance console log exists: /opt/stack/data/nova/instances/cbca099c-52a9-4d73-a91a-d9685cb310be/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:16:43.839089 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:43.839089 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:43.839089 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:43.839456 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Start _get_guest_xml network_info=[{"id": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "address": "fa:16:3e:9f:3b:b8", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa65d3-e4", "ovs_interfaceid": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'cbca099c-52a9-4d73-a91a-d9685cb310be', 'attached_at': '', 'detached_at': '', 'volume_id': '4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'serial': '4ff3b1d7-f2f3-406e-b5dd-50710c6f5136'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '21566e49-20c8-40a0-98e4-e648566dc72a', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:16:43.845572 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:16:43.846566 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-932025012', uuid='cbca099c-52a9-4d73-a91a-d9685cb310be'), owner=OwnerMeta(userid='8eeaf68cfb534238bfe879dd6e8f858f', username='tempest-TestVolumeBootPattern-360350731-project-member', projectid='bf4b0011da7449e7948bf2c8a41955f5', projectname='tempest-TestVolumeBootPattern-360350731'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "address": "fa:16:3e:9f:3b:b8", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa65d3-e4", "ovs_interfaceid": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851803.8462393) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:16:43.851029 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:16:43.851345 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:16:43.855760 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:16:43.855760 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:16:43.855760 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:16:43.855760 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:16:43.855760 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:16:43.855760 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:16:43.855760 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:16:43.855760 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:16:43.855760 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:16:43.855760 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:16:43.855760 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:16:43.855760 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:16:43.855760 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:16:43.855760 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:16:43.864950 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:16:43.865454 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:16:43.865609 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:16:43.865972 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:16:43.866186 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:16:43.877703 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:16:43.878331 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:16:43.878845 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:16:43.879012 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:16:43.879510 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:16:43.879752 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:16:43.893160 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:16:43.893160 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:43.900539 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:16:43.900539 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:43.909186 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136] added
May 27 03:16:43.909186 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:16:43.909186 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:16:43.909186 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:16:43.909186 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:16:43.909186 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:16:43.909186 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:43.909432 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:16:43.909607 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:16:43.909819 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:16:43.912236 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136] added
May 27 03:16:43.912236 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:16:43.912236 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:16:43.912236 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:16:43.912236 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:16:43.912236 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:16:43.912236 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:43.912441 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:16:43.912980 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0336(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:16:43.913292 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:16:44.541080 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-933e1cb8-089d-4979-95c9-e4d0e107a7c8 req-57721348-46ec-4427-b99d-2d86448acc80 service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Received event network-changed-4f833239-93b2-4653-b99e-685143dc0fde {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:44.541852 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-933e1cb8-089d-4979-95c9-e4d0e107a7c8 req-57721348-46ec-4427-b99d-2d86448acc80 service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Refreshing instance network info cache due to event network-changed-4f833239-93b2-4653-b99e-685143dc0fde. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:16:44.541993 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-933e1cb8-089d-4979-95c9-e4d0e107a7c8 req-57721348-46ec-4427-b99d-2d86448acc80 service nova] Acquiring lock "refresh_cache-a43f3291-bb24-41c9-b5b0-da6878a929ff" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:16:44.542082 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-933e1cb8-089d-4979-95c9-e4d0e107a7c8 req-57721348-46ec-4427-b99d-2d86448acc80 service nova] Acquired lock "refresh_cache-a43f3291-bb24-41c9-b5b0-da6878a929ff" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:16:44.542188 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-933e1cb8-089d-4979-95c9-e4d0e107a7c8 req-57721348-46ec-4427-b99d-2d86448acc80 service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Refreshing network info cache for port 4f833239-93b2-4653-b99e-685143dc0fde {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:16:44.910378 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:16:44.913775 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:16:44.924141 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:16:44.924141 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:16:44.926380 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:16:44.926380 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:44.937688 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:44.943669 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:44.952362 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:44.952362 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:44.952362 np0000001475 nova-compute[98471]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:44.952362 np0000001475 nova-compute[98471]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:44.952362 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:16:44.952635 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:44.952635 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:44.952635 np0000001475 nova-compute[98471]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:44.952635 np0000001475 nova-compute[98471]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:44.952635 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:16:44.959302 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:44.959302 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:44.959302 np0000001475 nova-compute[98471]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:44.959302 np0000001475 nova-compute[98471]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:44.959302 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:16:44.959493 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:44.959493 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:44.959493 np0000001475 nova-compute[98471]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:44.959493 np0000001475 nova-compute[98471]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:44.959493 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:16:44.992455 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136, portal: 192.168.50.100,3260]
May 27 03:16:44.992455 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136, portal: 192.168.50.100,3260] successful.
May 27 03:16:44.992455 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:45.005983 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:45.015214 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136, portal: 192.168.40.100,3260]
May 27 03:16:45.015214 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136, portal: 192.168.40.100,3260] successful.
May 27 03:16:45.015214 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:45.022190 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:45.022190 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:45.022190 np0000001475 nova-compute[98471]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:45.022190 np0000001475 nova-compute[98471]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:45.022190 np0000001475 nova-compute[98471]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:16:45.022190 np0000001475 nova-compute[98471]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:16:45.022190 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:16:45.022367 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:45.022367 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:45.022367 np0000001475 nova-compute[98471]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:45.022367 np0000001475 nova-compute[98471]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:45.022367 np0000001475 nova-compute[98471]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:16:45.022367 np0000001475 nova-compute[98471]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:16:45.022367 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:16:45.022578 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:16:45.022699 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:16:45.023542 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('11', '-', '-', 0) found on session 194 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:16:45.023663 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:16:45.030065 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:16:45.043634 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 194 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:16:45.044063 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:16:45.044700 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-933e1cb8-089d-4979-95c9-e4d0e107a7c8 req-57721348-46ec-4427-b99d-2d86448acc80 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:45.047983 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:45.047983 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:45.047983 np0000001475 nova-compute[98471]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:45.047983 np0000001475 nova-compute[98471]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:45.047983 np0000001475 nova-compute[98471]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:16:45.047983 np0000001475 nova-compute[98471]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:16:45.047983 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:16:45.048150 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:45.048150 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:16:45.048150 np0000001475 nova-compute[98471]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:45.048150 np0000001475 nova-compute[98471]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:16:45.048150 np0000001475 nova-compute[98471]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:16:45.048150 np0000001475 nova-compute[98471]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:16:45.048150 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:16:45.048349 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:16:45.048503 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:16:45.049251 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('12', '-', '-', 0) found on session 195 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:16:45.049398 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:16:45.064379 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 195 and hctl ['12', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:16:45.407404 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-933e1cb8-089d-4979-95c9-e4d0e107a7c8 req-57721348-46ec-4427-b99d-2d86448acc80 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:45.543575 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-933e1cb8-089d-4979-95c9-e4d0e107a7c8 req-57721348-46ec-4427-b99d-2d86448acc80 service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Updated VIF entry in instance network info cache for port 4f833239-93b2-4653-b99e-685143dc0fde. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:16:45.544051 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-933e1cb8-089d-4979-95c9-e4d0e107a7c8 req-57721348-46ec-4427-b99d-2d86448acc80 service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Updating instance_info_cache with network_info: [{"id": "4f833239-93b2-4653-b99e-685143dc0fde", "address": "fa:16:3e:a7:ee:83", "network": {"id": "40d85a12-de61-467c-bf94-207453df7823", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1622508986-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "033672aa8b3e44549f8c8185ad55f3f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833239-93", "ovs_interfaceid": "4f833239-93b2-4653-b99e-685143dc0fde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:16:46.046108 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-933e1cb8-089d-4979-95c9-e4d0e107a7c8 req-57721348-46ec-4427-b99d-2d86448acc80 service nova] Releasing lock "refresh_cache-a43f3291-bb24-41c9-b5b0-da6878a929ff" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:16:46.064673 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 195 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:16:46.064673 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:16:46.163922 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2f7b6880-abff-4b60-9c7e-c5b88521fb4b tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "55c414d9-4157-42a2-a40b-04907e27620f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:46.164065 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2f7b6880-abff-4b60-9c7e-c5b88521fb4b tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "55c414d9-4157-42a2-a40b-04907e27620f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:46.164233 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-2f7b6880-abff-4b60-9c7e-c5b88521fb4b tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Rebooting instance
May 27 03:16:46.712110 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:46.719426 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2f7b6880-abff-4b60-9c7e-c5b88521fb4b tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:16:46.719609 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2f7b6880-abff-4b60-9c7e-c5b88521fb4b tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquired lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:16:46.719844 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-2f7b6880-abff-4b60-9c7e-c5b88521fb4b tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:16:46.893301 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Found WWN 33000000024a033d2 for multipath device dm-4 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:16:46.893549 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:16:46.893720 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== connect_volume: return (3028ms) {'type': 'block', 'scsi_wwn': '33000000024a033d2', 'path': '/dev/dm-4', 'multipath_id': '33000000024a033d2'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:16:46.893871 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000024a033d2', 'path': '/dev/dm-4', 'multipath_id': '33000000024a033d2'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:16:47.222126 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-2f7b6880-abff-4b60-9c7e-c5b88521fb4b tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:47.399456 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-932025012',display_name='tempest-TestVolumeBootPattern-server-932025012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-932025012',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrODyiD4VhCOJ3tERckx7Bh6Fsg/COsZOnYO1f3ivTbPJBlJq5CAyuysfbSFnYE2CY9gLHg5LCbGvc+4zZov//XJVSGiq/xc3x5mfkk/4QWW2KrO26LCSpJilvOrlpAGQ==',key_name='tempest-keypair-1119925702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-rc3u78ge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:16:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=cbca099c-52a9-4d73-a91a-d9685cb310be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "address": "fa:16:3e:9f:3b:b8", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa65d3-e4", "ovs_interfaceid": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:16:47.399733 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "address": "fa:16:3e:9f:3b:b8", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa65d3-e4", "ovs_interfaceid": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:16:47.400301 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3b:b8,bridge_name='br-int',has_traffic_filtering=True,id=62fa65d3-e430-4df5-aad7-c5c21ddd7968,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa65d3-e4') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:16:47.400923 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'pci_devices' on Instance uuid cbca099c-52a9-4d73-a91a-d9685cb310be {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:16:47.511059 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-2f7b6880-abff-4b60-9c7e-c5b88521fb4b tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:47.622826 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-2f7b6880-abff-4b60-9c7e-c5b88521fb4b tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Updating instance_info_cache with network_info: [{"id": "2ae8763f-7d5e-4b11-879d-135cf5899359", "address": "fa:16:3e:7b:4f:67", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae8763f-7d", "ovs_interfaceid": "2ae8763f-7d5e-4b11-879d-135cf5899359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:16:47.903794 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] End _get_guest_xml xml=<domain type="qemu">
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:   <uuid>cbca099c-52a9-4d73-a91a-d9685cb310be</uuid>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:   <name>instance-0000004a</name>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestVolumeBootPattern-server-932025012</nova:name>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:16:43</nova:creationTime>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:         <nova:user uuid="8eeaf68cfb534238bfe879dd6e8f858f">tempest-TestVolumeBootPattern-360350731-project-member</nova:user>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:         <nova:project uuid="bf4b0011da7449e7948bf2c8a41955f5">tempest-TestVolumeBootPattern-360350731</nova:project>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:         <nova:port uuid="62fa65d3-e430-4df5-aad7-c5c21ddd7968">
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     <system>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <entry name="serial">cbca099c-52a9-4d73-a91a-d9685cb310be</entry>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <entry name="uuid">cbca099c-52a9-4d73-a91a-d9685cb310be</entry>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     </system>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:   <os>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:   </os>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:   <features>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:   </features>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:   <devices>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/cbca099c-52a9-4d73-a91a-d9685cb310be/disk.config"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     </disk>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <alias name="ua-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-4"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <serial>4ff3b1d7-f2f3-406e-b5dd-50710c6f5136</serial>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     </disk>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:9f:3b:b8"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <target dev="tap62fa65d3-e4"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     </interface>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/cbca099c-52a9-4d73-a91a-d9685cb310be/console.log" append="off"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     </serial>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     <video>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     </video>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     </rng>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:   </devices>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]: </domain>
May 27 03:16:47.903794 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:16:47.905955 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Preparing to wait for external event network-vif-plugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:16:47.905955 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:47.905955 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:47.905955 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:47.905955 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-932025012',display_name='tempest-TestVolumeBootPattern-server-932025012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-932025012',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrODyiD4VhCOJ3tERckx7Bh6Fsg/COsZOnYO1f3ivTbPJBlJq5CAyuysfbSFnYE2CY9gLHg5LCbGvc+4zZov//XJVSGiq/xc3x5mfkk/4QWW2KrO26LCSpJilvOrlpAGQ==',key_name='tempest-keypair-1119925702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-rc3u78ge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:16:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=cbca099c-52a9-4d73-a91a-d9685cb310be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "address": "fa:16:3e:9f:3b:b8", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa65d3-e4", "ovs_interfaceid": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:16:47.905955 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "address": "fa:16:3e:9f:3b:b8", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa65d3-e4", "ovs_interfaceid": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:16:47.905955 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3b:b8,bridge_name='br-int',has_traffic_filtering=True,id=62fa65d3-e430-4df5-aad7-c5c21ddd7968,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa65d3-e4') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:16:47.906231 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3b:b8,bridge_name='br-int',has_traffic_filtering=True,id=62fa65d3-e430-4df5-aad7-c5c21ddd7968,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa65d3-e4') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:16:47.906405 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:47.906623 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:16:47.906902 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:16:47.907443 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:47.907598 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd5f8c42-3a6d-5edb-879b-5a574a9aae39', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:16:47.908384 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:47.909139 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:16:47.909493 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:47.911137 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:47.911276 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62fa65d3-e4, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:16:47.911538 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62fa65d3-e4, col_values=(('qos', UUID('52e66866-bf4b-4f37-8eda-7c5d8e2d78da')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:16:47.911718 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62fa65d3-e4, col_values=(('external_ids', {'iface-id': '62fa65d3-e430-4df5-aad7-c5c21ddd7968', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:3b:b8', 'vm-uuid': 'cbca099c-52a9-4d73-a91a-d9685cb310be'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:16:47.912408 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:47.913691 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:16:47.918627 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:47.919893 np0000001475 nova-compute[98471]: INFO os_vif [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3b:b8,bridge_name='br-int',has_traffic_filtering=True,id=62fa65d3-e430-4df5-aad7-c5c21ddd7968,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa65d3-e4')
May 27 03:16:48.124765 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2f7b6880-abff-4b60-9c7e-c5b88521fb4b tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Releasing lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:16:48.630412 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-2f7b6880-abff-4b60-9c7e-c5b88521fb4b tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:49.435696 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:16:49.435808 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:16:49.435930 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No VIF found with MAC fa:16:3e:9f:3b:b8, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:16:49.436246 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Using config drive
May 27 03:16:49.940760 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:50.044234 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Creating config drive at /opt/stack/data/nova/instances/cbca099c-52a9-4d73-a91a-d9685cb310be/disk.config
May 27 03:16:50.048058 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cbca099c-52a9-4d73-a91a-d9685cb310be/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6_9emmk5 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:16:50.108253 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cbca099c-52a9-4d73-a91a-d9685cb310be/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6_9emmk5" returned: 0 in 0.060s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:16:50.501182 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:50.534438 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:50.627480 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:50.681329 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-69be2b5a-6c5e-4c32-9686-dad653629a10 req-478e4eda-282c-40d8-a625-1beb80a7ec95 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Received event network-vif-plugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:50.681841 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-69be2b5a-6c5e-4c32-9686-dad653629a10 req-478e4eda-282c-40d8-a625-1beb80a7ec95 service nova] Acquiring lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:50.682883 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-69be2b5a-6c5e-4c32-9686-dad653629a10 req-478e4eda-282c-40d8-a625-1beb80a7ec95 service nova] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:50.682883 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-69be2b5a-6c5e-4c32-9686-dad653629a10 req-478e4eda-282c-40d8-a625-1beb80a7ec95 service nova] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:50.682883 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-69be2b5a-6c5e-4c32-9686-dad653629a10 req-478e4eda-282c-40d8-a625-1beb80a7ec95 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Processing event network-vif-plugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:16:50.819849 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:50.822455 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:50.827431 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:50.828080 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:50.846968 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:51.175994 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851811.1756089, cbca099c-52a9-4d73-a91a-d9685cb310be => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:16:51.176380 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:16:51.176513 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] VM Started (Lifecycle Event)
May 27 03:16:51.180854 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:16:51.184370 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Instance spawned successfully.
May 27 03:16:51.184728 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:16:51.679489 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:51.682074 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:16:51.690172 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:16:51.690501 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:16:51.691026 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:16:51.691026 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:16:51.691026 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:16:51.691237 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:16:51.714536 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:52.038923 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:52.040939 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:52.058854 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:52.061316 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:52.090239 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:52.185968 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:16:52.186489 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851812.1860712, cbca099c-52a9-4d73-a91a-d9685cb310be => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:16:52.186489 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] VM Paused (Lifecycle Event)
May 27 03:16:52.198381 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Took 8.36 seconds to spawn the instance on the hypervisor.
May 27 03:16:52.198566 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:52.248275 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5f6ecdaf-654a-4f39-b297-3268a8e8b185 req-2f88cefa-17b4-4069-a87f-20b77ba5ab50 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received event network-vif-unplugged-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:52.248481 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5f6ecdaf-654a-4f39-b297-3268a8e8b185 req-2f88cefa-17b4-4069-a87f-20b77ba5ab50 service nova] Acquiring lock "55c414d9-4157-42a2-a40b-04907e27620f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:52.248694 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5f6ecdaf-654a-4f39-b297-3268a8e8b185 req-2f88cefa-17b4-4069-a87f-20b77ba5ab50 service nova] Lock "55c414d9-4157-42a2-a40b-04907e27620f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:52.249666 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5f6ecdaf-654a-4f39-b297-3268a8e8b185 req-2f88cefa-17b4-4069-a87f-20b77ba5ab50 service nova] Lock "55c414d9-4157-42a2-a40b-04907e27620f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:52.250506 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5f6ecdaf-654a-4f39-b297-3268a8e8b185 req-2f88cefa-17b4-4069-a87f-20b77ba5ab50 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] No waiting events found dispatching network-vif-unplugged-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:16:52.251189 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-5f6ecdaf-654a-4f39-b297-3268a8e8b185 req-2f88cefa-17b4-4069-a87f-20b77ba5ab50 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received unexpected event network-vif-unplugged-2ae8763f-7d5e-4b11-879d-135cf5899359 for instance with vm_state active and task_state reboot_started.
May 27 03:16:52.369001 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:52.654347 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-2f7b6880-abff-4b60-9c7e-c5b88521fb4b tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Instance shutdown successfully.
May 27 03:16:52.689371 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:52.692466 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851812.692204, cbca099c-52a9-4d73-a91a-d9685cb310be => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:16:52.692590 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] VM Resumed (Lifecycle Event)
May 27 03:16:52.715790 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Took 15.34 seconds to build instance.
May 27 03:16:52.758033 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8cee2cee-9cca-49bd-bacf-94839c9c2ba8 req-e724835c-fff6-4add-88c9-f88f45371bd3 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Received event network-vif-plugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:52.758188 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8cee2cee-9cca-49bd-bacf-94839c9c2ba8 req-e724835c-fff6-4add-88c9-f88f45371bd3 service nova] Acquiring lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:52.758338 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8cee2cee-9cca-49bd-bacf-94839c9c2ba8 req-e724835c-fff6-4add-88c9-f88f45371bd3 service nova] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:52.758450 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8cee2cee-9cca-49bd-bacf-94839c9c2ba8 req-e724835c-fff6-4add-88c9-f88f45371bd3 service nova] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:52.758562 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8cee2cee-9cca-49bd-bacf-94839c9c2ba8 req-e724835c-fff6-4add-88c9-f88f45371bd3 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] No waiting events found dispatching network-vif-plugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:16:52.759797 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-8cee2cee-9cca-49bd-bacf-94839c9c2ba8 req-e724835c-fff6-4add-88c9-f88f45371bd3 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Received unexpected event network-vif-plugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 for instance with vm_state active and task_state None.
May 27 03:16:52.913581 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:53.052676 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:53.086052 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:53.183487 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:53.194996 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:53.200836 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:16:53.217674 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.844s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:53.423907 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:53.425350 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:53.427114 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:53.448879 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:53.704570 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99971199599986 future=<Future at 0x7557046a8e00 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:16:53.705077 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999187642999914 future=<Future at 0x7557046a8e00 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:16:53.705256 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999017407999872 future=<Future at 0x7557046a8e00 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:16:53.866411 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Removed pending STOPPED event for 55c414d9-4157-42a2-a40b-04907e27620f due to new event <LifecycleEvent: 1779851813.8659124, 55c414d9-4157-42a2-a40b-04907e27620f => Resumed> {{(pid=98471) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 03:16:53.867119 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Instance running successfully.
May 27 03:16:53.867397 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851813.8659124, 55c414d9-4157-42a2-a40b-04907e27620f => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:16:53.867873 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-2f7b6880-abff-4b60-9c7e-c5b88521fb4b tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Instance soft rebooted successfully.
May 27 03:16:53.868149 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] VM Resumed (Lifecycle Event)
May 27 03:16:53.868875 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-2f7b6880-abff-4b60-9c7e-c5b88521fb4b tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:54.342372 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received event network-vif-unplugged-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:54.342906 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] Acquiring lock "55c414d9-4157-42a2-a40b-04907e27620f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:54.342906 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] Lock "55c414d9-4157-42a2-a40b-04907e27620f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:54.343050 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] Lock "55c414d9-4157-42a2-a40b-04907e27620f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:54.343212 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] No waiting events found dispatching network-vif-unplugged-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:16:54.344285 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received unexpected event network-vif-unplugged-2ae8763f-7d5e-4b11-879d-135cf5899359 for instance with vm_state active and task_state None.
May 27 03:16:54.344452 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received event network-vif-plugged-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:54.344677 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] Acquiring lock "55c414d9-4157-42a2-a40b-04907e27620f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:54.344847 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] Lock "55c414d9-4157-42a2-a40b-04907e27620f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:54.345003 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] Lock "55c414d9-4157-42a2-a40b-04907e27620f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:54.345156 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] No waiting events found dispatching network-vif-plugged-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:16:54.345309 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received unexpected event network-vif-plugged-2ae8763f-7d5e-4b11-879d-135cf5899359 for instance with vm_state active and task_state None.
May 27 03:16:54.345456 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received event network-vif-plugged-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:54.345724 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] Acquiring lock "55c414d9-4157-42a2-a40b-04907e27620f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:16:54.345819 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] Lock "55c414d9-4157-42a2-a40b-04907e27620f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:16:54.345975 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] Lock "55c414d9-4157-42a2-a40b-04907e27620f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:54.346123 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] No waiting events found dispatching network-vif-plugged-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:16:54.346258 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received unexpected event network-vif-plugged-2ae8763f-7d5e-4b11-879d-135cf5899359 for instance with vm_state active and task_state None.
May 27 03:16:54.346385 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Received event network-changed-62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:16:54.346523 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Refreshing instance network info cache due to event network-changed-62fa65d3-e430-4df5-aad7-c5c21ddd7968. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:16:54.346703 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] Acquiring lock "refresh_cache-cbca099c-52a9-4d73-a91a-d9685cb310be" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:16:54.346846 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] Acquired lock "refresh_cache-cbca099c-52a9-4d73-a91a-d9685cb310be" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:16:54.347024 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Refreshing network info cache for port 62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:16:54.372670 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:54.375347 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:16:54.380211 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-2f7b6880-abff-4b60-9c7e-c5b88521fb4b tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "55c414d9-4157-42a2-a40b-04907e27620f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.216s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:16:54.762470 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:16:54.762760 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:16:54.762957 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:16:54.763279 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.44 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:16:54.849580 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:54.880324 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851814.8800502, 55c414d9-4157-42a2-a40b-04907e27620f => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:16:54.880454 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] VM Started (Lifecycle Event)
May 27 03:16:55.193463 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:16:55.200443 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:16:55.200665 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:16:55.200926 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:16:55.337878 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Updated VIF entry in instance network info cache for port 62fa65d3-e430-4df5-aad7-c5c21ddd7968. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:16:55.338158 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Updating instance_info_cache with network_info: [{"id": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "address": "fa:16:3e:9f:3b:b8", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa65d3-e4", "ovs_interfaceid": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:16:55.382720 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:16:55.385075 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:16:55.840246 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-81f1da01-17c9-4881-9be9-baa70d084fcb req-ae669ee3-570e-4653-b8df-03817babbf74 service nova] Releasing lock "refresh_cache-cbca099c-52a9-4d73-a91a-d9685cb310be" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:16:56.196215 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:16:56.196503 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:16:56.199490 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:16:56.199833 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:16:56.716398 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:16:57.199887 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:16:57.200184 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:16:57.915176 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:00.196176 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:17:00.196660 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 8.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:17:01.205027 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:17:01.718261 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:02.917008 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:06.720201 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:07.918006 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:08.199609 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:17:08.703908 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:08.704076 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:08.704239 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:08.704352 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:17:08.704705 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.000429409000389569 future=<Future at 0x7557046a8e00 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:17:08.704831 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:17:09.725760 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:17:09.727680 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:17:09.816317 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:17:09.816849 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:17:09.903466 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:17:09.904477 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:17:09.909841 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:17:09.999438 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:17:09.999884 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:17:10.082220 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:17:10.082644 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:17:10.086363 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:17:10.087477 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:17:10.131007 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:17:10.131364 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=12982MB free_disk=72.61552810668945GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:17:10.131537 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:10.131782 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:10.909766 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Acquiring lock "a43f3291-bb24-41c9-b5b0-da6878a929ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:10.910259 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "a43f3291-bb24-41c9-b5b0-da6878a929ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:10.910259 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Acquiring lock "a43f3291-bb24-41c9-b5b0-da6878a929ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:10.910259 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "a43f3291-bb24-41c9-b5b0-da6878a929ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:10.910363 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "a43f3291-bb24-41c9-b5b0-da6878a929ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:10.912920 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Terminating instance
May 27 03:17:11.186906 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 55c414d9-4157-42a2-a40b-04907e27620f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:17:11.187022 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance a43f3291-bb24-41c9-b5b0-da6878a929ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:17:11.187112 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance cbca099c-52a9-4d73-a91a-d9685cb310be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:17:11.187242 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:17:11.187353 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:17:10 up 48 min,  2 users,  load average: 2.93, 4.37, 4.76\n', 'num_instances': '3', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '3', 'num_proj_132164e1033644c98f55a442c1bc16d6': '1', 'io_workload': '0', 'num_proj_033672aa8b3e44549f8c8185ad55f3f7': '1', 'num_proj_bf4b0011da7449e7948bf2c8a41955f5': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:17:11.355954 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:17:11.356281 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:17:11.415917 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:17:11.433704 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:11.435889 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:11.452235 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:11.476400 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:11.476931 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:11.568094 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-73f45d6e-026c-4b9c-ae00-0d26184314f0 req-941dd036-3466-41aa-ba80-29d0f7aba8ee service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Received event network-vif-unplugged-4f833239-93b2-4653-b99e-685143dc0fde {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:17:11.568483 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-73f45d6e-026c-4b9c-ae00-0d26184314f0 req-941dd036-3466-41aa-ba80-29d0f7aba8ee service nova] Acquiring lock "a43f3291-bb24-41c9-b5b0-da6878a929ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:11.568655 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-73f45d6e-026c-4b9c-ae00-0d26184314f0 req-941dd036-3466-41aa-ba80-29d0f7aba8ee service nova] Lock "a43f3291-bb24-41c9-b5b0-da6878a929ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:11.568813 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-73f45d6e-026c-4b9c-ae00-0d26184314f0 req-941dd036-3466-41aa-ba80-29d0f7aba8ee service nova] Lock "a43f3291-bb24-41c9-b5b0-da6878a929ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:11.568939 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-73f45d6e-026c-4b9c-ae00-0d26184314f0 req-941dd036-3466-41aa-ba80-29d0f7aba8ee service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] No waiting events found dispatching network-vif-unplugged-4f833239-93b2-4653-b99e-685143dc0fde {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:17:11.569040 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-73f45d6e-026c-4b9c-ae00-0d26184314f0 req-941dd036-3466-41aa-ba80-29d0f7aba8ee service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Received event network-vif-unplugged-4f833239-93b2-4653-b99e-685143dc0fde for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:17:11.721508 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:11.736061 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999630835000062 future=<Future at 0x755724668800 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:17:11.736455 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999212700000044 future=<Future at 0x755724668800 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:17:11.736572 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999071047000143 future=<Future at 0x755724668800 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:17:11.738825 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Instance destroyed successfully.
May 27 03:17:11.739260 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lazy-loading 'resources' on Instance uuid a43f3291-bb24-41c9-b5b0-da6878a929ff {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:17:11.859312 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:17:12.241614 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-instance-2036552287',display_name='tempest-instance-2036552287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-instance-2036552287',id=73,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+vg9C+TMbdZnHCVoF1gS+4GTcBdzjbosl1rh18Mp+YNTxeIkbT/p4AP8KvDA7/4XBNol4OfONW+J6aWCcvzH3hyzr9+DCPj6vLuf5Bwh8mu26/gYSUu/D9Zg8tT0AIcQ==',key_name='tempest-keypair-670115409',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:16:42Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='033672aa8b3e44549f8c8185ad55f3f7',ramdisk_id='',reservation_id='r-360et7x2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-1801307276',owner_user_name='tempest-VolumesBackupsTest-1801307276-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:16:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bab0444ac9a74758868a5056bb860779',uuid=a43f3291-bb24-41c9-b5b0-da6878a929ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f833239-93b2-4653-b99e-685143dc0fde", "address": "fa:16:3e:a7:ee:83", "network": {"id": "40d85a12-de61-467c-bf94-207453df7823", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1622508986-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "033672aa8b3e44549f8c8185ad55f3f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833239-93", "ovs_interfaceid": "4f833239-93b2-4653-b99e-685143dc0fde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:17:12.242208 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Converting VIF {"id": "4f833239-93b2-4653-b99e-685143dc0fde", "address": "fa:16:3e:a7:ee:83", "network": {"id": "40d85a12-de61-467c-bf94-207453df7823", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1622508986-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "033672aa8b3e44549f8c8185ad55f3f7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f833239-93", "ovs_interfaceid": "4f833239-93b2-4653-b99e-685143dc0fde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:17:12.242391 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:ee:83,bridge_name='br-int',has_traffic_filtering=True,id=4f833239-93b2-4653-b99e-685143dc0fde,network=Network(40d85a12-de61-467c-bf94-207453df7823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f833239-93') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:17:12.242690 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:ee:83,bridge_name='br-int',has_traffic_filtering=True,id=4f833239-93b2-4653-b99e-685143dc0fde,network=Network(40d85a12-de61-467c-bf94-207453df7823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f833239-93') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:17:12.243991 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:12.244252 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f833239-93, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:17:12.245193 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:12.246076 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:17:12.246828 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:12.246960 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03b42bdd-3420-44b2-8840-2506f079278a) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:17:12.247560 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:12.247882 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:17:12.249462 np0000001475 nova-compute[98471]: INFO os_vif [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:ee:83,bridge_name='br-int',has_traffic_filtering=True,id=4f833239-93b2-4653-b99e-685143dc0fde,network=Network(40d85a12-de61-467c-bf94-207453df7823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f833239-93')
May 27 03:17:12.250788 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:17:12.251089 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:17:12.251231 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:17:12.251580 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:17:12.251922 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:17:12.252071 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:17:12.276492 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:17:12.276492 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:17:12.276492 np0000001475 nova-compute[98471]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:17:12.276492 np0000001475 nova-compute[98471]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:17:12.276492 np0000001475 nova-compute[98471]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:12.276492 np0000001475 nova-compute[98471]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:12.276492 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:17:12.276768 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsi session list stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:17:12.276768 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:17:12.276768 np0000001475 nova-compute[98471]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:17:12.276768 np0000001475 nova-compute[98471]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a (non-flash)
May 27 03:17:12.276768 np0000001475 nova-compute[98471]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:12.276768 np0000001475 nova-compute[98471]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:12.276768 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:17:12.276893 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45', '190'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45', '191'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a', '192'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', '195')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:17:12.276969 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a', '192')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:17:12.277827 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a', '193')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:17:12.278507 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755724758860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a'): ({'sde'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:17:12.278704 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Removing multipathed devices sdd, sde {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:17:12.278926 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Flush multipath device 3300000008b8c66dd {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:17:12.337164 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:17:12.366606 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:17:12.367038 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.235s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:12.367411 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:17:12.397139 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:17:12.430983 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:17:12.431136 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:17:12.432169 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:17:12.442429 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:17:12.442655 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:17:12.454811 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:12.483560 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 192, target: iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a, portal: 192.168.40.100,3260]
May 27 03:17:12.483560 np0000001475 nova-compute[98471]: Logout of [sid: 192, target: iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a, portal: 192.168.40.100,3260] successful.
May 27 03:17:12.483560 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:12.497221 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:12.506792 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:12.534581 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 193, target: iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a, portal: 192.168.50.100,3260]
May 27 03:17:12.534581 np0000001475 nova-compute[98471]: Logout of [sid: 193, target: iqn.2023-03.storpool.com:os--volume-a78b4532-5ce5-4aa5-83a5-0ee74856d95a, portal: 192.168.50.100,3260] successful.
May 27 03:17:12.534581 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:12.547333 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:12.547505 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:17:12.547659 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] <== disconnect_volume: return (296ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:17:12.547790 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:17:12.548061 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Deleting instance files /opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff_del
May 27 03:17:12.548647 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Deletion of /opt/stack/data/nova/instances/a43f3291-bb24-41c9-b5b0-da6878a929ff_del complete
May 27 03:17:13.054206 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Took 1.64 seconds to destroy the instance on the hypervisor.
May 27 03:17:13.055682 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:17:13.055982 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:17:13.056083 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:17:13.056326 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:17:13.144475 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:17:13.522793 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c25da269-41a9-4b2d-acb1-b74e3d8543d9 req-94c16f28-a586-41f5-814a-fb827eb3169b service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Received event network-vif-deleted-4f833239-93b2-4653-b99e-685143dc0fde {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:17:13.523204 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-c25da269-41a9-4b2d-acb1-b74e3d8543d9 req-94c16f28-a586-41f5-814a-fb827eb3169b service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Neutron deleted interface 4f833239-93b2-4653-b99e-685143dc0fde; detaching it from the instance and deleting it from the info cache
May 27 03:17:13.523323 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-c25da269-41a9-4b2d-acb1-b74e3d8543d9 req-94c16f28-a586-41f5-814a-fb827eb3169b service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:17:13.628334 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-600c4e43-ce92-465d-abdb-1127ccd925c8 req-7e86daf7-e2b3-48fa-bcf1-b24bb9e0a53b service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Received event network-vif-unplugged-4f833239-93b2-4653-b99e-685143dc0fde {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:17:13.628693 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-600c4e43-ce92-465d-abdb-1127ccd925c8 req-7e86daf7-e2b3-48fa-bcf1-b24bb9e0a53b service nova] Acquiring lock "a43f3291-bb24-41c9-b5b0-da6878a929ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:13.628875 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-600c4e43-ce92-465d-abdb-1127ccd925c8 req-7e86daf7-e2b3-48fa-bcf1-b24bb9e0a53b service nova] Lock "a43f3291-bb24-41c9-b5b0-da6878a929ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:13.628994 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-600c4e43-ce92-465d-abdb-1127ccd925c8 req-7e86daf7-e2b3-48fa-bcf1-b24bb9e0a53b service nova] Lock "a43f3291-bb24-41c9-b5b0-da6878a929ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:13.629107 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-600c4e43-ce92-465d-abdb-1127ccd925c8 req-7e86daf7-e2b3-48fa-bcf1-b24bb9e0a53b service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] No waiting events found dispatching network-vif-unplugged-4f833239-93b2-4653-b99e-685143dc0fde {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:17:13.629214 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-600c4e43-ce92-465d-abdb-1127ccd925c8 req-7e86daf7-e2b3-48fa-bcf1-b24bb9e0a53b service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Received event network-vif-unplugged-4f833239-93b2-4653-b99e-685143dc0fde for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:17:13.982041 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:17:14.026595 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c25da269-41a9-4b2d-acb1-b74e3d8543d9 req-94c16f28-a586-41f5-814a-fb827eb3169b service nova] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Detach interface failed, port_id=4f833239-93b2-4653-b99e-685143dc0fde, reason: Instance a43f3291-bb24-41c9-b5b0-da6878a929ff could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:17:14.484215 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Took 1.43 seconds to deallocate network for instance.
May 27 03:17:15.034787 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Took 0.55 seconds to detach 1 volumes for instance.
May 27 03:17:15.539626 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:15.539849 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:15.718166 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:17:15.718381 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:17:16.220981 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:17:16.723251 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:16.727911 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.188s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:16.777812 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Deleted allocations for instance a43f3291-bb24-41c9-b5b0-da6878a929ff
May 27 03:17:17.248305 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:17.787031 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a1d07967-cf0b-41c3-9b1c-1ab998d465f1 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Lock "a43f3291-bb24-41c9-b5b0-da6878a929ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.877s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:21.725033 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:22.249191 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:26.726919 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:26.736051 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0003672249999908672 future=<Future at 0x755724668800 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:17:26.736613 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Emitting event <LifecycleEvent: 1779851831.7355807, a43f3291-bb24-41c9-b5b0-da6878a929ff => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:17:26.736818 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:17:26.737028 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] VM Stopped (Lifecycle Event)
May 27 03:17:27.239534 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-559a73a1-a30b-4938-842a-e633e65a709f tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a43f3291-bb24-41c9-b5b0-da6878a929ff] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:17:27.249844 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:31.277242 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca4396d8-d36a-4e1f-b130-f1aa1bc8f062 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "cbca099c-52a9-4d73-a91a-d9685cb310be" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:31.277625 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca4396d8-d36a-4e1f-b130-f1aa1bc8f062 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:31.277625 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ca4396d8-d36a-4e1f-b130-f1aa1bc8f062 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:17:31.279641 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ca4396d8-d36a-4e1f-b130-f1aa1bc8f062 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98471) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 27 03:17:31.280144 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ca4396d8-d36a-4e1f-b130-f1aa1bc8f062 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'flavor' on Instance uuid cbca099c-52a9-4d73-a91a-d9685cb310be {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:17:31.304121 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ac9d5233-5c8e-4dfe-b75e-a6e610598185 req-ceff5636-87dc-431b-8744-bbadf0a30505 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received event network-changed-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:17:31.304421 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ac9d5233-5c8e-4dfe-b75e-a6e610598185 req-ceff5636-87dc-431b-8744-bbadf0a30505 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Refreshing instance network info cache due to event network-changed-2ae8763f-7d5e-4b11-879d-135cf5899359. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:17:31.304593 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ac9d5233-5c8e-4dfe-b75e-a6e610598185 req-ceff5636-87dc-431b-8744-bbadf0a30505 service nova] Acquiring lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:17:31.304698 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ac9d5233-5c8e-4dfe-b75e-a6e610598185 req-ceff5636-87dc-431b-8744-bbadf0a30505 service nova] Acquired lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:17:31.304850 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ac9d5233-5c8e-4dfe-b75e-a6e610598185 req-ceff5636-87dc-431b-8744-bbadf0a30505 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Refreshing network info cache for port 2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:17:31.738112 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:31.806703 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-ac9d5233-5c8e-4dfe-b75e-a6e610598185 req-ceff5636-87dc-431b-8744-bbadf0a30505 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:17:32.157090 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8a8d6f23-3279-462e-9271-7b57e44c1d03 req-5021c2fa-3fd4-4149-bbe1-377f606d5b93 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received event network-changed-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:17:32.159527 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-ac9d5233-5c8e-4dfe-b75e-a6e610598185 req-ceff5636-87dc-431b-8744-bbadf0a30505 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:17:32.160970 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8a8d6f23-3279-462e-9271-7b57e44c1d03 req-5021c2fa-3fd4-4149-bbe1-377f606d5b93 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Refreshing instance network info cache due to event network-changed-2ae8763f-7d5e-4b11-879d-135cf5899359. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:17:32.161624 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8a8d6f23-3279-462e-9271-7b57e44c1d03 req-5021c2fa-3fd4-4149-bbe1-377f606d5b93 service nova] Acquiring lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:17:32.251399 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:32.301959 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:32.321036 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:32.323185 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:32.332462 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ac9d5233-5c8e-4dfe-b75e-a6e610598185 req-ceff5636-87dc-431b-8744-bbadf0a30505 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Updated VIF entry in instance network info cache for port 2ae8763f-7d5e-4b11-879d-135cf5899359. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:17:32.332698 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ac9d5233-5c8e-4dfe-b75e-a6e610598185 req-ceff5636-87dc-431b-8744-bbadf0a30505 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Updating instance_info_cache with network_info: [{"id": "2ae8763f-7d5e-4b11-879d-135cf5899359", "address": "fa:16:3e:7b:4f:67", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae8763f-7d", "ovs_interfaceid": "2ae8763f-7d5e-4b11-879d-135cf5899359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:17:32.337975 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:32.343140 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:32.601912 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99967165199996 future=<Future at 0x75572461c8c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:17:32.602357 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999241273999814 future=<Future at 0x75572461c8c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:17:32.603099 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.998910930999955 future=<Future at 0x75572461c8c0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:17:32.604431 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Instance destroyed successfully.
May 27 03:17:32.604720 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ca4396d8-d36a-4e1f-b130-f1aa1bc8f062 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'numa_topology' on Instance uuid cbca099c-52a9-4d73-a91a-d9685cb310be {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:17:32.704121 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "55c414d9-4157-42a2-a40b-04907e27620f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:32.704288 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "55c414d9-4157-42a2-a40b-04907e27620f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:32.834708 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ac9d5233-5c8e-4dfe-b75e-a6e610598185 req-ceff5636-87dc-431b-8744-bbadf0a30505 service nova] Releasing lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:17:32.835140 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8a8d6f23-3279-462e-9271-7b57e44c1d03 req-5021c2fa-3fd4-4149-bbe1-377f606d5b93 service nova] Acquired lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:17:32.835302 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-8a8d6f23-3279-462e-9271-7b57e44c1d03 req-5021c2fa-3fd4-4149-bbe1-377f606d5b93 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Refreshing network info cache for port 2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:17:33.106636 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-ca4396d8-d36a-4e1f-b130-f1aa1bc8f062 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Object Instance<cbca099c-52a9-4d73-a91a-d9685cb310be> lazy-loaded attributes: flavor,numa_topology {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:17:33.106977 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-ca4396d8-d36a-4e1f-b130-f1aa1bc8f062 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:17:33.206389 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Detaching volume 9ee95878-1b61-4914-98a3-55c4f7cbdb45
May 27 03:17:33.247889 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Attempting to driver detach volume 9ee95878-1b61-4914-98a3-55c4f7cbdb45 from mountpoint /dev/vdb
May 27 03:17:33.253481 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Found disk vdb by alias ua-9ee95878-1b61-4914-98a3-55c4f7cbdb45 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:17:33.254787 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Found disk vdb by alias ua-9ee95878-1b61-4914-98a3-55c4f7cbdb45 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:17:33.254918 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Attempting to detach device vdb from instance 55c414d9-4157-42a2-a40b-04907e27620f from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:17:33.255144 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:17:33.255144 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:17:33.255144 np0000001475 nova-compute[98471]:   <alias name="ua-9ee95878-1b61-4914-98a3-55c4f7cbdb45"/>
May 27 03:17:33.255144 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-0"/>
May 27 03:17:33.255144 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:17:33.255144 np0000001475 nova-compute[98471]:   <serial>9ee95878-1b61-4914-98a3-55c4f7cbdb45</serial>
May 27 03:17:33.255144 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:17:33.255144 np0000001475 nova-compute[98471]: </disk>
May 27 03:17:33.255144 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:17:33.260424 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Successfully detached device vdb from instance 55c414d9-4157-42a2-a40b-04907e27620f from the persistent domain config.
May 27 03:17:33.260557 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] (1/8): Attempting to detach device vdb with device alias ua-9ee95878-1b61-4914-98a3-55c4f7cbdb45 from instance 55c414d9-4157-42a2-a40b-04907e27620f from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:17:33.260762 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:17:33.260762 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:17:33.260762 np0000001475 nova-compute[98471]:   <alias name="ua-9ee95878-1b61-4914-98a3-55c4f7cbdb45"/>
May 27 03:17:33.260762 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-0"/>
May 27 03:17:33.260762 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:17:33.260762 np0000001475 nova-compute[98471]:   <serial>9ee95878-1b61-4914-98a3-55c4f7cbdb45</serial>
May 27 03:17:33.260762 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:17:33.260762 np0000001475 nova-compute[98471]: </disk>
May 27 03:17:33.260762 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:17:33.337432 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-8a8d6f23-3279-462e-9271-7b57e44c1d03 req-5021c2fa-3fd4-4149-bbe1-377f606d5b93 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:17:33.357456 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5a53cbe0-05b5-425d-bbdc-26bed8a19103 req-56566141-d178-4835-b71f-01036aec4d07 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Received event network-vif-unplugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:17:33.357690 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5a53cbe0-05b5-425d-bbdc-26bed8a19103 req-56566141-d178-4835-b71f-01036aec4d07 service nova] Acquiring lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:33.358525 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5a53cbe0-05b5-425d-bbdc-26bed8a19103 req-56566141-d178-4835-b71f-01036aec4d07 service nova] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:33.358898 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5a53cbe0-05b5-425d-bbdc-26bed8a19103 req-56566141-d178-4835-b71f-01036aec4d07 service nova] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:33.359040 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5a53cbe0-05b5-425d-bbdc-26bed8a19103 req-56566141-d178-4835-b71f-01036aec4d07 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] No waiting events found dispatching network-vif-unplugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:17:33.359126 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-5a53cbe0-05b5-425d-bbdc-26bed8a19103 req-56566141-d178-4835-b71f-01036aec4d07 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Received unexpected event network-vif-unplugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 for instance with vm_state stopped and task_state None.
May 27 03:17:33.359235 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5a53cbe0-05b5-425d-bbdc-26bed8a19103 req-56566141-d178-4835-b71f-01036aec4d07 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Received event network-vif-unplugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:17:33.359367 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5a53cbe0-05b5-425d-bbdc-26bed8a19103 req-56566141-d178-4835-b71f-01036aec4d07 service nova] Acquiring lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:33.359576 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5a53cbe0-05b5-425d-bbdc-26bed8a19103 req-56566141-d178-4835-b71f-01036aec4d07 service nova] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:33.359663 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5a53cbe0-05b5-425d-bbdc-26bed8a19103 req-56566141-d178-4835-b71f-01036aec4d07 service nova] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:33.359708 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5a53cbe0-05b5-425d-bbdc-26bed8a19103 req-56566141-d178-4835-b71f-01036aec4d07 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] No waiting events found dispatching network-vif-unplugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:17:33.359843 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-5a53cbe0-05b5-425d-bbdc-26bed8a19103 req-56566141-d178-4835-b71f-01036aec4d07 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Received unexpected event network-vif-unplugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 for instance with vm_state stopped and task_state None.
May 27 03:17:33.614438 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ca4396d8-d36a-4e1f-b130-f1aa1bc8f062 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.337s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:33.631475 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-8a8d6f23-3279-462e-9271-7b57e44c1d03 req-5021c2fa-3fd4-4149-bbe1-377f606d5b93 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:17:33.756503 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-8a8d6f23-3279-462e-9271-7b57e44c1d03 req-5021c2fa-3fd4-4149-bbe1-377f606d5b93 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Updated VIF entry in instance network info cache for port 2ae8763f-7d5e-4b11-879d-135cf5899359. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:17:33.756789 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-8a8d6f23-3279-462e-9271-7b57e44c1d03 req-5021c2fa-3fd4-4149-bbe1-377f606d5b93 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Updating instance_info_cache with network_info: [{"id": "2ae8763f-7d5e-4b11-879d-135cf5899359", "address": "fa:16:3e:7b:4f:67", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae8763f-7d", "ovs_interfaceid": "2ae8763f-7d5e-4b11-879d-135cf5899359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:17:33.764554 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851853.764165, 55c414d9-4157-42a2-a40b-04907e27620f => ua-9ee95878-1b61-4914-98a3-55c4f7cbdb45> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:17:33.765978 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9ee95878-1b61-4914-98a3-55c4f7cbdb45 for instance 55c414d9-4157-42a2-a40b-04907e27620f {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:17:33.768664 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Successfully detached device vdb from instance 55c414d9-4157-42a2-a40b-04907e27620f from the live domain config.
May 27 03:17:33.769763 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:17:33.770224 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45', 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ee95878-1b61-4914-98a3-55c4f7cbdb45', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:17:33.770374 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:17:33.770649 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:17:33.770925 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45', 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ee95878-1b61-4914-98a3-55c4f7cbdb45', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:17:33.771063 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:17:33.794043 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:17:33.794043 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:17:33.794043 np0000001475 nova-compute[98471]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:33.794043 np0000001475 nova-compute[98471]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:33.794043 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:17:33.794242 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsi session list stdout=tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:17:33.794242 np0000001475 nova-compute[98471]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45 (non-flash)
May 27 03:17:33.794242 np0000001475 nova-compute[98471]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:33.794242 np0000001475 nova-compute[98471]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:33.794242 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:17:33.794361 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45', '190'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45', '191'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', '195')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:17:33.794414 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45', '190')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:17:33.795144 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45', '191')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:17:33.795850 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572472cd60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45'): ({'sdc'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:17:33.795989 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Removing multipathed devices sdb, sdc {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:17:33.796202 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Flush multipath device 3300000005be48fb2 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:17:33.847054 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:17:33.896041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:17:33.936611 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:17:33.936611 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:17:33.936965 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:17:33.948176 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:17:33.948329 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:17:33.957991 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:33.988756 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 190, target: iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45, portal: 192.168.40.100,3260]
May 27 03:17:33.988756 np0000001475 nova-compute[98471]: Logout of [sid: 190, target: iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45, portal: 192.168.40.100,3260] successful.
May 27 03:17:33.988756 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:34.001428 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:34.011679 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:34.036525 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 191, target: iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45, portal: 192.168.50.100,3260]
May 27 03:17:34.036525 np0000001475 nova-compute[98471]: Logout of [sid: 191, target: iqn.2023-03.storpool.com:os--volume-9ee95878-1b61-4914-98a3-55c4f7cbdb45, portal: 192.168.50.100,3260] successful.
May 27 03:17:34.036525 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:34.047031 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:34.047208 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:17:34.047311 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] <== disconnect_volume: return (276ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:17:34.047447 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:17:34.258960 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8a8d6f23-3279-462e-9271-7b57e44c1d03 req-5021c2fa-3fd4-4149-bbe1-377f606d5b93 service nova] Releasing lock "refresh_cache-55c414d9-4157-42a2-a40b-04907e27620f" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:17:34.587906 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lazy-loading 'flavor' on Instance uuid 55c414d9-4157-42a2-a40b-04907e27620f {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:17:35.065598 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'flavor' on Instance uuid cbca099c-52a9-4d73-a91a-d9685cb310be {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:17:35.569266 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "refresh_cache-cbca099c-52a9-4d73-a91a-d9685cb310be" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:17:35.569390 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquired lock "refresh_cache-cbca099c-52a9-4d73-a91a-d9685cb310be" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:17:35.569461 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:17:35.569542 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'info_cache' on Instance uuid cbca099c-52a9-4d73-a91a-d9685cb310be {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:17:35.592764 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ce7f331a-b92e-4f3a-a4f6-5497ea6ebb68 tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "55c414d9-4157-42a2-a40b-04907e27620f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.888s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:36.071756 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Object Instance<cbca099c-52a9-4d73-a91a-d9685cb310be> lazy-loaded attributes: flavor,info_cache {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:17:36.573814 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:17:36.845450 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:17:36.963735 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Updating instance_info_cache with network_info: [{"id": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "address": "fa:16:3e:9f:3b:b8", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa65d3-e4", "ovs_interfaceid": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:17:37.029495 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "55c414d9-4157-42a2-a40b-04907e27620f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:37.029684 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "55c414d9-4157-42a2-a40b-04907e27620f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:37.029893 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "55c414d9-4157-42a2-a40b-04907e27620f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:37.030011 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "55c414d9-4157-42a2-a40b-04907e27620f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:37.030148 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "55c414d9-4157-42a2-a40b-04907e27620f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:37.032770 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Terminating instance
May 27 03:17:37.252359 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:37.465760 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Releasing lock "refresh_cache-cbca099c-52a9-4d73-a91a-d9685cb310be" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:17:37.535297 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:17:37.577197 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:37.593945 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:37.595593 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:37.619980 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:37.729964 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9a7e667a-27f4-4a0f-a8ba-c2c802d8e987 req-26efb1a2-cc17-48c2-a722-c117598c1708 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received event network-vif-unplugged-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:17:37.730659 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9a7e667a-27f4-4a0f-a8ba-c2c802d8e987 req-26efb1a2-cc17-48c2-a722-c117598c1708 service nova] Acquiring lock "55c414d9-4157-42a2-a40b-04907e27620f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:37.730907 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9a7e667a-27f4-4a0f-a8ba-c2c802d8e987 req-26efb1a2-cc17-48c2-a722-c117598c1708 service nova] Lock "55c414d9-4157-42a2-a40b-04907e27620f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:37.731015 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9a7e667a-27f4-4a0f-a8ba-c2c802d8e987 req-26efb1a2-cc17-48c2-a722-c117598c1708 service nova] Lock "55c414d9-4157-42a2-a40b-04907e27620f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:37.731605 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9a7e667a-27f4-4a0f-a8ba-c2c802d8e987 req-26efb1a2-cc17-48c2-a722-c117598c1708 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] No waiting events found dispatching network-vif-unplugged-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:17:37.731605 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9a7e667a-27f4-4a0f-a8ba-c2c802d8e987 req-26efb1a2-cc17-48c2-a722-c117598c1708 service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received event network-vif-unplugged-2ae8763f-7d5e-4b11-879d-135cf5899359 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:17:37.861886 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999779129999752 future=<Future at 0x7557047cb440 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:17:37.864028 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Instance destroyed successfully.
May 27 03:17:37.864413 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lazy-loading 'resources' on Instance uuid 55c414d9-4157-42a2-a40b-04907e27620f {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:17:38.369348 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:16:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-487010695',display_name='tempest-TestMinimumBasicScenario-server-487010695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testminimumbasicscenario-server-487010695',id=72,image_ref='5c367424-f8f8-4322-aa47-7443f358eee6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCy+Ol/SQVsBXa+demI2qQfNr+xpGXprsbFw6W/XckxdHqRfc6EIJ1KzdbsTxC6prmDhBu+I4kx6qtlEeKBDsU3MTjZg0JYi3bveOfOQdRdgtEjrtbmiSio5rKO17QY3DQ==',key_name='tempest-TestMinimumBasicScenario-1896972298',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:16:17Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='132164e1033644c98f55a442c1bc16d6',ramdisk_id='',reservation_id='r-z98g8ls1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5c367424-f8f8-4322-aa47-7443f358eee6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-31061921',owner_user_name='tempest-TestMinimumBasicScenario-31061921-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:16:54Z,user_data=None,user_id='9fbbe453781546378e2ba3b6656e4d7b',uuid=55c414d9-4157-42a2-a40b-04907e27620f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ae8763f-7d5e-4b11-879d-135cf5899359", "address": "fa:16:3e:7b:4f:67", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae8763f-7d", "ovs_interfaceid": "2ae8763f-7d5e-4b11-879d-135cf5899359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:17:38.369565 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Converting VIF {"id": "2ae8763f-7d5e-4b11-879d-135cf5899359", "address": "fa:16:3e:7b:4f:67", "network": {"id": "350d0822-2dfe-408f-83f3-80d1f7907146", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1219572236-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "132164e1033644c98f55a442c1bc16d6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae8763f-7d", "ovs_interfaceid": "2ae8763f-7d5e-4b11-879d-135cf5899359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:17:38.370035 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:4f:67,bridge_name='br-int',has_traffic_filtering=True,id=2ae8763f-7d5e-4b11-879d-135cf5899359,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae8763f-7d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:17:38.370266 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:4f:67,bridge_name='br-int',has_traffic_filtering=True,id=2ae8763f-7d5e-4b11-879d-135cf5899359,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae8763f-7d') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:17:38.371235 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:38.371609 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ae8763f-7d, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:17:38.372870 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:38.373636 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:17:38.378095 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:38.378873 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:38.379041 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71078c6a-29a5-4749-b118-7107333e218d) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:17:38.379634 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:38.380137 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:17:38.384054 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:38.385957 np0000001475 nova-compute[98471]: INFO os_vif [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:4f:67,bridge_name='br-int',has_traffic_filtering=True,id=2ae8763f-7d5e-4b11-879d-135cf5899359,network=Network(350d0822-2dfe-408f-83f3-80d1f7907146),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae8763f-7d')
May 27 03:17:38.386219 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Deleting instance files /opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f_del
May 27 03:17:38.386886 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Deletion of /opt/stack/data/nova/instances/55c414d9-4157-42a2-a40b-04907e27620f_del complete
May 27 03:17:38.476837 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Instance destroyed successfully.
May 27 03:17:38.477048 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'numa_topology' on Instance uuid cbca099c-52a9-4d73-a91a-d9685cb310be {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:17:38.891994 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Took 1.36 seconds to destroy the instance on the hypervisor.
May 27 03:17:38.892515 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:17:38.892883 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:17:38.892961 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:17:38.893170 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:17:38.979703 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Object Instance<cbca099c-52a9-4d73-a91a-d9685cb310be> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:17:38.980062 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'resources' on Instance uuid cbca099c-52a9-4d73-a91a-d9685cb310be {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:17:38.985337 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:17:39.481643 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Object Instance<cbca099c-52a9-4d73-a91a-d9685cb310be> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:17:39.482290 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-932025012',display_name='tempest-TestVolumeBootPattern-server-932025012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-932025012',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrODyiD4VhCOJ3tERckx7Bh6Fsg/COsZOnYO1f3ivTbPJBlJq5CAyuysfbSFnYE2CY9gLHg5LCbGvc+4zZov//XJVSGiq/xc3x5mfkk/4QWW2KrO26LCSpJilvOrlpAGQ==',key_name='tempest-keypair-1119925702',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:16:52Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-rc3u78ge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=cbca099c-52a9-4d73-a91a-d9685cb310be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "address": "fa:16:3e:9f:3b:b8", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa65d3-e4", "ovs_interfaceid": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:17:39.482427 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "address": "fa:16:3e:9f:3b:b8", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa65d3-e4", "ovs_interfaceid": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:17:39.482885 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3b:b8,bridge_name='br-int',has_traffic_filtering=True,id=62fa65d3-e430-4df5-aad7-c5c21ddd7968,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa65d3-e4') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:17:39.483067 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3b:b8,bridge_name='br-int',has_traffic_filtering=True,id=62fa65d3-e430-4df5-aad7-c5c21ddd7968,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa65d3-e4') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:17:39.483892 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:39.484142 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62fa65d3-e4, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:17:39.485173 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:39.485984 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:17:39.486508 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:39.486958 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:39.487091 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52e66866-bf4b-4f37-8eda-7c5d8e2d78da) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:17:39.487502 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:39.487934 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:17:39.488235 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:39.489593 np0000001475 nova-compute[98471]: INFO os_vif [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3b:b8,bridge_name='br-int',has_traffic_filtering=True,id=62fa65d3-e430-4df5-aad7-c5c21ddd7968,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa65d3-e4')
May 27 03:17:39.490945 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:17:39.491247 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:17:39.491373 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:17:39.491644 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:17:39.491908 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:17:39.492019 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:17:39.514079 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:39.514079 np0000001475 nova-compute[98471]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:39.514079 np0000001475 nova-compute[98471]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-028382ce-9d0b-48a6-8c10-08b9e440e41f (non-flash)
May 27 03:17:39.514079 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:17:39.514298 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:39.514298 np0000001475 nova-compute[98471]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:39.514298 np0000001475 nova-compute[98471]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-028382ce-9d0b-48a6-8c10-08b9e440e41f (non-flash)
May 27 03:17:39.514298 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:17:39.514298 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-028382ce-9d0b-48a6-8c10-08b9e440e41f', '197')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:17:39.514433 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', '195')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:17:39.515111 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', '194')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:17:39.515753 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c0dc5e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136'): ({'sdf'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:17:39.515924 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Removing multipathed devices sdf, sdg {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:17:39.516108 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flush multipath device 33000000024a033d2 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:17:39.567324 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:17:39.609313 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:17:39.650040 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:17:39.650211 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:17:39.650876 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:17:39.660450 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:17:39.660614 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:17:39.670098 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:39.676645 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:17:39.697860 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 195, target: iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136, portal: 192.168.40.100,3260]
May 27 03:17:39.697860 np0000001475 nova-compute[98471]: Logout of [sid: 195, target: iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136, portal: 192.168.40.100,3260] successful.
May 27 03:17:39.697860 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:39.711925 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:39.724238 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:39.761194 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 194, target: iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136, portal: 192.168.50.100,3260]
May 27 03:17:39.761194 np0000001475 nova-compute[98471]: Logout of [sid: 194, target: iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136, portal: 192.168.50.100,3260] successful.
May 27 03:17:39.761194 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:39.773954 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:39.774207 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:17:39.774357 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== disconnect_volume: return (282ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:17:39.774483 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:17:39.779302 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Start _get_guest_xml network_info=[{"id": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "address": "fa:16:3e:9f:3b:b8", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa65d3-e4", "ovs_interfaceid": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, 'status': 'reserved', 'instance': 'cbca099c-52a9-4d73-a91a-d9685cb310be', 'attached_at': '', 'detached_at': '', 'volume_id': '4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'serial': '4ff3b1d7-f2f3-406e-b5dd-50710c6f5136'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '21566e49-20c8-40a0-98e4-e648566dc72a', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:17:39.781667 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:17:39.782942 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-932025012', uuid='cbca099c-52a9-4d73-a91a-d9685cb310be'), owner=OwnerMeta(userid='8eeaf68cfb534238bfe879dd6e8f858f', username='tempest-TestVolumeBootPattern-360350731-project-member', projectid='bf4b0011da7449e7948bf2c8a41955f5', projectname='tempest-TestVolumeBootPattern-360350731'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "address": "fa:16:3e:9f:3b:b8", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa65d3-e4", "ovs_interfaceid": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851859.782578) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:17:39.784779 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:17:39.785130 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:17:39.787892 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8a213131-dbe0-4b1e-a3e5-8445d4831d11 req-617265cf-b81f-4af7-a0cf-155389a1120e service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received event network-vif-unplugged-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:17:39.788293 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:17:39.788436 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8a213131-dbe0-4b1e-a3e5-8445d4831d11 req-617265cf-b81f-4af7-a0cf-155389a1120e service nova] Acquiring lock "55c414d9-4157-42a2-a40b-04907e27620f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:39.788732 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8a213131-dbe0-4b1e-a3e5-8445d4831d11 req-617265cf-b81f-4af7-a0cf-155389a1120e service nova] Lock "55c414d9-4157-42a2-a40b-04907e27620f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:39.788821 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8a213131-dbe0-4b1e-a3e5-8445d4831d11 req-617265cf-b81f-4af7-a0cf-155389a1120e service nova] Lock "55c414d9-4157-42a2-a40b-04907e27620f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:39.789123 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:17:39.790179 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8a213131-dbe0-4b1e-a3e5-8445d4831d11 req-617265cf-b81f-4af7-a0cf-155389a1120e service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] No waiting events found dispatching network-vif-unplugged-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:17:39.790372 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:17:39.790700 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8a213131-dbe0-4b1e-a3e5-8445d4831d11 req-617265cf-b81f-4af7-a0cf-155389a1120e service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received event network-vif-unplugged-2ae8763f-7d5e-4b11-879d-135cf5899359 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:17:39.791044 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:17:39.791248 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8a213131-dbe0-4b1e-a3e5-8445d4831d11 req-617265cf-b81f-4af7-a0cf-155389a1120e service nova] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Received event network-vif-deleted-2ae8763f-7d5e-4b11-879d-135cf5899359 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:17:39.791458 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:17:39.791592 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:17:39.791750 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:17:39.791876 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:17:39.792016 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:17:39.792198 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:17:39.792348 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:17:39.792487 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:17:39.792626 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:17:39.792804 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:17:39.792976 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'vcpu_model' on Instance uuid cbca099c-52a9-4d73-a91a-d9685cb310be {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:17:40.179905 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Took 1.29 seconds to deallocate network for instance.
May 27 03:17:40.295357 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Object Instance<cbca099c-52a9-4d73-a91a-d9685cb310be> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:17:40.304315 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbca099c-52a9-4d73-a91a-d9685cb310be/disk.config --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:17:40.398427 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbca099c-52a9-4d73-a91a-d9685cb310be/disk.config --force-share --output=json" returned: 0 in 0.094s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:17:40.398875 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "/opt/stack/data/nova/instances/cbca099c-52a9-4d73-a91a-d9685cb310be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:40.399113 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "/opt/stack/data/nova/instances/cbca099c-52a9-4d73-a91a-d9685cb310be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:40.399682 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "/opt/stack/data/nova/instances/cbca099c-52a9-4d73-a91a-d9685cb310be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:40.400098 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:17:40.400489 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:17:40.400627 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:17:40.400947 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:17:40.401144 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:17:40.412268 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:17:40.412664 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:17:40.414125 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:17:40.414339 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:17:40.414737 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:17:40.415013 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:17:40.425580 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:17:40.425580 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:40.430340 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:17:40.430340 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:40.443337 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136] added
May 27 03:17:40.443337 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:17:40.443337 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:17:40.443337 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:17:40.443337 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:17:40.443337 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:17:40.443337 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:40.443547 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:17:40.443658 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:17:40.443827 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:17:40.447008 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136] added
May 27 03:17:40.447008 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:17:40.447008 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:17:40.447008 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:17:40.447008 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:17:40.447008 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:17:40.447008 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:40.447277 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:17:40.447452 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0331(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:17:40.447627 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:17:40.687809 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:40.687976 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:40.816658 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:17:40.816893 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:17:41.319701 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:17:41.444209 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:17:41.447997 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:17:41.455802 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:17:41.455802 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:17:41.460450 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:17:41.460450 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:41.465985 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:41.471753 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:41.477244 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-028382ce-9d0b-48a6-8c10-08b9e440e41f (non-flash)
May 27 03:17:41.477244 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:17:41.477373 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-028382ce-9d0b-48a6-8c10-08b9e440e41f (non-flash)
May 27 03:17:41.477373 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:17:41.482096 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-028382ce-9d0b-48a6-8c10-08b9e440e41f (non-flash)
May 27 03:17:41.482096 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:17:41.482203 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-028382ce-9d0b-48a6-8c10-08b9e440e41f (non-flash)
May 27 03:17:41.482203 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:17:41.500030 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136, portal: 192.168.40.100,3260]
May 27 03:17:41.500030 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136, portal: 192.168.40.100,3260] successful.
May 27 03:17:41.500030 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:41.511132 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:41.515387 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136, portal: 192.168.50.100,3260]
May 27 03:17:41.515387 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136, portal: 192.168.50.100,3260] successful.
May 27 03:17:41.515387 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:41.523499 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-028382ce-9d0b-48a6-8c10-08b9e440e41f (non-flash)
May 27 03:17:41.523499 np0000001475 nova-compute[98471]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:41.523499 np0000001475 nova-compute[98471]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:41.523499 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:17:41.523671 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-028382ce-9d0b-48a6-8c10-08b9e440e41f (non-flash)
May 27 03:17:41.523671 np0000001475 nova-compute[98471]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:41.523671 np0000001475 nova-compute[98471]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:41.523671 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:17:41.523850 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.109s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:17:41.523952 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:17:41.524490 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('8', '-', '-', 0) found on session 198 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:17:41.524586 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:17:41.528560 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:41.536666 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 198 and hctl ['8', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:17:41.543258 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-028382ce-9d0b-48a6-8c10-08b9e440e41f (non-flash)
May 27 03:17:41.543258 np0000001475 nova-compute[98471]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:41.543258 np0000001475 nova-compute[98471]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:41.543258 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:17:41.543445 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-028382ce-9d0b-48a6-8c10-08b9e440e41f (non-flash)
May 27 03:17:41.543445 np0000001475 nova-compute[98471]: tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:41.543445 np0000001475 nova-compute[98471]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:41.543445 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:17:41.543607 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:17:41.544144 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:17:41.544280 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('9', '-', '-', 0) found on session 199 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:17:41.544394 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:17:41.557983 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 199 and hctl ['9', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:17:41.825605 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.137s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:41.874414 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Deleted allocations for instance 55c414d9-4157-42a2-a40b-04907e27620f
May 27 03:17:42.537357 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 198 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:17:42.537809 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:17:42.555361 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 199 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:17:42.555493 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:17:42.883636 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-36368e83-aa7f-4fea-a3c9-c51d2bac2bea tempest-TestMinimumBasicScenario-31061921 tempest-TestMinimumBasicScenario-31061921-project-member] Lock "55c414d9-4157-42a2-a40b-04907e27620f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.854s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:43.415394 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:17:44.431103 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Found WWN 33000000024a033d2 for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:17:44.432109 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.031s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:17:44.432439 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== connect_volume: return (4031ms) {'type': 'block', 'scsi_wwn': '33000000024a033d2', 'path': '/dev/dm-0', 'multipath_id': '33000000024a033d2'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:17:44.432648 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000024a033d2', 'path': '/dev/dm-0', 'multipath_id': '33000000024a033d2'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:17:44.487817 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:44.939883 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-932025012',display_name='tempest-TestVolumeBootPattern-server-932025012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-932025012',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrODyiD4VhCOJ3tERckx7Bh6Fsg/COsZOnYO1f3ivTbPJBlJq5CAyuysfbSFnYE2CY9gLHg5LCbGvc+4zZov//XJVSGiq/xc3x5mfkk/4QWW2KrO26LCSpJilvOrlpAGQ==',key_name='tempest-keypair-1119925702',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:16:52Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-rc3u78ge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=cbca099c-52a9-4d73-a91a-d9685cb310be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "address": "fa:16:3e:9f:3b:b8", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa65d3-e4", "ovs_interfaceid": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:17:44.940148 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "address": "fa:16:3e:9f:3b:b8", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa65d3-e4", "ovs_interfaceid": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:17:44.941123 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3b:b8,bridge_name='br-int',has_traffic_filtering=True,id=62fa65d3-e430-4df5-aad7-c5c21ddd7968,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa65d3-e4') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:17:44.942069 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'pci_devices' on Instance uuid cbca099c-52a9-4d73-a91a-d9685cb310be {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:17:45.062904 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:45.445024 np0000001475 nova-compute[98471]: DEBUG nova.objects.base [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Object Instance<cbca099c-52a9-4d73-a91a-d9685cb310be> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98471) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 27 03:17:45.446000 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] End _get_guest_xml xml=<domain type="qemu">
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:   <uuid>cbca099c-52a9-4d73-a91a-d9685cb310be</uuid>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:   <name>instance-0000004a</name>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestVolumeBootPattern-server-932025012</nova:name>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:17:39</nova:creationTime>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:         <nova:user uuid="8eeaf68cfb534238bfe879dd6e8f858f">tempest-TestVolumeBootPattern-360350731-project-member</nova:user>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:         <nova:project uuid="bf4b0011da7449e7948bf2c8a41955f5">tempest-TestVolumeBootPattern-360350731</nova:project>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:         <nova:port uuid="62fa65d3-e430-4df5-aad7-c5c21ddd7968">
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     <system>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <entry name="serial">cbca099c-52a9-4d73-a91a-d9685cb310be</entry>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <entry name="uuid">cbca099c-52a9-4d73-a91a-d9685cb310be</entry>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     </system>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:   <os>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:   </os>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:   <features>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:   </features>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:   <devices>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/cbca099c-52a9-4d73-a91a-d9685cb310be/disk.config"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     </disk>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <alias name="ua-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-0"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <serial>4ff3b1d7-f2f3-406e-b5dd-50710c6f5136</serial>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     </disk>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:9f:3b:b8"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <target dev="tap62fa65d3-e4"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     </interface>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/cbca099c-52a9-4d73-a91a-d9685cb310be/console.log" append="off"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     </serial>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     <video>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     </video>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     </rng>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:   </devices>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]: </domain>
May 27 03:17:45.446000 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:17:45.449283 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:17:45.449283 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-932025012',display_name='tempest-TestVolumeBootPattern-server-932025012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-932025012',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrODyiD4VhCOJ3tERckx7Bh6Fsg/COsZOnYO1f3ivTbPJBlJq5CAyuysfbSFnYE2CY9gLHg5LCbGvc+4zZov//XJVSGiq/xc3x5mfkk/4QWW2KrO26LCSpJilvOrlpAGQ==',key_name='tempest-keypair-1119925702',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:16:52Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-rc3u78ge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=cbca099c-52a9-4d73-a91a-d9685cb310be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "address": "fa:16:3e:9f:3b:b8", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa65d3-e4", "ovs_interfaceid": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:17:45.449283 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "address": "fa:16:3e:9f:3b:b8", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa65d3-e4", "ovs_interfaceid": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:17:45.449283 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3b:b8,bridge_name='br-int',has_traffic_filtering=True,id=62fa65d3-e430-4df5-aad7-c5c21ddd7968,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa65d3-e4') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:17:45.449283 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3b:b8,bridge_name='br-int',has_traffic_filtering=True,id=62fa65d3-e430-4df5-aad7-c5c21ddd7968,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa65d3-e4') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:17:45.449283 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:45.450971 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:17:45.452886 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:17:45.453472 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:45.454964 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd5f8c42-3a6d-5edb-879b-5a574a9aae39', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:17:45.462844 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:17:45.467230 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:45.467403 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62fa65d3-e4, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:17:45.467707 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62fa65d3-e4, col_values=(('qos', UUID('1286610d-c7b6-468e-8108-d6288ff6bba6')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:17:45.467890 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62fa65d3-e4, col_values=(('external_ids', {'iface-id': '62fa65d3-e430-4df5-aad7-c5c21ddd7968', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:3b:b8', 'vm-uuid': 'cbca099c-52a9-4d73-a91a-d9685cb310be'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:17:45.468851 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:45.469932 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:17:45.474179 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:45.474952 np0000001475 nova-compute[98471]: INFO os_vif [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3b:b8,bridge_name='br-int',has_traffic_filtering=True,id=62fa65d3-e430-4df5-aad7-c5c21ddd7968,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa65d3-e4')
May 27 03:17:45.861224 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:45.881073 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:45.882804 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:45.971763 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:46.030454 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c00ef5f4-fa47-451d-bcae-ae3d8fd1a2a6 req-3e7ae366-62a0-406a-b87a-3774c40e12d3 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Received event network-vif-plugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:17:46.030650 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c00ef5f4-fa47-451d-bcae-ae3d8fd1a2a6 req-3e7ae366-62a0-406a-b87a-3774c40e12d3 service nova] Acquiring lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:46.030850 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c00ef5f4-fa47-451d-bcae-ae3d8fd1a2a6 req-3e7ae366-62a0-406a-b87a-3774c40e12d3 service nova] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:46.030994 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c00ef5f4-fa47-451d-bcae-ae3d8fd1a2a6 req-3e7ae366-62a0-406a-b87a-3774c40e12d3 service nova] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:46.031084 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c00ef5f4-fa47-451d-bcae-ae3d8fd1a2a6 req-3e7ae366-62a0-406a-b87a-3774c40e12d3 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] No waiting events found dispatching network-vif-plugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:17:46.031215 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-c00ef5f4-fa47-451d-bcae-ae3d8fd1a2a6 req-3e7ae366-62a0-406a-b87a-3774c40e12d3 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Received unexpected event network-vif-plugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 for instance with vm_state stopped and task_state powering-on.
May 27 03:17:46.230900 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:46.232309 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:46.233841 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:46.235266 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:46.252506 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:46.584866 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Removed pending STOPPED event for cbca099c-52a9-4d73-a91a-d9685cb310be due to new event <LifecycleEvent: 1779851866.5844145, cbca099c-52a9-4d73-a91a-d9685cb310be => Resumed> {{(pid=98471) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 27 03:17:46.585296 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851866.5844145, cbca099c-52a9-4d73-a91a-d9685cb310be => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:17:46.585296 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] VM Resumed (Lifecycle Event)
May 27 03:17:46.586865 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Instance event wait completed in 0 seconds for  {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:17:46.589393 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Instance rebooted successfully.
May 27 03:17:46.806475 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:46.807942 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:47.089037 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:17:47.091703 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:17:47.596692 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] During sync_power_state the instance has a pending task (powering-on). Skip.
May 27 03:17:47.597206 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851867.5968237, cbca099c-52a9-4d73-a91a-d9685cb310be => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:17:47.597206 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] VM Started (Lifecycle Event)
May 27 03:17:47.603955 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0023538650002592476 future=<Future at 0x75572461c8c0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:17:47.605056 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:17:47.605709 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=5.255854249000095 future=<Future at 0x7557047cb440 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:17:47.610365 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=5.2511947289999625 future=<Future at 0x7557047cb440 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:17:48.096927 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-715caf55-5fd7-46e0-9e60-74535b5f916f req-d92d30dc-aebf-4d8d-aaa5-17e75f1ed96b service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Received event network-vif-plugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:17:48.097173 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-715caf55-5fd7-46e0-9e60-74535b5f916f req-d92d30dc-aebf-4d8d-aaa5-17e75f1ed96b service nova] Acquiring lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:48.097296 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-715caf55-5fd7-46e0-9e60-74535b5f916f req-d92d30dc-aebf-4d8d-aaa5-17e75f1ed96b service nova] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:48.097442 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-715caf55-5fd7-46e0-9e60-74535b5f916f req-d92d30dc-aebf-4d8d-aaa5-17e75f1ed96b service nova] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:48.097543 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-715caf55-5fd7-46e0-9e60-74535b5f916f req-d92d30dc-aebf-4d8d-aaa5-17e75f1ed96b service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] No waiting events found dispatching network-vif-plugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:17:48.097704 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-715caf55-5fd7-46e0-9e60-74535b5f916f req-d92d30dc-aebf-4d8d-aaa5-17e75f1ed96b service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Received unexpected event network-vif-plugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 for instance with vm_state stopped and task_state powering-on.
May 27 03:17:48.103933 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:17:48.107730 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:17:48.120435 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:17:48.120435 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:17:48.120435 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No VIF found with MAC fa:16:3e:9f:3b:b8, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:17:48.120435 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-d5793688-d2e4-45ce-b0e6-66e2fc59a78e tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:17:48.611395 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] During sync_power_state the instance has a pending task (powering-on). Skip.
May 27 03:17:48.974175 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-1cfe58f3-016f-4d49-b23d-5b56ab894cb4 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Get console output
May 27 03:17:48.977214 np0000001475 nova-compute[98471]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 27 03:17:50.469277 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:51.144094 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "cbca099c-52a9-4d73-a91a-d9685cb310be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:51.144263 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:51.144417 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:51.144579 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:51.144730 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:51.146626 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Terminating instance
May 27 03:17:51.649557 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:17:51.669468 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:51.673080 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:51.688658 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:51.692618 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:51.717610 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:51.856508 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8759b47b-fec2-4612-8dea-4aa8724d4889 req-33e186d3-bde4-4d28-a557-3d1d002fd18e service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Received event network-vif-unplugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:17:51.856713 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8759b47b-fec2-4612-8dea-4aa8724d4889 req-33e186d3-bde4-4d28-a557-3d1d002fd18e service nova] Acquiring lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:51.856954 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8759b47b-fec2-4612-8dea-4aa8724d4889 req-33e186d3-bde4-4d28-a557-3d1d002fd18e service nova] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:51.857182 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-8759b47b-fec2-4612-8dea-4aa8724d4889 req-33e186d3-bde4-4d28-a557-3d1d002fd18e service nova] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:51.857332 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8759b47b-fec2-4612-8dea-4aa8724d4889 req-33e186d3-bde4-4d28-a557-3d1d002fd18e service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] No waiting events found dispatching network-vif-unplugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:17:51.857522 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-8759b47b-fec2-4612-8dea-4aa8724d4889 req-33e186d3-bde4-4d28-a557-3d1d002fd18e service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Received event network-vif-unplugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:17:51.966515 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:51.973710 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:51.999129 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999677923000036 future=<Future at 0x7557241dc890 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:17:52.000798 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Instance destroyed successfully.
May 27 03:17:52.001357 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'resources' on Instance uuid cbca099c-52a9-4d73-a91a-d9685cb310be {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:17:52.504474 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-932025012',display_name='tempest-TestVolumeBootPattern-server-932025012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-932025012',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrODyiD4VhCOJ3tERckx7Bh6Fsg/COsZOnYO1f3ivTbPJBlJq5CAyuysfbSFnYE2CY9gLHg5LCbGvc+4zZov//XJVSGiq/xc3x5mfkk/4QWW2KrO26LCSpJilvOrlpAGQ==',key_name='tempest-keypair-1119925702',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:16:52Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-rc3u78ge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:17:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=cbca099c-52a9-4d73-a91a-d9685cb310be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "address": "fa:16:3e:9f:3b:b8", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa65d3-e4", "ovs_interfaceid": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:17:52.504663 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "address": "fa:16:3e:9f:3b:b8", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap62fa65d3-e4", "ovs_interfaceid": "62fa65d3-e430-4df5-aad7-c5c21ddd7968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:17:52.505340 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3b:b8,bridge_name='br-int',has_traffic_filtering=True,id=62fa65d3-e430-4df5-aad7-c5c21ddd7968,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa65d3-e4') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:17:52.505625 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3b:b8,bridge_name='br-int',has_traffic_filtering=True,id=62fa65d3-e430-4df5-aad7-c5c21ddd7968,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa65d3-e4') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:17:52.507200 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:52.507482 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62fa65d3-e4, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:17:52.508851 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:52.509928 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:17:52.510324 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:52.510462 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1286610d-c7b6-468e-8108-d6288ff6bba6) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:17:52.510842 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:52.511873 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:17:52.513849 np0000001475 nova-compute[98471]: INFO os_vif [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3b:b8,bridge_name='br-int',has_traffic_filtering=True,id=62fa65d3-e430-4df5-aad7-c5c21ddd7968,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62fa65d3-e4')
May 27 03:17:52.518678 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:17:52.518678 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:17:52.518678 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:17:52.518678 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:17:52.519296 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:17:52.519510 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:17:52.544267 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:52.544267 np0000001475 nova-compute[98471]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:52.544267 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:17:52.544445 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [198] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:52.544445 np0000001475 nova-compute[98471]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136 (non-flash)
May 27 03:17:52.544445 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:17:52.544542 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', '199')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:17:52.544920 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', '198')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:17:52.545356 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136', '199')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:17:52.545852 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7557046f28e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136'): ({'sdd'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:17:52.546083 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Removing multipathed devices sdc, sdd {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:17:52.546207 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flush multipath device 33000000024a033d2 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:17:52.608274 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:17:52.664479 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:17:52.707086 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:17:52.707324 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:17:52.708171 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:17:52.719027 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:17:52.719360 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:17:52.732145 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:52.764020 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 198, target: iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136, portal: 192.168.40.100,3260]
May 27 03:17:52.764020 np0000001475 nova-compute[98471]: Logout of [sid: 198, target: iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136, portal: 192.168.40.100,3260] successful.
May 27 03:17:52.764020 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:52.776910 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:52.787997 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:52.817724 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 199, target: iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136, portal: 192.168.50.100,3260]
May 27 03:17:52.817724 np0000001475 nova-compute[98471]: Logout of [sid: 199, target: iqn.2023-03.storpool.com:os--volume-4ff3b1d7-f2f3-406e-b5dd-50710c6f5136, portal: 192.168.50.100,3260] successful.
May 27 03:17:52.817724 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:52.829186 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:17:52.829544 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:17:52.829839 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== disconnect_volume: return (311ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:17:52.829946 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:17:52.830317 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Deleting instance files /opt/stack/data/nova/instances/cbca099c-52a9-4d73-a91a-d9685cb310be_del
May 27 03:17:52.831161 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Deletion of /opt/stack/data/nova/instances/cbca099c-52a9-4d73-a91a-d9685cb310be_del complete
May 27 03:17:52.861955 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.00036096099984206376 future=<Future at 0x7557047cb440 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:17:52.862595 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] Emitting event <LifecycleEvent: 1779851857.8614984, 55c414d9-4157-42a2-a40b-04907e27620f => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:17:52.862818 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:17:52.863048 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] VM Stopped (Lifecycle Event)
May 27 03:17:52.863999 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.134775808000086 future=<Future at 0x7557241dc890 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:17:52.864226 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.134640737000154 future=<Future at 0x7557241dc890 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:17:53.336991 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Took 1.69 seconds to destroy the instance on the hypervisor.
May 27 03:17:53.337603 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:17:53.337921 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:17:53.338046 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:17:53.338314 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:17:53.367392 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c156f0ad-9932-4ed1-8027-0ef2bcfbd98f tempest-TestEncryptedCinderVolumes-913342494 tempest-TestEncryptedCinderVolumes-913342494-project-member] [instance: 55c414d9-4157-42a2-a40b-04907e27620f] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:17:53.395557 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:17:53.746026 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:53.819020 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-60882855-2972-44f0-a2d9-e378dccfd948 req-9c2c265c-c488-4f50-9d10-2e83be308cf0 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Received event network-vif-deleted-62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:17:53.819491 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-60882855-2972-44f0-a2d9-e378dccfd948 req-9c2c265c-c488-4f50-9d10-2e83be308cf0 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Neutron deleted interface 62fa65d3-e430-4df5-aad7-c5c21ddd7968; detaching it from the instance and deleting it from the info cache
May 27 03:17:53.819842 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-60882855-2972-44f0-a2d9-e378dccfd948 req-9c2c265c-c488-4f50-9d10-2e83be308cf0 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:17:53.908367 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0834a8a0-470b-428e-8061-62ff2cfe7cf7 req-30af4c7f-c3ae-4589-a96a-f847408e8dca service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Received event network-vif-unplugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:17:53.908847 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0834a8a0-470b-428e-8061-62ff2cfe7cf7 req-30af4c7f-c3ae-4589-a96a-f847408e8dca service nova] Acquiring lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:53.909008 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0834a8a0-470b-428e-8061-62ff2cfe7cf7 req-30af4c7f-c3ae-4589-a96a-f847408e8dca service nova] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:53.909123 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0834a8a0-470b-428e-8061-62ff2cfe7cf7 req-30af4c7f-c3ae-4589-a96a-f847408e8dca service nova] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:53.909269 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0834a8a0-470b-428e-8061-62ff2cfe7cf7 req-30af4c7f-c3ae-4589-a96a-f847408e8dca service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] No waiting events found dispatching network-vif-unplugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:17:53.909385 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0834a8a0-470b-428e-8061-62ff2cfe7cf7 req-30af4c7f-c3ae-4589-a96a-f847408e8dca service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Received event network-vif-unplugged-62fa65d3-e430-4df5-aad7-c5c21ddd7968 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:17:54.278576 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:17:54.323420 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-60882855-2972-44f0-a2d9-e378dccfd948 req-9c2c265c-c488-4f50-9d10-2e83be308cf0 service nova] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Detach interface failed, port_id=62fa65d3-e430-4df5-aad7-c5c21ddd7968, reason: Instance cbca099c-52a9-4d73-a91a-d9685cb310be could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:17:54.780570 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Took 1.44 seconds to deallocate network for instance.
May 27 03:17:55.323994 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Took 0.54 seconds to detach 1 volumes for instance.
May 27 03:17:55.367450 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:17:55.367646 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:17:55.367863 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:17:55.367975 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:17:55.368220 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.83 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:17:55.830454 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:17:55.830897 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:17:55.914392 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:17:55.914578 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:17:56.417490 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:17:56.923230 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.092s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:56.976174 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Deleted allocations for instance cbca099c-52a9-4d73-a91a-d9685cb310be
May 27 03:17:57.196631 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:17:57.196925 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:17:57.199303 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:17:57.199499 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:17:57.199712 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:17:57.511396 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:17:57.984163 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-6a742161-35da-4a8b-8837-b20ce7ce5ca7 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "cbca099c-52a9-4d73-a91a-d9685cb310be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.840s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:17:59.199533 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:17:59.200254 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 11.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:18:00.494799 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:02.512293 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:02.844778 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "f4a87215-c1ff-43cb-92f3-112e4526a393" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:02.844954 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "f4a87215-c1ff-43cb-92f3-112e4526a393" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:03.346724 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:18:03.608824 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:03.889975 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:03.890165 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:03.893278 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:18:03.893449 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Claim successful on node np0000001475
May 27 03:18:04.990697 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:18:04.991159 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:18:05.494627 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:18:05.540121 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:06.000132 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.110s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:06.000585 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:18:06.505978 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:18:06.506236 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:18:06.506828 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:06.507140 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:06.603467 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8eeaf68cfb534238bfe879dd6e8f858f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0011da7449e7948bf2c8a41955f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:18:06.808262 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:06.999289 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0004897519997939526 future=<Future at 0x7557241dc890 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:18:06.999587 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] Emitting event <LifecycleEvent: 1779851871.9986753, cbca099c-52a9-4d73-a91a-d9685cb310be => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:18:06.999707 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:18:06.999844 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] VM Stopped (Lifecycle Event)
May 27 03:18:07.007189 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:18:07.054554 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Successfully created port: 71fc9457-54c8-46d0-a9b6-f845805ab623 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:18:07.502193 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-21b9445a-60c0-46a1-83e3-19427330b281 tempest-VolumesBackupsTest-1801307276 tempest-VolumesBackupsTest-1801307276-project-member] [instance: cbca099c-52a9-4d73-a91a-d9685cb310be] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:18:07.511646 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:18:07.518268 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:07.543261 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Successfully updated port: 71fc9457-54c8-46d0-a9b6-f845805ab623 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:18:07.696726 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ec2216c3-0a8c-4e3f-aadc-642c70e98d68 req-37160342-a6e5-46ec-9796-7a9c98aa0be3 service nova] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Received event network-changed-71fc9457-54c8-46d0-a9b6-f845805ab623 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:18:07.697223 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-ec2216c3-0a8c-4e3f-aadc-642c70e98d68 req-37160342-a6e5-46ec-9796-7a9c98aa0be3 service nova] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Refreshing instance network info cache due to event network-changed-71fc9457-54c8-46d0-a9b6-f845805ab623. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:18:07.697423 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ec2216c3-0a8c-4e3f-aadc-642c70e98d68 req-37160342-a6e5-46ec-9796-7a9c98aa0be3 service nova] Acquiring lock "refresh_cache-f4a87215-c1ff-43cb-92f3-112e4526a393" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:18:07.697566 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ec2216c3-0a8c-4e3f-aadc-642c70e98d68 req-37160342-a6e5-46ec-9796-7a9c98aa0be3 service nova] Acquired lock "refresh_cache-f4a87215-c1ff-43cb-92f3-112e4526a393" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:18:07.697712 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ec2216c3-0a8c-4e3f-aadc-642c70e98d68 req-37160342-a6e5-46ec-9796-7a9c98aa0be3 service nova] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Refreshing network info cache for port 71fc9457-54c8-46d0-a9b6-f845805ab623 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:18:08.022051 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Booting with volume snapshot 9b7c8827-ffbf-403f-bb55-d03e2c2fe64d at /dev/vda
May 27 03:18:08.036047 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:08.047330 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "refresh_cache-f4a87215-c1ff-43cb-92f3-112e4526a393" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:18:08.199942 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-ec2216c3-0a8c-4e3f-aadc-642c70e98d68 req-37160342-a6e5-46ec-9796-7a9c98aa0be3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:08.253944 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ec2216c3-0a8c-4e3f-aadc-642c70e98d68 req-37160342-a6e5-46ec-9796-7a9c98aa0be3 service nova] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:18:08.397056 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-ec2216c3-0a8c-4e3f-aadc-642c70e98d68 req-37160342-a6e5-46ec-9796-7a9c98aa0be3 service nova] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:18:08.900688 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-ec2216c3-0a8c-4e3f-aadc-642c70e98d68 req-37160342-a6e5-46ec-9796-7a9c98aa0be3 service nova] Releasing lock "refresh_cache-f4a87215-c1ff-43cb-92f3-112e4526a393" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:18:08.901086 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquired lock "refresh_cache-f4a87215-c1ff-43cb-92f3-112e4526a393" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:18:08.901260 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:18:09.473862 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:18:09.620858 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:09.797368 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Updating instance_info_cache with network_info: [{"id": "71fc9457-54c8-46d0-a9b6-f845805ab623", "address": "fa:16:3e:ee:68:82", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fc9457-54", "ovs_interfaceid": "71fc9457-54c8-46d0-a9b6-f845805ab623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:18:10.199656 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:18:10.300250 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Releasing lock "refresh_cache-f4a87215-c1ff-43cb-92f3-112e4526a393" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:18:10.300607 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Instance network_info: |[{"id": "71fc9457-54c8-46d0-a9b6-f845805ab623", "address": "fa:16:3e:ee:68:82", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fc9457-54", "ovs_interfaceid": "71fc9457-54c8-46d0-a9b6-f845805ab623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:18:10.415862 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:10.703460 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:10.703930 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:10.703930 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:10.703930 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:18:10.715898 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:18:10.716680 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:18:10.764338 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:18:10.764843 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=13824MB free_disk=72.64623260498047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:18:10.765054 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:10.765304 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:11.483564 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:18:11.493399 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:18:11.514518 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:18:11.558067 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:18:11.558469 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:18:11.566751 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:18:11.567560 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148'] 
May 27 03:18:11.567692 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:18:11.567842 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:18:11.568086 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:18:11.568289 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Updating existing volume attachment record: 6bbddd5b-6683-41f5-b2cd-644eadf60b61 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:18:11.810691 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:11.826702 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance f4a87215-c1ff-43cb-92f3-112e4526a393 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:18:11.827157 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:18:11.827267 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:18:10 up 49 min,  2 users,  load average: 2.63, 3.99, 4.60\n', 'num_instances': '1', 'num_vm_building': '1', 'num_task_block_device_mapping': '1', 'num_os_type_None': '1', 'num_proj_bf4b0011da7449e7948bf2c8a41955f5': '1', 'io_workload': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:18:11.937805 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:18:11.938158 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:18:12.441521 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:18:12.519928 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:12.951191 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:18:12.951680 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.186s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:12.951850 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:18:13.670070 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:18:13.671303 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:18:13.671580 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Creating image(s)
May 27 03:18:13.671926 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:18:13.672099 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Ensure instance console log exists: /opt/stack/data/nova/instances/f4a87215-c1ff-43cb-92f3-112e4526a393/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:18:13.672366 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:13.672586 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:13.672751 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:13.673346 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Start _get_guest_xml network_info=[{"id": "71fc9457-54c8-46d0-a9b6-f845805ab623", "address": "fa:16:3e:ee:68:82", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fc9457-54", "ovs_interfaceid": "71fc9457-54c8-46d0-a9b6-f845805ab623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec', 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97c161db-b1ac-4e96-9b81-babde67118ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f4a87215-c1ff-43cb-92f3-112e4526a393', 'attached_at': '', 'detached_at': '', 'volume_id': '97c161db-b1ac-4e96-9b81-babde67118ec', 'serial': '97c161db-b1ac-4e96-9b81-babde67118ec'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '6bbddd5b-6683-41f5-b2cd-644eadf60b61', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:18:13.675700 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:18:13.677029 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1280021294', uuid='f4a87215-c1ff-43cb-92f3-112e4526a393'), owner=OwnerMeta(userid='8eeaf68cfb534238bfe879dd6e8f858f', username='tempest-TestVolumeBootPattern-360350731-project-member', projectid='bf4b0011da7449e7948bf2c8a41955f5', projectname='tempest-TestVolumeBootPattern-360350731'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "71fc9457-54c8-46d0-a9b6-f845805ab623", "address": "fa:16:3e:ee:68:82", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fc9457-54", "ovs_interfaceid": "71fc9457-54c8-46d0-a9b6-f845805ab623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851893.6766427) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:18:13.678108 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:18:13.678436 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:18:13.679398 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:18:13.679582 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:18:13.680597 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:18:13.680946 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:18:13.681153 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:18:13.681283 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:18:13.681449 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:18:13.681592 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:18:13.681695 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:18:13.681918 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:18:13.682062 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:18:13.682207 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:18:13.682345 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:18:13.682513 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:18:13.694980 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:18:13.695629 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec', 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97c161db-b1ac-4e96-9b81-babde67118ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:18:13.695629 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:18:13.695793 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:18:13.695939 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec', 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97c161db-b1ac-4e96-9b81-babde67118ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:18:13.706139 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:18:13.706587 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:18:13.707016 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:18:13.707166 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:18:13.707439 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:18:13.707631 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:18:13.716899 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:18:13.716899 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:13.721693 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:18:13.721693 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:13.732386 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec] added
May 27 03:18:13.732386 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:18:13.732386 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:18:13.732386 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:18:13.732386 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:18:13.732386 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:18:13.732386 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:13.732702 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:18:13.732772 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0255(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:18:13.732919 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:18:13.736479 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec] added
May 27 03:18:13.736479 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:18:13.736479 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:18:13.736479 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:18:13.736479 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:18:13.736479 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:18:13.736479 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:13.736758 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:18:13.736813 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:18:13.736944 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:18:13.938612 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "6b89f301-37fb-43a6-9bef-bca32191186e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:13.939705 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:14.442530 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:18:14.733325 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:18:14.737276 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:18:14.744803 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:18:14.744803 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:18:14.750177 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:18:14.750177 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:14.757192 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:14.763078 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:14.769608 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f7c0ff7-af21-4464-b9c1-e6c5aadc08f2 (non-flash)
May 27 03:18:14.769608 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:18:14.769732 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f7c0ff7-af21-4464-b9c1-e6c5aadc08f2 (non-flash)
May 27 03:18:14.769732 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:18:14.774861 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f7c0ff7-af21-4464-b9c1-e6c5aadc08f2 (non-flash)
May 27 03:18:14.774861 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:18:14.774962 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f7c0ff7-af21-4464-b9c1-e6c5aadc08f2 (non-flash)
May 27 03:18:14.774962 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:18:14.797163 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec, portal: 192.168.40.100,3260]
May 27 03:18:14.797163 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec, portal: 192.168.40.100,3260] successful.
May 27 03:18:14.797163 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:14.808041 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:14.820182 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec, portal: 192.168.50.100,3260]
May 27 03:18:14.820182 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec, portal: 192.168.50.100,3260] successful.
May 27 03:18:14.820182 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:14.820766 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f7c0ff7-af21-4464-b9c1-e6c5aadc08f2 (non-flash)
May 27 03:18:14.820766 np0000001475 nova-compute[98471]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec (non-flash)
May 27 03:18:14.820766 np0000001475 nova-compute[98471]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec (non-flash)
May 27 03:18:14.820766 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:18:14.820891 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f7c0ff7-af21-4464-b9c1-e6c5aadc08f2 (non-flash)
May 27 03:18:14.820891 np0000001475 nova-compute[98471]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec (non-flash)
May 27 03:18:14.820891 np0000001475 nova-compute[98471]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec (non-flash)
May 27 03:18:14.820891 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:18:14.823105 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.114s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:18:14.823105 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:18:14.823105 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('8', '-', '-', 0) found on session 203 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:18:14.823105 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:18:14.831692 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:14.839520 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 203 and hctl ['8', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:18:14.846627 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f7c0ff7-af21-4464-b9c1-e6c5aadc08f2 (non-flash)
May 27 03:18:14.846627 np0000001475 nova-compute[98471]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec (non-flash)
May 27 03:18:14.846627 np0000001475 nova-compute[98471]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec (non-flash)
May 27 03:18:14.846627 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:18:14.846767 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4f7c0ff7-af21-4464-b9c1-e6c5aadc08f2 (non-flash)
May 27 03:18:14.846767 np0000001475 nova-compute[98471]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec (non-flash)
May 27 03:18:14.846767 np0000001475 nova-compute[98471]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec (non-flash)
May 27 03:18:14.846767 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:18:14.846996 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:18:14.847090 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:18:14.847557 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('9', '-', '-', 0) found on session 204 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:18:14.847649 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:18:14.861793 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 204 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:18:14.861793 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '97c161db-b1ac-4e96-9b81-babde67118ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:18:15.007885 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:15.008199 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:15.012678 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:18:15.012961 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Claim successful on node np0000001475
May 27 03:18:15.840129 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 203 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:18:15.840620 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97c161db-b1ac-4e96-9b81-babde67118ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:18:16.148379 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:18:16.148556 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:18:16.654676 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:18:16.722695 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Found WWN 3300000003d04d275 for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:18:16.722974 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.027s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:18:16.723131 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== connect_volume: return (3027ms) {'type': 'block', 'scsi_wwn': '3300000003d04d275', 'path': '/dev/dm-0', 'multipath_id': '3300000003d04d275'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:18:16.723241 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003d04d275', 'path': '/dev/dm-0', 'multipath_id': '3300000003d04d275'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:18:16.811761 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:17.176699 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.165s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:17.180912 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:18:17.228392 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:18:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1280021294',display_name='tempest-TestVolumeBootPattern-server-1280021294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-1280021294',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-lz3vq36i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:18:08Z,user_data=None,user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=f4a87215-c1ff-43cb-92f3-112e4526a393,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71fc9457-54c8-46d0-a9b6-f845805ab623", "address": "fa:16:3e:ee:68:82", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fc9457-54", "ovs_interfaceid": "71fc9457-54c8-46d0-a9b6-f845805ab623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:18:17.228603 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "71fc9457-54c8-46d0-a9b6-f845805ab623", "address": "fa:16:3e:ee:68:82", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fc9457-54", "ovs_interfaceid": "71fc9457-54c8-46d0-a9b6-f845805ab623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:18:17.229349 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:68:82,bridge_name='br-int',has_traffic_filtering=True,id=71fc9457-54c8-46d0-a9b6-f845805ab623,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fc9457-54') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:18:17.230080 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'pci_devices' on Instance uuid f4a87215-c1ff-43cb-92f3-112e4526a393 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:18:17.521061 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:17.694105 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:18:17.694371 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:18:17.694783 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:17.695164 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:17.733464 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] End _get_guest_xml xml=<domain type="qemu">
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:   <uuid>f4a87215-c1ff-43cb-92f3-112e4526a393</uuid>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:   <name>instance-0000004b</name>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestVolumeBootPattern-server-1280021294</nova:name>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:18:13</nova:creationTime>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:         <nova:user uuid="8eeaf68cfb534238bfe879dd6e8f858f">tempest-TestVolumeBootPattern-360350731-project-member</nova:user>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:         <nova:project uuid="bf4b0011da7449e7948bf2c8a41955f5">tempest-TestVolumeBootPattern-360350731</nova:project>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:         <nova:port uuid="71fc9457-54c8-46d0-a9b6-f845805ab623">
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     <system>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <entry name="serial">f4a87215-c1ff-43cb-92f3-112e4526a393</entry>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <entry name="uuid">f4a87215-c1ff-43cb-92f3-112e4526a393</entry>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     </system>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:   <os>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:   </os>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:   <features>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:   </features>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:   <devices>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/f4a87215-c1ff-43cb-92f3-112e4526a393/disk.config"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     </disk>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <alias name="ua-97c161db-b1ac-4e96-9b81-babde67118ec"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-0"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <serial>97c161db-b1ac-4e96-9b81-babde67118ec</serial>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     </disk>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:ee:68:82"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <target dev="tap71fc9457-54"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     </interface>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/f4a87215-c1ff-43cb-92f3-112e4526a393/console.log" append="off"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     </serial>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     <video>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     </video>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     </rng>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:   </devices>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]: </domain>
May 27 03:18:17.733464 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:18:17.735707 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Preparing to wait for external event network-vif-plugged-71fc9457-54c8-46d0-a9b6-f845805ab623 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:18:17.735707 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "f4a87215-c1ff-43cb-92f3-112e4526a393-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:17.735707 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "f4a87215-c1ff-43cb-92f3-112e4526a393-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:17.735707 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "f4a87215-c1ff-43cb-92f3-112e4526a393-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:17.735707 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:18:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1280021294',display_name='tempest-TestVolumeBootPattern-server-1280021294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-1280021294',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-lz3vq36i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:18:08Z,user_data=None,user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=f4a87215-c1ff-43cb-92f3-112e4526a393,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71fc9457-54c8-46d0-a9b6-f845805ab623", "address": "fa:16:3e:ee:68:82", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fc9457-54", "ovs_interfaceid": "71fc9457-54c8-46d0-a9b6-f845805ab623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:18:17.735707 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "71fc9457-54c8-46d0-a9b6-f845805ab623", "address": "fa:16:3e:ee:68:82", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fc9457-54", "ovs_interfaceid": "71fc9457-54c8-46d0-a9b6-f845805ab623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:18:17.736269 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:68:82,bridge_name='br-int',has_traffic_filtering=True,id=71fc9457-54c8-46d0-a9b6-f845805ab623,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fc9457-54') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:18:17.736608 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:68:82,bridge_name='br-int',has_traffic_filtering=True,id=71fc9457-54c8-46d0-a9b6-f845805ab623,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fc9457-54') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:18:17.737062 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:17.737300 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:18:17.737548 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:18:17.739329 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:17.739481 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5cf63821-2418-554c-820a-cc318d5c97d5', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:18:17.746041 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:17.747408 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:18:17.748894 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:17.749102 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71fc9457-54, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:18:17.749466 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71fc9457-54, col_values=(('qos', UUID('00d1405e-6a56-411d-9f08-44ec523efddf')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:18:17.749982 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71fc9457-54, col_values=(('external_ids', {'iface-id': '71fc9457-54c8-46d0-a9b6-f845805ab623', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:68:82', 'vm-uuid': 'f4a87215-c1ff-43cb-92f3-112e4526a393'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:18:17.750604 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:17.752071 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:18:17.757687 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:17.760367 np0000001475 nova-compute[98471]: INFO os_vif [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:68:82,bridge_name='br-int',has_traffic_filtering=True,id=71fc9457-54c8-46d0-a9b6-f845805ab623,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fc9457-54')
May 27 03:18:17.761836 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f2d75db32981429883ad51cb41ca88ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4f4be9e90849f78581e1a1b5c6b050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:18:18.198637 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:18:18.210433 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Successfully created port: 9b056693-43c1-4a0b-b71c-febe908f0af9 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:18:18.655677 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Successfully updated port: 9b056693-43c1-4a0b-b71c-febe908f0af9 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:18:18.699750 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f41beb62-2be4-4a60-b7d1-d94d109f69b3 req-83650c96-00eb-4c95-a803-8da12fe2cdd9 service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Received event network-changed-9b056693-43c1-4a0b-b71c-febe908f0af9 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:18:18.700104 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f41beb62-2be4-4a60-b7d1-d94d109f69b3 req-83650c96-00eb-4c95-a803-8da12fe2cdd9 service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Refreshing instance network info cache due to event network-changed-9b056693-43c1-4a0b-b71c-febe908f0af9. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:18:18.700285 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f41beb62-2be4-4a60-b7d1-d94d109f69b3 req-83650c96-00eb-4c95-a803-8da12fe2cdd9 service nova] Acquiring lock "refresh_cache-6b89f301-37fb-43a6-9bef-bca32191186e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:18:18.700379 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f41beb62-2be4-4a60-b7d1-d94d109f69b3 req-83650c96-00eb-4c95-a803-8da12fe2cdd9 service nova] Acquired lock "refresh_cache-6b89f301-37fb-43a6-9bef-bca32191186e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:18:18.700497 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f41beb62-2be4-4a60-b7d1-d94d109f69b3 req-83650c96-00eb-4c95-a803-8da12fe2cdd9 service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Refreshing network info cache for port 9b056693-43c1-4a0b-b71c-febe908f0af9 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:18:18.701601 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:18:19.157542 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "refresh_cache-6b89f301-37fb-43a6-9bef-bca32191186e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:18:19.204691 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f41beb62-2be4-4a60-b7d1-d94d109f69b3 req-83650c96-00eb-4c95-a803-8da12fe2cdd9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:19.258987 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f41beb62-2be4-4a60-b7d1-d94d109f69b3 req-83650c96-00eb-4c95-a803-8da12fe2cdd9 service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:18:19.274636 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:18:19.274750 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:18:19.274858 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No VIF found with MAC fa:16:3e:ee:68:82, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:18:19.275174 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Using config drive
May 27 03:18:19.375134 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f41beb62-2be4-4a60-b7d1-d94d109f69b3 req-83650c96-00eb-4c95-a803-8da12fe2cdd9 service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:18:19.709833 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:18:19.710971 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:18:19.711259 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Creating image(s)
May 27 03:18:19.711804 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:19.711998 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "/opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:19.712516 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "/opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:19.713184 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:18:19.717333 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:18:19.718376 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:18:19.781439 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:19.810677 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.092s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:18:19.811071 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "74281789f74bbcf3c46063805512e2987f43205c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:19.811489 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:19.811927 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:18:19.814505 np0000001475 nova-compute[98471]: DEBUG oslo_utils.imageutils.format_inspector [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98471) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 27 03:18:19.814830 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:18:19.877709 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f41beb62-2be4-4a60-b7d1-d94d109f69b3 req-83650c96-00eb-4c95-a803-8da12fe2cdd9 service nova] Releasing lock "refresh_cache-6b89f301-37fb-43a6-9bef-bca32191186e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:18:19.878343 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquired lock "refresh_cache-6b89f301-37fb-43a6-9bef-bca32191186e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:18:19.878614 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:18:19.899047 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Creating config drive at /opt/stack/data/nova/instances/f4a87215-c1ff-43cb-92f3-112e4526a393/disk.config
May 27 03:18:19.901984 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f4a87215-c1ff-43cb-92f3-112e4526a393/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsuchhubl {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:18:19.914012 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.098s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:18:19.914837 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk 1073741824 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:18:19.965013 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f4a87215-c1ff-43cb-92f3-112e4526a393/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsuchhubl" returned: 0 in 0.063s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:18:19.976203 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c,backing_fmt=raw /opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk 1073741824" returned: 0 in 0.061s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:18:19.976637 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "74281789f74bbcf3c46063805512e2987f43205c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.165s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:19.977001 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:18:20.058370 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/74281789f74bbcf3c46063805512e2987f43205c --force-share --output=json" returned: 0 in 0.081s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:18:20.058870 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk. size=1073741824 {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 27 03:18:20.059139 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:18:20.151546 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:18:20.152025 np0000001475 nova-compute[98471]: DEBUG nova.virt.disk.api [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Cannot resize image /opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk to a smaller size. {{(pid=98471) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 27 03:18:20.152517 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Created local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 27 03:18:20.152711 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Ensure instance console log exists: /opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:18:20.153030 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:20.153256 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:20.153382 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:20.363946 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:20.384866 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:20.444722 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:18:20.473430 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:20.479820 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:20.557364 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-50bb37d5-6ff5-4bb4-aa7d-1f9dbb63ccf7 req-1052c50d-0e47-42b4-bf55-72989512ea56 service nova] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Received event network-vif-plugged-71fc9457-54c8-46d0-a9b6-f845805ab623 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:18:20.557654 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-50bb37d5-6ff5-4bb4-aa7d-1f9dbb63ccf7 req-1052c50d-0e47-42b4-bf55-72989512ea56 service nova] Acquiring lock "f4a87215-c1ff-43cb-92f3-112e4526a393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:20.557992 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-50bb37d5-6ff5-4bb4-aa7d-1f9dbb63ccf7 req-1052c50d-0e47-42b4-bf55-72989512ea56 service nova] Lock "f4a87215-c1ff-43cb-92f3-112e4526a393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:20.558140 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-50bb37d5-6ff5-4bb4-aa7d-1f9dbb63ccf7 req-1052c50d-0e47-42b4-bf55-72989512ea56 service nova] Lock "f4a87215-c1ff-43cb-92f3-112e4526a393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:20.558429 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-50bb37d5-6ff5-4bb4-aa7d-1f9dbb63ccf7 req-1052c50d-0e47-42b4-bf55-72989512ea56 service nova] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Processing event network-vif-plugged-71fc9457-54c8-46d0-a9b6-f845805ab623 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:18:20.659574 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:20.721420 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:20.725363 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:20.727171 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:20.745105 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:20.822658 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Updating instance_info_cache with network_info: [{"id": "9b056693-43c1-4a0b-b71c-febe908f0af9", "address": "fa:16:3e:b4:c7:b5", "network": {"id": "2615158a-fba8-4694-bc11-8825b25a885b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1409157499-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a4f4be9e90849f78581e1a1b5c6b050", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b056693-43", "ovs_interfaceid": "9b056693-43c1-4a0b-b71c-febe908f0af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:18:21.158013 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851901.1574314, f4a87215-c1ff-43cb-92f3-112e4526a393 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:18:21.158410 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:18:21.158600 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] VM Started (Lifecycle Event)
May 27 03:18:21.164632 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:18:21.167635 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Instance spawned successfully.
May 27 03:18:21.167995 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:18:21.325543 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Releasing lock "refresh_cache-6b89f301-37fb-43a6-9bef-bca32191186e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:18:21.326817 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Instance network_info: |[{"id": "9b056693-43c1-4a0b-b71c-febe908f0af9", "address": "fa:16:3e:b4:c7:b5", "network": {"id": "2615158a-fba8-4694-bc11-8825b25a885b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1409157499-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a4f4be9e90849f78581e1a1b5c6b050", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b056693-43", "ovs_interfaceid": "9b056693-43c1-4a0b-b71c-febe908f0af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:18:21.328233 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Start _get_guest_xml network_info=[{"id": "9b056693-43c1-4a0b-b71c-febe908f0af9", "address": "fa:16:3e:b4:c7:b5", "network": {"id": "2615158a-fba8-4694-bc11-8825b25a885b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1409157499-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a4f4be9e90849f78581e1a1b5c6b050", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b056693-43", "ovs_interfaceid": "9b056693-43c1-4a0b-b71c-febe908f0af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'size': 0, 'image_id': 'bb7555b3-2f7b-4a56-b628-91b0c2265c8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:18:21.338204 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:18:21.340151 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', instance_meta=NovaInstanceMeta(name='tempest-SnapshotDataIntegrityTests-server-1817871831', uuid='6b89f301-37fb-43a6-9bef-bca32191186e'), owner=OwnerMeta(userid='f2d75db32981429883ad51cb41ca88ad', username='tempest-SnapshotDataIntegrityTests-1109943454-project-member', projectid='5a4f4be9e90849f78581e1a1b5c6b050', projectname='tempest-SnapshotDataIntegrityTests-1109943454'), image=ImageMeta(id='bb7555b3-2f7b-4a56-b628-91b0c2265c8d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9b056693-43c1-4a0b-b71c-febe908f0af9", "address": "fa:16:3e:b4:c7:b5", "network": {"id": "2615158a-fba8-4694-bc11-8825b25a885b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1409157499-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a4f4be9e90849f78581e1a1b5c6b050", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b056693-43", "ovs_interfaceid": "9b056693-43c1-4a0b-b71c-febe908f0af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851901.3385248) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:18:21.345067 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:18:21.345370 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:18:21.347915 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:18:21.347915 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:18:21.348812 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:18:21.349271 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T02:55:02Z,direct_url=<?>,disk_format='qcow2',id=bb7555b3-2f7b-4a56-b628-91b0c2265c8d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ba717c80697f454cbbe062e8cd8e5989',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-27T02:55:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:18:21.349271 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:18:21.349442 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:18:21.349442 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:18:21.349531 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:18:21.349588 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:18:21.349721 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:18:21.349845 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:18:21.349967 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:18:21.350898 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:18:21.350898 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:18:21.360156 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1817871831',display_name='tempest-SnapshotDataIntegrityTests-server-1817871831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-snapshotdataintegritytests-server-1817871831',id=76,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+vSTsvb04xsda+FUipObODwoOPiWfyfz1//rGcwG0zlkdF+h36lkYRDyFsjTRmariUdqVfYPJaV77/jCJsdHpqxcCRRrI+JThRavjJbPmMIE2Q4JOV7VHTZbYZHm3GeA==',key_name='tempest-keypair-1000537643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a4f4be9e90849f78581e1a1b5c6b050',ramdisk_id='',reservation_id='r-fiqlp08e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1109943454',owner_user_name='tempest-SnapshotDataIntegrityTests-1109943454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:18:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2d75db32981429883ad51cb41ca88ad',uuid=6b89f301-37fb-43a6-9bef-bca32191186e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b056693-43c1-4a0b-b71c-febe908f0af9", "address": "fa:16:3e:b4:c7:b5", "network": {"id": "2615158a-fba8-4694-bc11-8825b25a885b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1409157499-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a4f4be9e90849f78581e1a1b5c6b050", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b056693-43", "ovs_interfaceid": "9b056693-43c1-4a0b-b71c-febe908f0af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:18:21.360421 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Converting VIF {"id": "9b056693-43c1-4a0b-b71c-febe908f0af9", "address": "fa:16:3e:b4:c7:b5", "network": {"id": "2615158a-fba8-4694-bc11-8825b25a885b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1409157499-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a4f4be9e90849f78581e1a1b5c6b050", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b056693-43", "ovs_interfaceid": "9b056693-43c1-4a0b-b71c-febe908f0af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:18:21.361711 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:c7:b5,bridge_name='br-int',has_traffic_filtering=True,id=9b056693-43c1-4a0b-b71c-febe908f0af9,network=Network(2615158a-fba8-4694-bc11-8825b25a885b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b056693-43') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:18:21.361711 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b89f301-37fb-43a6-9bef-bca32191186e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:18:21.661204 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:18:21.663161 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:18:21.674550 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:18:21.674701 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:18:21.674951 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:18:21.675202 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:18:21.675441 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:18:21.675672 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:18:21.813618 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:21.867356 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] End _get_guest_xml xml=<domain type="qemu">
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:   <uuid>6b89f301-37fb-43a6-9bef-bca32191186e</uuid>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:   <name>instance-0000004c</name>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1817871831</nova:name>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:18:21</nova:creationTime>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <nova:image uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d">
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:         <nova:user uuid="f2d75db32981429883ad51cb41ca88ad">tempest-SnapshotDataIntegrityTests-1109943454-project-member</nova:user>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:         <nova:project uuid="5a4f4be9e90849f78581e1a1b5c6b050">tempest-SnapshotDataIntegrityTests-1109943454</nova:project>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid="bb7555b3-2f7b-4a56-b628-91b0c2265c8d"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:         <nova:port uuid="9b056693-43c1-4a0b-b71c-febe908f0af9">
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     <system>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <entry name="serial">6b89f301-37fb-43a6-9bef-bca32191186e</entry>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <entry name="uuid">6b89f301-37fb-43a6-9bef-bca32191186e</entry>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     </system>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:   <os>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:   </os>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:   <features>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:   </features>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:   <devices>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     <disk type="file" device="disk">
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <driver name="qemu" type="qcow2" cache="none"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     </disk>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk.config"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     </disk>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:b4:c7:b5"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <target dev="tap9b056693-43"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     </interface>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/console.log" append="off"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     </serial>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     <video>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     </video>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     </rng>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:   </devices>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]: </domain>
May 27 03:18:21.867356 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:18:21.869351 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Preparing to wait for external event network-vif-plugged-9b056693-43c1-4a0b-b71c-febe908f0af9 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:18:21.869351 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "6b89f301-37fb-43a6-9bef-bca32191186e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:21.869351 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:21.869351 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:21.869351 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1817871831',display_name='tempest-SnapshotDataIntegrityTests-server-1817871831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-snapshotdataintegritytests-server-1817871831',id=76,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+vSTsvb04xsda+FUipObODwoOPiWfyfz1//rGcwG0zlkdF+h36lkYRDyFsjTRmariUdqVfYPJaV77/jCJsdHpqxcCRRrI+JThRavjJbPmMIE2Q4JOV7VHTZbYZHm3GeA==',key_name='tempest-keypair-1000537643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a4f4be9e90849f78581e1a1b5c6b050',ramdisk_id='',reservation_id='r-fiqlp08e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1109943454',owner_user_name='tempest-SnapshotDataIntegrityTests-1109943454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:18:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2d75db32981429883ad51cb41ca88ad',uuid=6b89f301-37fb-43a6-9bef-bca32191186e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b056693-43c1-4a0b-b71c-febe908f0af9", "address": "fa:16:3e:b4:c7:b5", "network": {"id": "2615158a-fba8-4694-bc11-8825b25a885b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1409157499-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a4f4be9e90849f78581e1a1b5c6b050", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b056693-43", "ovs_interfaceid": "9b056693-43c1-4a0b-b71c-febe908f0af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:18:21.869351 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Converting VIF {"id": "9b056693-43c1-4a0b-b71c-febe908f0af9", "address": "fa:16:3e:b4:c7:b5", "network": {"id": "2615158a-fba8-4694-bc11-8825b25a885b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1409157499-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a4f4be9e90849f78581e1a1b5c6b050", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b056693-43", "ovs_interfaceid": "9b056693-43c1-4a0b-b71c-febe908f0af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:18:21.869351 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:c7:b5,bridge_name='br-int',has_traffic_filtering=True,id=9b056693-43c1-4a0b-b71c-febe908f0af9,network=Network(2615158a-fba8-4694-bc11-8825b25a885b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b056693-43') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:18:21.869662 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:c7:b5,bridge_name='br-int',has_traffic_filtering=True,id=9b056693-43c1-4a0b-b71c-febe908f0af9,network=Network(2615158a-fba8-4694-bc11-8825b25a885b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b056693-43') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:18:21.869703 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:21.869943 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:18:21.870166 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:18:21.870665 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:21.870846 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7816e9fb-ba0a-589b-a3ea-0faf820f65f7', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:18:21.871720 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:21.872399 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:18:21.872838 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:21.874683 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:21.874919 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b056693-43, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:18:21.875194 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b056693-43, col_values=(('qos', UUID('79e9d506-774f-4e08-b800-22c1efd14a45')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:18:21.875355 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b056693-43, col_values=(('external_ids', {'iface-id': '9b056693-43c1-4a0b-b71c-febe908f0af9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:c7:b5', 'vm-uuid': '6b89f301-37fb-43a6-9bef-bca32191186e'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:18:21.876009 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:21.877075 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:18:21.881716 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:21.882509 np0000001475 nova-compute[98471]: INFO os_vif [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:c7:b5,bridge_name='br-int',has_traffic_filtering=True,id=9b056693-43c1-4a0b-b71c-febe908f0af9,network=Network(2615158a-fba8-4694-bc11-8825b25a885b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b056693-43')
May 27 03:18:22.165310 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:18:22.165564 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851902.1653953, f4a87215-c1ff-43cb-92f3-112e4526a393 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:18:22.165701 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] VM Paused (Lifecycle Event)
May 27 03:18:22.182431 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Took 8.51 seconds to spawn the instance on the hypervisor.
May 27 03:18:22.182646 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:18:22.619076 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-04c9c537-619f-4aed-9c17-1295695ad9c3 req-e79e140c-7f94-41e7-865e-8ec585e7ead8 service nova] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Received event network-vif-plugged-71fc9457-54c8-46d0-a9b6-f845805ab623 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:18:22.619243 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-04c9c537-619f-4aed-9c17-1295695ad9c3 req-e79e140c-7f94-41e7-865e-8ec585e7ead8 service nova] Acquiring lock "f4a87215-c1ff-43cb-92f3-112e4526a393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:22.619392 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-04c9c537-619f-4aed-9c17-1295695ad9c3 req-e79e140c-7f94-41e7-865e-8ec585e7ead8 service nova] Lock "f4a87215-c1ff-43cb-92f3-112e4526a393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:22.619506 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-04c9c537-619f-4aed-9c17-1295695ad9c3 req-e79e140c-7f94-41e7-865e-8ec585e7ead8 service nova] Lock "f4a87215-c1ff-43cb-92f3-112e4526a393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:22.619614 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-04c9c537-619f-4aed-9c17-1295695ad9c3 req-e79e140c-7f94-41e7-865e-8ec585e7ead8 service nova] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] No waiting events found dispatching network-vif-plugged-71fc9457-54c8-46d0-a9b6-f845805ab623 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:18:22.619753 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-04c9c537-619f-4aed-9c17-1295695ad9c3 req-e79e140c-7f94-41e7-865e-8ec585e7ead8 service nova] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Received unexpected event network-vif-plugged-71fc9457-54c8-46d0-a9b6-f845805ab623 for instance with vm_state active and task_state None.
May 27 03:18:22.668098 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:18:22.670334 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851902.6700892, f4a87215-c1ff-43cb-92f3-112e4526a393 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:18:22.670501 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] VM Resumed (Lifecycle Event)
May 27 03:18:22.690138 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Took 18.84 seconds to build instance.
May 27 03:18:23.174268 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:18:23.179153 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:18:23.192086 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "f4a87215-c1ff-43cb-92f3-112e4526a393" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.347s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:23.397362 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:18:23.397534 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:18:23.397700 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] No VIF found with MAC fa:16:3e:b4:c7:b5, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:18:23.398186 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Using config drive
May 27 03:18:23.905013 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:24.018358 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Creating config drive at /opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk.config
May 27 03:18:24.022600 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprdkd7p3h {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:18:24.078441 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprdkd7p3h" returned: 0 in 0.056s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:18:24.286378 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "f4a87215-c1ff-43cb-92f3-112e4526a393" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:24.286628 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "f4a87215-c1ff-43cb-92f3-112e4526a393" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:24.286915 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "f4a87215-c1ff-43cb-92f3-112e4526a393-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:24.287108 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "f4a87215-c1ff-43cb-92f3-112e4526a393-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:24.287268 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "f4a87215-c1ff-43cb-92f3-112e4526a393-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:24.291728 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Terminating instance
May 27 03:18:24.468039 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:24.489593 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:24.585180 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:24.635571 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b6bc6c65-598a-4c16-b9d2-bf388387f9a6 req-7911518e-6034-4362-939e-396c63158be6 service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Received event network-vif-plugged-9b056693-43c1-4a0b-b71c-febe908f0af9 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:18:24.635848 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b6bc6c65-598a-4c16-b9d2-bf388387f9a6 req-7911518e-6034-4362-939e-396c63158be6 service nova] Acquiring lock "6b89f301-37fb-43a6-9bef-bca32191186e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:24.636091 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b6bc6c65-598a-4c16-b9d2-bf388387f9a6 req-7911518e-6034-4362-939e-396c63158be6 service nova] Lock "6b89f301-37fb-43a6-9bef-bca32191186e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:24.637532 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-b6bc6c65-598a-4c16-b9d2-bf388387f9a6 req-7911518e-6034-4362-939e-396c63158be6 service nova] Lock "6b89f301-37fb-43a6-9bef-bca32191186e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:24.637665 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-b6bc6c65-598a-4c16-b9d2-bf388387f9a6 req-7911518e-6034-4362-939e-396c63158be6 service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Processing event network-vif-plugged-9b056693-43c1-4a0b-b71c-febe908f0af9 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:18:24.796550 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:18:24.803595 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:24.808995 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:24.810817 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:24.831262 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:24.833149 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:24.856811 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:24.946801 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:24.967551 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:24.971996 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5fb3c97e-1321-42a5-be51-c49db2929303 req-63228a91-9f2a-403e-af54-07a1d2ebc3d2 service nova] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Received event network-vif-unplugged-71fc9457-54c8-46d0-a9b6-f845805ab623 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:18:24.972167 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5fb3c97e-1321-42a5-be51-c49db2929303 req-63228a91-9f2a-403e-af54-07a1d2ebc3d2 service nova] Acquiring lock "f4a87215-c1ff-43cb-92f3-112e4526a393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:24.972305 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5fb3c97e-1321-42a5-be51-c49db2929303 req-63228a91-9f2a-403e-af54-07a1d2ebc3d2 service nova] Lock "f4a87215-c1ff-43cb-92f3-112e4526a393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:24.972439 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5fb3c97e-1321-42a5-be51-c49db2929303 req-63228a91-9f2a-403e-af54-07a1d2ebc3d2 service nova] Lock "f4a87215-c1ff-43cb-92f3-112e4526a393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:24.972560 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5fb3c97e-1321-42a5-be51-c49db2929303 req-63228a91-9f2a-403e-af54-07a1d2ebc3d2 service nova] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] No waiting events found dispatching network-vif-unplugged-71fc9457-54c8-46d0-a9b6-f845805ab623 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:18:24.972772 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5fb3c97e-1321-42a5-be51-c49db2929303 req-63228a91-9f2a-403e-af54-07a1d2ebc3d2 service nova] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Received event network-vif-unplugged-71fc9457-54c8-46d0-a9b6-f845805ab623 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:18:25.115871 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999643860000106 future=<Future at 0x75572c0fa090 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:18:25.116423 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999065816999973 future=<Future at 0x75572c0fa090 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:18:25.116528 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.998943630999747 future=<Future at 0x75572c0fa090 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:18:25.118435 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Instance destroyed successfully.
May 27 03:18:25.119250 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'resources' on Instance uuid f4a87215-c1ff-43cb-92f3-112e4526a393 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:18:25.262254 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851905.2618315, 6b89f301-37fb-43a6-9bef-bca32191186e => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:18:25.262758 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:18:25.262929 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] VM Started (Lifecycle Event)
May 27 03:18:25.265091 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:18:25.266990 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Instance spawned successfully.
May 27 03:18:25.267226 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:18:25.621573 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:18:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1280021294',display_name='tempest-TestVolumeBootPattern-server-1280021294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-1280021294',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:18:22Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-lz3vq36i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:18:22Z,user_data=None,user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=f4a87215-c1ff-43cb-92f3-112e4526a393,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71fc9457-54c8-46d0-a9b6-f845805ab623", "address": "fa:16:3e:ee:68:82", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fc9457-54", "ovs_interfaceid": "71fc9457-54c8-46d0-a9b6-f845805ab623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:18:25.621836 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "71fc9457-54c8-46d0-a9b6-f845805ab623", "address": "fa:16:3e:ee:68:82", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71fc9457-54", "ovs_interfaceid": "71fc9457-54c8-46d0-a9b6-f845805ab623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:18:25.622544 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:68:82,bridge_name='br-int',has_traffic_filtering=True,id=71fc9457-54c8-46d0-a9b6-f845805ab623,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fc9457-54') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:18:25.622791 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:68:82,bridge_name='br-int',has_traffic_filtering=True,id=71fc9457-54c8-46d0-a9b6-f845805ab623,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fc9457-54') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:18:25.624116 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:25.624405 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71fc9457-54, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:18:25.625375 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:25.626425 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:18:25.626425 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:25.627024 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:25.627192 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00d1405e-6a56-411d-9f08-44ec523efddf) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:18:25.628282 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:25.628282 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:18:25.628788 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:25.630766 np0000001475 nova-compute[98471]: INFO os_vif [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:68:82,bridge_name='br-int',has_traffic_filtering=True,id=71fc9457-54c8-46d0-a9b6-f845805ab623,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71fc9457-54')
May 27 03:18:25.632177 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:18:25.632508 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec', 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97c161db-b1ac-4e96-9b81-babde67118ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:18:25.632641 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:18:25.633023 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:18:25.633298 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec', 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97c161db-b1ac-4e96-9b81-babde67118ec', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:18:25.633473 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:18:25.654009 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec (non-flash)
May 27 03:18:25.654009 np0000001475 nova-compute[98471]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec (non-flash)
May 27 03:18:25.654009 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:18:25.654202 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec (non-flash)
May 27 03:18:25.654202 np0000001475 nova-compute[98471]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec (non-flash)
May 27 03:18:25.654202 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:18:25.654261 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec', '204')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:18:25.654363 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec', '203')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:18:25.655124 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec', '204')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:18:25.655683 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572475a0c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec'): ({'sdd'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:18:25.655929 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Removing multipathed devices sdc, sdd {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:18:25.656122 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flush multipath device 3300000003d04d275 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:18:25.708981 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:18:25.756980 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:18:25.769699 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:18:25.774519 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:18:25.774635 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:18:25.774932 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:18:25.775142 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:18:25.775375 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:18:25.778075 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:18:25.778075 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:18:25.801069 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if SCSI volumes sdc, sdd have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:18:25.801251 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] SCSI volumes sdc, sdd have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:18:25.802045 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if device paths {'sdc', 'sdd'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:18:25.816492 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Device paths {'sdc', 'sdd'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:18:25.816794 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:18:25.826996 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:25.860707 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 203, target: iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec, portal: 192.168.40.100,3260]
May 27 03:18:25.860707 np0000001475 nova-compute[98471]: Logout of [sid: 203, target: iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec, portal: 192.168.40.100,3260] successful.
May 27 03:18:25.860707 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:25.876098 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:25.886886 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:25.910865 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 204, target: iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec, portal: 192.168.50.100,3260]
May 27 03:18:25.910865 np0000001475 nova-compute[98471]: Logout of [sid: 204, target: iqn.2023-03.storpool.com:os--volume-97c161db-b1ac-4e96-9b81-babde67118ec, portal: 192.168.50.100,3260] successful.
May 27 03:18:25.910865 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:25.922728 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:25.922993 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:18:25.923128 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== disconnect_volume: return (290ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:18:25.923358 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:18:25.923515 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Deleting instance files /opt/stack/data/nova/instances/f4a87215-c1ff-43cb-92f3-112e4526a393_del
May 27 03:18:25.923997 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Deletion of /opt/stack/data/nova/instances/f4a87215-c1ff-43cb-92f3-112e4526a393_del complete
May 27 03:18:26.280064 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:18:26.280409 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851906.2801664, 6b89f301-37fb-43a6-9bef-bca32191186e => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:18:26.280443 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] VM Paused (Lifecycle Event)
May 27 03:18:26.283803 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Took 6.57 seconds to spawn the instance on the hypervisor.
May 27 03:18:26.283969 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:18:26.433055 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Took 1.64 seconds to destroy the instance on the hypervisor.
May 27 03:18:26.433592 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:18:26.433912 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:18:26.434025 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:18:26.434266 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:26.498717 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:26.695782 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-21a95101-d048-4978-8daf-ec0b37ff43f1 req-3657adea-b167-47af-bc39-b6a984165710 service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Received event network-vif-plugged-9b056693-43c1-4a0b-b71c-febe908f0af9 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:18:26.696139 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-21a95101-d048-4978-8daf-ec0b37ff43f1 req-3657adea-b167-47af-bc39-b6a984165710 service nova] Acquiring lock "6b89f301-37fb-43a6-9bef-bca32191186e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:26.696326 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-21a95101-d048-4978-8daf-ec0b37ff43f1 req-3657adea-b167-47af-bc39-b6a984165710 service nova] Lock "6b89f301-37fb-43a6-9bef-bca32191186e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:26.696482 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-21a95101-d048-4978-8daf-ec0b37ff43f1 req-3657adea-b167-47af-bc39-b6a984165710 service nova] Lock "6b89f301-37fb-43a6-9bef-bca32191186e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:26.696648 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-21a95101-d048-4978-8daf-ec0b37ff43f1 req-3657adea-b167-47af-bc39-b6a984165710 service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] No waiting events found dispatching network-vif-plugged-9b056693-43c1-4a0b-b71c-febe908f0af9 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:18:26.696825 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-21a95101-d048-4978-8daf-ec0b37ff43f1 req-3657adea-b167-47af-bc39-b6a984165710 service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Received unexpected event network-vif-plugged-9b056693-43c1-4a0b-b71c-febe908f0af9 for instance with vm_state active and task_state None.
May 27 03:18:26.773674 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a234bae3-67dd-493b-a03b-19aabbdc7ff6 req-5ddf5b01-eb8e-4556-b236-a6ba7175f531 service nova] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Received event network-vif-deleted-71fc9457-54c8-46d0-a9b6-f845805ab623 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:18:26.773837 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-a234bae3-67dd-493b-a03b-19aabbdc7ff6 req-5ddf5b01-eb8e-4556-b236-a6ba7175f531 service nova] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Neutron deleted interface 71fc9457-54c8-46d0-a9b6-f845805ab623; detaching it from the instance and deleting it from the info cache
May 27 03:18:26.774028 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a234bae3-67dd-493b-a03b-19aabbdc7ff6 req-5ddf5b01-eb8e-4556-b236-a6ba7175f531 service nova] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:18:26.782618 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:18:26.785217 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851906.7849197, 6b89f301-37fb-43a6-9bef-bca32191186e => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:18:26.785332 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] VM Resumed (Lifecycle Event)
May 27 03:18:26.794666 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Took 11.85 seconds to build instance.
May 27 03:18:26.816351 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:27.033809 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f8efcad5-c1b3-40b0-9cf3-7aca4d90c847 req-28a9f090-9017-43f1-bf4b-cbf093465142 service nova] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Received event network-vif-unplugged-71fc9457-54c8-46d0-a9b6-f845805ab623 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:18:27.034056 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8efcad5-c1b3-40b0-9cf3-7aca4d90c847 req-28a9f090-9017-43f1-bf4b-cbf093465142 service nova] Acquiring lock "f4a87215-c1ff-43cb-92f3-112e4526a393-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:27.034387 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8efcad5-c1b3-40b0-9cf3-7aca4d90c847 req-28a9f090-9017-43f1-bf4b-cbf093465142 service nova] Lock "f4a87215-c1ff-43cb-92f3-112e4526a393-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:27.034495 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8efcad5-c1b3-40b0-9cf3-7aca4d90c847 req-28a9f090-9017-43f1-bf4b-cbf093465142 service nova] Lock "f4a87215-c1ff-43cb-92f3-112e4526a393-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:27.034603 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f8efcad5-c1b3-40b0-9cf3-7aca4d90c847 req-28a9f090-9017-43f1-bf4b-cbf093465142 service nova] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] No waiting events found dispatching network-vif-unplugged-71fc9457-54c8-46d0-a9b6-f845805ab623 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:18:27.034731 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f8efcad5-c1b3-40b0-9cf3-7aca4d90c847 req-28a9f090-9017-43f1-bf4b-cbf093465142 service nova] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Received event network-vif-unplugged-71fc9457-54c8-46d0-a9b6-f845805ab623 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:18:27.205539 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:18:27.277700 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a234bae3-67dd-493b-a03b-19aabbdc7ff6 req-5ddf5b01-eb8e-4556-b236-a6ba7175f531 service nova] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Detach interface failed, port_id=71fc9457-54c8-46d0-a9b6-f845805ab623, reason: Instance f4a87215-c1ff-43cb-92f3-112e4526a393 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:18:27.287048 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:18:27.289111 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:18:27.296095 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-80fd9251-b423-4cb9-861f-1066941ec8d7 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.356s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:27.711976 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Took 1.28 seconds to deallocate network for instance.
May 27 03:18:28.257090 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Took 0.54 seconds to detach 1 volumes for instance.
May 27 03:18:28.259013 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Deleting volume: 97c161db-b1ac-4e96-9b81-babde67118ec {{(pid=98471) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 27 03:18:28.800005 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:28.800483 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:28.928100 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:18:28.928297 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:18:29.086529 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4da7cdd6-497a-4eaa-8ea3-29e8ffa05dd9 req-d81c1761-1a59-49d2-b5ba-ee37b1c9bce0 service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Received event network-changed-9b056693-43c1-4a0b-b71c-febe908f0af9 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:18:29.086723 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-4da7cdd6-497a-4eaa-8ea3-29e8ffa05dd9 req-d81c1761-1a59-49d2-b5ba-ee37b1c9bce0 service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Refreshing instance network info cache due to event network-changed-9b056693-43c1-4a0b-b71c-febe908f0af9. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:18:29.086969 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4da7cdd6-497a-4eaa-8ea3-29e8ffa05dd9 req-d81c1761-1a59-49d2-b5ba-ee37b1c9bce0 service nova] Acquiring lock "refresh_cache-6b89f301-37fb-43a6-9bef-bca32191186e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:18:29.087094 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4da7cdd6-497a-4eaa-8ea3-29e8ffa05dd9 req-d81c1761-1a59-49d2-b5ba-ee37b1c9bce0 service nova] Acquired lock "refresh_cache-6b89f301-37fb-43a6-9bef-bca32191186e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:18:29.087195 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4da7cdd6-497a-4eaa-8ea3-29e8ffa05dd9 req-d81c1761-1a59-49d2-b5ba-ee37b1c9bce0 service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Refreshing network info cache for port 9b056693-43c1-4a0b-b71c-febe908f0af9 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:18:29.430956 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:18:29.590727 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-4da7cdd6-497a-4eaa-8ea3-29e8ffa05dd9 req-d81c1761-1a59-49d2-b5ba-ee37b1c9bce0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:29.858761 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-4da7cdd6-497a-4eaa-8ea3-29e8ffa05dd9 req-d81c1761-1a59-49d2-b5ba-ee37b1c9bce0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:29.940466 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.140s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:29.983505 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4da7cdd6-497a-4eaa-8ea3-29e8ffa05dd9 req-d81c1761-1a59-49d2-b5ba-ee37b1c9bce0 service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Updated VIF entry in instance network info cache for port 9b056693-43c1-4a0b-b71c-febe908f0af9. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:18:29.983730 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-4da7cdd6-497a-4eaa-8ea3-29e8ffa05dd9 req-d81c1761-1a59-49d2-b5ba-ee37b1c9bce0 service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Updating instance_info_cache with network_info: [{"id": "9b056693-43c1-4a0b-b71c-febe908f0af9", "address": "fa:16:3e:b4:c7:b5", "network": {"id": "2615158a-fba8-4694-bc11-8825b25a885b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1409157499-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a4f4be9e90849f78581e1a1b5c6b050", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b056693-43", "ovs_interfaceid": "9b056693-43c1-4a0b-b71c-febe908f0af9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:18:30.007201 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Deleted allocations for instance f4a87215-c1ff-43cb-92f3-112e4526a393
May 27 03:18:30.485682 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-4da7cdd6-497a-4eaa-8ea3-29e8ffa05dd9 req-d81c1761-1a59-49d2-b5ba-ee37b1c9bce0 service nova] Releasing lock "refresh_cache-6b89f301-37fb-43a6-9bef-bca32191186e" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:18:30.632446 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:31.013699 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-29841f15-2216-4aab-bc84-8b9ad52d0f23 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "f4a87215-c1ff-43cb-92f3-112e4526a393" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.727s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:31.816733 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:35.634162 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:36.428951 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "24dc509c-5c24-4f2c-8a80-d466c11810e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:36.429147 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "24dc509c-5c24-4f2c-8a80-d466c11810e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:36.817802 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:36.930721 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:18:37.475077 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:37.475261 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:37.478369 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:18:37.478547 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Claim successful on node np0000001475
May 27 03:18:38.612844 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:18:38.613212 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:18:39.115677 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:18:39.626007 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.151s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:39.626447 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:18:40.115931 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.00040721599998505553 future=<Future at 0x75572c0fa090 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:18:40.116312 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Emitting event <LifecycleEvent: 1779851905.115409, f4a87215-c1ff-43cb-92f3-112e4526a393 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:18:40.116434 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:18:40.116523 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] VM Stopped (Lifecycle Event)
May 27 03:18:40.131509 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:18:40.132000 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:18:40.132315 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:40.132607 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:40.203542 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8eeaf68cfb534238bfe879dd6e8f858f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0011da7449e7948bf2c8a41955f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:18:40.618960 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: f4a87215-c1ff-43cb-92f3-112e4526a393] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:18:40.634977 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:18:40.637101 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:40.648462 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Successfully created port: 94e4ebcb-b252-4bcd-89d8-b71f5136c6db {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:18:41.069395 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Successfully updated port: 94e4ebcb-b252-4bcd-89d8-b71f5136c6db {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:18:41.110407 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e52599c8-9406-4339-92d2-e000b01b1cc4 req-337e46d6-f3a7-4d4f-b86f-5fe8ae4e14ad service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Received event network-changed-94e4ebcb-b252-4bcd-89d8-b71f5136c6db {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:18:41.110509 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e52599c8-9406-4339-92d2-e000b01b1cc4 req-337e46d6-f3a7-4d4f-b86f-5fe8ae4e14ad service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Refreshing instance network info cache due to event network-changed-94e4ebcb-b252-4bcd-89d8-b71f5136c6db. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:18:41.110654 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e52599c8-9406-4339-92d2-e000b01b1cc4 req-337e46d6-f3a7-4d4f-b86f-5fe8ae4e14ad service nova] Acquiring lock "refresh_cache-24dc509c-5c24-4f2c-8a80-d466c11810e4" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:18:41.110752 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e52599c8-9406-4339-92d2-e000b01b1cc4 req-337e46d6-f3a7-4d4f-b86f-5fe8ae4e14ad service nova] Acquired lock "refresh_cache-24dc509c-5c24-4f2c-8a80-d466c11810e4" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:18:41.110882 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-e52599c8-9406-4339-92d2-e000b01b1cc4 req-337e46d6-f3a7-4d4f-b86f-5fe8ae4e14ad service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Refreshing network info cache for port 94e4ebcb-b252-4bcd-89d8-b71f5136c6db {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:18:41.138090 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:18:41.571484 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "refresh_cache-24dc509c-5c24-4f2c-8a80-d466c11810e4" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:18:41.613925 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-e52599c8-9406-4339-92d2-e000b01b1cc4 req-337e46d6-f3a7-4d4f-b86f-5fe8ae4e14ad service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:41.641700 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Booting with volume f29009ed-eb32-4bf7-ab67-9e221afbe6aa at /dev/vda
May 27 03:18:41.673962 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:18:41.680318 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-e52599c8-9406-4339-92d2-e000b01b1cc4 req-337e46d6-f3a7-4d4f-b86f-5fe8ae4e14ad service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:18:41.683840 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:18:41.699870 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:18:41.742776 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:18:41.743052 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:18:41.750317 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:18:41.752198 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:feb4:c7b5', 'fe80::bc23:aaff:fec6:2747'] 
May 27 03:18:41.752359 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:18:41.752504 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:18:41.752764 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:18:41.753008 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Updating existing volume attachment record: c6301bdc-0824-474c-b66e-2f7b67395b7c {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:18:41.808066 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-e52599c8-9406-4339-92d2-e000b01b1cc4 req-337e46d6-f3a7-4d4f-b86f-5fe8ae4e14ad service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:18:41.817466 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:42.310453 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e52599c8-9406-4339-92d2-e000b01b1cc4 req-337e46d6-f3a7-4d4f-b86f-5fe8ae4e14ad service nova] Releasing lock "refresh_cache-24dc509c-5c24-4f2c-8a80-d466c11810e4" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:18:42.311192 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquired lock "refresh_cache-24dc509c-5c24-4f2c-8a80-d466c11810e4" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:18:42.311363 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:18:42.876507 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:18:43.015213 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:43.128426 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Updating instance_info_cache with network_info: [{"id": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "address": "fa:16:3e:b8:4d:a5", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4ebcb-b2", "ovs_interfaceid": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:18:43.630114 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Releasing lock "refresh_cache-24dc509c-5c24-4f2c-8a80-d466c11810e4" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:18:43.630660 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Instance network_info: |[{"id": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "address": "fa:16:3e:b8:4d:a5", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4ebcb-b2", "ovs_interfaceid": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:18:43.845433 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:18:43.846453 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:18:43.846695 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Creating image(s)
May 27 03:18:43.847000 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:18:43.847149 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Ensure instance console log exists: /opt/stack/data/nova/instances/24dc509c-5c24-4f2c-8a80-d466c11810e4/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:18:43.847381 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:43.847592 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:43.847734 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:43.848200 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Start _get_guest_xml network_info=[{"id": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "address": "fa:16:3e:b8:4d:a5", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4ebcb-b2", "ovs_interfaceid": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '24dc509c-5c24-4f2c-8a80-d466c11810e4', 'attached_at': '', 'detached_at': '', 'volume_id': 'f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 'serial': 'f29009ed-eb32-4bf7-ab67-9e221afbe6aa'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'c6301bdc-0824-474c-b66e-2f7b67395b7c', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:18:43.852849 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:18:43.853947 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-volume-backed-server-717886128', uuid='24dc509c-5c24-4f2c-8a80-d466c11810e4'), owner=OwnerMeta(userid='8eeaf68cfb534238bfe879dd6e8f858f', username='tempest-TestVolumeBootPattern-360350731-project-member', projectid='bf4b0011da7449e7948bf2c8a41955f5', projectname='tempest-TestVolumeBootPattern-360350731'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "address": "fa:16:3e:b8:4d:a5", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4ebcb-b2", "ovs_interfaceid": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851923.8535619) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:18:43.855283 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:18:43.855576 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:18:43.856583 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:18:43.856758 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:18:43.857588 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:18:43.857887 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:18:43.858036 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:18:43.858154 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:18:43.858299 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:18:43.858412 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:18:43.858526 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:18:43.858706 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:18:43.858852 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:18:43.858986 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:18:43.859111 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:18:43.859254 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:18:43.868336 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:18:43.868639 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:18:43.868815 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:18:43.869145 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:18:43.869349 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:18:43.880909 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:18:43.881250 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:18:43.881857 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:18:43.882140 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:18:43.882578 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:18:43.882807 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:18:43.892382 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:18:43.892382 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:43.896905 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:18:43.896905 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:43.903843 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa] added
May 27 03:18:43.903843 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:18:43.903843 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:18:43.903843 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:18:43.903843 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:18:43.903843 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:18:43.903843 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:43.904146 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:18:43.904204 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0225(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:18:43.904362 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:18:43.907839 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa] added
May 27 03:18:43.907839 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:18:43.907839 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:18:43.907839 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:18:43.907839 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:18:43.907839 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:18:43.907839 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:43.908009 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:18:43.908128 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0253(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:18:43.908250 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:18:44.904790 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:18:44.908684 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:18:44.915512 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:18:44.915512 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:18:44.920862 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:18:44.920862 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:44.928615 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:44.934294 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:44.939988 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 03:18:44.939988 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:18:44.940228 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 03:18:44.940228 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:18:44.940376 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 03:18:44.940376 np0000001475 nova-compute[98471]: 
May 27 03:18:44.945484 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 03:18:44.945484 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:18:44.945615 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 03:18:44.945615 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:18:44.945689 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 03:18:44.945689 np0000001475 nova-compute[98471]: 
May 27 03:18:45.638599 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:45.973067 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa, portal: 192.168.40.100,3260]
May 27 03:18:45.973067 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa, portal: 192.168.40.100,3260] successful.
May 27 03:18:45.973067 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:45.977702 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa, portal: 192.168.50.100,3260]
May 27 03:18:45.977702 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa, portal: 192.168.50.100,3260] successful.
May 27 03:18:45.977702 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:45.984205 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:45.990136 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:45.999228 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:45.999228 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:45.999228 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:18:45.999421 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:45.999421 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:45.999421 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:18:45.999703 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.118s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:18:45.999884 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:18:46.000494 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('7', '-', '-', 0) found on session 205 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:18:46.000638 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:18:46.006572 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:46.006572 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:46.006572 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:18:46.006719 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:46.006719 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:46.006719 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:18:46.007020 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.124s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:18:46.007189 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:18:46.007695 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('8', '-', '-', 0) found on session 206 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:18:46.007864 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:18:46.017898 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 205 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:18:46.017898 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:18:46.024726 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 206 and hctl ['8', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:18:46.819925 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:47.023706 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 206 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:18:47.024161 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:18:47.897871 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Found WWN 330000000f41a02bc for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:18:47.898111 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.029s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:18:47.898255 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== connect_volume: return (4029ms) {'type': 'block', 'scsi_wwn': '330000000f41a02bc', 'path': '/dev/dm-0', 'multipath_id': '330000000f41a02bc'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:18:47.898367 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f41a02bc', 'path': '/dev/dm-0', 'multipath_id': '330000000f41a02bc'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:18:48.404341 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:18:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-717886128',display_name='tempest-TestVolumeBootPattern-volume-backed-server-717886128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-volume-backed-server-717886128',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaeK25LOcBKMFOK8upFzJMngFISDwqzU0ViQLodmaXn2mLvFBmdBTsQKy1K9nbZtHQ11teNU05xWxZgC2bK+E91qw2s1eUPBGUKq7MS4sbxtSrxXSlyVwo25CpfPhkDbw==',key_name='tempest-keypair-927051654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-hn1l3xnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:18:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=24dc509c-5c24-4f2c-8a80-d466c11810e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "address": "fa:16:3e:b8:4d:a5", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4ebcb-b2", "ovs_interfaceid": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:18:48.404842 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "address": "fa:16:3e:b8:4d:a5", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4ebcb-b2", "ovs_interfaceid": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:18:48.405129 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:4d:a5,bridge_name='br-int',has_traffic_filtering=True,id=94e4ebcb-b252-4bcd-89d8-b71f5136c6db,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e4ebcb-b2') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:18:48.405763 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'pci_devices' on Instance uuid 24dc509c-5c24-4f2c-8a80-d466c11810e4 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:18:48.908551 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] End _get_guest_xml xml=<domain type="qemu">
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:   <uuid>24dc509c-5c24-4f2c-8a80-d466c11810e4</uuid>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:   <name>instance-0000004d</name>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-717886128</nova:name>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:18:43</nova:creationTime>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:         <nova:user uuid="8eeaf68cfb534238bfe879dd6e8f858f">tempest-TestVolumeBootPattern-360350731-project-member</nova:user>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:         <nova:project uuid="bf4b0011da7449e7948bf2c8a41955f5">tempest-TestVolumeBootPattern-360350731</nova:project>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:         <nova:port uuid="94e4ebcb-b252-4bcd-89d8-b71f5136c6db">
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     <system>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <entry name="serial">24dc509c-5c24-4f2c-8a80-d466c11810e4</entry>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <entry name="uuid">24dc509c-5c24-4f2c-8a80-d466c11810e4</entry>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     </system>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:   <os>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:   </os>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:   <features>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:   </features>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:   <devices>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/24dc509c-5c24-4f2c-8a80-d466c11810e4/disk.config"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     </disk>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <alias name="ua-f29009ed-eb32-4bf7-ab67-9e221afbe6aa"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-0"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <serial>f29009ed-eb32-4bf7-ab67-9e221afbe6aa</serial>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     </disk>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:b8:4d:a5"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <target dev="tap94e4ebcb-b2"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     </interface>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/24dc509c-5c24-4f2c-8a80-d466c11810e4/console.log" append="off"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     </serial>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     <video>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     </video>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     </rng>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:   </devices>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]: </domain>
May 27 03:18:48.908551 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:18:48.911589 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Preparing to wait for external event network-vif-plugged-94e4ebcb-b252-4bcd-89d8-b71f5136c6db {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:18:48.911589 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "24dc509c-5c24-4f2c-8a80-d466c11810e4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:48.911589 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "24dc509c-5c24-4f2c-8a80-d466c11810e4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:48.911589 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "24dc509c-5c24-4f2c-8a80-d466c11810e4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:48.911589 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:18:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-717886128',display_name='tempest-TestVolumeBootPattern-volume-backed-server-717886128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-volume-backed-server-717886128',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaeK25LOcBKMFOK8upFzJMngFISDwqzU0ViQLodmaXn2mLvFBmdBTsQKy1K9nbZtHQ11teNU05xWxZgC2bK+E91qw2s1eUPBGUKq7MS4sbxtSrxXSlyVwo25CpfPhkDbw==',key_name='tempest-keypair-927051654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-hn1l3xnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:18:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=24dc509c-5c24-4f2c-8a80-d466c11810e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "address": "fa:16:3e:b8:4d:a5", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4ebcb-b2", "ovs_interfaceid": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:18:48.911589 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "address": "fa:16:3e:b8:4d:a5", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4ebcb-b2", "ovs_interfaceid": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:18:48.911589 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:4d:a5,bridge_name='br-int',has_traffic_filtering=True,id=94e4ebcb-b252-4bcd-89d8-b71f5136c6db,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e4ebcb-b2') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:18:48.911589 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:4d:a5,bridge_name='br-int',has_traffic_filtering=True,id=94e4ebcb-b252-4bcd-89d8-b71f5136c6db,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e4ebcb-b2') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:18:48.911589 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:48.912172 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:18:48.912172 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:18:48.912515 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:48.912686 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1480ec9-2cb9-563c-887c-2bc8eeaed187', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:18:48.913426 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:48.914027 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:18:48.914354 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:48.916758 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:48.916903 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94e4ebcb-b2, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:18:48.917173 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94e4ebcb-b2, col_values=(('qos', UUID('fe19cc66-25ed-4281-af90-78205ebec0e8')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:18:48.917313 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94e4ebcb-b2, col_values=(('external_ids', {'iface-id': '94e4ebcb-b252-4bcd-89d8-b71f5136c6db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:4d:a5', 'vm-uuid': '24dc509c-5c24-4f2c-8a80-d466c11810e4'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:18:48.917990 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:48.919033 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:18:48.922904 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:48.923832 np0000001475 nova-compute[98471]: INFO os_vif [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:4d:a5,bridge_name='br-int',has_traffic_filtering=True,id=94e4ebcb-b252-4bcd-89d8-b71f5136c6db,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e4ebcb-b2')
May 27 03:18:50.438605 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:18:50.439044 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:18:50.439044 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No VIF found with MAC fa:16:3e:b8:4d:a5, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:18:50.439197 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Using config drive
May 27 03:18:50.943986 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:51.050216 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Creating config drive at /opt/stack/data/nova/instances/24dc509c-5c24-4f2c-8a80-d466c11810e4/disk.config
May 27 03:18:51.053796 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/24dc509c-5c24-4f2c-8a80-d466c11810e4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6jml616d {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:18:51.108071 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/24dc509c-5c24-4f2c-8a80-d466c11810e4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6jml616d" returned: 0 in 0.054s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:18:51.495994 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:51.517530 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:51.518832 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:51.592566 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:51.696230 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7cb4c104-c19c-4b5f-8c97-50f6160605bb req-0810933d-e398-4374-b1f1-524dee95665a service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Received event network-vif-plugged-94e4ebcb-b252-4bcd-89d8-b71f5136c6db {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:18:51.696575 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7cb4c104-c19c-4b5f-8c97-50f6160605bb req-0810933d-e398-4374-b1f1-524dee95665a service nova] Acquiring lock "24dc509c-5c24-4f2c-8a80-d466c11810e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:51.696868 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7cb4c104-c19c-4b5f-8c97-50f6160605bb req-0810933d-e398-4374-b1f1-524dee95665a service nova] Lock "24dc509c-5c24-4f2c-8a80-d466c11810e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:51.697072 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7cb4c104-c19c-4b5f-8c97-50f6160605bb req-0810933d-e398-4374-b1f1-524dee95665a service nova] Lock "24dc509c-5c24-4f2c-8a80-d466c11810e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:51.697245 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7cb4c104-c19c-4b5f-8c97-50f6160605bb req-0810933d-e398-4374-b1f1-524dee95665a service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Processing event network-vif-plugged-94e4ebcb-b252-4bcd-89d8-b71f5136c6db {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:18:51.819859 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:51.859132 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:51.861646 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:51.870633 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:51.888197 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:52.290200 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:18:52.290573 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851932.2903228, 24dc509c-5c24-4f2c-8a80-d466c11810e4 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:18:52.290703 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] VM Started (Lifecycle Event)
May 27 03:18:52.293368 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:18:52.296059 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Instance spawned successfully.
May 27 03:18:52.297037 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:18:52.667141 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "6b89f301-37fb-43a6-9bef-bca32191186e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:52.667736 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:52.794060 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:18:52.797189 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:18:52.803626 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:18:52.803897 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:18:52.804019 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:18:52.804231 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:18:52.804474 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:18:52.804727 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:18:53.173911 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lazy-loading 'flavor' on Instance uuid 6b89f301-37fb-43a6-9bef-bca32191186e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:18:53.300965 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:18:53.301157 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851933.3010108, 24dc509c-5c24-4f2c-8a80-d466c11810e4 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:18:53.301250 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] VM Paused (Lifecycle Event)
May 27 03:18:53.313294 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Took 9.47 seconds to spawn the instance on the hypervisor.
May 27 03:18:53.313428 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:18:53.745882 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-180f86ec-a183-47c8-aba1-178d0d62ff57 req-9376f2cc-2ff7-43dc-a399-a56c6800f63d service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Received event network-vif-plugged-94e4ebcb-b252-4bcd-89d8-b71f5136c6db {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:18:53.746385 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-180f86ec-a183-47c8-aba1-178d0d62ff57 req-9376f2cc-2ff7-43dc-a399-a56c6800f63d service nova] Acquiring lock "24dc509c-5c24-4f2c-8a80-d466c11810e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:53.746603 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-180f86ec-a183-47c8-aba1-178d0d62ff57 req-9376f2cc-2ff7-43dc-a399-a56c6800f63d service nova] Lock "24dc509c-5c24-4f2c-8a80-d466c11810e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:53.746835 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-180f86ec-a183-47c8-aba1-178d0d62ff57 req-9376f2cc-2ff7-43dc-a399-a56c6800f63d service nova] Lock "24dc509c-5c24-4f2c-8a80-d466c11810e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:53.746957 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-180f86ec-a183-47c8-aba1-178d0d62ff57 req-9376f2cc-2ff7-43dc-a399-a56c6800f63d service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] No waiting events found dispatching network-vif-plugged-94e4ebcb-b252-4bcd-89d8-b71f5136c6db {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:18:53.747099 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-180f86ec-a183-47c8-aba1-178d0d62ff57 req-9376f2cc-2ff7-43dc-a399-a56c6800f63d service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Received unexpected event network-vif-plugged-94e4ebcb-b252-4bcd-89d8-b71f5136c6db for instance with vm_state active and task_state None.
May 27 03:18:53.804106 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:18:53.807251 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851933.806994, 24dc509c-5c24-4f2c-8a80-d466c11810e4 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:18:53.807421 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] VM Resumed (Lifecycle Event)
May 27 03:18:53.822175 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Took 16.39 seconds to build instance.
May 27 03:18:53.919324 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:54.182380 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:54.309825 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:18:54.311844 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:18:54.323515 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "24dc509c-5c24-4f2c-8a80-d466c11810e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.894s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:18:55.234126 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "6b89f301-37fb-43a6-9bef-bca32191186e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:18:55.234832 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:18:55.234832 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Attaching volume 892e5286-e0e9-4c61-9fd9-bf86cbeca371 to /dev/vdb
May 27 03:18:55.279943 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:18:55.295461 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:18:55.307303 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-157b8024-a564-4bce-b8af-980e5dd47e6e req-2cb275f9-a498-442d-8735-7414c5f58384 service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Received event network-changed-94e4ebcb-b252-4bcd-89d8-b71f5136c6db {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:18:55.307449 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-157b8024-a564-4bce-b8af-980e5dd47e6e req-2cb275f9-a498-442d-8735-7414c5f58384 service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Refreshing instance network info cache due to event network-changed-94e4ebcb-b252-4bcd-89d8-b71f5136c6db. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:18:55.309245 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-157b8024-a564-4bce-b8af-980e5dd47e6e req-2cb275f9-a498-442d-8735-7414c5f58384 service nova] Acquiring lock "refresh_cache-24dc509c-5c24-4f2c-8a80-d466c11810e4" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:18:55.312165 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-157b8024-a564-4bce-b8af-980e5dd47e6e req-2cb275f9-a498-442d-8735-7414c5f58384 service nova] Acquired lock "refresh_cache-24dc509c-5c24-4f2c-8a80-d466c11810e4" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:18:55.312351 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-157b8024-a564-4bce-b8af-980e5dd47e6e req-2cb275f9-a498-442d-8735-7414c5f58384 service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Refreshing network info cache for port 94e4ebcb-b252-4bcd-89d8-b71f5136c6db {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:18:55.318145 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:18:55.362891 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:18:55.363204 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:18:55.370768 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:18:55.371638 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:feb4:c7b5', 'fe80::bc23:aaff:fec6:2747', 'fe80::fc16:3eff:feb8:4da5', 'fe80::1870:c1ff:feca:47f8'] 
May 27 03:18:55.371789 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:18:55.371904 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:18:55.372148 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:18:55.372363 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Updating existing volume attachment record: 91f37667-94db-4533-9a9d-69af640873e4 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:18:55.815038 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-157b8024-a564-4bce-b8af-980e5dd47e6e req-2cb275f9-a498-442d-8735-7414c5f58384 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:55.923510 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:18:55.923868 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371', 'iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '892e5286-e0e9-4c61-9fd9-bf86cbeca371', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:18:55.924030 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:18:55.927523 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:18:55.927763 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371', 'iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '892e5286-e0e9-4c61-9fd9-bf86cbeca371', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:18:55.940296 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:18:55.941587 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:18:55.942050 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:18:55.942328 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:18:55.943142 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:18:55.943427 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:18:55.951979 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:18:55.952370 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:18:55.952515 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:18:55.952827 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.25 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:18:55.955177 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:18:55.955177 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:55.959807 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:18:55.959807 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:55.966985 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371] added
May 27 03:18:55.966985 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:18:55.966985 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:18:55.966985 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:18:55.966985 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:18:55.966985 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:18:55.966985 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:55.967286 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:18:55.967286 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.025(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:18:55.967860 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:18:55.970349 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371] added
May 27 03:18:55.970349 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:18:55.970349 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:18:55.970349 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:18:55.970349 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:18:55.970349 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:18:55.970349 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:55.970586 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:18:55.970763 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0273(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:18:55.970990 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:18:56.085950 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-157b8024-a564-4bce-b8af-980e5dd47e6e req-2cb275f9-a498-442d-8735-7414c5f58384 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:18:56.201012 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:18:56.201012 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:18:56.212543 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-157b8024-a564-4bce-b8af-980e5dd47e6e req-2cb275f9-a498-442d-8735-7414c5f58384 service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Updated VIF entry in instance network info cache for port 94e4ebcb-b252-4bcd-89d8-b71f5136c6db. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:18:56.212999 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-157b8024-a564-4bce-b8af-980e5dd47e6e req-2cb275f9-a498-442d-8735-7414c5f58384 service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Updating instance_info_cache with network_info: [{"id": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "address": "fa:16:3e:b8:4d:a5", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4ebcb-b2", "ovs_interfaceid": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:18:56.716428 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-157b8024-a564-4bce-b8af-980e5dd47e6e req-2cb275f9-a498-442d-8735-7414c5f58384 service nova] Releasing lock "refresh_cache-24dc509c-5c24-4f2c-8a80-d466c11810e4" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:18:56.822634 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:56.968079 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:18:56.971246 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:18:56.980107 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:18:56.980107 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:18:56.984129 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:18:56.984129 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:56.993438 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:57.000527 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:57.004932 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:57.004932 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:57.004932 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:18:57.005161 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:57.005161 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:57.005161 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:18:57.012929 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:57.012929 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:57.012929 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:18:57.013644 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:57.013644 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:57.013644 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:18:57.038854 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371, portal: 192.168.40.100,3260]
May 27 03:18:57.038854 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371, portal: 192.168.40.100,3260] successful.
May 27 03:18:57.038854 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:57.050040 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:57.055778 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371, portal: 192.168.50.100,3260]
May 27 03:18:57.055778 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371, portal: 192.168.50.100,3260] successful.
May 27 03:18:57.055778 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:57.063311 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:57.063311 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:57.063311 np0000001475 nova-compute[98471]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371 (non-flash)
May 27 03:18:57.063311 np0000001475 nova-compute[98471]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371 (non-flash)
May 27 03:18:57.063311 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:18:57.063453 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:57.063453 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:57.063453 np0000001475 nova-compute[98471]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371 (non-flash)
May 27 03:18:57.063453 np0000001475 nova-compute[98471]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371 (non-flash)
May 27 03:18:57.063453 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:18:57.063714 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.122s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:18:57.063849 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:18:57.064459 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] HCTL ('9', '-', '-', 0) found on session 209 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:18:57.064684 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:18:57.071597 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:18:57.090272 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Searching for a device in session 209 and hctl ['9', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:18:57.090272 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:57.090272 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:57.090272 np0000001475 nova-compute[98471]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371 (non-flash)
May 27 03:18:57.090272 np0000001475 nova-compute[98471]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371 (non-flash)
May 27 03:18:57.090272 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:18:57.090272 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:57.090272 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:18:57.090272 np0000001475 nova-compute[98471]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371 (non-flash)
May 27 03:18:57.090272 np0000001475 nova-compute[98471]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371 (non-flash)
May 27 03:18:57.090272 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:18:57.090272 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:18:57.090272 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:18:57.091688 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] HCTL ('10', '-', '-', 0) found on session 210 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:18:57.091688 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:18:57.106629 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Searching for a device in session 210 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:18:57.106629 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '892e5286-e0e9-4c61-9fd9-bf86cbeca371', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:18:57.201767 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:18:57.201767 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:18:58.086705 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Searching for a device in session 209 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:18:58.087132 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '892e5286-e0e9-4c61-9fd9-bf86cbeca371', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:18:58.921898 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:18:58.958224 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Found WWN 330000000d7736d41 for multipath device dm-3 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:18:58.958457 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:18:58.958602 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000d7736d41', 'path': '/dev/dm-3', 'multipath_id': '330000000d7736d41'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:18:58.958730 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d7736d41', 'path': '/dev/dm-3', 'multipath_id': '330000000d7736d41'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:18:58.961523 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lazy-loading 'flavor' on Instance uuid 6b89f301-37fb-43a6-9bef-bca32191186e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:18:59.196177 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:18:59.196593 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:18:59.199490 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:18:59.199824 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:18:59.464607 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Attempting to attach volume 892e5286-e0e9-4c61-9fd9-bf86cbeca371 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:18:59.465988 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:18:59.465988 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:18:59.465988 np0000001475 nova-compute[98471]:   <alias name="ua-892e5286-e0e9-4c61-9fd9-bf86cbeca371"/>
May 27 03:18:59.465988 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:18:59.465988 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:18:59.465988 np0000001475 nova-compute[98471]:   <serial>892e5286-e0e9-4c61-9fd9-bf86cbeca371</serial>
May 27 03:18:59.465988 np0000001475 nova-compute[98471]: </disk>
May 27 03:18:59.465988 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:19:01.099325 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:19:01.099932 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:19:01.099932 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:19:01.099932 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] No VIF found with MAC fa:16:3e:b4:c7:b5, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:19:01.199768 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:19:01.200026 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:19:01.207898 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:19:01.824717 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:02.648643 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-0bac2c14-2293-4b81-8f95-500c7bef5296 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.414s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:19:03.196142 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:19:03.196434 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:19:03.922955 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:06.826498 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:08.925653 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:10.199667 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:19:10.703852 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:19:10.704001 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:19:10.704101 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:19:10.704235 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:19:11.724379 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:19:11.813574 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:19:11.814082 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:19:11.828946 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:11.900638 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:19:11.901097 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:19:11.905167 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:19:11.906772 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:19:11.907789 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:19:11.951301 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:19:11.951794 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=13243MB free_disk=72.59159088134766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:19:11.951990 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:19:11.952263 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:19:12.027490 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "6b89f301-37fb-43a6-9bef-bca32191186e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:19:12.027696 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:19:12.531036 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Detaching volume 892e5286-e0e9-4c61-9fd9-bf86cbeca371
May 27 03:19:12.564736 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Attempting to driver detach volume 892e5286-e0e9-4c61-9fd9-bf86cbeca371 from mountpoint /dev/vdb
May 27 03:19:12.569905 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Found disk vdb by alias ua-892e5286-e0e9-4c61-9fd9-bf86cbeca371 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:19:12.571075 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Found disk vdb by alias ua-892e5286-e0e9-4c61-9fd9-bf86cbeca371 {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:19:12.571189 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Attempting to detach device vdb from instance 6b89f301-37fb-43a6-9bef-bca32191186e from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:19:12.571421 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:19:12.571421 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:19:12.571421 np0000001475 nova-compute[98471]:   <alias name="ua-892e5286-e0e9-4c61-9fd9-bf86cbeca371"/>
May 27 03:19:12.571421 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:19:12.571421 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:19:12.571421 np0000001475 nova-compute[98471]:   <serial>892e5286-e0e9-4c61-9fd9-bf86cbeca371</serial>
May 27 03:19:12.571421 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:19:12.571421 np0000001475 nova-compute[98471]: </disk>
May 27 03:19:12.571421 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:19:12.577343 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Successfully detached device vdb from instance 6b89f301-37fb-43a6-9bef-bca32191186e from the persistent domain config.
May 27 03:19:12.577469 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] (1/8): Attempting to detach device vdb with device alias ua-892e5286-e0e9-4c61-9fd9-bf86cbeca371 from instance 6b89f301-37fb-43a6-9bef-bca32191186e from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:19:12.577731 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:19:12.577731 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:19:12.577731 np0000001475 nova-compute[98471]:   <alias name="ua-892e5286-e0e9-4c61-9fd9-bf86cbeca371"/>
May 27 03:19:12.577731 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:19:12.577731 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:19:12.577731 np0000001475 nova-compute[98471]:   <serial>892e5286-e0e9-4c61-9fd9-bf86cbeca371</serial>
May 27 03:19:12.577731 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:19:12.577731 np0000001475 nova-compute[98471]: </disk>
May 27 03:19:12.577731 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:19:13.007028 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 6b89f301-37fb-43a6-9bef-bca32191186e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:19:13.007392 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 24dc509c-5c24-4f2c-8a80-d466c11810e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:19:13.007459 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:19:13.007648 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:19:11 up 50 min,  2 users,  load average: 2.69, 3.73, 4.47\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_5a4f4be9e90849f78581e1a1b5c6b050': '1', 'io_workload': '0', 'num_proj_bf4b0011da7449e7948bf2c8a41955f5': '1'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:19:13.021282 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851953.0209095, 6b89f301-37fb-43a6-9bef-bca32191186e => ua-892e5286-e0e9-4c61-9fd9-bf86cbeca371> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:19:13.022162 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-892e5286-e0e9-4c61-9fd9-bf86cbeca371 for instance 6b89f301-37fb-43a6-9bef-bca32191186e {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:19:13.024249 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Successfully detached device vdb from instance 6b89f301-37fb-43a6-9bef-bca32191186e from the live domain config.
May 27 03:19:13.025211 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:19:13.025529 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371', 'iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '892e5286-e0e9-4c61-9fd9-bf86cbeca371', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:19:13.025664 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:19:13.123147 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:19:13.123362 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:19:13.625753 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:19:13.928763 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:14.078693 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.052s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:19:14.078693 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371', 'iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '892e5286-e0e9-4c61-9fd9-bf86cbeca371', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:19:14.078693 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:19:14.100774 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:14.100774 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:14.100774 np0000001475 nova-compute[98471]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371 (non-flash)
May 27 03:19:14.100774 np0000001475 nova-compute[98471]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371 (non-flash)
May 27 03:19:14.100774 np0000001475 nova-compute[98471]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-043a7068-2c0d-458c-8dc9-86d22b59eadf (non-flash)
May 27 03:19:14.100774 np0000001475 nova-compute[98471]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-043a7068-2c0d-458c-8dc9-86d22b59eadf (non-flash)
May 27 03:19:14.100774 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:19:14.100774 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:14.100774 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:14.100774 np0000001475 nova-compute[98471]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371 (non-flash)
May 27 03:19:14.100774 np0000001475 nova-compute[98471]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371 (non-flash)
May 27 03:19:14.100774 np0000001475 nova-compute[98471]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-043a7068-2c0d-458c-8dc9-86d22b59eadf (non-flash)
May 27 03:19:14.100774 np0000001475 nova-compute[98471]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-043a7068-2c0d-458c-8dc9-86d22b59eadf (non-flash)
May 27 03:19:14.100774 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:19:14.100774 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371', '210'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-043a7068-2c0d-458c-8dc9-86d22b59eadf', '213'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-043a7068-2c0d-458c-8dc9-86d22b59eadf', '214')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:19:14.101217 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371', '209')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:19:14.101755 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371', '210')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:19:14.102400 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755724788ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371'): ({'sde'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:19:14.102589 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Removing multipathed devices sdd, sde {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:19:14.102876 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Flush multipath device 330000000d7736d41 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:19:14.131393 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:19:14.131546 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.179s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:19:14.131883 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 37.07 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:19:14.137078 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:19:14.177383 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:19:14.228134 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:19:14.228274 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:19:14.229199 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:19:14.239251 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:19:14.239542 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:19:14.252280 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:14.285537 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 209, target: iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371, portal: 192.168.40.100,3260]
May 27 03:19:14.285537 np0000001475 nova-compute[98471]: Logout of [sid: 209, target: iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371, portal: 192.168.40.100,3260] successful.
May 27 03:19:14.285537 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:14.299424 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:14.309079 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:14.336415 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 210, target: iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371, portal: 192.168.50.100,3260]
May 27 03:19:14.336415 np0000001475 nova-compute[98471]: Logout of [sid: 210, target: iqn.2023-03.storpool.com:os--volume-892e5286-e0e9-4c61-9fd9-bf86cbeca371, portal: 192.168.50.100,3260] successful.
May 27 03:19:14.336415 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:14.350086 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:14.350281 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:19:14.350388 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] <== disconnect_volume: return (1324ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:19:14.350498 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:19:14.890406 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lazy-loading 'flavor' on Instance uuid 6b89f301-37fb-43a6-9bef-bca32191186e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:19:15.895355 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-9ec667b7-3c81-422c-8132-f981c671ac9f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.867s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:19:16.829966 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:17.552384 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "6b89f301-37fb-43a6-9bef-bca32191186e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:19:17.552734 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:19:18.055411 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lazy-loading 'flavor' on Instance uuid 6b89f301-37fb-43a6-9bef-bca32191186e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:19:18.931950 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:19.059967 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:19:20.256947 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "6b89f301-37fb-43a6-9bef-bca32191186e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:19:20.257561 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:19:20.257561 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Attaching volume 371f0bef-c82b-499f-9602-ea337708c0ab to /dev/vdb
May 27 03:19:20.290180 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:19:20.300945 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:19:20.320219 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:19:20.364714 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:19:20.364982 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:19:20.373661 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:19:20.374932 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:feb4:c7b5', 'fe80::bc23:aaff:fec6:2747', 'fe80::fc16:3eff:feb8:4da5', 'fe80::1870:c1ff:feca:47f8'] 
May 27 03:19:20.375075 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:19:20.375204 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:19:20.375521 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:19:20.375925 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Updating existing volume attachment record: 6887ebfa-1791-49ef-8a1c-276f304884d1 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:19:20.925586 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:19:20.925969 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab', 'iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '371f0bef-c82b-499f-9602-ea337708c0ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:19:20.926109 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:19:20.926577 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:19:20.926768 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab', 'iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '371f0bef-c82b-499f-9602-ea337708c0ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:19:20.940604 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:19:20.942190 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:19:20.942815 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:19:20.943154 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:19:20.943431 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:19:20.943652 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:19:20.955243 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:19:20.955243 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:20.959800 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:19:20.959800 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:20.967377 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab] added
May 27 03:19:20.967377 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:19:20.967377 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:19:20.967377 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:19:20.967377 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:19:20.967377 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:19:20.967377 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:20.967691 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:19:20.967691 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.024(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:19:20.967858 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:19:20.972186 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab] added
May 27 03:19:20.972186 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:19:20.972186 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:19:20.972186 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:19:20.972186 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:19:20.972186 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:19:20.972186 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:20.972372 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:19:20.972587 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0295(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:19:20.972805 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:19:21.831127 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:21.968276 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:19:21.973341 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:19:21.980429 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:19:21.980429 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:19:21.986781 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:19:21.986781 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:21.992942 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:21.999501 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:22.005925 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:22.005925 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:22.005925 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:19:22.006064 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:22.006064 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:22.006064 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:19:22.011325 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:22.011325 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:22.011325 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:19:22.011499 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:22.011499 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:22.011499 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:19:22.029301 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab, portal: 192.168.50.100,3260]
May 27 03:19:22.029301 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab, portal: 192.168.50.100,3260] successful.
May 27 03:19:22.029301 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:22.040083 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:22.044856 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab, portal: 192.168.40.100,3260]
May 27 03:19:22.044856 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab, portal: 192.168.40.100,3260] successful.
May 27 03:19:22.044856 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:22.052930 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:22.052930 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:22.052930 np0000001475 nova-compute[98471]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab (non-flash)
May 27 03:19:22.052930 np0000001475 nova-compute[98471]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab (non-flash)
May 27 03:19:22.052930 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:19:22.053111 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:22.053111 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:22.053111 np0000001475 nova-compute[98471]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab (non-flash)
May 27 03:19:22.053111 np0000001475 nova-compute[98471]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab (non-flash)
May 27 03:19:22.053111 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:19:22.053338 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.110s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:19:22.053441 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:19:22.054159 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] HCTL ('9', '-', '-', 0) found on session 215 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:19:22.054262 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:19:22.058196 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:22.066983 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Searching for a device in session 215 and hctl ['9', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:19:22.071729 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:22.071729 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:22.071729 np0000001475 nova-compute[98471]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab (non-flash)
May 27 03:19:22.071729 np0000001475 nova-compute[98471]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab (non-flash)
May 27 03:19:22.071729 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:19:22.071877 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:22.071877 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:22.071877 np0000001475 nova-compute[98471]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab (non-flash)
May 27 03:19:22.071877 np0000001475 nova-compute[98471]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab (non-flash)
May 27 03:19:22.071877 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:19:22.072070 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:19:22.072165 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:19:22.072672 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] HCTL ('10', '-', '-', 0) found on session 216 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:19:22.072781 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:19:22.085087 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Searching for a device in session 216 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:19:22.085087 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '371f0bef-c82b-499f-9602-ea337708c0ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:19:23.066390 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Searching for a device in session 215 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:19:23.066825 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '371f0bef-c82b-499f-9602-ea337708c0ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:19:23.475555 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:23.933341 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:23.958368 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Found WWN 330000000fc15be8d for multipath device dm-3 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:19:23.958666 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:19:23.958836 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000fc15be8d', 'path': '/dev/dm-3', 'multipath_id': '330000000fc15be8d'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:19:23.958999 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000fc15be8d', 'path': '/dev/dm-3', 'multipath_id': '330000000fc15be8d'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:19:23.962025 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lazy-loading 'flavor' on Instance uuid 6b89f301-37fb-43a6-9bef-bca32191186e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:19:24.465078 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Attempting to attach volume 371f0bef-c82b-499f-9602-ea337708c0ab with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:19:24.466391 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:19:24.466391 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:19:24.466391 np0000001475 nova-compute[98471]:   <alias name="ua-371f0bef-c82b-499f-9602-ea337708c0ab"/>
May 27 03:19:24.466391 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:19:24.466391 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:19:24.466391 np0000001475 nova-compute[98471]:   <serial>371f0bef-c82b-499f-9602-ea337708c0ab</serial>
May 27 03:19:24.466391 np0000001475 nova-compute[98471]: </disk>
May 27 03:19:24.466391 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:19:25.338018 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:19:25.338254 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:19:25.840714 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:19:26.098411 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:19:26.098574 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:19:26.098574 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:19:26.098732 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] No VIF found with MAC fa:16:3e:b4:c7:b5, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:19:26.383439 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:19:26.383641 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:19:26.386842 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:19:26.387056 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Claim successful on node np0000001475
May 27 03:19:27.543621 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:19:27.543996 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:19:27.638644 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-de4678f7-2234-4c89-8200-98a7356cc85a tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.381s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:19:28.046455 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:19:28.554588 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.171s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:19:28.555149 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:19:28.936073 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:29.059008 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:19:29.061097 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:19:29.061234 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:19:29.061472 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:19:29.061720 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:19:29.123421 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8eeaf68cfb534238bfe879dd6e8f858f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0011da7449e7948bf2c8a41955f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:19:29.507452 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Successfully created port: be24e43a-cbcb-4021-95f2-804a31e9b436 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:19:29.563386 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:19:29.968346 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Successfully updated port: be24e43a-cbcb-4021-95f2-804a31e9b436 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:19:30.018411 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-923e4e5b-47d1-4311-ae32-d2816b37808d req-e2899ea7-acbe-4fa0-84b8-22ea17ee4370 service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Received event network-changed-be24e43a-cbcb-4021-95f2-804a31e9b436 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:19:30.019525 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-923e4e5b-47d1-4311-ae32-d2816b37808d req-e2899ea7-acbe-4fa0-84b8-22ea17ee4370 service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Refreshing instance network info cache due to event network-changed-be24e43a-cbcb-4021-95f2-804a31e9b436. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:19:30.019691 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-923e4e5b-47d1-4311-ae32-d2816b37808d req-e2899ea7-acbe-4fa0-84b8-22ea17ee4370 service nova] Acquiring lock "refresh_cache-7e08cfc9-c2e0-477d-92e6-89eeb0bdd340" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:19:30.019845 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-923e4e5b-47d1-4311-ae32-d2816b37808d req-e2899ea7-acbe-4fa0-84b8-22ea17ee4370 service nova] Acquired lock "refresh_cache-7e08cfc9-c2e0-477d-92e6-89eeb0bdd340" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:19:30.020060 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-923e4e5b-47d1-4311-ae32-d2816b37808d req-e2899ea7-acbe-4fa0-84b8-22ea17ee4370 service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Refreshing network info cache for port be24e43a-cbcb-4021-95f2-804a31e9b436 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:19:30.067035 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Booting with volume snapshot 2237777e-e7b2-4e90-becc-7f84afe9abdc at /dev/vda
May 27 03:19:30.470443 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "refresh_cache-7e08cfc9-c2e0-477d-92e6-89eeb0bdd340" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:19:30.521874 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-923e4e5b-47d1-4311-ae32-d2816b37808d req-e2899ea7-acbe-4fa0-84b8-22ea17ee4370 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:19:30.575134 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-923e4e5b-47d1-4311-ae32-d2816b37808d req-e2899ea7-acbe-4fa0-84b8-22ea17ee4370 service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:19:30.699188 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-923e4e5b-47d1-4311-ae32-d2816b37808d req-e2899ea7-acbe-4fa0-84b8-22ea17ee4370 service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:19:30.818403 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "6b89f301-37fb-43a6-9bef-bca32191186e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:19:30.818591 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:19:31.201113 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-923e4e5b-47d1-4311-ae32-d2816b37808d req-e2899ea7-acbe-4fa0-84b8-22ea17ee4370 service nova] Releasing lock "refresh_cache-7e08cfc9-c2e0-477d-92e6-89eeb0bdd340" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:19:31.201430 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquired lock "refresh_cache-7e08cfc9-c2e0-477d-92e6-89eeb0bdd340" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:19:31.201602 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:19:31.320950 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Detaching volume 371f0bef-c82b-499f-9602-ea337708c0ab
May 27 03:19:31.356691 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Attempting to driver detach volume 371f0bef-c82b-499f-9602-ea337708c0ab from mountpoint /dev/vdb
May 27 03:19:31.361826 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Found disk vdb by alias ua-371f0bef-c82b-499f-9602-ea337708c0ab {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:19:31.363167 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Found disk vdb by alias ua-371f0bef-c82b-499f-9602-ea337708c0ab {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:19:31.363308 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Attempting to detach device vdb from instance 6b89f301-37fb-43a6-9bef-bca32191186e from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:19:31.363573 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:19:31.363573 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:19:31.363573 np0000001475 nova-compute[98471]:   <alias name="ua-371f0bef-c82b-499f-9602-ea337708c0ab"/>
May 27 03:19:31.363573 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:19:31.363573 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:19:31.363573 np0000001475 nova-compute[98471]:   <serial>371f0bef-c82b-499f-9602-ea337708c0ab</serial>
May 27 03:19:31.363573 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:19:31.363573 np0000001475 nova-compute[98471]: </disk>
May 27 03:19:31.363573 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:19:31.369034 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Successfully detached device vdb from instance 6b89f301-37fb-43a6-9bef-bca32191186e from the persistent domain config.
May 27 03:19:31.369192 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] (1/8): Attempting to detach device vdb with device alias ua-371f0bef-c82b-499f-9602-ea337708c0ab from instance 6b89f301-37fb-43a6-9bef-bca32191186e from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:19:31.369463 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:19:31.369463 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:19:31.369463 np0000001475 nova-compute[98471]:   <alias name="ua-371f0bef-c82b-499f-9602-ea337708c0ab"/>
May 27 03:19:31.369463 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-3"/>
May 27 03:19:31.369463 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:19:31.369463 np0000001475 nova-compute[98471]:   <serial>371f0bef-c82b-499f-9602-ea337708c0ab</serial>
May 27 03:19:31.369463 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:19:31.369463 np0000001475 nova-compute[98471]: </disk>
May 27 03:19:31.369463 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:19:31.762767 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:19:31.833700 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:31.839308 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851971.8389602, 6b89f301-37fb-43a6-9bef-bca32191186e => ua-371f0bef-c82b-499f-9602-ea337708c0ab> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:19:31.840341 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-371f0bef-c82b-499f-9602-ea337708c0ab for instance 6b89f301-37fb-43a6-9bef-bca32191186e {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:19:31.842385 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Successfully detached device vdb from instance 6b89f301-37fb-43a6-9bef-bca32191186e from the live domain config.
May 27 03:19:31.843402 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:19:31.843681 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab', 'iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '371f0bef-c82b-499f-9602-ea337708c0ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:19:31.843836 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:19:31.844139 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:19:31.844384 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab', 'iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '371f0bef-c82b-499f-9602-ea337708c0ab', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:19:31.844534 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:19:31.867833 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:31.867833 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:31.867833 np0000001475 nova-compute[98471]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab (non-flash)
May 27 03:19:31.867833 np0000001475 nova-compute[98471]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab (non-flash)
May 27 03:19:31.867833 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:19:31.868010 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:31.868010 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:31.868010 np0000001475 nova-compute[98471]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab (non-flash)
May 27 03:19:31.868010 np0000001475 nova-compute[98471]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab (non-flash)
May 27 03:19:31.868010 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:19:31.868095 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', '206'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab', '216')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:19:31.868201 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab', '216')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:19:31.869007 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab', '215')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:19:31.869626 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x755724789a80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab'): ({'sdd'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:19:31.869830 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Removing multipathed devices sdd, sde {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:19:31.870071 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Flush multipath device 330000000fc15be8d {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:19:31.894892 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:19:31.903222 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:19:31.943243 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:19:31.990286 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:19:31.990488 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:19:31.991555 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:19:32.001983 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:19:32.002236 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:19:32.006599 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Updating instance_info_cache with network_info: [{"id": "be24e43a-cbcb-4021-95f2-804a31e9b436", "address": "fa:16:3e:3b:ac:7f", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24e43a-cb", "ovs_interfaceid": "be24e43a-cbcb-4021-95f2-804a31e9b436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:19:32.013533 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:32.040558 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 216, target: iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab, portal: 192.168.40.100,3260]
May 27 03:19:32.040558 np0000001475 nova-compute[98471]: Logout of [sid: 216, target: iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab, portal: 192.168.40.100,3260] successful.
May 27 03:19:32.040558 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:32.052953 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:32.062867 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:32.090779 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 215, target: iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab, portal: 192.168.50.100,3260]
May 27 03:19:32.090779 np0000001475 nova-compute[98471]: Logout of [sid: 215, target: iqn.2023-03.storpool.com:os--volume-371f0bef-c82b-499f-9602-ea337708c0ab, portal: 192.168.50.100,3260] successful.
May 27 03:19:32.090779 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:32.102992 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:32.103193 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:19:32.103304 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] <== disconnect_volume: return (259ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:19:32.103416 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:19:32.508430 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Releasing lock "refresh_cache-7e08cfc9-c2e0-477d-92e6-89eeb0bdd340" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:19:32.508739 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Instance network_info: |[{"id": "be24e43a-cbcb-4021-95f2-804a31e9b436", "address": "fa:16:3e:3b:ac:7f", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24e43a-cb", "ovs_interfaceid": "be24e43a-cbcb-4021-95f2-804a31e9b436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:19:32.645948 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lazy-loading 'flavor' on Instance uuid 6b89f301-37fb-43a6-9bef-bca32191186e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:19:33.420720 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:19:33.430911 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:19:33.450234 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:19:33.494169 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:19:33.494433 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:19:33.502889 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:19:33.505073 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:feb4:c7b5', 'fe80::bc23:aaff:fec6:2747', 'fe80::fc16:3eff:feb8:4da5', 'fe80::1870:c1ff:feca:47f8'] 
May 27 03:19:33.505174 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:19:33.505282 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:19:33.505499 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:19:33.505723 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Updating existing volume attachment record: 10c66108-7f47-4494-a1c4-62c95856a9f9 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:19:33.651365 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f42ae143-bff4-4df3-a2ff-9b330371e43f tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.833s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:19:33.938961 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:35.135811 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "6b89f301-37fb-43a6-9bef-bca32191186e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:19:35.136261 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:19:35.590012 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:19:35.591168 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:19:35.591391 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Creating image(s)
May 27 03:19:35.591751 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:19:35.591889 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Ensure instance console log exists: /opt/stack/data/nova/instances/7e08cfc9-c2e0-477d-92e6-89eeb0bdd340/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:19:35.592100 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:19:35.592264 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:19:35.592403 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:19:35.593006 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Start _get_guest_xml network_info=[{"id": "be24e43a-cbcb-4021-95f2-804a31e9b436", "address": "fa:16:3e:3b:ac:7f", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24e43a-cb", "ovs_interfaceid": "be24e43a-cbcb-4021-95f2-804a31e9b436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-27T03:19:22Z,direct_url=<?>,disk_format='raw',id=18aba7c5-034e-4529-9558-7accac2e46fa,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-594298908',owner='bf4b0011da7449e7948bf2c8a41955f5',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-27T03:19:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4e84a5fb-8d85-456d-91f3-34ad03465904', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7e08cfc9-c2e0-477d-92e6-89eeb0bdd340', 'attached_at': '', 'detached_at': '', 'volume_id': '4e84a5fb-8d85-456d-91f3-34ad03465904', 'serial': '4e84a5fb-8d85-456d-91f3-34ad03465904'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '10c66108-7f47-4494-a1c4-62c95856a9f9', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:19:35.597547 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:19:35.598927 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-image-snapshot-server-1715903198', uuid='7e08cfc9-c2e0-477d-92e6-89eeb0bdd340'), owner=OwnerMeta(userid='8eeaf68cfb534238bfe879dd6e8f858f', username='tempest-TestVolumeBootPattern-360350731-project-member', projectid='bf4b0011da7449e7948bf2c8a41955f5', projectname='tempest-TestVolumeBootPattern-360350731'), image=ImageMeta(id='18aba7c5-034e-4529-9558-7accac2e46fa', name=None, container_format='bare', disk_format='raw', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_bdm_v2': True, 'img_root_device_name': '/dev/vda'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "be24e43a-cbcb-4021-95f2-804a31e9b436", "address": "fa:16:3e:3b:ac:7f", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24e43a-cb", "ovs_interfaceid": "be24e43a-cbcb-4021-95f2-804a31e9b436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779851975.5984566) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:19:35.600017 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:19:35.600304 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:19:35.601801 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:19:35.602339 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:19:35.603057 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:19:35.603384 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-27T03:19:22Z,direct_url=<?>,disk_format='raw',id=18aba7c5-034e-4529-9558-7accac2e46fa,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-594298908',owner='bf4b0011da7449e7948bf2c8a41955f5',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-27T03:19:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:19:35.603544 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:19:35.603683 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:19:35.603850 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:19:35.603944 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:19:35.604059 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:19:35.604205 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:19:35.604302 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:19:35.604407 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:19:35.604503 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:19:35.604612 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:19:35.613428 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:19:35.613754 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4e84a5fb-8d85-456d-91f3-34ad03465904', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:19:35.613892 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:19:35.614230 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:19:35.614399 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4e84a5fb-8d85-456d-91f3-34ad03465904', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:19:35.624716 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:19:35.625257 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:19:35.625727 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:19:35.625909 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:19:35.626251 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:19:35.626444 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:19:35.637126 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:19:35.637126 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:35.639807 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lazy-loading 'flavor' on Instance uuid 6b89f301-37fb-43a6-9bef-bca32191186e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:19:35.642229 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:19:35.642229 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:35.649578 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904] added
May 27 03:19:35.649578 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:19:35.649578 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:19:35.649578 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:19:35.649578 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:19:35.649578 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:19:35.649578 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:35.649852 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:19:35.649957 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0235(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:19:35.650139 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:19:35.652754 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904] added
May 27 03:19:35.652754 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:19:35.652754 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:19:35.652754 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:19:35.652754 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:19:35.652754 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:19:35.652754 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:35.652928 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:19:35.653107 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0272(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:19:35.653241 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:19:36.644418 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:19:36.650555 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:19:36.653674 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:19:36.662203 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:19:36.662203 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:19:36.668102 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:19:36.668102 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:36.676255 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:36.680925 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:36.688621 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:36.688621 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:36.688621 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:19:36.688851 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:36.688851 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:36.688851 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:19:36.694512 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:36.694512 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:36.694512 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:19:36.694688 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:36.694688 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:36.694688 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:19:36.715875 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904, portal: 192.168.40.100,3260]
May 27 03:19:36.715875 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904, portal: 192.168.40.100,3260] successful.
May 27 03:19:36.715875 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:36.724236 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904, portal: 192.168.50.100,3260]
May 27 03:19:36.724236 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904, portal: 192.168.50.100,3260] successful.
May 27 03:19:36.724236 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:36.728468 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:36.734428 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:36.741997 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:36.741997 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:36.741997 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:36.741997 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:36.741997 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:19:36.742162 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:36.742162 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:36.742162 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:36.742162 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:36.742162 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:19:36.742424 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.116s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:19:36.742559 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:19:36.743190 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('9', '-', '-', 0) found on session 217 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:19:36.743321 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:19:36.748054 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:36.748054 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:36.748054 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:36.748054 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:36.748054 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:19:36.748197 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:36.748197 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:36.748197 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:36.748197 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:36.748197 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:19:36.748394 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.123s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:19:36.748522 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:19:36.749046 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('10', '-', '-', 0) found on session 218 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:19:36.749150 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:19:36.758409 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 217 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:19:36.758409 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4e84a5fb-8d85-456d-91f3-34ad03465904', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:19:36.763651 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 218 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:19:36.763651 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4e84a5fb-8d85-456d-91f3-34ad03465904', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:19:36.836784 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:37.626509 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:19:37.699956 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "6b89f301-37fb-43a6-9bef-bca32191186e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:19:37.700490 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:19:37.700490 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Attaching volume 949be1f5-e13d-4358-8d1e-fdbb3f0873eb to /dev/vdb
May 27 03:19:37.736529 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:19:37.747279 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:19:37.767889 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:19:37.812613 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:19:37.812977 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:19:37.821355 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:19:37.822391 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:feb4:c7b5', 'fe80::bc23:aaff:fec6:2747', 'fe80::fc16:3eff:feb8:4da5', 'fe80::1870:c1ff:feca:47f8'] 
May 27 03:19:37.822517 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:19:37.822631 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:19:37.822905 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:19:37.823139 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Updating existing volume attachment record: e240fa87-976f-4f87-93ff-dbf21cf1e722 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:19:38.368736 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:19:38.369078 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb', 'iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '949be1f5-e13d-4358-8d1e-fdbb3f0873eb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:19:38.369219 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:19:38.642615 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Found WWN 330000000a2d4d9fd for multipath device dm-3 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:19:38.642944 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:19:38.643135 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '330000000a2d4d9fd', 'path': '/dev/dm-3', 'multipath_id': '330000000a2d4d9fd'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:19:38.643283 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a2d4d9fd', 'path': '/dev/dm-3', 'multipath_id': '330000000a2d4d9fd'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:19:38.643956 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.274s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:19:38.643956 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb', 'iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '949be1f5-e13d-4358-8d1e-fdbb3f0873eb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:19:38.654930 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:19:38.655570 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:19:38.656019 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:19:38.656235 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:19:38.656630 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:19:38.656835 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:19:38.666909 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:19:38.666909 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:38.671610 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:19:38.671610 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:38.678257 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb] added
May 27 03:19:38.678257 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:19:38.678257 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:19:38.678257 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:19:38.678257 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:19:38.678257 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:19:38.678257 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:38.678462 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:19:38.678599 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0224(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:19:38.678922 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:19:38.681403 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb] added
May 27 03:19:38.681403 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:19:38.681403 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:19:38.681403 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:19:38.681403 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:19:38.681403 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:19:38.681403 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:38.681403 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:19:38.681550 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0247(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:19:38.681696 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:19:38.959366 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:39.150370 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:19:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1715903198',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1715903198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-image-snapshot-server-1715903198',id=78,image_ref='18aba7c5-034e-4529-9558-7accac2e46fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOa7Rsk7mHkuIrao2J1jh8DKwVYpfWu/Mkir5ktk21esXsd60s/tiPp0884eka8Uci+liADyXDy7qOcRKr1ZugflxMLgPCNGupxawMXMf8c/UKVP4X2EOWEl+X103bu4Hg==',key_name='tempest-keypair-610226626',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-b1colqlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-360350731',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:19:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=7e08cfc9-c2e0-477d-92e6-89eeb0bdd340,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be24e43a-cbcb-4021-95f2-804a31e9b436", "address": "fa:16:3e:3b:ac:7f", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24e43a-cb", "ovs_interfaceid": "be24e43a-cbcb-4021-95f2-804a31e9b436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:19:39.150657 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "be24e43a-cbcb-4021-95f2-804a31e9b436", "address": "fa:16:3e:3b:ac:7f", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24e43a-cb", "ovs_interfaceid": "be24e43a-cbcb-4021-95f2-804a31e9b436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:19:39.151315 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ac:7f,bridge_name='br-int',has_traffic_filtering=True,id=be24e43a-cbcb-4021-95f2-804a31e9b436,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe24e43a-cb') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:19:39.151988 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:19:39.656485 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] End _get_guest_xml xml=<domain type="qemu">
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:   <uuid>7e08cfc9-c2e0-477d-92e6-89eeb0bdd340</uuid>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:   <name>instance-0000004e</name>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1715903198</nova:name>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:19:35</nova:creationTime>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:         <nova:containerFormat>bare</nova:containerFormat>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:         <nova:diskFormat>raw</nova:diskFormat>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:           <nova:property name="hw_machine_type">pc</nova:property>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:           <nova:property name="hw_video_model">virtio</nova:property>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:           <nova:property name="img_bdm_v2">True</nova:property>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:           <nova:property name="img_root_device_name">/dev/vda</nova:property>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:         <nova:user uuid="8eeaf68cfb534238bfe879dd6e8f858f">tempest-TestVolumeBootPattern-360350731-project-member</nova:user>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:         <nova:project uuid="bf4b0011da7449e7948bf2c8a41955f5">tempest-TestVolumeBootPattern-360350731</nova:project>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <nova:root type="image" uuid=""/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:         <nova:port uuid="be24e43a-cbcb-4021-95f2-804a31e9b436">
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     <system>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <entry name="serial">7e08cfc9-c2e0-477d-92e6-89eeb0bdd340</entry>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <entry name="uuid">7e08cfc9-c2e0-477d-92e6-89eeb0bdd340</entry>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     </system>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:   <os>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:   </os>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:   <features>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:   </features>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:   <devices>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/7e08cfc9-c2e0-477d-92e6-89eeb0bdd340/disk.config"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     </disk>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <alias name="ua-4e84a5fb-8d85-456d-91f3-34ad03465904"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-3"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <serial>4e84a5fb-8d85-456d-91f3-34ad03465904</serial>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     </disk>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:3b:ac:7f"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <target dev="tapbe24e43a-cb"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     </interface>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/7e08cfc9-c2e0-477d-92e6-89eeb0bdd340/console.log" append="off"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     </serial>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     <video>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     </video>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     </rng>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:   </devices>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]: </domain>
May 27 03:19:39.656485 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:19:39.659618 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Preparing to wait for external event network-vif-plugged-be24e43a-cbcb-4021-95f2-804a31e9b436 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:19:39.659618 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:19:39.659618 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:19:39.659618 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:19:39.659618 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:19:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1715903198',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1715903198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-image-snapshot-server-1715903198',id=78,image_ref='18aba7c5-034e-4529-9558-7accac2e46fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOa7Rsk7mHkuIrao2J1jh8DKwVYpfWu/Mkir5ktk21esXsd60s/tiPp0884eka8Uci+liADyXDy7qOcRKr1ZugflxMLgPCNGupxawMXMf8c/UKVP4X2EOWEl+X103bu4Hg==',key_name='tempest-keypair-610226626',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-b1colqlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-360350731',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:19:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=7e08cfc9-c2e0-477d-92e6-89eeb0bdd340,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be24e43a-cbcb-4021-95f2-804a31e9b436", "address": "fa:16:3e:3b:ac:7f", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24e43a-cb", "ovs_interfaceid": "be24e43a-cbcb-4021-95f2-804a31e9b436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:19:39.659618 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "be24e43a-cbcb-4021-95f2-804a31e9b436", "address": "fa:16:3e:3b:ac:7f", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24e43a-cb", "ovs_interfaceid": "be24e43a-cbcb-4021-95f2-804a31e9b436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:19:39.659618 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ac:7f,bridge_name='br-int',has_traffic_filtering=True,id=be24e43a-cbcb-4021-95f2-804a31e9b436,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe24e43a-cb') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:19:39.659618 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ac:7f,bridge_name='br-int',has_traffic_filtering=True,id=be24e43a-cbcb-4021-95f2-804a31e9b436,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe24e43a-cb') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:19:39.659618 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:39.659618 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:19:39.660166 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:19:39.660496 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:39.660644 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81839ed0-8930-59e9-a42f-6ac4072b8309', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:19:39.661381 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:39.662103 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:19:39.662655 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:39.664767 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:39.664767 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe24e43a-cb, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:19:39.664767 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe24e43a-cb, col_values=(('qos', UUID('c9a9e276-44cc-4813-b861-f9a2ce6fe851')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:19:39.664767 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe24e43a-cb, col_values=(('external_ids', {'iface-id': 'be24e43a-cbcb-4021-95f2-804a31e9b436', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:ac:7f', 'vm-uuid': '7e08cfc9-c2e0-477d-92e6-89eeb0bdd340'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:19:39.665415 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:39.666229 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:19:39.671487 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:39.672198 np0000001475 nova-compute[98471]: INFO os_vif [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ac:7f,bridge_name='br-int',has_traffic_filtering=True,id=be24e43a-cbcb-4021-95f2-804a31e9b436,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe24e43a-cb')
May 27 03:19:39.679217 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:19:39.681994 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:19:39.691395 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:19:39.691395 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:19:39.696937 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:19:39.696937 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:39.703067 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:39.708925 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:39.716313 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:39.716313 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:39.716313 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:39.716313 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:39.716313 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:19:39.716534 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:39.716534 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:39.716534 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:39.716534 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:39.716534 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:19:39.724888 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:39.724888 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:39.724888 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:39.724888 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:39.724888 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:19:39.725031 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:39.725031 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:39.725031 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:39.725031 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:39.725031 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:19:39.753728 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb, portal: 192.168.40.100,3260]
May 27 03:19:39.753728 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb, portal: 192.168.40.100,3260] successful.
May 27 03:19:39.753728 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:39.764395 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:39.769519 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb, portal: 192.168.50.100,3260]
May 27 03:19:39.769519 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb, portal: 192.168.50.100,3260] successful.
May 27 03:19:39.769519 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:39.778053 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:39.778053 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:39.778053 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:39.778053 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:39.778053 np0000001475 nova-compute[98471]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb (non-flash)
May 27 03:19:39.778053 np0000001475 nova-compute[98471]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb (non-flash)
May 27 03:19:39.778053 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:19:39.778303 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:39.778303 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:39.778303 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:39.778303 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:39.778303 np0000001475 nova-compute[98471]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb (non-flash)
May 27 03:19:39.778303 np0000001475 nova-compute[98471]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb (non-flash)
May 27 03:19:39.778303 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:19:39.778494 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.123s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:19:39.778494 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:19:39.778932 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:39.779696 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] HCTL ('11', '-', '-', 0) found on session 219 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:19:39.779842 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:19:39.793417 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:39.793417 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:39.793417 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:39.793417 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:39.793417 np0000001475 nova-compute[98471]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb (non-flash)
May 27 03:19:39.793417 np0000001475 nova-compute[98471]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb (non-flash)
May 27 03:19:39.793417 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:19:39.793708 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:39.793708 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:39.793708 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:39.793708 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:39.793708 np0000001475 nova-compute[98471]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb (non-flash)
May 27 03:19:39.793708 np0000001475 nova-compute[98471]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb (non-flash)
May 27 03:19:39.793708 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:19:39.796159 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:19:39.796159 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:19:39.796159 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Searching for a device in session 219 and hctl ['11', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:19:39.796159 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] HCTL ('12', '-', '-', 0) found on session 220 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:19:39.796159 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:19:39.810152 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Searching for a device in session 220 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:19:39.810152 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '949be1f5-e13d-4358-8d1e-fdbb3f0873eb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:19:40.795635 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Searching for a device in session 219 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:19:40.796135 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '949be1f5-e13d-4358-8d1e-fdbb3f0873eb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:19:41.188259 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:19:41.188400 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:19:41.188539 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No VIF found with MAC fa:16:3e:3b:ac:7f, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:19:41.189046 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Using config drive
May 27 03:19:41.671915 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Found WWN 330000000415fc3c8 for multipath device dm-7 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:19:41.672148 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:19:41.672296 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] <== connect_volume: return (3302ms) {'type': 'block', 'scsi_wwn': '330000000415fc3c8', 'path': '/dev/dm-7', 'multipath_id': '330000000415fc3c8'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:19:41.672426 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000415fc3c8', 'path': '/dev/dm-7', 'multipath_id': '330000000415fc3c8'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:19:41.674986 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lazy-loading 'flavor' on Instance uuid 6b89f301-37fb-43a6-9bef-bca32191186e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:19:41.693711 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:19:41.795623 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Creating config drive at /opt/stack/data/nova/instances/7e08cfc9-c2e0-477d-92e6-89eeb0bdd340/disk.config
May 27 03:19:41.799612 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7e08cfc9-c2e0-477d-92e6-89eeb0bdd340/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0mctwfgj {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:19:41.855673 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7e08cfc9-c2e0-477d-92e6-89eeb0bdd340/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0mctwfgj" returned: 0 in 0.056s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:19:42.178812 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Attempting to attach volume 949be1f5-e13d-4358-8d1e-fdbb3f0873eb with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:19:42.180829 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:19:42.180829 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:19:42.180829 np0000001475 nova-compute[98471]:   <alias name="ua-949be1f5-e13d-4358-8d1e-fdbb3f0873eb"/>
May 27 03:19:42.180829 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-7"/>
May 27 03:19:42.180829 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:19:42.180829 np0000001475 nova-compute[98471]:   <serial>949be1f5-e13d-4358-8d1e-fdbb3f0873eb</serial>
May 27 03:19:42.180829 np0000001475 nova-compute[98471]: </disk>
May 27 03:19:42.180829 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:19:42.209448 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:42.231598 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:42.233339 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:42.346263 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:42.347073 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:42.357181 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0e2cd07e-6fd8-476c-b37a-3776eab19273 req-c7a6578d-c934-4850-b6f0-b09094c0fa3c service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Received event network-vif-plugged-be24e43a-cbcb-4021-95f2-804a31e9b436 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:19:42.357241 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0e2cd07e-6fd8-476c-b37a-3776eab19273 req-c7a6578d-c934-4850-b6f0-b09094c0fa3c service nova] Acquiring lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:19:42.357738 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0e2cd07e-6fd8-476c-b37a-3776eab19273 req-c7a6578d-c934-4850-b6f0-b09094c0fa3c service nova] Lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:19:42.357933 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-0e2cd07e-6fd8-476c-b37a-3776eab19273 req-c7a6578d-c934-4850-b6f0-b09094c0fa3c service nova] Lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:19:42.358031 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-0e2cd07e-6fd8-476c-b37a-3776eab19273 req-c7a6578d-c934-4850-b6f0-b09094c0fa3c service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Processing event network-vif-plugged-be24e43a-cbcb-4021-95f2-804a31e9b436 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:19:42.420823 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:42.962401 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851982.962032, 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:19:42.962854 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] VM Started (Lifecycle Event)
May 27 03:19:42.963969 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:19:42.966174 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:19:42.969277 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Instance spawned successfully.
May 27 03:19:42.969717 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:19:42.973481 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:19:42.974020 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:19:43.465252 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:19:43.467123 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:19:43.479677 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Took 7.89 seconds to spawn the instance on the hypervisor.
May 27 03:19:43.480101 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:19:43.847139 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:19:43.847246 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:19:43.847331 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:19:43.847457 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] No VIF found with MAC fa:16:3e:b4:c7:b5, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:19:43.969561 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:19:43.970067 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851983.9697037, 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:19:43.970067 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] VM Paused (Lifecycle Event)
May 27 03:19:43.988822 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Took 17.64 seconds to build instance.
May 27 03:19:44.425971 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-080786cd-7054-4712-9883-a0935a899715 req-9bd51e25-0ff5-4fb6-9020-4c7ec4a9e445 service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Received event network-vif-plugged-be24e43a-cbcb-4021-95f2-804a31e9b436 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:19:44.426251 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-080786cd-7054-4712-9883-a0935a899715 req-9bd51e25-0ff5-4fb6-9020-4c7ec4a9e445 service nova] Acquiring lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:19:44.426337 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-080786cd-7054-4712-9883-a0935a899715 req-9bd51e25-0ff5-4fb6-9020-4c7ec4a9e445 service nova] Lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:19:44.426458 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-080786cd-7054-4712-9883-a0935a899715 req-9bd51e25-0ff5-4fb6-9020-4c7ec4a9e445 service nova] Lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:19:44.426574 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-080786cd-7054-4712-9883-a0935a899715 req-9bd51e25-0ff5-4fb6-9020-4c7ec4a9e445 service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] No waiting events found dispatching network-vif-plugged-be24e43a-cbcb-4021-95f2-804a31e9b436 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:19:44.426705 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-080786cd-7054-4712-9883-a0935a899715 req-9bd51e25-0ff5-4fb6-9020-4c7ec4a9e445 service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Received unexpected event network-vif-plugged-be24e43a-cbcb-4021-95f2-804a31e9b436 for instance with vm_state active and task_state None.
May 27 03:19:44.472168 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:19:44.474368 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779851984.474181, 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:19:44.474514 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] VM Resumed (Lifecycle Event)
May 27 03:19:44.490072 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-bf60fa66-4307-41ac-8a2b-4ef4ce03c5e0 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.152s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:19:44.665998 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:44.977053 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:19:44.980423 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:19:45.401921 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-ffc40e63-83a5-48d8-a25e-58a5832fc281 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.702s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:19:46.481484 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fa162639-60c4-4578-a65f-20810d693188 req-0b1cd6d9-67af-4a83-81d2-6fed9525c372 service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Received event network-changed-be24e43a-cbcb-4021-95f2-804a31e9b436 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:19:46.481868 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-fa162639-60c4-4578-a65f-20810d693188 req-0b1cd6d9-67af-4a83-81d2-6fed9525c372 service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Refreshing instance network info cache due to event network-changed-be24e43a-cbcb-4021-95f2-804a31e9b436. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:19:46.481868 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fa162639-60c4-4578-a65f-20810d693188 req-0b1cd6d9-67af-4a83-81d2-6fed9525c372 service nova] Acquiring lock "refresh_cache-7e08cfc9-c2e0-477d-92e6-89eeb0bdd340" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:19:46.482039 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fa162639-60c4-4578-a65f-20810d693188 req-0b1cd6d9-67af-4a83-81d2-6fed9525c372 service nova] Acquired lock "refresh_cache-7e08cfc9-c2e0-477d-92e6-89eeb0bdd340" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:19:46.482039 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-fa162639-60c4-4578-a65f-20810d693188 req-0b1cd6d9-67af-4a83-81d2-6fed9525c372 service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Refreshing network info cache for port be24e43a-cbcb-4021-95f2-804a31e9b436 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:19:46.839554 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:46.986560 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-fa162639-60c4-4578-a65f-20810d693188 req-0b1cd6d9-67af-4a83-81d2-6fed9525c372 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:19:47.277432 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-fa162639-60c4-4578-a65f-20810d693188 req-0b1cd6d9-67af-4a83-81d2-6fed9525c372 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:19:47.397136 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-fa162639-60c4-4578-a65f-20810d693188 req-0b1cd6d9-67af-4a83-81d2-6fed9525c372 service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Updated VIF entry in instance network info cache for port be24e43a-cbcb-4021-95f2-804a31e9b436. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:19:47.397439 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-fa162639-60c4-4578-a65f-20810d693188 req-0b1cd6d9-67af-4a83-81d2-6fed9525c372 service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Updating instance_info_cache with network_info: [{"id": "be24e43a-cbcb-4021-95f2-804a31e9b436", "address": "fa:16:3e:3b:ac:7f", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24e43a-cb", "ovs_interfaceid": "be24e43a-cbcb-4021-95f2-804a31e9b436", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:19:47.899443 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-fa162639-60c4-4578-a65f-20810d693188 req-0b1cd6d9-67af-4a83-81d2-6fed9525c372 service nova] Releasing lock "refresh_cache-7e08cfc9-c2e0-477d-92e6-89eeb0bdd340" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:19:49.300660 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "6b89f301-37fb-43a6-9bef-bca32191186e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:19:49.301180 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:19:49.667000 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:49.802754 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Detaching volume 949be1f5-e13d-4358-8d1e-fdbb3f0873eb
May 27 03:19:49.835429 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Attempting to driver detach volume 949be1f5-e13d-4358-8d1e-fdbb3f0873eb from mountpoint /dev/vdb
May 27 03:19:49.839613 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Found disk vdb by alias ua-949be1f5-e13d-4358-8d1e-fdbb3f0873eb {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:19:49.840565 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Found disk vdb by alias ua-949be1f5-e13d-4358-8d1e-fdbb3f0873eb {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:19:49.840670 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Attempting to detach device vdb from instance 6b89f301-37fb-43a6-9bef-bca32191186e from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:19:49.840918 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:19:49.840918 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:19:49.840918 np0000001475 nova-compute[98471]:   <alias name="ua-949be1f5-e13d-4358-8d1e-fdbb3f0873eb"/>
May 27 03:19:49.840918 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-7"/>
May 27 03:19:49.840918 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:19:49.840918 np0000001475 nova-compute[98471]:   <serial>949be1f5-e13d-4358-8d1e-fdbb3f0873eb</serial>
May 27 03:19:49.840918 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:19:49.840918 np0000001475 nova-compute[98471]: </disk>
May 27 03:19:49.840918 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:19:49.846023 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Successfully detached device vdb from instance 6b89f301-37fb-43a6-9bef-bca32191186e from the persistent domain config.
May 27 03:19:49.846137 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] (1/8): Attempting to detach device vdb with device alias ua-949be1f5-e13d-4358-8d1e-fdbb3f0873eb from instance 6b89f301-37fb-43a6-9bef-bca32191186e from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:19:49.846354 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:19:49.846354 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:19:49.846354 np0000001475 nova-compute[98471]:   <alias name="ua-949be1f5-e13d-4358-8d1e-fdbb3f0873eb"/>
May 27 03:19:49.846354 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-7"/>
May 27 03:19:49.846354 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:19:49.846354 np0000001475 nova-compute[98471]:   <serial>949be1f5-e13d-4358-8d1e-fdbb3f0873eb</serial>
May 27 03:19:49.846354 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:19:49.846354 np0000001475 nova-compute[98471]: </disk>
May 27 03:19:49.846354 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:19:50.268380 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779851990.2680118, 6b89f301-37fb-43a6-9bef-bca32191186e => ua-949be1f5-e13d-4358-8d1e-fdbb3f0873eb> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:19:50.269272 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-949be1f5-e13d-4358-8d1e-fdbb3f0873eb for instance 6b89f301-37fb-43a6-9bef-bca32191186e {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:19:50.271224 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Successfully detached device vdb from instance 6b89f301-37fb-43a6-9bef-bca32191186e from the live domain config.
May 27 03:19:50.272300 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:19:50.272588 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb', 'iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '949be1f5-e13d-4358-8d1e-fdbb3f0873eb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:19:50.272713 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:19:50.273076 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:19:50.273347 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb', 'iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '949be1f5-e13d-4358-8d1e-fdbb3f0873eb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:19:50.273488 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:19:50.300602 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:50.300602 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:50.300602 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:50.300602 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:50.300602 np0000001475 nova-compute[98471]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb (non-flash)
May 27 03:19:50.300602 np0000001475 nova-compute[98471]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb (non-flash)
May 27 03:19:50.300602 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:19:50.301476 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:50.301476 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:50.301476 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:50.301476 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:50.301476 np0000001475 nova-compute[98471]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb (non-flash)
May 27 03:19:50.301476 np0000001475 nova-compute[98471]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb (non-flash)
May 27 03:19:50.301476 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:19:50.301476 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', '218'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb', '219'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb', '220')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:19:50.301476 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb', '219')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:19:50.302187 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb', '220')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:19:50.303051 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572464fd80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb'): ({'sdg'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:19:50.303290 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Removing multipathed devices sdf, sdg {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:19:50.303550 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Flush multipath device 330000000415fc3c8 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:19:50.349481 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:19:50.391360 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:19:50.433224 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:19:50.433451 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:19:50.434844 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:19:50.446531 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:19:50.446698 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:19:50.457093 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:50.481689 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 219, target: iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb, portal: 192.168.40.100,3260]
May 27 03:19:50.481689 np0000001475 nova-compute[98471]: Logout of [sid: 219, target: iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb, portal: 192.168.40.100,3260] successful.
May 27 03:19:50.481689 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:50.495694 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:50.505550 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:50.535602 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 220, target: iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb, portal: 192.168.50.100,3260]
May 27 03:19:50.535602 np0000001475 nova-compute[98471]: Logout of [sid: 220, target: iqn.2023-03.storpool.com:os--volume-949be1f5-e13d-4358-8d1e-fdbb3f0873eb, portal: 192.168.50.100,3260] successful.
May 27 03:19:50.535602 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:50.548933 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:50.549372 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:19:50.549544 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] <== disconnect_volume: return (276ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:19:50.549662 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:19:51.096475 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lazy-loading 'flavor' on Instance uuid 6b89f301-37fb-43a6-9bef-bca32191186e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:19:51.200022 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:19:51.701753 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:19:51.841707 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:52.102834 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-1b58fb29-9c29-469d-8fd2-66af0f078086 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.802s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:19:53.669590 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "6b89f301-37fb-43a6-9bef-bca32191186e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:19:53.669896 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:19:53.701490 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:19:53.701638 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:19:53.702122 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.50 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:19:54.172660 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lazy-loading 'flavor' on Instance uuid 6b89f301-37fb-43a6-9bef-bca32191186e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:19:54.668012 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:55.178169 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:19:56.200267 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:19:56.200704 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:19:56.200704 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:19:56.245098 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "6b89f301-37fb-43a6-9bef-bca32191186e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:19:56.245293 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:19:56.245512 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Attaching volume 4e2b979e-f3fb-4878-bc21-7269e57dde5d to /dev/vdb
May 27 03:19:56.280330 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:19:56.291241 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:19:56.311803 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:19:56.359841 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:19:56.360204 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:19:56.368440 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:19:56.369828 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:feb4:c7b5', 'fe80::bc23:aaff:fec6:2747', 'fe80::fc16:3eff:feb8:4da5', 'fe80::1870:c1ff:feca:47f8', 'fe80::fc16:3eff:fe3b:ac7f'] 
May 27 03:19:56.369990 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:19:56.370117 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:19:56.370414 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:19:56.370715 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Updating existing volume attachment record: a4400d61-2fc0-4f43-adf2-d1c6c2933a41 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:19:56.843149 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:56.920403 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:19:56.920728 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d', 'iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4e2b979e-f3fb-4878-bc21-7269e57dde5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:19:56.920886 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:19:56.921308 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:19:56.921555 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d', 'iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4e2b979e-f3fb-4878-bc21-7269e57dde5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:19:56.934003 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:19:56.934557 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:19:56.934958 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:19:56.935254 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:19:56.935631 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:19:56.935826 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:19:56.946665 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:19:56.946665 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:56.948667 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:19:56.948667 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:56.958753 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d] added
May 27 03:19:56.958753 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:19:56.958753 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:19:56.958753 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:19:56.958753 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:19:56.958753 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:19:56.958753 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:56.959144 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:19:56.959258 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.024(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:19:56.959407 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:19:56.961245 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d] added
May 27 03:19:56.961245 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:19:56.961245 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:19:56.961245 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:19:56.961245 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:19:56.961245 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:19:56.961245 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:56.961401 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:19:56.961587 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:19:56.961758 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:19:57.959845 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:19:57.962149 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:19:57.971762 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:19:57.971762 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:19:57.977316 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:19:57.977316 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:57.984645 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:57.989541 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:57.997593 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:57.997593 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:57.997593 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:57.997593 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:57.997593 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:19:57.997776 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:57.997776 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:57.997776 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:57.997776 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:57.997776 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:19:58.003206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:58.003206 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:58.003206 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:58.003206 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:58.003206 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:19:58.003206 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:58.003206 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:58.003206 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:58.003206 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:58.003206 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:19:58.033593 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d, portal: 192.168.50.100,3260]
May 27 03:19:58.033593 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d, portal: 192.168.50.100,3260] successful.
May 27 03:19:58.033593 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:58.034341 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d, portal: 192.168.40.100,3260]
May 27 03:19:58.034341 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d, portal: 192.168.40.100,3260] successful.
May 27 03:19:58.034341 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:58.045825 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:58.053345 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:19:58.062956 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:58.062956 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:58.062956 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:58.062956 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:58.062956 np0000001475 nova-compute[98471]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d (non-flash)
May 27 03:19:58.062956 np0000001475 nova-compute[98471]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d (non-flash)
May 27 03:19:58.062956 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:19:58.062956 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:58.062956 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:58.062956 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:58.062956 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:58.062956 np0000001475 nova-compute[98471]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d (non-flash)
May 27 03:19:58.062956 np0000001475 nova-compute[98471]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d (non-flash)
May 27 03:19:58.062956 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:19:58.062956 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.127s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:19:58.062956 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:19:58.063450 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] HCTL ('12', '-', '-', 0) found on session 222 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:19:58.063489 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:19:58.069562 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:58.069562 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:58.069562 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:58.069562 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:58.069562 np0000001475 nova-compute[98471]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d (non-flash)
May 27 03:19:58.069562 np0000001475 nova-compute[98471]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d (non-flash)
May 27 03:19:58.069562 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:19:58.069562 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:58.069562 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:19:58.069562 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:58.069562 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:19:58.069562 np0000001475 nova-compute[98471]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d (non-flash)
May 27 03:19:58.069562 np0000001475 nova-compute[98471]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d (non-flash)
May 27 03:19:58.069562 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:19:58.069562 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:19:58.069562 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:19:58.069562 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] HCTL ('11', '-', '-', 0) found on session 221 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:19:58.069562 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:19:58.075474 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Searching for a device in session 222 and hctl ['12', '*', '*', 0] yield: sdf {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:19:58.076167 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4e2b979e-f3fb-4878-bc21-7269e57dde5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:19:58.084211 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Searching for a device in session 221 and hctl ['11', '*', '*', 0] yield: sdg {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:19:58.084323 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4e2b979e-f3fb-4878-bc21-7269e57dde5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:19:58.200216 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:19:58.200545 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:19:58.935733 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:19:59.668912 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:19:59.950774 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Found WWN 3300000005f4b3fea for multipath device dm-7 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:19:59.951071 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:19:59.951271 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '3300000005f4b3fea', 'path': '/dev/dm-7', 'multipath_id': '3300000005f4b3fea'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:19:59.951440 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005f4b3fea', 'path': '/dev/dm-7', 'multipath_id': '3300000005f4b3fea'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:19:59.954460 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lazy-loading 'flavor' on Instance uuid 6b89f301-37fb-43a6-9bef-bca32191186e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:20:00.199680 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:20:00.199933 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:20:00.458355 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Attempting to attach volume 4e2b979e-f3fb-4878-bc21-7269e57dde5d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98471) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 27 03:20:00.459835 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] attach device xml: <disk type="block" device="disk">
May 27 03:20:00.459835 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:20:00.459835 np0000001475 nova-compute[98471]:   <alias name="ua-4e2b979e-f3fb-4878-bc21-7269e57dde5d"/>
May 27 03:20:00.459835 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-7"/>
May 27 03:20:00.459835 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:20:00.459835 np0000001475 nova-compute[98471]:   <serial>4e2b979e-f3fb-4878-bc21-7269e57dde5d</serial>
May 27 03:20:00.459835 np0000001475 nova-compute[98471]: </disk>
May 27 03:20:00.459835 np0000001475 nova-compute[98471]:  {{(pid=98471) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 27 03:20:01.196349 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:20:01.196857 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:20:01.846925 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:02.097927 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:20:02.098054 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:20:02.098054 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:20:02.098201 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] No VIF found with MAC fa:16:3e:b4:c7:b5, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:20:02.199716 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:20:02.200329 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:20:03.647679 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-4aebabc9-3352-45eb-a6c9-9f3cf0541148 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.402s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:04.670020 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:06.199856 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:20:06.199856 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98471) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 27 03:20:06.701662 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:20:06.860930 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:07.031604 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "6b89f301-37fb-43a6-9bef-bca32191186e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:07.031812 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:07.534160 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Detaching volume 4e2b979e-f3fb-4878-bc21-7269e57dde5d
May 27 03:20:07.566196 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Attempting to driver detach volume 4e2b979e-f3fb-4878-bc21-7269e57dde5d from mountpoint /dev/vdb
May 27 03:20:07.570338 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Found disk vdb by alias ua-4e2b979e-f3fb-4878-bc21-7269e57dde5d {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:20:07.571646 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Found disk vdb by alias ua-4e2b979e-f3fb-4878-bc21-7269e57dde5d {{(pid=98471) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 27 03:20:07.571767 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Attempting to detach device vdb from instance 6b89f301-37fb-43a6-9bef-bca32191186e from the persistent domain config. {{(pid=98471) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 27 03:20:07.572019 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:20:07.572019 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:20:07.572019 np0000001475 nova-compute[98471]:   <alias name="ua-4e2b979e-f3fb-4878-bc21-7269e57dde5d"/>
May 27 03:20:07.572019 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-7"/>
May 27 03:20:07.572019 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:20:07.572019 np0000001475 nova-compute[98471]:   <serial>4e2b979e-f3fb-4878-bc21-7269e57dde5d</serial>
May 27 03:20:07.572019 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:20:07.572019 np0000001475 nova-compute[98471]: </disk>
May 27 03:20:07.572019 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:20:07.577790 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Successfully detached device vdb from instance 6b89f301-37fb-43a6-9bef-bca32191186e from the persistent domain config.
May 27 03:20:07.577986 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] (1/8): Attempting to detach device vdb with device alias ua-4e2b979e-f3fb-4878-bc21-7269e57dde5d from instance 6b89f301-37fb-43a6-9bef-bca32191186e from the live domain config. {{(pid=98471) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 27 03:20:07.578217 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.guest [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] detach device xml: <disk type="block" device="disk">
May 27 03:20:07.578217 np0000001475 nova-compute[98471]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:20:07.578217 np0000001475 nova-compute[98471]:   <alias name="ua-4e2b979e-f3fb-4878-bc21-7269e57dde5d"/>
May 27 03:20:07.578217 np0000001475 nova-compute[98471]:   <source dev="/dev/dm-7"/>
May 27 03:20:07.578217 np0000001475 nova-compute[98471]:   <target dev="vdb" bus="virtio"/>
May 27 03:20:07.578217 np0000001475 nova-compute[98471]:   <serial>4e2b979e-f3fb-4878-bc21-7269e57dde5d</serial>
May 27 03:20:07.578217 np0000001475 nova-compute[98471]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 27 03:20:07.578217 np0000001475 nova-compute[98471]: </disk>
May 27 03:20:07.578217 np0000001475 nova-compute[98471]:  {{(pid=98471) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 27 03:20:08.035487 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Received event <DeviceRemovedEvent: 1779852008.0351295, 6b89f301-37fb-43a6-9bef-bca32191186e => ua-4e2b979e-f3fb-4878-bc21-7269e57dde5d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98471) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 27 03:20:08.036391 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4e2b979e-f3fb-4878-bc21-7269e57dde5d for instance 6b89f301-37fb-43a6-9bef-bca32191186e {{(pid=98471) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 27 03:20:08.038222 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Successfully detached device vdb from instance 6b89f301-37fb-43a6-9bef-bca32191186e from the live domain config.
May 27 03:20:08.039099 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:20:08.039338 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d', 'iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4e2b979e-f3fb-4878-bc21-7269e57dde5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:20:08.039459 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:20:08.039755 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:20:08.039996 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d', 'iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4e2b979e-f3fb-4878-bc21-7269e57dde5d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:20:08.040122 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:20:08.062021 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:20:08.062021 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:20:08.062021 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:20:08.062021 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:20:08.062021 np0000001475 nova-compute[98471]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d (non-flash)
May 27 03:20:08.062021 np0000001475 nova-compute[98471]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d (non-flash)
May 27 03:20:08.062021 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:20:08.062322 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:20:08.062322 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:20:08.062322 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:20:08.062322 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:20:08.062322 np0000001475 nova-compute[98471]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d (non-flash)
May 27 03:20:08.062322 np0000001475 nova-compute[98471]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d (non-flash)
May 27 03:20:08.062322 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:20:08.062322 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', '218'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d', '221'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d', '222')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:20:08.062322 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d', '221')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:20:08.063212 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d', '222')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:20:08.063857 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572475bec0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d'): ({'sdf'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:20:08.064024 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Removing multipathed devices sdf, sdg {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:20:08.064219 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Flush multipath device 3300000005f4b3fea {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:20:08.098983 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:20:08.141216 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:20:08.186188 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:20:08.186339 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:20:08.187381 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:20:08.197839 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:20:08.198072 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:20:08.208460 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:08.243987 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 221, target: iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d, portal: 192.168.40.100,3260]
May 27 03:20:08.243987 np0000001475 nova-compute[98471]: Logout of [sid: 221, target: iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d, portal: 192.168.40.100,3260] successful.
May 27 03:20:08.243987 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:08.262670 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:08.275393 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:08.308086 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 222, target: iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d, portal: 192.168.50.100,3260]
May 27 03:20:08.308086 np0000001475 nova-compute[98471]: Logout of [sid: 222, target: iqn.2023-03.storpool.com:os--volume-4e2b979e-f3fb-4878-bc21-7269e57dde5d, portal: 192.168.50.100,3260] successful.
May 27 03:20:08.308086 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:08.325028 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:08.325356 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:20:08.325528 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] <== disconnect_volume: return (285ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:20:08.325703 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:20:08.873125 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lazy-loading 'flavor' on Instance uuid 6b89f301-37fb-43a6-9bef-bca32191186e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:20:09.671017 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:09.701728 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:20:09.702014 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Cleaning up deleted instances {{(pid=98471) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 27 03:20:09.878499 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-c3806f65-bdcf-46f9-9624-b0ee9b1a0e45 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.847s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:10.203960 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] There are 0 instances to clean {{(pid=98471) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 27 03:20:10.204182 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.50 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:20:11.869100 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:12.702159 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:20:13.207441 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:13.207892 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:13.207892 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:13.207967 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:20:14.232294 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:20:14.327825 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:20:14.328294 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk --force-share --output=json {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:20:14.442519 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:20:14.447129 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:20:14.448672 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:20:14.450393 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:20:14.451426 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:20:14.497228 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:20:14.497627 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=13013MB free_disk=72.5781478881836GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:20:14.497791 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:14.498065 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:14.673066 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:15.733428 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 6b89f301-37fb-43a6-9bef-bca32191186e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:20:15.733947 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 24dc509c-5c24-4f2c-8a80-d466c11810e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:20:15.733947 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:20:15.734077 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:20:15.734249 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:20:14 up 52 min,  2 users,  load average: 1.80, 3.28, 4.26\n', 'num_instances': '3', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '3', 'num_proj_5a4f4be9e90849f78581e1a1b5c6b050': '1', 'io_workload': '0', 'num_proj_bf4b0011da7449e7948bf2c8a41955f5': '2'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:20:15.895597 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:20:15.895839 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:20:16.398570 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:20:16.905146 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:20:16.905663 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.407s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:16.905663 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 42.50 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:20:17.953270 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "6b89f301-37fb-43a6-9bef-bca32191186e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:17.953683 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:17.953683 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "6b89f301-37fb-43a6-9bef-bca32191186e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:17.953794 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:17.953984 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:17.956162 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Terminating instance
May 27 03:20:18.461054 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:20:18.477282 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:18.479150 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:18.492849 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:18.511903 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:18.610441 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-dee8e6a3-0722-4ec7-87f8-5186bdb7e012 req-bf16431b-a615-47fb-9a83-052882ebe0c1 service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Received event network-vif-unplugged-9b056693-43c1-4a0b-b71c-febe908f0af9 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:20:18.610632 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-dee8e6a3-0722-4ec7-87f8-5186bdb7e012 req-bf16431b-a615-47fb-9a83-052882ebe0c1 service nova] Acquiring lock "6b89f301-37fb-43a6-9bef-bca32191186e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:18.611600 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-dee8e6a3-0722-4ec7-87f8-5186bdb7e012 req-bf16431b-a615-47fb-9a83-052882ebe0c1 service nova] Lock "6b89f301-37fb-43a6-9bef-bca32191186e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:18.611600 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-dee8e6a3-0722-4ec7-87f8-5186bdb7e012 req-bf16431b-a615-47fb-9a83-052882ebe0c1 service nova] Lock "6b89f301-37fb-43a6-9bef-bca32191186e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:18.611600 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-dee8e6a3-0722-4ec7-87f8-5186bdb7e012 req-bf16431b-a615-47fb-9a83-052882ebe0c1 service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] No waiting events found dispatching network-vif-unplugged-9b056693-43c1-4a0b-b71c-febe908f0af9 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:20:18.611600 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-dee8e6a3-0722-4ec7-87f8-5186bdb7e012 req-bf16431b-a615-47fb-9a83-052882ebe0c1 service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Received event network-vif-unplugged-9b056693-43c1-4a0b-b71c-febe908f0af9 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:20:18.773621 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999682526000015 future=<Future at 0x75570462b5f0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:20:18.774096 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999215131000255 future=<Future at 0x75570462b5f0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:20:18.774284 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.998983167000006 future=<Future at 0x75570462b5f0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:20:18.775416 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Instance destroyed successfully.
May 27 03:20:18.776574 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lazy-loading 'resources' on Instance uuid 6b89f301-37fb-43a6-9bef-bca32191186e {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:20:19.278217 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1817871831',display_name='tempest-SnapshotDataIntegrityTests-server-1817871831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-snapshotdataintegritytests-server-1817871831',id=76,image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+vSTsvb04xsda+FUipObODwoOPiWfyfz1//rGcwG0zlkdF+h36lkYRDyFsjTRmariUdqVfYPJaV77/jCJsdHpqxcCRRrI+JThRavjJbPmMIE2Q4JOV7VHTZbYZHm3GeA==',key_name='tempest-keypair-1000537643',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:18:26Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a4f4be9e90849f78581e1a1b5c6b050',ramdisk_id='',reservation_id='r-fiqlp08e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bb7555b3-2f7b-4a56-b628-91b0c2265c8d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1109943454',owner_user_name='tempest-SnapshotDataIntegrityTests-1109943454-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f2d75db32981429883ad51cb41ca88ad',uuid=6b89f301-37fb-43a6-9bef-bca32191186e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b056693-43c1-4a0b-b71c-febe908f0af9", "address": "fa:16:3e:b4:c7:b5", "network": {"id": "2615158a-fba8-4694-bc11-8825b25a885b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1409157499-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a4f4be9e90849f78581e1a1b5c6b050", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b056693-43", "ovs_interfaceid": "9b056693-43c1-4a0b-b71c-febe908f0af9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:20:19.278791 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Converting VIF {"id": "9b056693-43c1-4a0b-b71c-febe908f0af9", "address": "fa:16:3e:b4:c7:b5", "network": {"id": "2615158a-fba8-4694-bc11-8825b25a885b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1409157499-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5a4f4be9e90849f78581e1a1b5c6b050", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b056693-43", "ovs_interfaceid": "9b056693-43c1-4a0b-b71c-febe908f0af9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:20:19.279181 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:c7:b5,bridge_name='br-int',has_traffic_filtering=True,id=9b056693-43c1-4a0b-b71c-febe908f0af9,network=Network(2615158a-fba8-4694-bc11-8825b25a885b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b056693-43') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:20:19.279450 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:c7:b5,bridge_name='br-int',has_traffic_filtering=True,id=9b056693-43c1-4a0b-b71c-febe908f0af9,network=Network(2615158a-fba8-4694-bc11-8825b25a885b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b056693-43') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:20:19.280951 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:19.281225 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b056693-43, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:20:19.289882 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:19.290491 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:20:19.291065 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:19.291833 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:19.291956 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79e9d506-774f-4e08-b800-22c1efd14a45) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:20:19.292966 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:19.293865 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:20:19.295769 np0000001475 nova-compute[98471]: INFO os_vif [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:c7:b5,bridge_name='br-int',has_traffic_filtering=True,id=9b056693-43c1-4a0b-b71c-febe908f0af9,network=Network(2615158a-fba8-4694-bc11-8825b25a885b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b056693-43')
May 27 03:20:19.295876 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Deleting instance files /opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e_del
May 27 03:20:19.296644 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Deletion of /opt/stack/data/nova/instances/6b89f301-37fb-43a6-9bef-bca32191186e_del complete
May 27 03:20:19.803575 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Took 1.34 seconds to destroy the instance on the hypervisor.
May 27 03:20:19.804246 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:20:19.804575 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:20:19.804707 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:20:19.805024 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:20:19.909640 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:20:20.666649 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a0d69dbd-ff94-46b3-b4d8-05097eeebaea req-bc7f4d2d-5aeb-4261-ba01-60a37dba106a service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Received event network-vif-unplugged-9b056693-43c1-4a0b-b71c-febe908f0af9 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:20:20.667021 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a0d69dbd-ff94-46b3-b4d8-05097eeebaea req-bc7f4d2d-5aeb-4261-ba01-60a37dba106a service nova] Acquiring lock "6b89f301-37fb-43a6-9bef-bca32191186e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:20.667262 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a0d69dbd-ff94-46b3-b4d8-05097eeebaea req-bc7f4d2d-5aeb-4261-ba01-60a37dba106a service nova] Lock "6b89f301-37fb-43a6-9bef-bca32191186e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:20.667413 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a0d69dbd-ff94-46b3-b4d8-05097eeebaea req-bc7f4d2d-5aeb-4261-ba01-60a37dba106a service nova] Lock "6b89f301-37fb-43a6-9bef-bca32191186e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:20.667542 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a0d69dbd-ff94-46b3-b4d8-05097eeebaea req-bc7f4d2d-5aeb-4261-ba01-60a37dba106a service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] No waiting events found dispatching network-vif-unplugged-9b056693-43c1-4a0b-b71c-febe908f0af9 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:20:20.667660 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a0d69dbd-ff94-46b3-b4d8-05097eeebaea req-bc7f4d2d-5aeb-4261-ba01-60a37dba106a service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Received event network-vif-unplugged-9b056693-43c1-4a0b-b71c-febe908f0af9 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:20:20.667790 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a0d69dbd-ff94-46b3-b4d8-05097eeebaea req-bc7f4d2d-5aeb-4261-ba01-60a37dba106a service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Received event network-vif-deleted-9b056693-43c1-4a0b-b71c-febe908f0af9 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:20:20.667908 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-a0d69dbd-ff94-46b3-b4d8-05097eeebaea req-bc7f4d2d-5aeb-4261-ba01-60a37dba106a service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Neutron deleted interface 9b056693-43c1-4a0b-b71c-febe908f0af9; detaching it from the instance and deleting it from the info cache
May 27 03:20:20.668044 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a0d69dbd-ff94-46b3-b4d8-05097eeebaea req-bc7f4d2d-5aeb-4261-ba01-60a37dba106a service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:20:20.737116 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:20:21.172254 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a0d69dbd-ff94-46b3-b4d8-05097eeebaea req-bc7f4d2d-5aeb-4261-ba01-60a37dba106a service nova] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Detach interface failed, port_id=9b056693-43c1-4a0b-b71c-febe908f0af9, reason: Instance 6b89f301-37fb-43a6-9bef-bca32191186e could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:20:21.239683 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Took 1.43 seconds to deallocate network for instance.
May 27 03:20:21.743106 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:21.743559 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:21.743559 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:21.743680 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:21.743843 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:21.745600 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Terminating instance
May 27 03:20:21.749758 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:21.749893 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:21.791960 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Refreshing inventories for resource provider 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 27 03:20:21.830830 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Updating ProviderTree inventory for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 27 03:20:21.830955 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Updating inventory in ProviderTree for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 27 03:20:21.865091 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Refreshing aggregate associations for resource provider 379b682a-2af7-4cd6-bb46-9d0c412d430a, aggregates: None {{(pid=98471) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 27 03:20:21.883774 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:21.905374 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Refreshing trait associations for resource provider 379b682a-2af7-4cd6-bb46-9d0c412d430a, traits: HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ARCH_X86_64,HW_CPU_X86_SSSE3,COMPUTE_ARCH_S390X,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_ARCH_PPC64LE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_SOUND_MODEL_SB16,COMPUTE_NODE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ARCH_RISCV64,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ARCH_AARCH64,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ARCH_MIPSEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_ARCH_X86_64,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE {{(pid=98471) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 27 03:20:22.056324 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:20:22.056560 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:20:22.248248 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:20:22.261583 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:22.263015 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:22.277382 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:22.384123 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-aa058e9d-7841-4ccc-a6a3-1c7e4983c085 req-c28f5b8c-0249-4f0d-a4f0-5c907b70afb3 service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Received event network-vif-unplugged-be24e43a-cbcb-4021-95f2-804a31e9b436 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:20:22.384517 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa058e9d-7841-4ccc-a6a3-1c7e4983c085 req-c28f5b8c-0249-4f0d-a4f0-5c907b70afb3 service nova] Acquiring lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:22.384656 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa058e9d-7841-4ccc-a6a3-1c7e4983c085 req-c28f5b8c-0249-4f0d-a4f0-5c907b70afb3 service nova] Lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:22.384783 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa058e9d-7841-4ccc-a6a3-1c7e4983c085 req-c28f5b8c-0249-4f0d-a4f0-5c907b70afb3 service nova] Lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:22.384907 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-aa058e9d-7841-4ccc-a6a3-1c7e4983c085 req-c28f5b8c-0249-4f0d-a4f0-5c907b70afb3 service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] No waiting events found dispatching network-vif-unplugged-be24e43a-cbcb-4021-95f2-804a31e9b436 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:20:22.385015 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-aa058e9d-7841-4ccc-a6a3-1c7e4983c085 req-c28f5b8c-0249-4f0d-a4f0-5c907b70afb3 service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Received event network-vif-unplugged-be24e43a-cbcb-4021-95f2-804a31e9b436 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:20:22.398144 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:22.403758 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:22.559215 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:20:22.567730 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999766834000184 future=<Future at 0x75570462ab40 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:20:22.570312 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Instance destroyed successfully.
May 27 03:20:22.571006 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'resources' on Instance uuid 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:20:23.069708 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.320s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:23.073862 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:19:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1715903198',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1715903198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-image-snapshot-server-1715903198',id=78,image_ref='18aba7c5-034e-4529-9558-7accac2e46fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOa7Rsk7mHkuIrao2J1jh8DKwVYpfWu/Mkir5ktk21esXsd60s/tiPp0884eka8Uci+liADyXDy7qOcRKr1ZugflxMLgPCNGupxawMXMf8c/UKVP4X2EOWEl+X103bu4Hg==',key_name='tempest-keypair-610226626',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:19:43Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-b1colqlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-360350731',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:19:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=7e08cfc9-c2e0-477d-92e6-89eeb0bdd340,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be24e43a-cbcb-4021-95f2-804a31e9b436", "address": "fa:16:3e:3b:ac:7f", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24e43a-cb", "ovs_interfaceid": "be24e43a-cbcb-4021-95f2-804a31e9b436", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:20:23.074095 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "be24e43a-cbcb-4021-95f2-804a31e9b436", "address": "fa:16:3e:3b:ac:7f", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe24e43a-cb", "ovs_interfaceid": "be24e43a-cbcb-4021-95f2-804a31e9b436", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:20:23.074575 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ac:7f,bridge_name='br-int',has_traffic_filtering=True,id=be24e43a-cbcb-4021-95f2-804a31e9b436,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe24e43a-cb') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:20:23.074773 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ac:7f,bridge_name='br-int',has_traffic_filtering=True,id=be24e43a-cbcb-4021-95f2-804a31e9b436,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe24e43a-cb') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:20:23.075611 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:23.075836 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe24e43a-cb, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:20:23.077299 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:23.078107 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:20:23.078548 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:23.078700 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9a9e276-44cc-4813-b861-f9a2ce6fe851) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:20:23.079919 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:20:23.081259 np0000001475 nova-compute[98471]: INFO os_vif [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ac:7f,bridge_name='br-int',has_traffic_filtering=True,id=be24e43a-cbcb-4021-95f2-804a31e9b436,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe24e43a-cb')
May 27 03:20:23.082854 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:20:23.083219 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4e84a5fb-8d85-456d-91f3-34ad03465904', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:20:23.083390 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:20:23.083823 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:20:23.084204 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4e84a5fb-8d85-456d-91f3-34ad03465904', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:20:23.084386 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:20:23.104916 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:20:23.104916 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:20:23.104916 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:20:23.104916 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:20:23.104916 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:20:23.105232 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:20:23.105232 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:20:23.105232 np0000001475 nova-compute[98471]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:20:23.105232 np0000001475 nova-compute[98471]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904 (non-flash)
May 27 03:20:23.105232 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:20:23.105232 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', '218')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:20:23.105490 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', '217')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:20:23.106241 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904', '218')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:20:23.106888 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572472f7e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904'): ({'sde'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:20:23.107104 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Removing multipathed devices sdd, sde {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:20:23.107354 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flush multipath device 330000000a2d4d9fd {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:20:23.115039 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Deleted allocations for instance 6b89f301-37fb-43a6-9bef-bca32191186e
May 27 03:20:23.161059 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:20:23.208345 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:20:23.245066 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:20:23.245227 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:20:23.246018 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:20:23.256021 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:20:23.256293 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:20:23.266759 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:23.300776 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 217, target: iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904, portal: 192.168.40.100,3260]
May 27 03:20:23.300776 np0000001475 nova-compute[98471]: Logout of [sid: 217, target: iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904, portal: 192.168.40.100,3260] successful.
May 27 03:20:23.300776 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:23.313221 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:23.322671 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:23.346543 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 218, target: iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904, portal: 192.168.50.100,3260]
May 27 03:20:23.346543 np0000001475 nova-compute[98471]: Logout of [sid: 218, target: iqn.2023-03.storpool.com:os--volume-4e84a5fb-8d85-456d-91f3-34ad03465904, portal: 192.168.50.100,3260] successful.
May 27 03:20:23.346543 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:23.361111 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:23.361326 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:20:23.361446 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== disconnect_volume: return (277ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:20:23.361535 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:20:23.361797 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Deleting instance files /opt/stack/data/nova/instances/7e08cfc9-c2e0-477d-92e6-89eeb0bdd340_del
May 27 03:20:23.362232 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Deletion of /opt/stack/data/nova/instances/7e08cfc9-c2e0-477d-92e6-89eeb0bdd340_del complete
May 27 03:20:23.867610 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Took 1.62 seconds to destroy the instance on the hypervisor.
May 27 03:20:23.868483 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:20:23.868615 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:20:23.868717 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:20:23.868946 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:20:23.958492 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:20:24.122556 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-75a0a505-09fb-4aa3-a80b-4c5ea2d5c5a0 tempest-SnapshotDataIntegrityTests-1109943454 tempest-SnapshotDataIntegrityTests-1109943454-project-member] Lock "6b89f301-37fb-43a6-9bef-bca32191186e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.169s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:24.246613 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:24.321299 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1ca83bab-962a-4e3d-9123-bf20eeb5bf2e req-57a9459c-618d-4438-9caf-2ec51dd2b9b4 service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Received event network-vif-deleted-be24e43a-cbcb-4021-95f2-804a31e9b436 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:20:24.321473 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-1ca83bab-962a-4e3d-9123-bf20eeb5bf2e req-57a9459c-618d-4438-9caf-2ec51dd2b9b4 service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Neutron deleted interface be24e43a-cbcb-4021-95f2-804a31e9b436; detaching it from the instance and deleting it from the info cache
May 27 03:20:24.321587 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-1ca83bab-962a-4e3d-9123-bf20eeb5bf2e req-57a9459c-618d-4438-9caf-2ec51dd2b9b4 service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:20:24.441596 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-90f1c7e1-8dc4-44ca-a29b-f87b21136131 req-a364ebf4-097d-4d2b-a015-647bd115a36d service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Received event network-vif-unplugged-be24e43a-cbcb-4021-95f2-804a31e9b436 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:20:24.441733 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-90f1c7e1-8dc4-44ca-a29b-f87b21136131 req-a364ebf4-097d-4d2b-a015-647bd115a36d service nova] Acquiring lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:24.442193 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-90f1c7e1-8dc4-44ca-a29b-f87b21136131 req-a364ebf4-097d-4d2b-a015-647bd115a36d service nova] Lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:24.442384 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-90f1c7e1-8dc4-44ca-a29b-f87b21136131 req-a364ebf4-097d-4d2b-a015-647bd115a36d service nova] Lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:24.442563 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-90f1c7e1-8dc4-44ca-a29b-f87b21136131 req-a364ebf4-097d-4d2b-a015-647bd115a36d service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] No waiting events found dispatching network-vif-unplugged-be24e43a-cbcb-4021-95f2-804a31e9b436 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:20:24.442692 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-90f1c7e1-8dc4-44ca-a29b-f87b21136131 req-a364ebf4-097d-4d2b-a015-647bd115a36d service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Received event network-vif-unplugged-be24e43a-cbcb-4021-95f2-804a31e9b436 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:20:24.780864 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:20:24.824927 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-1ca83bab-962a-4e3d-9123-bf20eeb5bf2e req-57a9459c-618d-4438-9caf-2ec51dd2b9b4 service nova] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Detach interface failed, port_id=be24e43a-cbcb-4021-95f2-804a31e9b436, reason: Instance 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:20:25.282504 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Took 1.41 seconds to deallocate network for instance.
May 27 03:20:25.826318 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Took 0.54 seconds to detach 1 volumes for instance.
May 27 03:20:25.828498 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Deleting volume: 4e84a5fb-8d85-456d-91f3-34ad03465904 {{(pid=98471) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 27 03:20:26.024537 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:26.367030 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:26.367399 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:26.490322 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:20:26.490510 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:20:26.993011 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:20:27.501999 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.135s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:27.548059 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:27.557891 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Deleted allocations for instance 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340
May 27 03:20:28.079941 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:28.566591 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-70d68395-7b2b-45c5-8d13-0dad230d73db tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "7e08cfc9-c2e0-477d-92e6-89eeb0bdd340" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.823s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:30.789074 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "24dc509c-5c24-4f2c-8a80-d466c11810e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:30.789489 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "24dc509c-5c24-4f2c-8a80-d466c11810e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:30.789489 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "24dc509c-5c24-4f2c-8a80-d466c11810e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:30.789489 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "24dc509c-5c24-4f2c-8a80-d466c11810e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:30.789559 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "24dc509c-5c24-4f2c-8a80-d466c11810e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:30.791356 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Terminating instance
May 27 03:20:31.295132 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:20:31.308475 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:31.323902 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:31.342171 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:31.435033 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-983af76d-fab4-4cc7-87db-be5edb10d5cb req-527acb60-699f-4b56-88b6-595be7fa89b6 service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Received event network-vif-unplugged-94e4ebcb-b252-4bcd-89d8-b71f5136c6db {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:20:31.435198 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-983af76d-fab4-4cc7-87db-be5edb10d5cb req-527acb60-699f-4b56-88b6-595be7fa89b6 service nova] Acquiring lock "24dc509c-5c24-4f2c-8a80-d466c11810e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:31.435370 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-983af76d-fab4-4cc7-87db-be5edb10d5cb req-527acb60-699f-4b56-88b6-595be7fa89b6 service nova] Lock "24dc509c-5c24-4f2c-8a80-d466c11810e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:31.435492 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-983af76d-fab4-4cc7-87db-be5edb10d5cb req-527acb60-699f-4b56-88b6-595be7fa89b6 service nova] Lock "24dc509c-5c24-4f2c-8a80-d466c11810e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:31.435601 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-983af76d-fab4-4cc7-87db-be5edb10d5cb req-527acb60-699f-4b56-88b6-595be7fa89b6 service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] No waiting events found dispatching network-vif-unplugged-94e4ebcb-b252-4bcd-89d8-b71f5136c6db {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:20:31.435729 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-983af76d-fab4-4cc7-87db-be5edb10d5cb req-527acb60-699f-4b56-88b6-595be7fa89b6 service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Received event network-vif-unplugged-94e4ebcb-b252-4bcd-89d8-b71f5136c6db for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:20:31.615016 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99974887999997 future=<Future at 0x7557047a33b0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:20:31.616277 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Instance destroyed successfully.
May 27 03:20:31.616816 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'resources' on Instance uuid 24dc509c-5c24-4f2c-8a80-d466c11810e4 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:20:32.119380 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:18:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-717886128',display_name='tempest-TestVolumeBootPattern-volume-backed-server-717886128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-volume-backed-server-717886128',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaeK25LOcBKMFOK8upFzJMngFISDwqzU0ViQLodmaXn2mLvFBmdBTsQKy1K9nbZtHQ11teNU05xWxZgC2bK+E91qw2s1eUPBGUKq7MS4sbxtSrxXSlyVwo25CpfPhkDbw==',key_name='tempest-keypair-927051654',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:18:53Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-hn1l3xnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:18:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=24dc509c-5c24-4f2c-8a80-d466c11810e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "address": "fa:16:3e:b8:4d:a5", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4ebcb-b2", "ovs_interfaceid": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:20:32.120075 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "address": "fa:16:3e:b8:4d:a5", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e4ebcb-b2", "ovs_interfaceid": "94e4ebcb-b252-4bcd-89d8-b71f5136c6db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:20:32.120298 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:4d:a5,bridge_name='br-int',has_traffic_filtering=True,id=94e4ebcb-b252-4bcd-89d8-b71f5136c6db,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e4ebcb-b2') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:20:32.120551 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:4d:a5,bridge_name='br-int',has_traffic_filtering=True,id=94e4ebcb-b252-4bcd-89d8-b71f5136c6db,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e4ebcb-b2') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:20:32.122117 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:32.122337 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94e4ebcb-b2, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:20:32.123273 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:32.124172 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:20:32.124830 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:32.124964 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe19cc66-25ed-4281-af90-78205ebec0e8) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:20:32.125351 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:32.125929 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:20:32.127766 np0000001475 nova-compute[98471]: INFO os_vif [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:4d:a5,bridge_name='br-int',has_traffic_filtering=True,id=94e4ebcb-b252-4bcd-89d8-b71f5136c6db,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e4ebcb-b2')
May 27 03:20:32.129194 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:20:32.129528 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:20:32.129692 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:20:32.130054 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:20:32.130385 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:20:32.130576 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:20:32.149508 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:20:32.149508 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:20:32.149508 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:20:32.149697 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:20:32.149697 np0000001475 nova-compute[98471]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa (non-flash)
May 27 03:20:32.149697 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:20:32.149800 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', '206')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:20:32.149895 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', '205')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:20:32.150577 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa', '206')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:20:32.151196 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c286a20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa'): ({'sdc'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:20:32.151385 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Removing multipathed devices sdb, sdc {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:20:32.151570 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flush multipath device 330000000f41a02bc {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:20:32.206353 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:20:32.247278 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:20:32.285121 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:20:32.285372 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:20:32.286085 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:20:32.296429 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:20:32.296596 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:20:32.307135 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:32.328572 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 205, target: iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa, portal: 192.168.40.100,3260]
May 27 03:20:32.328572 np0000001475 nova-compute[98471]: Logout of [sid: 205, target: iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa, portal: 192.168.40.100,3260] successful.
May 27 03:20:32.328572 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:32.338832 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:32.349329 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:32.378616 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 206, target: iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa, portal: 192.168.50.100,3260]
May 27 03:20:32.378616 np0000001475 nova-compute[98471]: Logout of [sid: 206, target: iqn.2023-03.storpool.com:os--volume-f29009ed-eb32-4bf7-ab67-9e221afbe6aa, portal: 192.168.50.100,3260] successful.
May 27 03:20:32.378616 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:32.389545 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:32.389804 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:20:32.389928 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== disconnect_volume: return (260ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:20:32.390039 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:20:32.390284 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Deleting instance files /opt/stack/data/nova/instances/24dc509c-5c24-4f2c-8a80-d466c11810e4_del
May 27 03:20:32.390949 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Deletion of /opt/stack/data/nova/instances/24dc509c-5c24-4f2c-8a80-d466c11810e4_del complete
May 27 03:20:32.896492 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Took 1.60 seconds to destroy the instance on the hypervisor.
May 27 03:20:32.897061 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:20:32.897197 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:20:32.897296 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:20:32.897483 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:20:32.949628 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:20:33.483972 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a0d727aa-34af-4ce4-9d88-f71e2e69716e req-163173e4-4c0e-4338-9df4-5ca52abe4c64 service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Received event network-vif-unplugged-94e4ebcb-b252-4bcd-89d8-b71f5136c6db {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:20:33.484299 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a0d727aa-34af-4ce4-9d88-f71e2e69716e req-163173e4-4c0e-4338-9df4-5ca52abe4c64 service nova] Acquiring lock "24dc509c-5c24-4f2c-8a80-d466c11810e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:33.484299 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a0d727aa-34af-4ce4-9d88-f71e2e69716e req-163173e4-4c0e-4338-9df4-5ca52abe4c64 service nova] Lock "24dc509c-5c24-4f2c-8a80-d466c11810e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:33.484432 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a0d727aa-34af-4ce4-9d88-f71e2e69716e req-163173e4-4c0e-4338-9df4-5ca52abe4c64 service nova] Lock "24dc509c-5c24-4f2c-8a80-d466c11810e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:33.484488 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a0d727aa-34af-4ce4-9d88-f71e2e69716e req-163173e4-4c0e-4338-9df4-5ca52abe4c64 service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] No waiting events found dispatching network-vif-unplugged-94e4ebcb-b252-4bcd-89d8-b71f5136c6db {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:20:33.484587 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a0d727aa-34af-4ce4-9d88-f71e2e69716e req-163173e4-4c0e-4338-9df4-5ca52abe4c64 service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Received event network-vif-unplugged-94e4ebcb-b252-4bcd-89d8-b71f5136c6db for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:20:33.484885 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a0d727aa-34af-4ce4-9d88-f71e2e69716e req-163173e4-4c0e-4338-9df4-5ca52abe4c64 service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Received event network-vif-deleted-94e4ebcb-b252-4bcd-89d8-b71f5136c6db {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:20:33.484984 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-a0d727aa-34af-4ce4-9d88-f71e2e69716e req-163173e4-4c0e-4338-9df4-5ca52abe4c64 service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Neutron deleted interface 94e4ebcb-b252-4bcd-89d8-b71f5136c6db; detaching it from the instance and deleting it from the info cache
May 27 03:20:33.485086 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-a0d727aa-34af-4ce4-9d88-f71e2e69716e req-163173e4-4c0e-4338-9df4-5ca52abe4c64 service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:20:33.747485 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:20:33.774122 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0008175979996849492 future=<Future at 0x75570462b5f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:20:33.774524 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Emitting event <LifecycleEvent: 1779852018.7731876, 6b89f301-37fb-43a6-9bef-bca32191186e => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:20:33.774682 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:20:33.774890 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] VM Stopped (Lifecycle Event)
May 27 03:20:33.775788 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=3.7916804900000898 future=<Future at 0x75570462ab40 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:20:33.775883 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=3.7915643219998856 future=<Future at 0x75570462ab40 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:20:33.987729 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a0d727aa-34af-4ce4-9d88-f71e2e69716e req-163173e4-4c0e-4338-9df4-5ca52abe4c64 service nova] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Detach interface failed, port_id=94e4ebcb-b252-4bcd-89d8-b71f5136c6db, reason: Instance 24dc509c-5c24-4f2c-8a80-d466c11810e4 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:20:34.249489 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Took 1.35 seconds to deallocate network for instance.
May 27 03:20:34.277782 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-1a272cfc-4d32-45a6-825e-41a9a6a2f143 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 6b89f301-37fb-43a6-9bef-bca32191186e] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:20:34.792944 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Took 0.54 seconds to detach 1 volumes for instance.
May 27 03:20:34.794792 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Deleting volume: f29009ed-eb32-4bf7-ab67-9e221afbe6aa {{(pid=98471) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 27 03:20:35.328296 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:35.329015 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:35.410204 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:20:35.410422 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:20:35.912612 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:20:36.418855 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.090s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:36.462345 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Deleted allocations for instance 24dc509c-5c24-4f2c-8a80-d466c11810e4
May 27 03:20:37.125760 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:37.469754 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f5c77f2f-8639-4edc-93e8-cb4444a22a0a tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "24dc509c-5c24-4f2c-8a80-d466c11810e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.680s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:37.567829 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.0003489830000944494 future=<Future at 0x75570462ab40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:20:37.567913 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:20:37.568184 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=9.046735413000079 future=<Future at 0x7557047a33b0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:20:37.568316 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=9.046412099000008 future=<Future at 0x7557047a33b0 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:20:37.568818 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] Emitting event <LifecycleEvent: 1779852022.5673935, 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:20:37.568938 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] VM Stopped (Lifecycle Event)
May 27 03:20:38.071479 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-c4f0b09d-fc94-4b42-a23c-0a7967e54e71 tempest-VolumeMultiattachTests-1876764595 tempest-VolumeMultiattachTests-1876764595-project-member] [instance: 7e08cfc9-c2e0-477d-92e6-89eeb0bdd340] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:20:41.753516 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:41.753896 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:42.126653 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:42.255245 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:20:42.801966 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:42.802427 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:42.805476 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:20:42.805612 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Claim successful on node np0000001475
May 27 03:20:43.890148 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:20:43.890445 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:20:44.392951 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:20:44.900709 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.098s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:44.901171 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:20:45.406351 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:20:45.406610 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:20:45.406898 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:20:45.407114 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:20:45.469013 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8eeaf68cfb534238bfe879dd6e8f858f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0011da7449e7948bf2c8a41955f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:20:45.817072 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Successfully created port: 43488408-8c4f-4e7d-bab5-ec9b250528f1 {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:20:45.909337 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:20:46.203241 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Successfully updated port: 43488408-8c4f-4e7d-bab5-ec9b250528f1 {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:20:46.246137 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9ff2e7ad-5700-4cfb-8111-b800f2bc209c req-670e0175-b2c9-45b2-913c-b5acb0f224d3 service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Received event network-changed-43488408-8c4f-4e7d-bab5-ec9b250528f1 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:20:46.246253 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9ff2e7ad-5700-4cfb-8111-b800f2bc209c req-670e0175-b2c9-45b2-913c-b5acb0f224d3 service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Refreshing instance network info cache due to event network-changed-43488408-8c4f-4e7d-bab5-ec9b250528f1. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:20:46.246400 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ff2e7ad-5700-4cfb-8111-b800f2bc209c req-670e0175-b2c9-45b2-913c-b5acb0f224d3 service nova] Acquiring lock "refresh_cache-0d6d4453-e875-4fad-a9b8-64cfc6a7f805" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:20:46.246493 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ff2e7ad-5700-4cfb-8111-b800f2bc209c req-670e0175-b2c9-45b2-913c-b5acb0f224d3 service nova] Acquired lock "refresh_cache-0d6d4453-e875-4fad-a9b8-64cfc6a7f805" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:20:46.246601 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-9ff2e7ad-5700-4cfb-8111-b800f2bc209c req-670e0175-b2c9-45b2-913c-b5acb0f224d3 service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Refreshing network info cache for port 43488408-8c4f-4e7d-bab5-ec9b250528f1 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:20:46.412358 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:20:46.615126 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.00035489200035954127 future=<Future at 0x7557047a33b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:20:46.615799 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Emitting event <LifecycleEvent: 1779852031.6146736, 24dc509c-5c24-4f2c-8a80-d466c11810e4 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:20:46.615992 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:20:46.616163 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] VM Stopped (Lifecycle Event)
May 27 03:20:46.704914 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "refresh_cache-0d6d4453-e875-4fad-a9b8-64cfc6a7f805" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:20:46.748315 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-9ff2e7ad-5700-4cfb-8111-b800f2bc209c req-670e0175-b2c9-45b2-913c-b5acb0f224d3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:20:46.803785 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-9ff2e7ad-5700-4cfb-8111-b800f2bc209c req-670e0175-b2c9-45b2-913c-b5acb0f224d3 service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:20:46.916262 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-9ff2e7ad-5700-4cfb-8111-b800f2bc209c req-670e0175-b2c9-45b2-913c-b5acb0f224d3 service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:20:46.918381 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Booting with volume 8b231942-ad4a-439f-8fbb-5a4b623319d4 at /dev/vda
May 27 03:20:46.952312 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:20:46.962347 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:20:46.981339 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:20:47.024523 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:20:47.024819 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:20:47.032052 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:20:47.032819 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148'] 
May 27 03:20:47.032925 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:20:47.033026 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:20:47.033340 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:20:47.033560 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Updating existing volume attachment record: 51554cc3-da8e-425a-8e0b-c570a4fc7fd5 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:20:47.118972 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 24dc509c-5c24-4f2c-8a80-d466c11810e4] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:20:47.127663 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:47.421006 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9ff2e7ad-5700-4cfb-8111-b800f2bc209c req-670e0175-b2c9-45b2-913c-b5acb0f224d3 service nova] Releasing lock "refresh_cache-0d6d4453-e875-4fad-a9b8-64cfc6a7f805" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:20:47.421795 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquired lock "refresh_cache-0d6d4453-e875-4fad-a9b8-64cfc6a7f805" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:20:47.421795 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:20:47.977473 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:20:48.111123 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:20:48.225142 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Updating instance_info_cache with network_info: [{"id": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "address": "fa:16:3e:c5:d6:87", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43488408-8c", "ovs_interfaceid": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:20:48.726884 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Releasing lock "refresh_cache-0d6d4453-e875-4fad-a9b8-64cfc6a7f805" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:20:48.727201 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Instance network_info: |[{"id": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "address": "fa:16:3e:c5:d6:87", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43488408-8c", "ovs_interfaceid": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:20:49.119162 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:20:49.120279 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:20:49.120515 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Creating image(s)
May 27 03:20:49.120822 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:20:49.120957 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Ensure instance console log exists: /opt/stack/data/nova/instances/0d6d4453-e875-4fad-a9b8-64cfc6a7f805/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:20:49.121164 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:49.121339 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:49.121475 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:49.121904 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Start _get_guest_xml network_info=[{"id": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "address": "fa:16:3e:c5:d6:87", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43488408-8c", "ovs_interfaceid": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b231942-ad4a-439f-8fbb-5a4b623319d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0d6d4453-e875-4fad-a9b8-64cfc6a7f805', 'attached_at': '', 'detached_at': '', 'volume_id': '8b231942-ad4a-439f-8fbb-5a4b623319d4', 'serial': '8b231942-ad4a-439f-8fbb-5a4b623319d4'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '51554cc3-da8e-425a-8e0b-c570a4fc7fd5', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:20:49.124602 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:20:49.126107 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-244664608', uuid='0d6d4453-e875-4fad-a9b8-64cfc6a7f805'), owner=OwnerMeta(userid='8eeaf68cfb534238bfe879dd6e8f858f', username='tempest-TestVolumeBootPattern-360350731-project-member', projectid='bf4b0011da7449e7948bf2c8a41955f5', projectname='tempest-TestVolumeBootPattern-360350731'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "address": "fa:16:3e:c5:d6:87", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43488408-8c", "ovs_interfaceid": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779852049.125703) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:20:49.127286 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:20:49.127637 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:20:49.128852 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:20:49.129042 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:20:49.130109 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:20:49.130470 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:20:49.130656 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:20:49.130804 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:20:49.130974 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:20:49.131091 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:20:49.131235 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:20:49.131443 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:20:49.131584 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:20:49.131737 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:20:49.131904 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:20:49.132066 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:20:49.141150 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:20:49.141686 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b231942-ad4a-439f-8fbb-5a4b623319d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:20:49.141686 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:20:49.141950 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:20:49.142124 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b231942-ad4a-439f-8fbb-5a4b623319d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:20:49.152551 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:20:49.153078 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:20:49.153519 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:20:49.153718 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:20:49.154104 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:20:49.154319 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:20:49.163607 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:20:49.163607 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:49.168000 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:20:49.168000 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:49.174307 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4] added
May 27 03:20:49.174307 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:20:49.174307 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:20:49.174307 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:20:49.174307 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:20:49.174307 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:20:49.174307 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:49.174532 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:20:49.174780 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0209(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:20:49.174780 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:20:49.178400 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4] added
May 27 03:20:49.178400 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:20:49.178400 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:20:49.178400 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:20:49.178400 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:20:49.178400 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:20:49.178400 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:49.178708 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:20:49.178708 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0244(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:20:49.178794 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:20:50.175227 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:20:50.179146 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:20:50.186222 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:20:50.186222 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:20:50.192373 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:20:50.192373 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:50.198513 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:50.203985 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:50.209444 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 03:20:50.209444 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:20:50.209645 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 03:20:50.209645 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:20:50.209730 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 03:20:50.209730 np0000001475 nova-compute[98471]: 
May 27 03:20:50.214918 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 03:20:50.214918 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:20:50.215062 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 03:20:50.215062 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:20:50.215162 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 03:20:50.215162 np0000001475 nova-compute[98471]: 
May 27 03:20:51.239962 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4, portal: 192.168.40.100,3260]
May 27 03:20:51.239962 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4, portal: 192.168.40.100,3260] successful.
May 27 03:20:51.239962 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:51.241568 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4, portal: 192.168.50.100,3260]
May 27 03:20:51.241568 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4, portal: 192.168.50.100,3260] successful.
May 27 03:20:51.241568 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:51.252571 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:51.257400 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:20:51.265138 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:20:51.265138 np0000001475 nova-compute[98471]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:20:51.265138 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:20:51.265379 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:20:51.265379 np0000001475 nova-compute[98471]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:20:51.265379 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:20:51.265507 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.112s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:20:51.265584 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:20:51.266058 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('7', '-', '-', 0) found on session 223 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:20:51.266170 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:20:51.272431 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:20:51.272431 np0000001475 nova-compute[98471]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:20:51.272431 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:20:51.272560 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:20:51.272560 np0000001475 nova-compute[98471]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:20:51.272560 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:20:51.272797 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.119s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:20:51.272894 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:20:51.273270 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('8', '-', '-', 0) found on session 224 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:20:51.273369 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:20:51.282987 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 223 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:20:51.282987 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b231942-ad4a-439f-8fbb-5a4b623319d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:20:51.289221 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 224 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:20:51.289221 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8b231942-ad4a-439f-8fbb-5a4b623319d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:20:52.129038 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:52.154585 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:20:53.170792 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Found WWN 3300000006b84f358 for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:20:53.171244 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.029s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:20:53.171244 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== connect_volume: return (4029ms) {'type': 'block', 'scsi_wwn': '3300000006b84f358', 'path': '/dev/dm-0', 'multipath_id': '3300000006b84f358'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:20:53.171244 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006b84f358', 'path': '/dev/dm-0', 'multipath_id': '3300000006b84f358'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:20:53.676405 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-244664608',display_name='tempest-TestVolumeBootPattern-server-244664608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-244664608',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICaryW4xfMFHV+vlIJcg6UNnKAtZNnDFSwST0X5b5IQQ966Sp0B9I62DrdIKfoOlKzioaNnLaLM1LeIw4dbGTngQZarioDM4qdeAarf7UROlLEa8o2W+L1+VBzL0o5/WQ==',key_name='tempest-TestVolumeBootPattern-176174463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-igwwk7io',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:20:46Z,user_data=None,user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=0d6d4453-e875-4fad-a9b8-64cfc6a7f805,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "address": "fa:16:3e:c5:d6:87", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43488408-8c", "ovs_interfaceid": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:20:53.676605 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "address": "fa:16:3e:c5:d6:87", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43488408-8c", "ovs_interfaceid": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:20:53.677237 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:d6:87,bridge_name='br-int',has_traffic_filtering=True,id=43488408-8c4f-4e7d-bab5-ec9b250528f1,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43488408-8c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:20:53.677876 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d6d4453-e875-4fad-a9b8-64cfc6a7f805 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:20:54.180610 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] End _get_guest_xml xml=<domain type="qemu">
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:   <uuid>0d6d4453-e875-4fad-a9b8-64cfc6a7f805</uuid>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:   <name>instance-0000004f</name>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestVolumeBootPattern-server-244664608</nova:name>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:20:49</nova:creationTime>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:         <nova:user uuid="8eeaf68cfb534238bfe879dd6e8f858f">tempest-TestVolumeBootPattern-360350731-project-member</nova:user>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:         <nova:project uuid="bf4b0011da7449e7948bf2c8a41955f5">tempest-TestVolumeBootPattern-360350731</nova:project>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:         <nova:port uuid="43488408-8c4f-4e7d-bab5-ec9b250528f1">
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     <system>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <entry name="serial">0d6d4453-e875-4fad-a9b8-64cfc6a7f805</entry>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <entry name="uuid">0d6d4453-e875-4fad-a9b8-64cfc6a7f805</entry>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     </system>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:   <os>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:   </os>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:   <features>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:   </features>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:   <devices>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/0d6d4453-e875-4fad-a9b8-64cfc6a7f805/disk.config"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     </disk>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <alias name="ua-8b231942-ad4a-439f-8fbb-5a4b623319d4"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-0"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <serial>8b231942-ad4a-439f-8fbb-5a4b623319d4</serial>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     </disk>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:c5:d6:87"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <target dev="tap43488408-8c"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     </interface>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/0d6d4453-e875-4fad-a9b8-64cfc6a7f805/console.log" append="off"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     </serial>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     <video>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     </video>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     </rng>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:   </devices>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]: </domain>
May 27 03:20:54.180610 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:20:54.182886 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Preparing to wait for external event network-vif-plugged-43488408-8c4f-4e7d-bab5-ec9b250528f1 {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:20:54.182886 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:54.182886 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:54.182886 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:54.182886 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-244664608',display_name='tempest-TestVolumeBootPattern-server-244664608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-244664608',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICaryW4xfMFHV+vlIJcg6UNnKAtZNnDFSwST0X5b5IQQ966Sp0B9I62DrdIKfoOlKzioaNnLaLM1LeIw4dbGTngQZarioDM4qdeAarf7UROlLEa8o2W+L1+VBzL0o5/WQ==',key_name='tempest-TestVolumeBootPattern-176174463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-igwwk7io',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:20:46Z,user_data=None,user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=0d6d4453-e875-4fad-a9b8-64cfc6a7f805,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "address": "fa:16:3e:c5:d6:87", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43488408-8c", "ovs_interfaceid": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:20:54.182886 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "address": "fa:16:3e:c5:d6:87", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43488408-8c", "ovs_interfaceid": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:20:54.182886 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:d6:87,bridge_name='br-int',has_traffic_filtering=True,id=43488408-8c4f-4e7d-bab5-ec9b250528f1,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43488408-8c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:20:54.182886 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:d6:87,bridge_name='br-int',has_traffic_filtering=True,id=43488408-8c4f-4e7d-bab5-ec9b250528f1,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43488408-8c') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:20:54.183225 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:54.183403 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:20:54.183760 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:20:54.184223 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:54.184404 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a012e833-00c6-5e8b-a848-e1e7672cf062', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:20:54.192064 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:54.193253 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:20:54.194869 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:54.195040 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43488408-8c, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:20:54.195394 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43488408-8c, col_values=(('qos', UUID('4536f096-8852-47e6-8377-225164f82116')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:20:54.195605 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43488408-8c, col_values=(('external_ids', {'iface-id': '43488408-8c4f-4e7d-bab5-ec9b250528f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:d6:87', 'vm-uuid': '0d6d4453-e875-4fad-a9b8-64cfc6a7f805'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:20:54.196400 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:54.197865 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:20:54.201849 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:54.202634 np0000001475 nova-compute[98471]: INFO os_vif [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:d6:87,bridge_name='br-int',has_traffic_filtering=True,id=43488408-8c4f-4e7d-bab5-ec9b250528f1,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43488408-8c')
May 27 03:20:55.717077 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:20:55.717505 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:20:55.717505 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No VIF found with MAC fa:16:3e:c5:d6:87, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:20:55.717676 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Using config drive
May 27 03:20:56.222340 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:20:56.325475 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Creating config drive at /opt/stack/data/nova/instances/0d6d4453-e875-4fad-a9b8-64cfc6a7f805/disk.config
May 27 03:20:56.328262 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0d6d4453-e875-4fad-a9b8-64cfc6a7f805/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjs3vihg3 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:20:56.379083 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0d6d4453-e875-4fad-a9b8-64cfc6a7f805/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjs3vihg3" returned: 0 in 0.050s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:20:56.738251 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:56.752462 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:56.833617 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:56.837418 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:56.886021 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5fa3e923-7e6b-4a05-b2d1-ad16c958fd10 req-5ad7b041-3b8d-4952-ae3c-a0f3b4ac68c1 service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Received event network-vif-plugged-43488408-8c4f-4e7d-bab5-ec9b250528f1 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:20:56.886021 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5fa3e923-7e6b-4a05-b2d1-ad16c958fd10 req-5ad7b041-3b8d-4952-ae3c-a0f3b4ac68c1 service nova] Acquiring lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:56.886021 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5fa3e923-7e6b-4a05-b2d1-ad16c958fd10 req-5ad7b041-3b8d-4952-ae3c-a0f3b4ac68c1 service nova] Lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:56.886021 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5fa3e923-7e6b-4a05-b2d1-ad16c958fd10 req-5ad7b041-3b8d-4952-ae3c-a0f3b4ac68c1 service nova] Lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:56.886021 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5fa3e923-7e6b-4a05-b2d1-ad16c958fd10 req-5ad7b041-3b8d-4952-ae3c-a0f3b4ac68c1 service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Processing event network-vif-plugged-43488408-8c4f-4e7d-bab5-ec9b250528f1 {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:20:57.033824 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:57.035530 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:57.037762 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:57.051303 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:57.391703 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779852057.3912828, 0d6d4453-e875-4fad-a9b8-64cfc6a7f805 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:20:57.391847 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] VM Started (Lifecycle Event)
May 27 03:20:57.393535 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:20:57.395809 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:20:57.398680 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Instance spawned successfully.
May 27 03:20:57.399063 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:20:57.894772 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:20:57.897204 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:20:57.905230 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:20:57.905349 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:20:57.905612 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:20:57.905832 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:20:57.906294 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:20:57.906294 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:20:58.399607 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:20:58.399948 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779852058.3997242, 0d6d4453-e875-4fad-a9b8-64cfc6a7f805 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:20:58.400101 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] VM Paused (Lifecycle Event)
May 27 03:20:58.411241 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Took 9.29 seconds to spawn the instance on the hypervisor.
May 27 03:20:58.411241 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:20:58.902354 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:20:58.904434 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779852058.9042485, 0d6d4453-e875-4fad-a9b8-64cfc6a7f805 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:20:58.904628 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] VM Resumed (Lifecycle Event)
May 27 03:20:58.920088 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Took 16.16 seconds to build instance.
May 27 03:20:58.947464 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-31e5788a-e148-4085-a352-9d73c93cb52c req-d2e2d4dc-0856-41c1-ab64-28087abe4537 service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Received event network-vif-plugged-43488408-8c4f-4e7d-bab5-ec9b250528f1 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:20:58.947464 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-31e5788a-e148-4085-a352-9d73c93cb52c req-d2e2d4dc-0856-41c1-ab64-28087abe4537 service nova] Acquiring lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:20:58.947464 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-31e5788a-e148-4085-a352-9d73c93cb52c req-d2e2d4dc-0856-41c1-ab64-28087abe4537 service nova] Lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:20:58.947464 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-31e5788a-e148-4085-a352-9d73c93cb52c req-d2e2d4dc-0856-41c1-ab64-28087abe4537 service nova] Lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:20:58.947464 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-31e5788a-e148-4085-a352-9d73c93cb52c req-d2e2d4dc-0856-41c1-ab64-28087abe4537 service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] No waiting events found dispatching network-vif-plugged-43488408-8c4f-4e7d-bab5-ec9b250528f1 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:20:58.947464 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-31e5788a-e148-4085-a352-9d73c93cb52c req-d2e2d4dc-0856-41c1-ab64-28087abe4537 service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Received unexpected event network-vif-plugged-43488408-8c4f-4e7d-bab5-ec9b250528f1 for instance with vm_state active and task_state None.
May 27 03:20:59.206268 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:20:59.403422 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:20:59.404699 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:20:59.405200 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:20:59.405200 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:20:59.405200 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:20:59.405713 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.79 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:20:59.406260 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:20:59.408297 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:20:59.420832 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.667s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:21:00.200069 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:21:00.200901 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:21:00.945436 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e681fac9-b4f5-4460-86c6-1fe1f81de417 req-4a7234e4-b782-471f-96ab-aee5529da17b service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Received event network-changed-43488408-8c4f-4e7d-bab5-ec9b250528f1 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:21:00.945873 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-e681fac9-b4f5-4460-86c6-1fe1f81de417 req-4a7234e4-b782-471f-96ab-aee5529da17b service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Refreshing instance network info cache due to event network-changed-43488408-8c4f-4e7d-bab5-ec9b250528f1. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:21:00.946162 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e681fac9-b4f5-4460-86c6-1fe1f81de417 req-4a7234e4-b782-471f-96ab-aee5529da17b service nova] Acquiring lock "refresh_cache-0d6d4453-e875-4fad-a9b8-64cfc6a7f805" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:21:00.946288 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e681fac9-b4f5-4460-86c6-1fe1f81de417 req-4a7234e4-b782-471f-96ab-aee5529da17b service nova] Acquired lock "refresh_cache-0d6d4453-e875-4fad-a9b8-64cfc6a7f805" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:21:00.946490 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-e681fac9-b4f5-4460-86c6-1fe1f81de417 req-4a7234e4-b782-471f-96ab-aee5529da17b service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Refreshing network info cache for port 43488408-8c4f-4e7d-bab5-ec9b250528f1 {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:21:01.210002 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:21:01.449796 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-e681fac9-b4f5-4460-86c6-1fe1f81de417 req-4a7234e4-b782-471f-96ab-aee5529da17b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:21:01.730843 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-e681fac9-b4f5-4460-86c6-1fe1f81de417 req-4a7234e4-b782-471f-96ab-aee5529da17b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:21:01.847642 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-e681fac9-b4f5-4460-86c6-1fe1f81de417 req-4a7234e4-b782-471f-96ab-aee5529da17b service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Updated VIF entry in instance network info cache for port 43488408-8c4f-4e7d-bab5-ec9b250528f1. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:21:01.847956 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-e681fac9-b4f5-4460-86c6-1fe1f81de417 req-4a7234e4-b782-471f-96ab-aee5529da17b service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Updating instance_info_cache with network_info: [{"id": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "address": "fa:16:3e:c5:d6:87", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43488408-8c", "ovs_interfaceid": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:21:01.903859 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:02.199808 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:21:02.199973 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:21:02.349758 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-e681fac9-b4f5-4460-86c6-1fe1f81de417 req-4a7234e4-b782-471f-96ab-aee5529da17b service nova] Releasing lock "refresh_cache-0d6d4453-e875-4fad-a9b8-64cfc6a7f805" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:21:03.196153 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:21:03.196434 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:21:04.195823 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:21:04.196280 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 10.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:21:04.222174 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:06.912604 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:09.232463 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:11.919564 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:14.199772 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:21:14.251210 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:14.703823 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:21:14.703823 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:21:14.704025 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:21:14.704120 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:21:15.722296 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:21:15.724336 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:21:15.725593 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:21:15.776888 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.051s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:21:15.777272 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=13767MB free_disk=72.60279083251953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:21:15.777438 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:21:15.777646 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:21:16.828708 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 0d6d4453-e875-4fad-a9b8-64cfc6a7f805 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:21:16.829030 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:21:16.829030 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:21:15 up 53 min,  2 users,  load average: 1.13, 2.81, 4.04\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_bf4b0011da7449e7948bf2c8a41955f5': '1', 'io_workload': '0'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:21:16.904001 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:21:16.904220 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:21:16.926596 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:17.406971 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:21:17.916312 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:21:17.916834 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.139s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:21:17.916884 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 42.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:21:19.260526 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:21.937516 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:24.278806 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:24.978661 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:21:24.978661 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:21:24.978661 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:21:24.978661 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:21:24.978661 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:21:24.981545 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Terminating instance
May 27 03:21:25.484453 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:21:25.510633 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:25.512783 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:25.524896 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:25.529148 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:25.545561 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:25.645472 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-45c5885a-33ad-4263-b71e-2bd37d5c7900 req-fe591a7d-99ea-4dcb-bd60-f02a6ae08e32 service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Received event network-vif-unplugged-43488408-8c4f-4e7d-bab5-ec9b250528f1 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:21:25.645949 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-45c5885a-33ad-4263-b71e-2bd37d5c7900 req-fe591a7d-99ea-4dcb-bd60-f02a6ae08e32 service nova] Acquiring lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:21:25.646117 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-45c5885a-33ad-4263-b71e-2bd37d5c7900 req-fe591a7d-99ea-4dcb-bd60-f02a6ae08e32 service nova] Lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:21:25.646244 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-45c5885a-33ad-4263-b71e-2bd37d5c7900 req-fe591a7d-99ea-4dcb-bd60-f02a6ae08e32 service nova] Lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:21:25.646387 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-45c5885a-33ad-4263-b71e-2bd37d5c7900 req-fe591a7d-99ea-4dcb-bd60-f02a6ae08e32 service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] No waiting events found dispatching network-vif-unplugged-43488408-8c4f-4e7d-bab5-ec9b250528f1 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:21:25.646504 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-45c5885a-33ad-4263-b71e-2bd37d5c7900 req-fe591a7d-99ea-4dcb-bd60-f02a6ae08e32 service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Received event network-vif-unplugged-43488408-8c4f-4e7d-bab5-ec9b250528f1 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:21:25.727181 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:25.803682 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999658782000097 future=<Future at 0x75572c0f8b00 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:21:25.804099 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999298158000329 future=<Future at 0x75572c0f8b00 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:21:25.804269 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99904987400032 future=<Future at 0x75572c0f8b00 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:21:25.805692 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Instance destroyed successfully.
May 27 03:21:25.806132 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'resources' on Instance uuid 0d6d4453-e875-4fad-a9b8-64cfc6a7f805 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:21:26.308367 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-244664608',display_name='tempest-TestVolumeBootPattern-server-244664608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-244664608',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICaryW4xfMFHV+vlIJcg6UNnKAtZNnDFSwST0X5b5IQQ966Sp0B9I62DrdIKfoOlKzioaNnLaLM1LeIw4dbGTngQZarioDM4qdeAarf7UROlLEa8o2W+L1+VBzL0o5/WQ==',key_name='tempest-TestVolumeBootPattern-176174463',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:20:58Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-igwwk7io',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:20:58Z,user_data=None,user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=0d6d4453-e875-4fad-a9b8-64cfc6a7f805,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "address": "fa:16:3e:c5:d6:87", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43488408-8c", "ovs_interfaceid": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:21:26.308672 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "address": "fa:16:3e:c5:d6:87", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43488408-8c", "ovs_interfaceid": "43488408-8c4f-4e7d-bab5-ec9b250528f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:21:26.309230 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:d6:87,bridge_name='br-int',has_traffic_filtering=True,id=43488408-8c4f-4e7d-bab5-ec9b250528f1,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43488408-8c') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:21:26.309445 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:d6:87,bridge_name='br-int',has_traffic_filtering=True,id=43488408-8c4f-4e7d-bab5-ec9b250528f1,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43488408-8c') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:21:26.311278 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:26.311571 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43488408-8c, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:21:26.312612 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:26.313473 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:21:26.313732 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:26.314311 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:26.314444 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4536f096-8852-47e6-8377-225164f82116) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:21:26.314850 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:26.315335 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:21:26.315534 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:26.317242 np0000001475 nova-compute[98471]: INFO os_vif [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:d6:87,bridge_name='br-int',has_traffic_filtering=True,id=43488408-8c4f-4e7d-bab5-ec9b250528f1,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43488408-8c')
May 27 03:21:26.318727 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:21:26.319088 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b231942-ad4a-439f-8fbb-5a4b623319d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:21:26.319227 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:21:26.319569 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:21:26.319896 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b231942-ad4a-439f-8fbb-5a4b623319d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:21:26.320029 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:21:26.342634 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:21:26.342634 np0000001475 nova-compute[98471]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:21:26.342634 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:21:26.342858 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:21:26.342858 np0000001475 nova-compute[98471]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:21:26.342858 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:21:26.342942 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', '223'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', '224')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:21:26.343007 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', '223')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:21:26.343846 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', '224')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:21:26.344404 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572c29d1c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4'): ({'sdc'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:21:26.344594 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Removing multipathed devices sdb, sdc {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:21:26.344830 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flush multipath device 3300000006b84f358 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:21:26.396117 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:21:26.430100 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:21:26.467028 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:21:26.467181 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:21:26.467875 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:21:26.478575 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:21:26.478813 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:21:26.490231 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:21:26.524618 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 223, target: iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4, portal: 192.168.40.100,3260]
May 27 03:21:26.524618 np0000001475 nova-compute[98471]: Logout of [sid: 223, target: iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4, portal: 192.168.40.100,3260] successful.
May 27 03:21:26.524618 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:21:26.537003 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:21:26.547754 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:21:26.579630 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 224, target: iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4, portal: 192.168.50.100,3260]
May 27 03:21:26.579630 np0000001475 nova-compute[98471]: Logout of [sid: 224, target: iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4, portal: 192.168.50.100,3260] successful.
May 27 03:21:26.579630 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:21:26.589824 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:21:26.590062 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:21:26.590180 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== disconnect_volume: return (270ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:21:26.590287 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:21:26.590519 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Deleting instance files /opt/stack/data/nova/instances/0d6d4453-e875-4fad-a9b8-64cfc6a7f805_del
May 27 03:21:26.590987 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Deletion of /opt/stack/data/nova/instances/0d6d4453-e875-4fad-a9b8-64cfc6a7f805_del complete
May 27 03:21:26.957097 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:27.096342 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Took 1.61 seconds to destroy the instance on the hypervisor.
May 27 03:21:27.096928 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:21:27.097245 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:21:27.097357 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:21:27.097634 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:21:27.152966 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:21:27.545938 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-10157ef7-a75d-441a-856d-075c5ed58269 req-c3f7701f-514b-4e7a-9f21-4849b6889ecb service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Received event network-vif-deleted-43488408-8c4f-4e7d-bab5-ec9b250528f1 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:21:27.546216 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-10157ef7-a75d-441a-856d-075c5ed58269 req-c3f7701f-514b-4e7a-9f21-4849b6889ecb service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Neutron deleted interface 43488408-8c4f-4e7d-bab5-ec9b250528f1; detaching it from the instance and deleting it from the info cache
May 27 03:21:27.546216 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-10157ef7-a75d-441a-856d-075c5ed58269 req-c3f7701f-514b-4e7a-9f21-4849b6889ecb service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:21:27.695386 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5ca10291-6107-435f-8f73-b2eb81efab92 req-970dd073-d38e-4cf5-a3db-5259359565d5 service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Received event network-vif-unplugged-43488408-8c4f-4e7d-bab5-ec9b250528f1 {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:21:27.696090 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5ca10291-6107-435f-8f73-b2eb81efab92 req-970dd073-d38e-4cf5-a3db-5259359565d5 service nova] Acquiring lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:21:27.696308 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5ca10291-6107-435f-8f73-b2eb81efab92 req-970dd073-d38e-4cf5-a3db-5259359565d5 service nova] Lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:21:27.696477 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-5ca10291-6107-435f-8f73-b2eb81efab92 req-970dd073-d38e-4cf5-a3db-5259359565d5 service nova] Lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:21:27.696659 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5ca10291-6107-435f-8f73-b2eb81efab92 req-970dd073-d38e-4cf5-a3db-5259359565d5 service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] No waiting events found dispatching network-vif-unplugged-43488408-8c4f-4e7d-bab5-ec9b250528f1 {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:21:27.696796 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-5ca10291-6107-435f-8f73-b2eb81efab92 req-970dd073-d38e-4cf5-a3db-5259359565d5 service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Received event network-vif-unplugged-43488408-8c4f-4e7d-bab5-ec9b250528f1 for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:21:28.006924 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:21:28.049479 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-10157ef7-a75d-441a-856d-075c5ed58269 req-c3f7701f-514b-4e7a-9f21-4849b6889ecb service nova] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Detach interface failed, port_id=43488408-8c4f-4e7d-bab5-ec9b250528f1, reason: Instance 0d6d4453-e875-4fad-a9b8-64cfc6a7f805 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:21:28.509526 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Took 1.41 seconds to deallocate network for instance.
May 27 03:21:29.049615 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Took 0.54 seconds to detach 1 volumes for instance.
May 27 03:21:29.554777 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:21:29.554925 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:21:29.635434 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:21:29.635670 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:21:30.138355 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:21:30.646644 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.092s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:21:30.691274 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Deleted allocations for instance 0d6d4453-e875-4fad-a9b8-64cfc6a7f805
May 27 03:21:31.315715 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:31.699556 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-48f46808-3231-4a4f-b681-a0dea61fa7f3 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "0d6d4453-e875-4fad-a9b8-64cfc6a7f805" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.723s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:21:33.118283 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "a8f228ca-3043-456d-9378-7917e42ae0a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:21:33.118633 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "a8f228ca-3043-456d-9378-7917e42ae0a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:21:33.620250 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:21:34.163981 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:21:34.164376 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:21:34.167658 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:21:34.167853 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Claim successful on node np0000001475
May 27 03:21:35.252561 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:21:35.252895 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:21:35.755432 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:21:36.261132 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.097s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:21:36.261661 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:21:36.316336 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:36.766579 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:21:36.767418 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:21:36.767671 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:21:36.767921 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:21:36.829876 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8eeaf68cfb534238bfe879dd6e8f858f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0011da7449e7948bf2c8a41955f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:21:37.216139 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Successfully created port: be06fe35-1d22-412f-a7ee-e757f9f9032f {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:21:37.267456 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:21:37.646269 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Successfully updated port: be06fe35-1d22-412f-a7ee-e757f9f9032f {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:21:37.690312 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7f9682a1-8cab-4709-91a7-b4e1fd48aa55 req-60d1fb49-aa28-4ef1-bc18-856e159cae5a service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Received event network-changed-be06fe35-1d22-412f-a7ee-e757f9f9032f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:21:37.690491 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-7f9682a1-8cab-4709-91a7-b4e1fd48aa55 req-60d1fb49-aa28-4ef1-bc18-856e159cae5a service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Refreshing instance network info cache due to event network-changed-be06fe35-1d22-412f-a7ee-e757f9f9032f. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:21:37.690623 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7f9682a1-8cab-4709-91a7-b4e1fd48aa55 req-60d1fb49-aa28-4ef1-bc18-856e159cae5a service nova] Acquiring lock "refresh_cache-a8f228ca-3043-456d-9378-7917e42ae0a1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:21:37.690706 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7f9682a1-8cab-4709-91a7-b4e1fd48aa55 req-60d1fb49-aa28-4ef1-bc18-856e159cae5a service nova] Acquired lock "refresh_cache-a8f228ca-3043-456d-9378-7917e42ae0a1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:21:37.690888 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7f9682a1-8cab-4709-91a7-b4e1fd48aa55 req-60d1fb49-aa28-4ef1-bc18-856e159cae5a service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Refreshing network info cache for port be06fe35-1d22-412f-a7ee-e757f9f9032f {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:21:37.770417 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:21:38.150884 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "refresh_cache-a8f228ca-3043-456d-9378-7917e42ae0a1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:21:38.195110 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-7f9682a1-8cab-4709-91a7-b4e1fd48aa55 req-60d1fb49-aa28-4ef1-bc18-856e159cae5a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:21:38.246797 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7f9682a1-8cab-4709-91a7-b4e1fd48aa55 req-60d1fb49-aa28-4ef1-bc18-856e159cae5a service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:21:38.274274 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Booting with volume 8b231942-ad4a-439f-8fbb-5a4b623319d4 at /dev/vda
May 27 03:21:38.309083 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:21:38.320985 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:21:38.340596 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:21:38.369449 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-7f9682a1-8cab-4709-91a7-b4e1fd48aa55 req-60d1fb49-aa28-4ef1-bc18-856e159cae5a service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:21:38.385325 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:21:38.385572 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:21:38.394032 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:21:38.394752 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148'] 
May 27 03:21:38.394878 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:21:38.394981 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:21:38.395450 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:21:38.395625 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Updating existing volume attachment record: a65917d7-0d71-42ca-a7b1-a15c7b983ea4 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:21:38.873446 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-7f9682a1-8cab-4709-91a7-b4e1fd48aa55 req-60d1fb49-aa28-4ef1-bc18-856e159cae5a service nova] Releasing lock "refresh_cache-a8f228ca-3043-456d-9378-7917e42ae0a1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:21:38.873986 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquired lock "refresh_cache-a8f228ca-3043-456d-9378-7917e42ae0a1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:21:38.874175 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:21:39.437604 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:21:39.585656 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:21:39.720249 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Updating instance_info_cache with network_info: [{"id": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "address": "fa:16:3e:c3:aa:16", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06fe35-1d", "ovs_interfaceid": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:21:40.222112 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Releasing lock "refresh_cache-a8f228ca-3043-456d-9378-7917e42ae0a1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:21:40.222419 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Instance network_info: |[{"id": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "address": "fa:16:3e:c3:aa:16", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06fe35-1d", "ovs_interfaceid": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:21:40.482438 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:21:40.483640 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:21:40.483958 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Creating image(s)
May 27 03:21:40.484306 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:21:40.484485 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Ensure instance console log exists: /opt/stack/data/nova/instances/a8f228ca-3043-456d-9378-7917e42ae0a1/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:21:40.484758 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:21:40.485020 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:21:40.485196 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:21:40.485665 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Start _get_guest_xml network_info=[{"id": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "address": "fa:16:3e:c3:aa:16", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06fe35-1d", "ovs_interfaceid": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b231942-ad4a-439f-8fbb-5a4b623319d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a8f228ca-3043-456d-9378-7917e42ae0a1', 'attached_at': '', 'detached_at': '', 'volume_id': '8b231942-ad4a-439f-8fbb-5a4b623319d4', 'serial': '8b231942-ad4a-439f-8fbb-5a4b623319d4'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'a65917d7-0d71-42ca-a7b1-a15c7b983ea4', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:21:40.490222 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:21:40.491283 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-933697506', uuid='a8f228ca-3043-456d-9378-7917e42ae0a1'), owner=OwnerMeta(userid='8eeaf68cfb534238bfe879dd6e8f858f', username='tempest-TestVolumeBootPattern-360350731-project-member', projectid='bf4b0011da7449e7948bf2c8a41955f5', projectname='tempest-TestVolumeBootPattern-360350731'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "address": "fa:16:3e:c3:aa:16", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06fe35-1d", "ovs_interfaceid": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779852100.4909632) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:21:40.492525 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:21:40.492940 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:21:40.493928 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:21:40.494185 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:21:40.495036 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:21:40.495314 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:21:40.495482 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:21:40.495595 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:21:40.495737 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:21:40.495885 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:21:40.496012 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:21:40.496202 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:21:40.496327 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:21:40.496465 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:21:40.496593 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:21:40.496735 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:21:40.505889 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:21:40.506184 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b231942-ad4a-439f-8fbb-5a4b623319d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:21:40.506332 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:21:40.506656 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:21:40.506909 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b231942-ad4a-439f-8fbb-5a4b623319d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:21:40.518011 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:21:40.518727 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:21:40.519285 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:21:40.519519 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:21:40.519969 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:21:40.520205 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:21:40.531259 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:21:40.531259 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:21:40.538054 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:21:40.538054 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:21:40.545033 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4] added
May 27 03:21:40.545033 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:21:40.545033 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:21:40.545033 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:21:40.545033 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:21:40.545033 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:21:40.545033 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:21:40.545335 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:21:40.545608 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.026(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:21:40.545887 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:21:40.549357 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4] added
May 27 03:21:40.549357 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:21:40.549357 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:21:40.549357 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:21:40.549357 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:21:40.549357 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:21:40.549357 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:21:40.549645 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:21:40.549645 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0295(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:21:40.549819 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:21:40.803757 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.00041285399993284955 future=<Future at 0x75572c0f8b00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:21:40.804369 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Emitting event <LifecycleEvent: 1779852085.8032286, 0d6d4453-e875-4fad-a9b8-64cfc6a7f805 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:21:40.804511 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:21:40.804630 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] VM Stopped (Lifecycle Event)
May 27 03:21:41.307282 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 0d6d4453-e875-4fad-a9b8-64cfc6a7f805] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:21:41.317884 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:41.546345 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:21:41.550847 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:21:41.558418 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:21:41.558418 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:21:41.564292 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:21:41.564292 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:21:41.571074 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:21:41.577653 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:21:41.582568 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 03:21:41.582568 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:21:41.582568 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 03:21:41.582568 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:21:41.582568 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 03:21:41.582568 np0000001475 nova-compute[98471]: 
May 27 03:21:41.588509 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 27 03:21:41.588509 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:21:41.588625 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 27 03:21:41.588625 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:21:41.588730 np0000001475 nova-compute[98471]: WARNING os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 27 03:21:41.588730 np0000001475 nova-compute[98471]: 
May 27 03:21:42.614237 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4, portal: 192.168.50.100,3260]
May 27 03:21:42.614237 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4, portal: 192.168.50.100,3260] successful.
May 27 03:21:42.614237 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:21:42.615211 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4, portal: 192.168.40.100,3260]
May 27 03:21:42.615211 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4, portal: 192.168.40.100,3260] successful.
May 27 03:21:42.615211 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:21:42.626316 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:21:42.630713 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:21:42.638008 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:21:42.638008 np0000001475 nova-compute[98471]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:21:42.638008 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:21:42.638181 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:21:42.638181 np0000001475 nova-compute[98471]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:21:42.638181 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:21:42.638369 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.119s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:21:42.638489 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:21:42.639061 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('8', '-', '-', 0) found on session 226 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:21:42.639161 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:21:42.643442 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:21:42.643442 np0000001475 nova-compute[98471]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:21:42.643442 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:21:42.643574 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:21:42.643574 np0000001475 nova-compute[98471]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:21:42.643574 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:21:42.643792 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.125s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:21:42.643927 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:21:42.644335 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('7', '-', '-', 0) found on session 225 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:21:42.644470 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:21:42.655471 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 226 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:21:42.655471 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8b231942-ad4a-439f-8fbb-5a4b623319d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:21:42.661980 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 225 and hctl ['7', '*', '*', 0] yield: None {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:21:43.662584 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 225 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:21:43.663026 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b231942-ad4a-439f-8fbb-5a4b623319d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:21:44.534015 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Found WWN 3300000006b84f358 for multipath device dm-0 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:21:44.534270 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.028s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:21:44.534416 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== connect_volume: return (4027ms) {'type': 'block', 'scsi_wwn': '3300000006b84f358', 'path': '/dev/dm-0', 'multipath_id': '3300000006b84f358'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:21:44.534523 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006b84f358', 'path': '/dev/dm-0', 'multipath_id': '3300000006b84f358'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:21:45.039294 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:21:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-933697506',display_name='tempest-TestVolumeBootPattern-server-933697506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-933697506',id=80,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICaryW4xfMFHV+vlIJcg6UNnKAtZNnDFSwST0X5b5IQQ966Sp0B9I62DrdIKfoOlKzioaNnLaLM1LeIw4dbGTngQZarioDM4qdeAarf7UROlLEa8o2W+L1+VBzL0o5/WQ==',key_name='tempest-TestVolumeBootPattern-176174463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-genyxv23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:21:38Z,user_data=None,user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=a8f228ca-3043-456d-9378-7917e42ae0a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "address": "fa:16:3e:c3:aa:16", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06fe35-1d", "ovs_interfaceid": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:21:45.039621 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "address": "fa:16:3e:c3:aa:16", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06fe35-1d", "ovs_interfaceid": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:21:45.039967 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:aa:16,bridge_name='br-int',has_traffic_filtering=True,id=be06fe35-1d22-412f-a7ee-e757f9f9032f,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe06fe35-1d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:21:45.040456 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'pci_devices' on Instance uuid a8f228ca-3043-456d-9378-7917e42ae0a1 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:21:45.543797 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] End _get_guest_xml xml=<domain type="qemu">
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:   <uuid>a8f228ca-3043-456d-9378-7917e42ae0a1</uuid>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:   <name>instance-00000050</name>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestVolumeBootPattern-server-933697506</nova:name>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:21:40</nova:creationTime>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:         <nova:user uuid="8eeaf68cfb534238bfe879dd6e8f858f">tempest-TestVolumeBootPattern-360350731-project-member</nova:user>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:         <nova:project uuid="bf4b0011da7449e7948bf2c8a41955f5">tempest-TestVolumeBootPattern-360350731</nova:project>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:         <nova:port uuid="be06fe35-1d22-412f-a7ee-e757f9f9032f">
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     <system>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <entry name="serial">a8f228ca-3043-456d-9378-7917e42ae0a1</entry>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <entry name="uuid">a8f228ca-3043-456d-9378-7917e42ae0a1</entry>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     </system>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:   <os>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:   </os>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:   <features>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:   </features>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:   <devices>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/a8f228ca-3043-456d-9378-7917e42ae0a1/disk.config"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     </disk>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <alias name="ua-8b231942-ad4a-439f-8fbb-5a4b623319d4"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-0"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <serial>8b231942-ad4a-439f-8fbb-5a4b623319d4</serial>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     </disk>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:c3:aa:16"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <target dev="tapbe06fe35-1d"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     </interface>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/a8f228ca-3043-456d-9378-7917e42ae0a1/console.log" append="off"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     </serial>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     <video>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     </video>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     </rng>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:   </devices>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]: </domain>
May 27 03:21:45.543797 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:21:45.543797 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Preparing to wait for external event network-vif-plugged-be06fe35-1d22-412f-a7ee-e757f9f9032f {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:21:45.543797 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "a8f228ca-3043-456d-9378-7917e42ae0a1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:21:45.543797 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "a8f228ca-3043-456d-9378-7917e42ae0a1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:21:45.543797 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "a8f228ca-3043-456d-9378-7917e42ae0a1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:21:45.545958 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:21:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-933697506',display_name='tempest-TestVolumeBootPattern-server-933697506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-933697506',id=80,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICaryW4xfMFHV+vlIJcg6UNnKAtZNnDFSwST0X5b5IQQ966Sp0B9I62DrdIKfoOlKzioaNnLaLM1LeIw4dbGTngQZarioDM4qdeAarf7UROlLEa8o2W+L1+VBzL0o5/WQ==',key_name='tempest-TestVolumeBootPattern-176174463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-genyxv23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:21:38Z,user_data=None,user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=a8f228ca-3043-456d-9378-7917e42ae0a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "address": "fa:16:3e:c3:aa:16", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06fe35-1d", "ovs_interfaceid": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:21:45.545958 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "address": "fa:16:3e:c3:aa:16", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06fe35-1d", "ovs_interfaceid": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:21:45.545958 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:aa:16,bridge_name='br-int',has_traffic_filtering=True,id=be06fe35-1d22-412f-a7ee-e757f9f9032f,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe06fe35-1d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:21:45.545958 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:aa:16,bridge_name='br-int',has_traffic_filtering=True,id=be06fe35-1d22-412f-a7ee-e757f9f9032f,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe06fe35-1d') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:21:45.545958 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:45.545958 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:21:45.546362 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:21:45.546595 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:45.546734 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5bfbd71a-f708-563f-b901-a0b6207417c3', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:21:45.555387 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:45.556053 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:21:45.556357 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:45.557714 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:45.557845 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe06fe35-1d, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:21:45.558124 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe06fe35-1d, col_values=(('qos', UUID('0d8dd463-31a0-4949-bd14-3c54f01a1a68')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:21:45.558281 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe06fe35-1d, col_values=(('external_ids', {'iface-id': 'be06fe35-1d22-412f-a7ee-e757f9f9032f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:aa:16', 'vm-uuid': 'a8f228ca-3043-456d-9378-7917e42ae0a1'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:21:45.559049 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:45.559913 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:21:45.564043 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:45.564721 np0000001475 nova-compute[98471]: INFO os_vif [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:aa:16,bridge_name='br-int',has_traffic_filtering=True,id=be06fe35-1d22-412f-a7ee-e757f9f9032f,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe06fe35-1d')
May 27 03:21:47.079368 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:21:47.079811 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:21:47.079811 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No VIF found with MAC fa:16:3e:c3:aa:16, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:21:47.080048 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Using config drive
May 27 03:21:47.585012 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:21:47.687374 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Creating config drive at /opt/stack/data/nova/instances/a8f228ca-3043-456d-9378-7917e42ae0a1/disk.config
May 27 03:21:47.690326 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a8f228ca-3043-456d-9378-7917e42ae0a1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqm9hz0lw {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:21:47.741767 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a8f228ca-3043-456d-9378-7917e42ae0a1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqm9hz0lw" returned: 0 in 0.051s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:21:48.108696 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:48.122454 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:48.202076 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:48.206089 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:48.244776 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a3af0568-217e-4546-815e-3cdfaeeb35c3 req-5718c17d-53da-4f37-aac6-a1ae4ce9e6de service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Received event network-vif-plugged-be06fe35-1d22-412f-a7ee-e757f9f9032f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:21:48.245301 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a3af0568-217e-4546-815e-3cdfaeeb35c3 req-5718c17d-53da-4f37-aac6-a1ae4ce9e6de service nova] Acquiring lock "a8f228ca-3043-456d-9378-7917e42ae0a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:21:48.245584 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a3af0568-217e-4546-815e-3cdfaeeb35c3 req-5718c17d-53da-4f37-aac6-a1ae4ce9e6de service nova] Lock "a8f228ca-3043-456d-9378-7917e42ae0a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:21:48.245700 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-a3af0568-217e-4546-815e-3cdfaeeb35c3 req-5718c17d-53da-4f37-aac6-a1ae4ce9e6de service nova] Lock "a8f228ca-3043-456d-9378-7917e42ae0a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:21:48.245762 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-a3af0568-217e-4546-815e-3cdfaeeb35c3 req-5718c17d-53da-4f37-aac6-a1ae4ce9e6de service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Processing event network-vif-plugged-be06fe35-1d22-412f-a7ee-e757f9f9032f {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:21:48.390918 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:48.392602 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:48.394442 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:48.407219 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:48.750433 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779852108.7500453, a8f228ca-3043-456d-9378-7917e42ae0a1 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:21:48.751001 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:21:48.751185 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] VM Started (Lifecycle Event)
May 27 03:21:48.752966 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:21:48.755841 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Instance spawned successfully.
May 27 03:21:48.756787 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:21:49.254330 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:21:49.256263 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:21:49.262227 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:21:49.262401 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:21:49.262681 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:21:49.262961 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:21:49.263243 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:21:49.263520 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:21:49.760103 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:21:49.760377 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779852109.7601898, a8f228ca-3043-456d-9378-7917e42ae0a1 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:21:49.760488 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] VM Paused (Lifecycle Event)
May 27 03:21:49.770879 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Took 9.29 seconds to spawn the instance on the hypervisor.
May 27 03:21:49.770879 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:21:50.262577 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:21:50.264540 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779852110.2643185, a8f228ca-3043-456d-9378-7917e42ae0a1 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:21:50.264661 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] VM Resumed (Lifecycle Event)
May 27 03:21:50.277383 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Took 16.15 seconds to build instance.
May 27 03:21:50.317136 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-aa6345ab-2264-47e3-a2c5-2304d9de9505 req-31bce17d-1f98-4b04-9739-2596c9db9786 service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Received event network-vif-plugged-be06fe35-1d22-412f-a7ee-e757f9f9032f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:21:50.317303 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa6345ab-2264-47e3-a2c5-2304d9de9505 req-31bce17d-1f98-4b04-9739-2596c9db9786 service nova] Acquiring lock "a8f228ca-3043-456d-9378-7917e42ae0a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:21:50.317452 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa6345ab-2264-47e3-a2c5-2304d9de9505 req-31bce17d-1f98-4b04-9739-2596c9db9786 service nova] Lock "a8f228ca-3043-456d-9378-7917e42ae0a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:21:50.317560 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-aa6345ab-2264-47e3-a2c5-2304d9de9505 req-31bce17d-1f98-4b04-9739-2596c9db9786 service nova] Lock "a8f228ca-3043-456d-9378-7917e42ae0a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:21:50.317959 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-aa6345ab-2264-47e3-a2c5-2304d9de9505 req-31bce17d-1f98-4b04-9739-2596c9db9786 service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] No waiting events found dispatching network-vif-plugged-be06fe35-1d22-412f-a7ee-e757f9f9032f {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:21:50.318078 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-aa6345ab-2264-47e3-a2c5-2304d9de9505 req-31bce17d-1f98-4b04-9739-2596c9db9786 service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Received unexpected event network-vif-plugged-be06fe35-1d22-412f-a7ee-e757f9f9032f for instance with vm_state active and task_state None.
May 27 03:21:50.578579 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:50.766787 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:21:50.768702 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:21:50.779202 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-7d98ed6e-1f79-49b2-818d-e52df4aa3610 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "a8f228ca-3043-456d-9378-7917e42ae0a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.661s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:21:51.971286 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:52.230355 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f30b4142-1bef-48c2-a995-779a919d31cd req-91151f2f-2475-4db5-9a12-2a15c38918b2 service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Received event network-changed-be06fe35-1d22-412f-a7ee-e757f9f9032f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:21:52.230510 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f30b4142-1bef-48c2-a995-779a919d31cd req-91151f2f-2475-4db5-9a12-2a15c38918b2 service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Refreshing instance network info cache due to event network-changed-be06fe35-1d22-412f-a7ee-e757f9f9032f. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:21:52.230664 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f30b4142-1bef-48c2-a995-779a919d31cd req-91151f2f-2475-4db5-9a12-2a15c38918b2 service nova] Acquiring lock "refresh_cache-a8f228ca-3043-456d-9378-7917e42ae0a1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:21:52.230861 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f30b4142-1bef-48c2-a995-779a919d31cd req-91151f2f-2475-4db5-9a12-2a15c38918b2 service nova] Acquired lock "refresh_cache-a8f228ca-3043-456d-9378-7917e42ae0a1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:21:52.231356 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f30b4142-1bef-48c2-a995-779a919d31cd req-91151f2f-2475-4db5-9a12-2a15c38918b2 service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Refreshing network info cache for port be06fe35-1d22-412f-a7ee-e757f9f9032f {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:21:52.733310 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f30b4142-1bef-48c2-a995-779a919d31cd req-91151f2f-2475-4db5-9a12-2a15c38918b2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:21:53.021752 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-f30b4142-1bef-48c2-a995-779a919d31cd req-91151f2f-2475-4db5-9a12-2a15c38918b2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:21:53.155542 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f30b4142-1bef-48c2-a995-779a919d31cd req-91151f2f-2475-4db5-9a12-2a15c38918b2 service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Updated VIF entry in instance network info cache for port be06fe35-1d22-412f-a7ee-e757f9f9032f. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:21:53.155973 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-f30b4142-1bef-48c2-a995-779a919d31cd req-91151f2f-2475-4db5-9a12-2a15c38918b2 service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Updating instance_info_cache with network_info: [{"id": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "address": "fa:16:3e:c3:aa:16", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06fe35-1d", "ovs_interfaceid": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:21:53.658371 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f30b4142-1bef-48c2-a995-779a919d31cd req-91151f2f-2475-4db5-9a12-2a15c38918b2 service nova] Releasing lock "refresh_cache-a8f228ca-3043-456d-9378-7917e42ae0a1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:21:55.597552 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:56.982894 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:21:59.917224 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:21:59.917853 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:21:59.917853 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:21:59.918037 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.28 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:22:00.200189 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:22:00.200324 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:22:00.200548 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:22:00.200800 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:22:00.599942 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:01.983762 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:02.199644 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:22:02.199972 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:22:05.196228 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:22:05.196711 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 11.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:22:05.601806 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:06.985157 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:10.603735 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:11.987514 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:15.612633 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:16.199791 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:22:16.706392 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:22:16.706868 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:22:16.706909 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:22:16.707149 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:22:17.006789 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:17.726616 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:22:17.728199 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:22:17.728901 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:22:17.772705 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:22:17.773134 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=13781MB free_disk=72.60028839111328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:22:17.773310 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:22:17.773525 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:22:18.833231 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance a8f228ca-3043-456d-9378-7917e42ae0a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:22:18.833583 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:22:18.833583 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:22:17 up 54 min,  2 users,  load average: 0.70, 2.38, 3.81\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_bf4b0011da7449e7948bf2c8a41955f5': '1', 'io_workload': '0'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:22:18.912603 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:22:18.912815 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:22:19.415527 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:22:19.923980 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:22:19.924598 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.151s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:22:19.924598 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 42.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:22:20.628102 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:22.014985 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:25.638689 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:27.022910 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:30.649800 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:32.023366 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:32.295679 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "463c4fd3-c1f9-4549-9617-108c1a1e7240" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:22:32.295861 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "463c4fd3-c1f9-4549-9617-108c1a1e7240" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:22:32.798432 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Starting instance... {{(pid=98471) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 27 03:22:33.340760 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:22:33.341170 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:22:33.344052 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98471) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 27 03:22:33.344229 np0000001475 nova-compute[98471]: INFO nova.compute.claims [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Claim successful on node np0000001475
May 27 03:22:34.473350 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:22:34.473703 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:22:34.975937 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:22:35.481807 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.141s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:22:35.482296 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Start building networks asynchronously for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 27 03:22:35.664989 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:35.987194 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Allocating IP information in the background. {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 27 03:22:35.988281 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] allocate_for_instance() {{(pid=98471) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 27 03:22:35.988281 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:22:35.988629 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:22:36.087650 np0000001475 nova-compute[98471]: DEBUG nova.policy [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8eeaf68cfb534238bfe879dd6e8f858f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4b0011da7449e7948bf2c8a41955f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98471) authorize /opt/stack/nova/nova/policy.py:192}}
May 27 03:22:36.346829 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:36.469986 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Successfully created port: 6957fbdc-0839-435a-a71b-1eece0f0652b {{(pid=98471) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 27 03:22:36.488078 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 27 03:22:36.932020 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Successfully updated port: 6957fbdc-0839-435a-a71b-1eece0f0652b {{(pid=98471) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 27 03:22:36.975887 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-682819c9-6c60-48dc-b82a-87c46d26ef5c req-b39edb6a-fc6f-44b8-a83e-745df3d70b3c service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Received event network-changed-6957fbdc-0839-435a-a71b-1eece0f0652b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:22:36.976040 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-682819c9-6c60-48dc-b82a-87c46d26ef5c req-b39edb6a-fc6f-44b8-a83e-745df3d70b3c service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Refreshing instance network info cache due to event network-changed-6957fbdc-0839-435a-a71b-1eece0f0652b. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:22:36.976251 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-682819c9-6c60-48dc-b82a-87c46d26ef5c req-b39edb6a-fc6f-44b8-a83e-745df3d70b3c service nova] Acquiring lock "refresh_cache-463c4fd3-c1f9-4549-9617-108c1a1e7240" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:22:36.976344 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-682819c9-6c60-48dc-b82a-87c46d26ef5c req-b39edb6a-fc6f-44b8-a83e-745df3d70b3c service nova] Acquired lock "refresh_cache-463c4fd3-c1f9-4549-9617-108c1a1e7240" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:22:36.976457 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-682819c9-6c60-48dc-b82a-87c46d26ef5c req-b39edb6a-fc6f-44b8-a83e-745df3d70b3c service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Refreshing network info cache for port 6957fbdc-0839-435a-a71b-1eece0f0652b {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:22:36.990715 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Start building block device mappings for instance. {{(pid=98471) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 27 03:22:37.433996 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "refresh_cache-463c4fd3-c1f9-4549-9617-108c1a1e7240" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:22:37.479029 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-682819c9-6c60-48dc-b82a-87c46d26ef5c req-b39edb6a-fc6f-44b8-a83e-745df3d70b3c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:22:37.494634 np0000001475 nova-compute[98471]: INFO nova.virt.block_device [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Booting with volume e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1 at /dev/vda
May 27 03:22:37.531784 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.185', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001475', 'execute': None}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:22:37.537955 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-682819c9-6c60-48dc-b82a-87c46d26ef5c req-b39edb6a-fc6f-44b8-a83e-745df3d70b3c service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:22:37.541843 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.scaleio [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98471) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 27 03:22:37.561632 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): nvme version {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:22:37.606005 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] 'nvme version' failed. Not Retrying. {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 27 03:22:37.606371 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] nvme not present on system {{(pid=98471) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 27 03:22:37.615316 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98471) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 27 03:22:37.616131 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.lightos [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Current host hostNQN  and IP(s) are ['10.4.3.185', 'fe80::f816:3eff:fe89:4940', '192.168.40.6', 'fe80::f816:3eff:feae:7770', '192.168.50.6', 'fe80::f816:3eff:fe67:5d9d', '192.168.10.6', 'fe80::f816:3eff:fe45:4a99', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::91:6fff:feb2:3148', 'fe80::fc16:3eff:fec3:aa16', 'fe80::1870:c1ff:feca:47f8'] 
May 27 03:22:37.616414 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 27 03:22:37.616536 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.lightos [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] LIGHTOS: no hostnqn found. {{(pid=98471) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 27 03:22:37.616736 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.185', 'host': 'np0000001475', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:4aeefd5f071', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '057eef24-dd8c-48d3-9d64-7a8bcae32990', 'nvme_native_multipath': False} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:22:37.616947 np0000001475 nova-compute[98471]: DEBUG nova.virt.block_device [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Updating existing volume attachment record: 1c20c716-3efd-48aa-a6c5-0c44cee96535 {{(pid=98471) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 27 03:22:37.674708 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-682819c9-6c60-48dc-b82a-87c46d26ef5c req-b39edb6a-fc6f-44b8-a83e-745df3d70b3c service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:22:38.177465 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-682819c9-6c60-48dc-b82a-87c46d26ef5c req-b39edb6a-fc6f-44b8-a83e-745df3d70b3c service nova] Releasing lock "refresh_cache-463c4fd3-c1f9-4549-9617-108c1a1e7240" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:22:38.178009 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquired lock "refresh_cache-463c4fd3-c1f9-4549-9617-108c1a1e7240" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:22:38.178166 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Building network info cache for instance {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 27 03:22:38.735506 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Instance cache missing network info. {{(pid=98471) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 27 03:22:38.867541 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:22:38.985129 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Updating instance_info_cache with network_info: [{"id": "6957fbdc-0839-435a-a71b-1eece0f0652b", "address": "fa:16:3e:a9:e6:c0", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6957fbdc-08", "ovs_interfaceid": "6957fbdc-0839-435a-a71b-1eece0f0652b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:22:39.487103 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Releasing lock "refresh_cache-463c4fd3-c1f9-4549-9617-108c1a1e7240" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:22:39.487363 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Instance network_info: |[{"id": "6957fbdc-0839-435a-a71b-1eece0f0652b", "address": "fa:16:3e:a9:e6:c0", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6957fbdc-08", "ovs_interfaceid": "6957fbdc-0839-435a-a71b-1eece0f0652b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98471) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 27 03:22:39.695010 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Start spawning the instance on the hypervisor. {{(pid=98471) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 27 03:22:39.695893 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Creating instance directory {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 27 03:22:39.696167 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Creating image(s)
May 27 03:22:39.696480 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Did not create local disks {{(pid=98471) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 27 03:22:39.696611 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Ensure instance console log exists: /opt/stack/data/nova/instances/463c4fd3-c1f9-4549-9617-108c1a1e7240/console.log {{(pid=98471) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 27 03:22:39.696856 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:22:39.697042 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:22:39.697179 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:22:39.697641 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Start _get_guest_xml network_info=[{"id": "6957fbdc-0839-435a-a71b-1eece0f0652b", "address": "fa:16:3e:a9:e6:c0", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6957fbdc-08", "ovs_interfaceid": "6957fbdc-0839-435a-a71b-1eece0f0652b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '463c4fd3-c1f9-4549-9617-108c1a1e7240', 'attached_at': '', 'detached_at': '', 'volume_id': 'e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 'serial': 'e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1'}, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '1c20c716-3efd-48aa-a6c5-0c44cee96535', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 27 03:22:39.701671 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:22:39.702663 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1750837879', uuid='463c4fd3-c1f9-4549-9617-108c1a1e7240'), owner=OwnerMeta(userid='8eeaf68cfb534238bfe879dd6e8f858f', username='tempest-TestVolumeBootPattern-360350731-project-member', projectid='bf4b0011da7449e7948bf2c8a41955f5', projectname='tempest-TestVolumeBootPattern-360350731'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6957fbdc-0839-435a-a71b-1eece0f0652b", "address": "fa:16:3e:a9:e6:c0", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6957fbdc-08", "ovs_interfaceid": "6957fbdc-0839-435a-a71b-1eece0f0652b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779852159.7023513) {{(pid=98471) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 27 03:22:39.703736 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V1... {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 27 03:22:39.704031 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller missing on host. {{(pid=98471) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 27 03:22:39.704985 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching host: 'np0000001475' for CPU controller through CGroups V2... {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 27 03:22:39.705155 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.host [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU controller found on host. {{(pid=98471) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 27 03:22:39.706014 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98471) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 27 03:22:39.706293 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T02:55:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 27 03:22:39.706428 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 27 03:22:39.706514 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image limits 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 27 03:22:39.706625 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flavor pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 27 03:22:39.706702 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Image pref 0:0:0 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 27 03:22:39.706815 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 27 03:22:39.706958 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 27 03:22:39.707066 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 27 03:22:39.707186 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got 1 possible topologies {{(pid=98471) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 27 03:22:39.707303 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 27 03:22:39.707415 np0000001475 nova-compute[98471]: DEBUG nova.virt.hardware [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98471) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 27 03:22:39.716145 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Calling os-brick to attach iSCSI Volume {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 27 03:22:39.716445 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:22:39.716568 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:22:39.716901 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:22:39.717107 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 27 03:22:39.727543 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:22:39.728183 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:22:39.728619 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:22:39.728797 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:22:39.729177 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:22:39.729371 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:22:39.738377 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:22:39.738377 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:22:39.742634 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 27 03:22:39.742634 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:22:39.748693 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1] added
May 27 03:22:39.748693 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:22:39.748693 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:22:39.748693 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:22:39.748693 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:22:39.748693 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:22:39.748693 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:22:39.748948 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:22:39.749107 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0202(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:22:39.749288 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:22:39.752462 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1] added
May 27 03:22:39.752462 np0000001475 nova-compute[98471]:  stderr=iscsiadm: Config file line 363 does not have value
May 27 03:22:39.752462 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:22:39.752462 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:22:39.752462 np0000001475 nova-compute[98471]: iscsiadm: Config file line 363 does not have value
May 27 03:22:39.752462 np0000001475 nova-compute[98471]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 27 03:22:39.752462 np0000001475 nova-compute[98471]:  {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:22:39.752616 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98471) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 27 03:22:39.752736 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0234(s), this was the 1st time calling it. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 27 03:22:39.752888 np0000001475 nova-compute[98471]: DEBUG os_brick.utils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98471) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 27 03:22:40.667146 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:40.749720 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 27 03:22:40.753182 np0000001475 nova-compute[98471]: INFO os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.40.100
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:22:40.761692 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:22:40.761692 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.name = iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.tpgt = -1
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.startup = manual
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.leading_login = No
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.iscsi_ifacename = default
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.net_ifacename = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.ipaddress = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.prefix_len = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.hwaddress = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.transport_name = tcp
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.initiatorname = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.state = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.vlan_id = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.vlan_priority = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.vlan_state = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.iface_num = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.mtu = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.port = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.bootproto = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.subnet_mask = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.gateway = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id_state = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.dhcp_alt_client_id = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.dhcp_dns = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.dhcp_learn_iqn = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.dhcp_req_vendor_id_state = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id_state = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.dhcp_vendor_id = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.dhcp_slp_da = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.fragmentation = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.gratuitous_arp = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.incoming_forwarding = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.tos_state = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.tos = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.ttl = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.delayed_ack = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.tcp_nagle = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.tcp_wsf_state = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.tcp_wsf = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.tcp_timer_scale = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.tcp_timestamp = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.redirect = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.def_task_mgmt_timeout = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.header_digest = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.data_digest = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.immediate_data = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.initial_r2t = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.data_seq_inorder = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.data_pdu_inorder = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.erl = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.max_receive_data_len = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.first_burst_len = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.max_outstanding_r2t = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.max_burst_len = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.chap_auth = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.bidi_chap = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.strict_login_compliance = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.discovery_auth = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: iface.discovery_logout = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.discovery_address = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.discovery_port = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.discovery_type = fw
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.initial_cmdsn = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.initial_login_retry_max = 8
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.xmit_thread_priority = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.cmds_max = 128
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.queue_depth = 32
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.nr_sessions = 1
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.auth.authmethod = None
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.auth.username = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.auth.password = ***
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.auth.username_in = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.auth.password_in = <empty>
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.auth.chap_algs = SHA256
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.timeo.replacement_timeout = 120
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.err_timeo.abort_timeout = 15
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.err_timeo.lu_reset_timeout = 30
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.err_timeo.tgt_reset_timeout = 30
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.err_timeo.host_reset_timeout = 60
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.iscsi.FastAbort = Yes
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.iscsi.InitialR2T = No
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.iscsi.ImmediateData = Yes
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.iscsi.FirstBurstLength = 262144
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.iscsi.MaxBurstLength = 16776192
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Retain = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.iscsi.DefaultTime2Wait = 2
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.iscsi.MaxConnections = 1
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.iscsi.MaxOutstandingR2T = 1
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.iscsi.ERL = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.scan = auto
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.session.reopen_max = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.conn[0].address = 192.168.50.100
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.conn[0].port = 3260
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.conn[0].startup = manual
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.conn[0].tcp.window_size = 524288
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.conn[0].tcp.type_of_service = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.conn[0].timeo.logout_timeout = 15
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.conn[0].timeo.login_timeout = 15
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.conn[0].timeo.auth_timeout = 45
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_interval = 5
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.conn[0].timeo.noop_out_timeout = 5
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.conn[0].iscsi.HeaderDigest = None
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.conn[0].iscsi.DataDigest = None
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.conn[0].iscsi.IFMarker = No
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: node.conn[0].iscsi.OFMarker = No
May 27 03:22:40.766610 np0000001475 nova-compute[98471]: # END RECORD
May 27 03:22:40.766610 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:22:40.773733 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:22:40.778975 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:22:40.786645 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:22:40.786645 np0000001475 nova-compute[98471]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:22:40.786645 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:22:40.786645 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:22:40.786645 np0000001475 nova-compute[98471]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:22:40.786645 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:22:40.791583 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:22:40.791583 np0000001475 nova-compute[98471]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:22:40.791583 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:22:40.791770 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:22:40.791770 np0000001475 nova-compute[98471]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:22:40.791770 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:22:40.815917 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1, portal: 192.168.40.100,3260]
May 27 03:22:40.815917 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1, portal: 192.168.40.100,3260] successful.
May 27 03:22:40.815917 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:22:40.826253 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:22:40.839459 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1, portal: 192.168.50.100,3260]
May 27 03:22:40.839459 np0000001475 nova-compute[98471]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1, portal: 192.168.50.100,3260] successful.
May 27 03:22:40.839459 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:22:40.840015 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:22:40.840015 np0000001475 nova-compute[98471]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:22:40.840015 np0000001475 nova-compute[98471]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1 (non-flash)
May 27 03:22:40.840015 np0000001475 nova-compute[98471]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1 (non-flash)
May 27 03:22:40.840015 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:22:40.840844 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:22:40.840844 np0000001475 nova-compute[98471]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:22:40.840844 np0000001475 nova-compute[98471]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1 (non-flash)
May 27 03:22:40.840844 np0000001475 nova-compute[98471]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1 (non-flash)
May 27 03:22:40.840844 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:22:40.840844 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.112s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:22:40.840844 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.40.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:22:40.841288 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('9', '-', '-', 0) found on session 227 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:22:40.841409 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:22:40.850395 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:22:40.857026 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 227 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:22:40.857212 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:22:40.867078 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:22:40.867078 np0000001475 nova-compute[98471]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:22:40.867078 np0000001475 nova-compute[98471]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1 (non-flash)
May 27 03:22:40.867078 np0000001475 nova-compute[98471]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1 (non-flash)
May 27 03:22:40.867078 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:22:40.867289 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:22:40.867289 np0000001475 nova-compute[98471]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:22:40.867289 np0000001475 nova-compute[98471]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1 (non-flash)
May 27 03:22:40.867289 np0000001475 nova-compute[98471]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1 (non-flash)
May 27 03:22:40.867289 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:22:40.867634 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:22:40.867809 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to 192.168.50.100:3260 {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 27 03:22:40.868441 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] HCTL ('10', '-', '-', 0) found on session 228 with lun 0 {{(pid=98471) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 27 03:22:40.868560 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98471) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 27 03:22:40.881960 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Searching for a device in session 228 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98471) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 27 03:22:40.881960 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98471) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 27 03:22:41.729729 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 27 03:22:42.744087 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Found WWN 330000000764d272b for multipath device dm-3 {{(pid=98471) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 27 03:22:42.744592 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.027s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:22:42.744799 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== connect_volume: return (3027ms) {'type': 'block', 'scsi_wwn': '330000000764d272b', 'path': '/dev/dm-3', 'multipath_id': '330000000764d272b'} {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:22:42.744912 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000764d272b', 'path': '/dev/dm-3', 'multipath_id': '330000000764d272b'} {{(pid=98471) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 27 03:22:43.250143 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1750837879',display_name='tempest-TestVolumeBootPattern-server-1750837879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-1750837879',id=81,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICaryW4xfMFHV+vlIJcg6UNnKAtZNnDFSwST0X5b5IQQ966Sp0B9I62DrdIKfoOlKzioaNnLaLM1LeIw4dbGTngQZarioDM4qdeAarf7UROlLEa8o2W+L1+VBzL0o5/WQ==',key_name='tempest-TestVolumeBootPattern-176174463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-61yacp3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:22:37Z,user_data=None,user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=463c4fd3-c1f9-4549-9617-108c1a1e7240,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6957fbdc-0839-435a-a71b-1eece0f0652b", "address": "fa:16:3e:a9:e6:c0", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6957fbdc-08", "ovs_interfaceid": "6957fbdc-0839-435a-a71b-1eece0f0652b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98471) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 27 03:22:43.250404 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "6957fbdc-0839-435a-a71b-1eece0f0652b", "address": "fa:16:3e:a9:e6:c0", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6957fbdc-08", "ovs_interfaceid": "6957fbdc-0839-435a-a71b-1eece0f0652b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:22:43.251009 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e6:c0,bridge_name='br-int',has_traffic_filtering=True,id=6957fbdc-0839-435a-a71b-1eece0f0652b,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6957fbdc-08') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:22:43.251591 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'pci_devices' on Instance uuid 463c4fd3-c1f9-4549-9617-108c1a1e7240 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:22:43.754148 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] End _get_guest_xml xml=<domain type="qemu">
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:   <uuid>463c4fd3-c1f9-4549-9617-108c1a1e7240</uuid>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:   <name>instance-00000051</name>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:   <memory>196608</memory>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:   <vcpu>1</vcpu>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:   <metadata>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <nova:package version="33.1.0"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <nova:name>tempest-TestVolumeBootPattern-server-1750837879</nova:name>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <nova:creationTime>2026-05-27 03:22:39</nova:creationTime>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <nova:flavor name="m1.nano" id="42">
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:         <nova:memory>192</nova:memory>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:         <nova:disk>1</nova:disk>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:         <nova:swap>0</nova:swap>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:         <nova:ephemeral>0</nova:ephemeral>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:         <nova:vcpus>1</nova:vcpus>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:         <nova:extraSpecs>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:         </nova:extraSpecs>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       </nova:flavor>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <nova:image uuid="">
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:         <nova:minDisk>1</nova:minDisk>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:         <nova:minRam>0</nova:minRam>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:         <nova:properties>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:         </nova:properties>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       </nova:image>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <nova:owner>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:         <nova:user uuid="8eeaf68cfb534238bfe879dd6e8f858f">tempest-TestVolumeBootPattern-360350731-project-member</nova:user>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:         <nova:project uuid="bf4b0011da7449e7948bf2c8a41955f5">tempest-TestVolumeBootPattern-360350731</nova:project>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       </nova:owner>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <nova:root type="volume" uuid=""/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <nova:ports>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:         <nova:port uuid="6957fbdc-0839-435a-a71b-1eece0f0652b">
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:         </nova:port>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       </nova:ports>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     </nova:instance>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:   </metadata>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:   <sysinfo type="smbios">
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     <system>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <entry name="product">OpenStack Nova</entry>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <entry name="version">33.1.0</entry>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <entry name="serial">463c4fd3-c1f9-4549-9617-108c1a1e7240</entry>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <entry name="uuid">463c4fd3-c1f9-4549-9617-108c1a1e7240</entry>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <entry name="family">Virtual Machine</entry>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     </system>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:   </sysinfo>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:   <os>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     <type arch="x86_64" machine="pc">hvm</type>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     <boot dev="hd"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     <smbios mode="sysinfo"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:   </os>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:   <features>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     <acpi/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     <tcg>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <tb-cache unit="MiB">128</tb-cache>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     </tcg>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     <vmcoreinfo/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:   </features>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:   <iothreads>1</iothreads>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:   <clock offset="utc"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:   <cpu mode="custom" match="exact">
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     <model>Nehalem</model>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     <topology sockets="1" cores="1" threads="1"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:   </cpu>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:   <devices>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     <disk type="file" device="cdrom">
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <source file="/opt/stack/data/nova/instances/463c4fd3-c1f9-4549-9617-108c1a1e7240/disk.config"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <target dev="hda" bus="ide"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     </disk>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     <disk type="block" device="disk">
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <alias name="ua-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <source dev="/dev/dm-3"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <target dev="vda" bus="virtio"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <serial>e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1</serial>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     </disk>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     <interface type="ethernet">
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <mac address="fa:16:3e:a9:e6:c0"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <driver name="qemu"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <mtu size="1372"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <target dev="tap6957fbdc-08"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     </interface>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     <serial type="pty">
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <log file="/opt/stack/data/nova/instances/463c4fd3-c1f9-4549-9617-108c1a1e7240/console.log" append="off"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     </serial>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     <video>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <model type="virtio"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     </video>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     <rng model="virtio">
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <backend model="random">/dev/urandom</backend>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     </rng>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     <controller type="usb" index="0" model="none"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:       <stats period="10"/>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:     </memballoon>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:   </devices>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]: </domain>
May 27 03:22:43.754148 np0000001475 nova-compute[98471]:  {{(pid=98471) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 27 03:22:43.756915 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Preparing to wait for external event network-vif-plugged-6957fbdc-0839-435a-a71b-1eece0f0652b {{(pid=98471) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 27 03:22:43.756915 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "463c4fd3-c1f9-4549-9617-108c1a1e7240-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:22:43.756915 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "463c4fd3-c1f9-4549-9617-108c1a1e7240-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:22:43.756915 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "463c4fd3-c1f9-4549-9617-108c1a1e7240-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:22:43.756915 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T03:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1750837879',display_name='tempest-TestVolumeBootPattern-server-1750837879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-1750837879',id=81,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICaryW4xfMFHV+vlIJcg6UNnKAtZNnDFSwST0X5b5IQQ966Sp0B9I62DrdIKfoOlKzioaNnLaLM1LeIw4dbGTngQZarioDM4qdeAarf7UROlLEa8o2W+L1+VBzL0o5/WQ==',key_name='tempest-TestVolumeBootPattern-176174463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-61yacp3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T03:22:37Z,user_data=None,user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=463c4fd3-c1f9-4549-9617-108c1a1e7240,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6957fbdc-0839-435a-a71b-1eece0f0652b", "address": "fa:16:3e:a9:e6:c0", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6957fbdc-08", "ovs_interfaceid": "6957fbdc-0839-435a-a71b-1eece0f0652b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 27 03:22:43.756915 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "6957fbdc-0839-435a-a71b-1eece0f0652b", "address": "fa:16:3e:a9:e6:c0", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6957fbdc-08", "ovs_interfaceid": "6957fbdc-0839-435a-a71b-1eece0f0652b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:22:43.756915 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e6:c0,bridge_name='br-int',has_traffic_filtering=True,id=6957fbdc-0839-435a-a71b-1eece0f0652b,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6957fbdc-08') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:22:43.756915 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e6:c0,bridge_name='br-int',has_traffic_filtering=True,id=6957fbdc-0839-435a-a71b-1eece0f0652b,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6957fbdc-08') {{(pid=98471) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 27 03:22:43.756915 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:43.756915 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:22:43.756915 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 27 03:22:43.757547 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:43.757699 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14a34020-662a-56f4-86f1-b12db46d562d', '_type': 'linux-noop'}}, row=False) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:22:43.758439 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:43.759099 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:22:43.759497 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:43.761192 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:43.761350 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6957fbdc-08, may_exist=True, interface_attrs={}) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:22:43.761642 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6957fbdc-08, col_values=(('qos', UUID('b56982bd-06e1-416c-8590-f6a4b95be85b')),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:22:43.761814 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6957fbdc-08, col_values=(('external_ids', {'iface-id': '6957fbdc-0839-435a-a71b-1eece0f0652b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:e6:c0', 'vm-uuid': '463c4fd3-c1f9-4549-9617-108c1a1e7240'}),), if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:22:43.762464 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:43.763637 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:22:43.767854 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:43.768873 np0000001475 nova-compute[98471]: INFO os_vif [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e6:c0,bridge_name='br-int',has_traffic_filtering=True,id=6957fbdc-0839-435a-a71b-1eece0f0652b,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6957fbdc-08')
May 27 03:22:45.282981 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name hda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:22:45.283471 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No BDM found with device name vda, not building metadata. {{(pid=98471) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 27 03:22:45.283471 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] No VIF found with MAC fa:16:3e:a9:e6:c0, not building metadata {{(pid=98471) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 27 03:22:45.283604 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Using config drive
May 27 03:22:45.788455 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:22:45.892339 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Creating config drive at /opt/stack/data/nova/instances/463c4fd3-c1f9-4549-9617-108c1a1e7240/disk.config
May 27 03:22:45.895233 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/463c4fd3-c1f9-4549-9617-108c1a1e7240/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp25rfxl55 {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:22:45.947815 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/463c4fd3-c1f9-4549-9617-108c1a1e7240/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp25rfxl55" returned: 0 in 0.052s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:22:46.302063 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:46.317727 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:46.319558 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:46.408290 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:46.436225 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9a472c71-cc62-449d-800a-468c3154b1c6 req-99dda794-9b32-485b-8224-aa3c49693673 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Received event network-vif-plugged-6957fbdc-0839-435a-a71b-1eece0f0652b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:22:46.436585 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9a472c71-cc62-449d-800a-468c3154b1c6 req-99dda794-9b32-485b-8224-aa3c49693673 service nova] Acquiring lock "463c4fd3-c1f9-4549-9617-108c1a1e7240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:22:46.436854 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9a472c71-cc62-449d-800a-468c3154b1c6 req-99dda794-9b32-485b-8224-aa3c49693673 service nova] Lock "463c4fd3-c1f9-4549-9617-108c1a1e7240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:22:46.437012 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9a472c71-cc62-449d-800a-468c3154b1c6 req-99dda794-9b32-485b-8224-aa3c49693673 service nova] Lock "463c4fd3-c1f9-4549-9617-108c1a1e7240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:22:46.437140 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9a472c71-cc62-449d-800a-468c3154b1c6 req-99dda794-9b32-485b-8224-aa3c49693673 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Processing event network-vif-plugged-6957fbdc-0839-435a-a71b-1eece0f0652b {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 27 03:22:46.451970 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:46.941338 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779852166.9408922, 463c4fd3-c1f9-4549-9617-108c1a1e7240 => Started> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:22:46.941612 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98471) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 27 03:22:46.941754 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] VM Started (Lifecycle Event)
May 27 03:22:46.943721 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Guest created on hypervisor {{(pid=98471) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 27 03:22:46.945944 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Instance spawned successfully.
May 27 03:22:46.946902 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 27 03:22:47.033976 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:47.445111 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:22:47.447192 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:22:47.452675 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Found default for hw_cdrom_bus of ide {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:22:47.452675 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Found default for hw_disk_bus of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:22:47.452882 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Found default for hw_input_bus of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:22:47.453136 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Found default for hw_pointer_model of None {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:22:47.453428 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Found default for hw_video_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:22:47.456112 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Found default for hw_vif_model of virtio {{(pid=98471) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 27 03:22:47.950689 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] During sync_power_state the instance has a pending task (spawning). Skip.
May 27 03:22:47.950993 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779852167.9508007, 463c4fd3-c1f9-4549-9617-108c1a1e7240 => Paused> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:22:47.951105 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] VM Paused (Lifecycle Event)
May 27 03:22:47.960358 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Took 8.27 seconds to spawn the instance on the hypervisor.
May 27 03:22:47.960497 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:22:48.453452 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:22:48.458926 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Emitting event <LifecycleEvent: 1779852168.4587295, 463c4fd3-c1f9-4549-9617-108c1a1e7240 => Resumed> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:22:48.459029 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] VM Resumed (Lifecycle Event)
May 27 03:22:48.468490 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Took 15.17 seconds to build instance.
May 27 03:22:48.488426 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-71bd82f9-c8e6-44ce-86fa-766dcb5450e0 req-f8623e74-779c-451c-89d0-ba1d9a044923 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Received event network-vif-plugged-6957fbdc-0839-435a-a71b-1eece0f0652b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:22:48.488630 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-71bd82f9-c8e6-44ce-86fa-766dcb5450e0 req-f8623e74-779c-451c-89d0-ba1d9a044923 service nova] Acquiring lock "463c4fd3-c1f9-4549-9617-108c1a1e7240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:22:48.489027 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-71bd82f9-c8e6-44ce-86fa-766dcb5450e0 req-f8623e74-779c-451c-89d0-ba1d9a044923 service nova] Lock "463c4fd3-c1f9-4549-9617-108c1a1e7240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:22:48.489202 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-71bd82f9-c8e6-44ce-86fa-766dcb5450e0 req-f8623e74-779c-451c-89d0-ba1d9a044923 service nova] Lock "463c4fd3-c1f9-4549-9617-108c1a1e7240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:22:48.489353 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-71bd82f9-c8e6-44ce-86fa-766dcb5450e0 req-f8623e74-779c-451c-89d0-ba1d9a044923 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] No waiting events found dispatching network-vif-plugged-6957fbdc-0839-435a-a71b-1eece0f0652b {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:22:48.489500 np0000001475 nova-compute[98471]: WARNING nova.compute.manager [req-71bd82f9-c8e6-44ce-86fa-766dcb5450e0 req-f8623e74-779c-451c-89d0-ba1d9a044923 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Received unexpected event network-vif-plugged-6957fbdc-0839-435a-a71b-1eece0f0652b for instance with vm_state active and task_state None.
May 27 03:22:48.764255 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:48.961016 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:22:48.965765 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98471) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 27 03:22:48.970365 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-89ff9ec5-ea37-47bb-bc0e-0fd0b942ae5c tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "463c4fd3-c1f9-4549-9617-108c1a1e7240" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.674s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:22:50.235383 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2b70cc65-73cb-4833-9934-59c4e6f227d7 req-1c2c82bd-e05e-466f-814a-c162718a9497 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Received event network-changed-6957fbdc-0839-435a-a71b-1eece0f0652b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:22:50.235719 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-2b70cc65-73cb-4833-9934-59c4e6f227d7 req-1c2c82bd-e05e-466f-814a-c162718a9497 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Refreshing instance network info cache due to event network-changed-6957fbdc-0839-435a-a71b-1eece0f0652b. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:22:50.235719 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2b70cc65-73cb-4833-9934-59c4e6f227d7 req-1c2c82bd-e05e-466f-814a-c162718a9497 service nova] Acquiring lock "refresh_cache-463c4fd3-c1f9-4549-9617-108c1a1e7240" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:22:50.235798 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2b70cc65-73cb-4833-9934-59c4e6f227d7 req-1c2c82bd-e05e-466f-814a-c162718a9497 service nova] Acquired lock "refresh_cache-463c4fd3-c1f9-4549-9617-108c1a1e7240" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:22:50.235902 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-2b70cc65-73cb-4833-9934-59c4e6f227d7 req-1c2c82bd-e05e-466f-814a-c162718a9497 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Refreshing network info cache for port 6957fbdc-0839-435a-a71b-1eece0f0652b {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:22:50.738307 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-2b70cc65-73cb-4833-9934-59c4e6f227d7 req-1c2c82bd-e05e-466f-814a-c162718a9497 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:22:51.030840 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-2b70cc65-73cb-4833-9934-59c4e6f227d7 req-1c2c82bd-e05e-466f-814a-c162718a9497 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:22:51.148590 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-2b70cc65-73cb-4833-9934-59c4e6f227d7 req-1c2c82bd-e05e-466f-814a-c162718a9497 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Updated VIF entry in instance network info cache for port 6957fbdc-0839-435a-a71b-1eece0f0652b. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:22:51.148978 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-2b70cc65-73cb-4833-9934-59c4e6f227d7 req-1c2c82bd-e05e-466f-814a-c162718a9497 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Updating instance_info_cache with network_info: [{"id": "6957fbdc-0839-435a-a71b-1eece0f0652b", "address": "fa:16:3e:a9:e6:c0", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6957fbdc-08", "ovs_interfaceid": "6957fbdc-0839-435a-a71b-1eece0f0652b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:22:51.651050 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-2b70cc65-73cb-4833-9934-59c4e6f227d7 req-1c2c82bd-e05e-466f-814a-c162718a9497 service nova] Releasing lock "refresh_cache-463c4fd3-c1f9-4549-9617-108c1a1e7240" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:22:52.036090 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:53.766549 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:57.048721 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:22:58.768428 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:01.212262 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:23:01.924512 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:23:01.924719 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:23:01.924890 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:23:01.925134 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:23:01.925340 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:23:01.925517 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:23:01.925792 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.27 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:23:02.047732 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:03.769285 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:04.200015 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:23:04.200280 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:23:05.196110 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:23:05.196560 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:23:07.060254 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:07.196156 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:23:07.196530 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 10.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:23:08.771507 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:12.070516 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:13.774403 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:17.086219 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:17.199776 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:23:17.704397 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:23:17.704615 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:23:17.704731 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:23:17.704881 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:23:18.725178 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:23:18.726563 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98471) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 27 03:23:18.728086 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:23:18.729007 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:23:18.776586 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:18.778904 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:23:18.779426 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=13456MB free_disk=72.58992767333984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:23:18.779651 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:23:18.779987 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:23:19.838808 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance a8f228ca-3043-456d-9378-7917e42ae0a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:23:19.839169 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Instance 463c4fd3-c1f9-4549-9617-108c1a1e7240 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98471) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 27 03:23:19.839169 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:23:19.839271 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:23:18 up 55 min,  2 users,  load average: 0.80, 2.08, 3.61\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_bf4b0011da7449e7948bf2c8a41955f5': '2', 'io_workload': '0'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:23:19.962611 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:23:19.962834 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:23:20.465592 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:23:20.974616 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:23:20.975114 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.195s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:23:20.975462 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 41.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:23:23.779529 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:23:26.986709 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-84a00262-ad5b-42b5-8722-14f0b3aaf096 req-92be27c7-9d0e-488c-9608-f18876b1af79 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Received event network-changed-6957fbdc-0839-435a-a71b-1eece0f0652b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:23:26.987102 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-84a00262-ad5b-42b5-8722-14f0b3aaf096 req-92be27c7-9d0e-488c-9608-f18876b1af79 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Refreshing instance network info cache due to event network-changed-6957fbdc-0839-435a-a71b-1eece0f0652b. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:23:26.987102 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-84a00262-ad5b-42b5-8722-14f0b3aaf096 req-92be27c7-9d0e-488c-9608-f18876b1af79 service nova] Acquiring lock "refresh_cache-463c4fd3-c1f9-4549-9617-108c1a1e7240" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:23:26.987321 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-84a00262-ad5b-42b5-8722-14f0b3aaf096 req-92be27c7-9d0e-488c-9608-f18876b1af79 service nova] Acquired lock "refresh_cache-463c4fd3-c1f9-4549-9617-108c1a1e7240" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:23:26.987321 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-84a00262-ad5b-42b5-8722-14f0b3aaf096 req-92be27c7-9d0e-488c-9608-f18876b1af79 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Refreshing network info cache for port 6957fbdc-0839-435a-a71b-1eece0f0652b {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:23:27.089184 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:27.489622 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-84a00262-ad5b-42b5-8722-14f0b3aaf096 req-92be27c7-9d0e-488c-9608-f18876b1af79 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:23:27.494510 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "463c4fd3-c1f9-4549-9617-108c1a1e7240" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:23:27.494882 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "463c4fd3-c1f9-4549-9617-108c1a1e7240" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:23:27.495130 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "463c4fd3-c1f9-4549-9617-108c1a1e7240-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:23:27.495339 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "463c4fd3-c1f9-4549-9617-108c1a1e7240-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:23:27.495510 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "463c4fd3-c1f9-4549-9617-108c1a1e7240-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:23:27.498351 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Terminating instance
May 27 03:23:27.744506 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-84a00262-ad5b-42b5-8722-14f0b3aaf096 req-92be27c7-9d0e-488c-9608-f18876b1af79 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:23:27.861041 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-84a00262-ad5b-42b5-8722-14f0b3aaf096 req-92be27c7-9d0e-488c-9608-f18876b1af79 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Updated VIF entry in instance network info cache for port 6957fbdc-0839-435a-a71b-1eece0f0652b. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:23:27.861309 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-84a00262-ad5b-42b5-8722-14f0b3aaf096 req-92be27c7-9d0e-488c-9608-f18876b1af79 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Updating instance_info_cache with network_info: [{"id": "6957fbdc-0839-435a-a71b-1eece0f0652b", "address": "fa:16:3e:a9:e6:c0", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6957fbdc-08", "ovs_interfaceid": "6957fbdc-0839-435a-a71b-1eece0f0652b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:23:28.001336 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:23:28.027322 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:28.029348 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:28.040156 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:28.173925 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9533e7e2-ea61-44be-b8ec-bac277ab93c1 req-25ccfd99-8f45-4601-a523-c8f07287bdc1 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Received event network-vif-unplugged-6957fbdc-0839-435a-a71b-1eece0f0652b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:23:28.173988 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9533e7e2-ea61-44be-b8ec-bac277ab93c1 req-25ccfd99-8f45-4601-a523-c8f07287bdc1 service nova] Acquiring lock "463c4fd3-c1f9-4549-9617-108c1a1e7240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:23:28.174129 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9533e7e2-ea61-44be-b8ec-bac277ab93c1 req-25ccfd99-8f45-4601-a523-c8f07287bdc1 service nova] Lock "463c4fd3-c1f9-4549-9617-108c1a1e7240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:23:28.174838 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-9533e7e2-ea61-44be-b8ec-bac277ab93c1 req-25ccfd99-8f45-4601-a523-c8f07287bdc1 service nova] Lock "463c4fd3-c1f9-4549-9617-108c1a1e7240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:23:28.175427 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9533e7e2-ea61-44be-b8ec-bac277ab93c1 req-25ccfd99-8f45-4601-a523-c8f07287bdc1 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] No waiting events found dispatching network-vif-unplugged-6957fbdc-0839-435a-a71b-1eece0f0652b {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:23:28.175624 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-9533e7e2-ea61-44be-b8ec-bac277ab93c1 req-25ccfd99-8f45-4601-a523-c8f07287bdc1 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Received event network-vif-unplugged-6957fbdc-0839-435a-a71b-1eece0f0652b for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:23:28.176187 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:28.182001 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:28.310553 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999673209999855 future=<Future at 0x75572c129370 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:23:28.311050 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99910289499985 future=<Future at 0x75572c129370 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:23:28.311398 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.99874059800004 future=<Future at 0x75572c129370 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:23:28.313343 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Instance destroyed successfully.
May 27 03:23:28.313790 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'resources' on Instance uuid 463c4fd3-c1f9-4549-9617-108c1a1e7240 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:23:28.363060 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-84a00262-ad5b-42b5-8722-14f0b3aaf096 req-92be27c7-9d0e-488c-9608-f18876b1af79 service nova] Releasing lock "refresh_cache-463c4fd3-c1f9-4549-9617-108c1a1e7240" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:23:28.781083 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:28.816102 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1750837879',display_name='tempest-TestVolumeBootPattern-server-1750837879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-1750837879',id=81,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICaryW4xfMFHV+vlIJcg6UNnKAtZNnDFSwST0X5b5IQQ966Sp0B9I62DrdIKfoOlKzioaNnLaLM1LeIw4dbGTngQZarioDM4qdeAarf7UROlLEa8o2W+L1+VBzL0o5/WQ==',key_name='tempest-TestVolumeBootPattern-176174463',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:22:47Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-61yacp3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:22:48Z,user_data=None,user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=463c4fd3-c1f9-4549-9617-108c1a1e7240,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6957fbdc-0839-435a-a71b-1eece0f0652b", "address": "fa:16:3e:a9:e6:c0", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6957fbdc-08", "ovs_interfaceid": "6957fbdc-0839-435a-a71b-1eece0f0652b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:23:28.816409 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "6957fbdc-0839-435a-a71b-1eece0f0652b", "address": "fa:16:3e:a9:e6:c0", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6957fbdc-08", "ovs_interfaceid": "6957fbdc-0839-435a-a71b-1eece0f0652b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:23:28.816989 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:e6:c0,bridge_name='br-int',has_traffic_filtering=True,id=6957fbdc-0839-435a-a71b-1eece0f0652b,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6957fbdc-08') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:23:28.817291 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:e6:c0,bridge_name='br-int',has_traffic_filtering=True,id=6957fbdc-0839-435a-a71b-1eece0f0652b,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6957fbdc-08') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:23:28.818408 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:28.818647 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6957fbdc-08, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:23:28.819593 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:28.820377 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:23:28.820645 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:28.821384 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:28.821555 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b56982bd-06e1-416c-8590-f6a4b95be85b) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:23:28.821976 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:28.822418 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:23:28.822591 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:28.824280 np0000001475 nova-compute[98471]: INFO os_vif [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:e6:c0,bridge_name='br-int',has_traffic_filtering=True,id=6957fbdc-0839-435a-a71b-1eece0f0652b,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6957fbdc-08')
May 27 03:23:28.825909 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:23:28.826217 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:23:28.826339 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:23:28.826708 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:23:28.827020 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:23:28.827155 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:23:28.849747 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:23:28.849747 np0000001475 nova-compute[98471]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:23:28.849747 np0000001475 nova-compute[98471]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1 (non-flash)
May 27 03:23:28.849747 np0000001475 nova-compute[98471]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1 (non-flash)
May 27 03:23:28.849747 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:23:28.849968 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:23:28.849968 np0000001475 nova-compute[98471]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:23:28.849968 np0000001475 nova-compute[98471]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1 (non-flash)
May 27 03:23:28.849968 np0000001475 nova-compute[98471]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1 (non-flash)
May 27 03:23:28.849968 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:23:28.849968 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', '225'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', '226'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', '227'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', '228')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:23:28.850111 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', '227')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:23:28.850850 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1', '228')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:23:28.851551 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x75572472f100>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1'): ({'sde'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:23:28.851732 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Removing multipathed devices sdd, sde {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:23:28.851943 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flush multipath device 330000000764d272b {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:23:28.903039 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:23:28.942246 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:23:28.987006 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:23:28.987190 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:23:28.988248 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:23:28.999637 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:23:28.999853 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:23:29.010348 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:23:29.046614 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 227, target: iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1, portal: 192.168.40.100,3260]
May 27 03:23:29.046614 np0000001475 nova-compute[98471]: Logout of [sid: 227, target: iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1, portal: 192.168.40.100,3260] successful.
May 27 03:23:29.046614 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:23:29.060246 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:23:29.071181 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:23:29.094640 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 228, target: iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1, portal: 192.168.50.100,3260]
May 27 03:23:29.094640 np0000001475 nova-compute[98471]: Logout of [sid: 228, target: iqn.2023-03.storpool.com:os--volume-e71aa60c-986b-48e5-ab3b-3eefe0f1d7b1, portal: 192.168.50.100,3260] successful.
May 27 03:23:29.094640 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:23:29.105876 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:23:29.106079 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:23:29.106234 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== disconnect_volume: return (279ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:23:29.106390 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:23:29.106681 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Deleting instance files /opt/stack/data/nova/instances/463c4fd3-c1f9-4549-9617-108c1a1e7240_del
May 27 03:23:29.107152 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Deletion of /opt/stack/data/nova/instances/463c4fd3-c1f9-4549-9617-108c1a1e7240_del complete
May 27 03:23:29.612859 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Took 1.61 seconds to destroy the instance on the hypervisor.
May 27 03:23:29.614274 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:23:29.614636 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:23:29.614760 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:23:29.614998 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:23:29.703953 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:23:29.921138 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-86c45ace-0fc4-4311-aa52-0ec3d1a7c3e6 req-42592131-f4fe-42f6-b5b2-ad5af6a63c5c service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Received event network-vif-deleted-6957fbdc-0839-435a-a71b-1eece0f0652b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:23:29.921138 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-86c45ace-0fc4-4311-aa52-0ec3d1a7c3e6 req-42592131-f4fe-42f6-b5b2-ad5af6a63c5c service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Neutron deleted interface 6957fbdc-0839-435a-a71b-1eece0f0652b; detaching it from the instance and deleting it from the info cache
May 27 03:23:29.921138 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-86c45ace-0fc4-4311-aa52-0ec3d1a7c3e6 req-42592131-f4fe-42f6-b5b2-ad5af6a63c5c service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:23:30.226578 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-72c8e065-4c85-4ccb-b8d0-edb191d90d46 req-e8453f3c-8907-4348-8f56-92e40c468106 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Received event network-vif-unplugged-6957fbdc-0839-435a-a71b-1eece0f0652b {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:23:30.226966 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-72c8e065-4c85-4ccb-b8d0-edb191d90d46 req-e8453f3c-8907-4348-8f56-92e40c468106 service nova] Acquiring lock "463c4fd3-c1f9-4549-9617-108c1a1e7240-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:23:30.227005 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-72c8e065-4c85-4ccb-b8d0-edb191d90d46 req-e8453f3c-8907-4348-8f56-92e40c468106 service nova] Lock "463c4fd3-c1f9-4549-9617-108c1a1e7240-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:23:30.227149 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-72c8e065-4c85-4ccb-b8d0-edb191d90d46 req-e8453f3c-8907-4348-8f56-92e40c468106 service nova] Lock "463c4fd3-c1f9-4549-9617-108c1a1e7240-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:23:30.227286 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-72c8e065-4c85-4ccb-b8d0-edb191d90d46 req-e8453f3c-8907-4348-8f56-92e40c468106 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] No waiting events found dispatching network-vif-unplugged-6957fbdc-0839-435a-a71b-1eece0f0652b {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:23:30.227413 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-72c8e065-4c85-4ccb-b8d0-edb191d90d46 req-e8453f3c-8907-4348-8f56-92e40c468106 service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Received event network-vif-unplugged-6957fbdc-0839-435a-a71b-1eece0f0652b for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:23:30.373283 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:23:30.424032 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-86c45ace-0fc4-4311-aa52-0ec3d1a7c3e6 req-42592131-f4fe-42f6-b5b2-ad5af6a63c5c service nova] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Detach interface failed, port_id=6957fbdc-0839-435a-a71b-1eece0f0652b, reason: Instance 463c4fd3-c1f9-4549-9617-108c1a1e7240 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:23:30.875237 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Took 1.26 seconds to deallocate network for instance.
May 27 03:23:31.420675 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Took 0.55 seconds to detach 1 volumes for instance.
May 27 03:23:31.925813 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:23:31.925948 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:23:32.043388 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:23:32.043575 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:23:32.546048 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:23:33.052548 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.126s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:23:33.094443 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Deleted allocations for instance 463c4fd3-c1f9-4549-9617-108c1a1e7240
May 27 03:23:33.822920 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:34.101964 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-348ab8b3-3daf-4ca6-a903-1fb3def24c37 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "463c4fd3-c1f9-4549-9617-108c1a1e7240" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.607s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:23:36.337139 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-be51ce07-2d75-4aa8-913d-c663399e5eb1 req-5f00fe8a-3d3f-4d2a-a9c2-8cf47deb2c59 service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Received event network-changed-be06fe35-1d22-412f-a7ee-e757f9f9032f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:23:36.337423 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-be51ce07-2d75-4aa8-913d-c663399e5eb1 req-5f00fe8a-3d3f-4d2a-a9c2-8cf47deb2c59 service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Refreshing instance network info cache due to event network-changed-be06fe35-1d22-412f-a7ee-e757f9f9032f. {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 27 03:23:36.337834 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-be51ce07-2d75-4aa8-913d-c663399e5eb1 req-5f00fe8a-3d3f-4d2a-a9c2-8cf47deb2c59 service nova] Acquiring lock "refresh_cache-a8f228ca-3043-456d-9378-7917e42ae0a1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 27 03:23:36.337954 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-be51ce07-2d75-4aa8-913d-c663399e5eb1 req-5f00fe8a-3d3f-4d2a-a9c2-8cf47deb2c59 service nova] Acquired lock "refresh_cache-a8f228ca-3043-456d-9378-7917e42ae0a1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 27 03:23:36.338092 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-be51ce07-2d75-4aa8-913d-c663399e5eb1 req-5f00fe8a-3d3f-4d2a-a9c2-8cf47deb2c59 service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Refreshing network info cache for port be06fe35-1d22-412f-a7ee-e757f9f9032f {{(pid=98471) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 27 03:23:36.819234 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "a8f228ca-3043-456d-9378-7917e42ae0a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:23:36.819439 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "a8f228ca-3043-456d-9378-7917e42ae0a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:23:36.819681 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "a8f228ca-3043-456d-9378-7917e42ae0a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:23:36.819871 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "a8f228ca-3043-456d-9378-7917e42ae0a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:23:36.820007 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "a8f228ca-3043-456d-9378-7917e42ae0a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:23:36.822016 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Terminating instance
May 27 03:23:36.839733 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-be51ce07-2d75-4aa8-913d-c663399e5eb1 req-5f00fe8a-3d3f-4d2a-a9c2-8cf47deb2c59 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:23:37.091890 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [req-be51ce07-2d75-4aa8-913d-c663399e5eb1 req-5f00fe8a-3d3f-4d2a-a9c2-8cf47deb2c59 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:23:37.206398 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-be51ce07-2d75-4aa8-913d-c663399e5eb1 req-5f00fe8a-3d3f-4d2a-a9c2-8cf47deb2c59 service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Updated VIF entry in instance network info cache for port be06fe35-1d22-412f-a7ee-e757f9f9032f. {{(pid=98471) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 27 03:23:37.206647 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-be51ce07-2d75-4aa8-913d-c663399e5eb1 req-5f00fe8a-3d3f-4d2a-a9c2-8cf47deb2c59 service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Updating instance_info_cache with network_info: [{"id": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "address": "fa:16:3e:c3:aa:16", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06fe35-1d", "ovs_interfaceid": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:23:37.325084 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Start destroying the instance on the hypervisor. {{(pid=98471) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 27 03:23:37.338949 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:37.341075 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:37.353017 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:37.356264 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:37.371303 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:37.466910 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f8332dea-db30-4fe8-a77d-9d586d33a998 req-b1a2e0c0-93f2-4972-8560-1330350d5a7a service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Received event network-vif-unplugged-be06fe35-1d22-412f-a7ee-e757f9f9032f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:23:37.466910 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8332dea-db30-4fe8-a77d-9d586d33a998 req-b1a2e0c0-93f2-4972-8560-1330350d5a7a service nova] Acquiring lock "a8f228ca-3043-456d-9378-7917e42ae0a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:23:37.466910 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8332dea-db30-4fe8-a77d-9d586d33a998 req-b1a2e0c0-93f2-4972-8560-1330350d5a7a service nova] Lock "a8f228ca-3043-456d-9378-7917e42ae0a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:23:37.467071 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-f8332dea-db30-4fe8-a77d-9d586d33a998 req-b1a2e0c0-93f2-4972-8560-1330350d5a7a service nova] Lock "a8f228ca-3043-456d-9378-7917e42ae0a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:23:37.467156 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f8332dea-db30-4fe8-a77d-9d586d33a998 req-b1a2e0c0-93f2-4972-8560-1330350d5a7a service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] No waiting events found dispatching network-vif-unplugged-be06fe35-1d22-412f-a7ee-e757f9f9032f {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:23:37.467372 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-f8332dea-db30-4fe8-a77d-9d586d33a998 req-b1a2e0c0-93f2-4972-8560-1330350d5a7a service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Received event network-vif-unplugged-be06fe35-1d22-412f-a7ee-e757f9f9032f for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:23:37.532167 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:37.642935 np0000001475 nova-compute[98471]: DEBUG nova.utils [None req-40805dce-02dc-4ac5-9380-5e15d5cfc703 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=14.999733270999968 future=<Future at 0x755704662690 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:23:37.645779 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [-] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Instance destroyed successfully.
May 27 03:23:37.646622 np0000001475 nova-compute[98471]: DEBUG nova.objects.instance [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lazy-loading 'resources' on Instance uuid a8f228ca-3043-456d-9378-7917e42ae0a1 {{(pid=98471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 27 03:23:37.708425 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-be51ce07-2d75-4aa8-913d-c663399e5eb1 req-5f00fe8a-3d3f-4d2a-a9c2-8cf47deb2c59 service nova] Releasing lock "refresh_cache-a8f228ca-3043-456d-9378-7917e42ae0a1" {{(pid=98471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 27 03:23:38.148667 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.vif [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T03:21:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-933697506',display_name='tempest-TestVolumeBootPattern-server-933697506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001475',hostname='tempest-testvolumebootpattern-server-933697506',id=80,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICaryW4xfMFHV+vlIJcg6UNnKAtZNnDFSwST0X5b5IQQ966Sp0B9I62DrdIKfoOlKzioaNnLaLM1LeIw4dbGTngQZarioDM4qdeAarf7UROlLEa8o2W+L1+VBzL0o5/WQ==',key_name='tempest-TestVolumeBootPattern-176174463',keypairs=<?>,launch_index=0,launched_at=2026-05-27T03:21:49Z,launched_on='np0000001475',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001475',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf4b0011da7449e7948bf2c8a41955f5',ramdisk_id='',reservation_id='r-genyxv23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-360350731',owner_user_name='tempest-TestVolumeBootPattern-360350731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-27T03:21:50Z,user_data=None,user_id='8eeaf68cfb534238bfe879dd6e8f858f',uuid=a8f228ca-3043-456d-9378-7917e42ae0a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "address": "fa:16:3e:c3:aa:16", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06fe35-1d", "ovs_interfaceid": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 27 03:23:38.148977 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converting VIF {"id": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "address": "fa:16:3e:c3:aa:16", "network": {"id": "6db10034-3fec-4590-a630-1d148f050041", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-84589454-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "bf4b0011da7449e7948bf2c8a41955f5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe06fe35-1d", "ovs_interfaceid": "be06fe35-1d22-412f-a7ee-e757f9f9032f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 27 03:23:38.149380 np0000001475 nova-compute[98471]: DEBUG nova.network.os_vif_util [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:aa:16,bridge_name='br-int',has_traffic_filtering=True,id=be06fe35-1d22-412f-a7ee-e757f9f9032f,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe06fe35-1d') {{(pid=98471) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 27 03:23:38.149639 np0000001475 nova-compute[98471]: DEBUG os_vif [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:aa:16,bridge_name='br-int',has_traffic_filtering=True,id=be06fe35-1d22-412f-a7ee-e757f9f9032f,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe06fe35-1d') {{(pid=98471) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 27 03:23:38.150430 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:38.150628 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe06fe35-1d, bridge=br-int, if_exists=True) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:23:38.151654 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:38.152527 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:23:38.152717 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:38.153248 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:38.153377 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d8dd463-31a0-4949-bd14-3c54f01a1a68) {{(pid=98471) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 27 03:23:38.153791 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:38.154347 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:23:38.156324 np0000001475 nova-compute[98471]: INFO os_vif [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:aa:16,bridge_name='br-int',has_traffic_filtering=True,id=be06fe35-1d22-412f-a7ee-e757f9f9032f,network=Network(6db10034-3fec-4590-a630-1d148f050041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe06fe35-1d')
May 27 03:23:38.157843 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] calling os-brick to detach iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 27 03:23:38.158072 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x755724739be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b231942-ad4a-439f-8fbb-5a4b623319d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 27 03:23:38.158207 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 27 03:23:38.158496 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 27 03:23:38.158751 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b231942-ad4a-439f-8fbb-5a4b623319d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 27 03:23:38.158899 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', 0)] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 27 03:23:38.183789 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:23:38.183789 np0000001475 nova-compute[98471]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:23:38.183789 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 27 03:23:38.183977 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:23:38.183977 np0000001475 nova-compute[98471]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4 (non-flash)
May 27 03:23:38.183977 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 27 03:23:38.183977 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', '225'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', '226')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 27 03:23:38.184103 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', '225')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:23:38.184846 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4', '226')] {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 27 03:23:38.185410 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7557246244a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4'): ({'sdb'}, set())}) {{(pid=98471) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 27 03:23:38.185581 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Removing multipathed devices sdc, sdb {{(pid=98471) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 27 03:23:38.185785 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Flush multipath device 3300000006b84f358 {{(pid=98471) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 27 03:23:38.231822 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:23:38.276018 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98471) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 27 03:23:38.310914 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 27 03:23:38.311031 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98471) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 27 03:23:38.311607 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 27 03:23:38.320991 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.linuxscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98471) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 27 03:23:38.321136 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4')] {{(pid=98471) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 27 03:23:38.329610 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:23:38.360230 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 225, target: iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4, portal: 192.168.40.100,3260]
May 27 03:23:38.360230 np0000001475 nova-compute[98471]: Logout of [sid: 225, target: iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4, portal: 192.168.40.100,3260] successful.
May 27 03:23:38.360230 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:23:38.371046 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:23:38.380049 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:23:38.409353 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 226, target: iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4, portal: 192.168.50.100,3260]
May 27 03:23:38.409353 np0000001475 nova-compute[98471]: Logout of [sid: 226, target: iqn.2023-03.storpool.com:os--volume-8b231942-ad4a-439f-8fbb-5a4b623319d4, portal: 192.168.50.100,3260] successful.
May 27 03:23:38.409353 np0000001475 nova-compute[98471]:  stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:23:38.419708 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98471) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 27 03:23:38.419936 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.base [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 27 03:23:38.420042 np0000001475 nova-compute[98471]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] <== disconnect_volume: return (261ms) None {{(pid=98471) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 27 03:23:38.420145 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Disconnected iSCSI Volume {{(pid=98471) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 27 03:23:38.420398 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Deleting instance files /opt/stack/data/nova/instances/a8f228ca-3043-456d-9378-7917e42ae0a1_del
May 27 03:23:38.420969 np0000001475 nova-compute[98471]: INFO nova.virt.libvirt.driver [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Deletion of /opt/stack/data/nova/instances/a8f228ca-3043-456d-9378-7917e42ae0a1_del complete
May 27 03:23:38.926875 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Took 1.60 seconds to destroy the instance on the hypervisor.
May 27 03:23:38.927274 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._common.loopingcall [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98471) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 27 03:23:38.927480 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [-] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Deallocating network for instance {{(pid=98471) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 27 03:23:38.927575 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] deallocate_for_instance() {{(pid=98471) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 27 03:23:38.927782 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:23:39.011475 np0000001475 nova-compute[98471]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 27 03:23:39.226423 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-005b0eb1-548f-46ba-a883-2cf9518a4cc0 req-4cde2ef3-ff21-4d7d-b382-78ac09bd9887 service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Received event network-vif-deleted-be06fe35-1d22-412f-a7ee-e757f9f9032f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:23:39.226497 np0000001475 nova-compute[98471]: INFO nova.compute.manager [req-005b0eb1-548f-46ba-a883-2cf9518a4cc0 req-4cde2ef3-ff21-4d7d-b382-78ac09bd9887 service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Neutron deleted interface be06fe35-1d22-412f-a7ee-e757f9f9032f; detaching it from the instance and deleting it from the info cache
May 27 03:23:39.226641 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [req-005b0eb1-548f-46ba-a883-2cf9518a4cc0 req-4cde2ef3-ff21-4d7d-b382-78ac09bd9887 service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:23:39.515864 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c06649cf-4687-4377-a198-9ecbf847ee32 req-0072867a-aa08-4c22-815e-9513b9346129 service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Received event network-vif-unplugged-be06fe35-1d22-412f-a7ee-e757f9f9032f {{(pid=98471) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 27 03:23:39.516191 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c06649cf-4687-4377-a198-9ecbf847ee32 req-0072867a-aa08-4c22-815e-9513b9346129 service nova] Acquiring lock "a8f228ca-3043-456d-9378-7917e42ae0a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:23:39.516191 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c06649cf-4687-4377-a198-9ecbf847ee32 req-0072867a-aa08-4c22-815e-9513b9346129 service nova] Lock "a8f228ca-3043-456d-9378-7917e42ae0a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:23:39.516311 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [req-c06649cf-4687-4377-a198-9ecbf847ee32 req-0072867a-aa08-4c22-815e-9513b9346129 service nova] Lock "a8f228ca-3043-456d-9378-7917e42ae0a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:23:39.516413 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c06649cf-4687-4377-a198-9ecbf847ee32 req-0072867a-aa08-4c22-815e-9513b9346129 service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] No waiting events found dispatching network-vif-unplugged-be06fe35-1d22-412f-a7ee-e757f9f9032f {{(pid=98471) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 27 03:23:39.516556 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-c06649cf-4687-4377-a198-9ecbf847ee32 req-0072867a-aa08-4c22-815e-9513b9346129 service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Received event network-vif-unplugged-be06fe35-1d22-412f-a7ee-e757f9f9032f for instance with task_state deleting. {{(pid=98471) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 27 03:23:39.687569 np0000001475 nova-compute[98471]: DEBUG nova.network.neutron [-] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Updating instance_info_cache with network_info: [] {{(pid=98471) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 27 03:23:39.729646 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [req-005b0eb1-548f-46ba-a883-2cf9518a4cc0 req-4cde2ef3-ff21-4d7d-b382-78ac09bd9887 service nova] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Detach interface failed, port_id=be06fe35-1d22-412f-a7ee-e757f9f9032f, reason: Instance a8f228ca-3043-456d-9378-7917e42ae0a1 could not be found. {{(pid=98471) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 27 03:23:40.189221 np0000001475 nova-compute[98471]: INFO nova.compute.manager [-] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Took 1.26 seconds to deallocate network for instance.
May 27 03:23:40.732615 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Took 0.54 seconds to detach 1 volumes for instance.
May 27 03:23:41.237450 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:23:41.237612 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:23:41.318529 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:23:41.318779 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:23:41.821032 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:23:42.327084 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.089s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:23:42.369651 np0000001475 nova-compute[98471]: INFO nova.scheduler.client.report [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Deleted allocations for instance a8f228ca-3043-456d-9378-7917e42ae0a1
May 27 03:23:43.154614 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:43.310521 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.00034815800017895526 future=<Future at 0x75572c129370 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:23:43.311014 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Emitting event <LifecycleEvent: 1779852208.3100762, 463c4fd3-c1f9-4549-9617-108c1a1e7240 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:23:43.311184 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:23:43.311376 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] VM Stopped (Lifecycle Event)
May 27 03:23:43.312384 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=9.330112621999888 future=<Future at 0x755704662690 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:23:43.312706 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=9.329777516999911 future=<Future at 0x755704662690 state=pending>) {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:23:43.377810 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-f4f97929-1b28-4238-86a6-71351a693087 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Lock "a8f228ca-3043-456d-9378-7917e42ae0a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.558s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:23:43.813810 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-adaac247-e3dd-47a6-a484-ae5ddc9fde05 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: 463c4fd3-c1f9-4549-9617-108c1a1e7240] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:23:45.903295 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:47.770665 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:48.156285 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:52.642981 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x75573587f4d0>>, remaining_delay=-0.00043078799990325933 future=<Future at 0x755704662690 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x755735a553d0> {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:23:52.643536 np0000001475 nova-compute[98471]: DEBUG nova.virt.driver [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] Emitting event <LifecycleEvent: 1779852217.6424277, a8f228ca-3043-456d-9378-7917e42ae0a1 => Stopped> {{(pid=98471) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 27 03:23:52.643687 np0000001475 nova-compute[98471]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98471) _log /opt/stack/nova/nova/utils.py:1500}}
May 27 03:23:52.643878 np0000001475 nova-compute[98471]: INFO nova.compute.manager [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] VM Stopped (Lifecycle Event)
May 27 03:23:53.146485 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-22be27df-b6dd-48cb-8933-cacc8f289604 tempest-TestVolumeBootPattern-360350731 tempest-TestVolumeBootPattern-360350731-project-member] [instance: a8f228ca-3043-456d-9378-7917e42ae0a1] Checking state {{(pid=98471) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 27 03:23:53.159272 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:23:53.159496 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:23:53.159601 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98471) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 03:23:53.159701 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98471) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 03:23:53.167077 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:23:53.167325 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98471) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 03:23:58.167892 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:24:01.975561 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:24:01.976014 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:24:01.976014 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:24:01.976014 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:24:01.976229 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.22 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:24:02.199937 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:24:02.200188 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:24:02.200525 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:24:03.173267 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:24:03.173731 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:24:03.173731 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98471) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 03:24:03.173731 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98471) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 03:24:03.181123 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:24:03.181287 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98471) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 03:24:04.199653 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:24:04.200575 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:24:08.182986 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:24:09.196721 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:24:09.197138 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 9.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:24:13.184357 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:24:18.185319 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:24:18.185725 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:24:18.185725 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98471) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 03:24:18.185725 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98471) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 03:24:18.185868 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98471) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 03:24:18.185987 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:24:18.199506 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:24:18.704002 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:24:18.704130 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:24:18.704250 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:24:18.704350 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Auditing locally available compute resources for np0000001475 (node: np0000001475) {{(pid=98471) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 27 03:24:18.715632 np0000001475 nova-compute[98471]: WARNING nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 27 03:24:18.716400 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 27 03:24:18.762927 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.processutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98471) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 27 03:24:18.763274 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Hypervisor/Node resource view: name=np0000001475 free_ram=14272MB free_disk=72.5877685546875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98471) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 27 03:24:18.763438 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 27 03:24:18.763626 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 27 03:24:19.815298 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 27 03:24:19.815808 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Final resource view: name=np0000001475 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:24:18 up 56 min,  1 user,  load average: 0.68, 1.83, 3.43\n'} {{(pid=98471) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 27 03:24:19.858579 np0000001475 nova-compute[98471]: DEBUG nova.virt.libvirt.driver [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98471) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 27 03:24:19.858859 np0000001475 nova-compute[98471]: DEBUG nova.compute.provider_tree [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed in ProviderTree for provider: 379b682a-2af7-4cd6-bb46-9d0c412d430a {{(pid=98471) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 27 03:24:20.361402 np0000001475 nova-compute[98471]: DEBUG nova.scheduler.client.report [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Inventory has not changed for provider 379b682a-2af7-4cd6-bb46-9d0c412d430a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98471) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 27 03:24:20.867563 np0000001475 nova-compute[98471]: DEBUG nova.compute.resource_tracker [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Compute_service record updated for np0000001475:np0000001475 {{(pid=98471) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 27 03:24:20.868077 np0000001475 nova-compute[98471]: DEBUG oslo_concurrency.lockutils [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.104s {{(pid=98471) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 27 03:24:20.868214 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 32.33 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:24:23.187542 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:24:28.190003 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:24:33.191783 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:24:38.194086 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:24:43.195837 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:24:43.195837 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:24:43.195837 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98471) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 27 03:24:43.195837 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98471) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 03:24:43.196501 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:24:43.196501 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98471) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 27 03:24:43.196501 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:24:48.197547 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:24:53.199582 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:24:53.200300 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:24:53.702188 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:24:58.201916 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:24:59.701873 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:24:59.702415 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:24:59.702415 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98471) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 27 03:24:59.702580 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.50 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:25:01.214870 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:25:02.199996 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:25:02.200277 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:25:02.200577 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:25:03.199726 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:25:03.200133 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:25:03.203926 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:25:04.199677 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:25:04.199942 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:25:08.205151 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 27 03:25:10.196074 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:25:10.196517 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:25:11.196052 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:25:11.196285 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:25:12.199767 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:25:12.201165 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98471) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 27 03:25:12.702345 np0000001475 nova-compute[98471]: DEBUG oslo.service.backend._threading.loopingcall [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98471) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 27 03:25:13.206834 np0000001475 nova-compute[98471]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98471) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 27 03:25:16.702856 np0000001475 nova-compute[98471]: DEBUG oslo_service.periodic_task [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98471) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 27 03:25:16.703453 np0000001475 nova-compute[98471]: DEBUG nova.compute.manager [None req-a8abca50-f0f0-41c0-915e-534f723e5889 None None] Cleaning up deleted instances {{(pid=98471) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}